Data Engineer Job at Torque Technologies LLC, New York, NY

  • Torque Technologies LLC
  • New York, NY

Job Description

Position: Data Engineer

Location:Manhattan NY (Hybrid 3 days a week to office)

Long Term

Key Skills

SQL | Python | Spark | Airflow / ADF | Cloud data services | CI/CD

Required Qualifications

  • 8-10+ years in data engineering
  • Strong SQL and Python (or Scala) skills
  • Experience with orchestration tools such as Airflow or Azure Data Factory
  • Hands-on experience with cloud data services and big data frameworks such as Spark
  • Understanding of data warehousing and lakehouse concepts
  • Familiarity with Git, CI/CD and infrastructure-as-code
  • Experience supporting ML/AI data needs is a plus

Key Responsibilities

  • Design, build and optimize batch and streaming data pipelines
  • Implement data models and transformations defined by the Data Architect
  • Ingest and integrate data from multiple source systems and APIs
  • Implement data quality checks, monitoring and alerting
  • Optimize performance and cost of data workloads
  • Collaborate with AI Developers and analysts to provision datasets
  • Maintain documentation, version control and CI/CD for data code
  • Work with offshore data engineers on knowledge transfer and delivery

Job Tags

Work at office, 3 days per week

Similar Jobs

St. Charles MO Law Firm

Litigation Paralegal/Legal Secretary Job at St. Charles MO Law Firm

 ...Job Description Job Description St. Charles, Missouri law firm seeking an experienced Litigation Paralegal / Legal Secretary to join our team. This position provides both substantive litigation support and day-to-day administrative support to attorneys. The successful... 

Jacobs

Electrical Engineer: Energy and Power Job at Jacobs

 ...transform the world for good. Your impact Electrical Engineer - Energy and PowerThese openings provide the opportunity to engage with...  ...microgrids Power generation projects exceeding 10MW capacity Renewable energy projects including wind, solar, hydro, geothermal and... 

SMITH ROWE, LLC

Commercial Diver Job at SMITH ROWE, LLC

 ...unlimited general contractor. Intercoastal Marine began as a small commercial diving/service corporation supporting heavy construction,...  ...Referral BonusesPosition OverviewThe position of a Bridges/Structures Diver is a position that works below surface of water, using... 

Northeastern Technical College, SC

Adjunct Biology Instructor Job at Northeastern Technical College, SC

 ...regardless of race, color, sex, -including the basis of pregnancy, childbirth, or related medical conditions, national origin, age, religion, or disability. South Carolina is making our veterans a priority for employment in state agencies and institutions. Veteran... 

PM Pediatric Care

Radiologic Technician-Part Time-Yonkers, NY $2500 sign on bonus Job at PM Pediatric Care

 ...truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. Summary The Radiologic Technologist (X-ray Tech) is responsible for all departmental functions aligned with the mission, vision, and goals of PM Pediatrics...