1006 Data Engineer Python Pyspark Data Bricks jobs in New York,NY

~ 1 hr 13 min OnsiteUrgently HiringEducation AssistanceHealth InsuranceRetirement Benefit

Director, Data Engineering

Subway Restaurants

Bridgeport, CT 06606

$184,500-$230,600/yr

8–12 years of experience in data engineering or adjacent platform roles
3–5 years of experience leading teams or enterprise-scale data capabilities
Bachelor's degree required (Computer Science, Engineering, Data, or related field)
Advanced degree preferred
Deep understanding of modern data architectures (cloud data platforms, batch/stream processing)
Strong experience leading data engineering teams and platforms in a technology organization
Ability to influence across Product, Analytics, Platform, and Security; proven people leadership and delivery management skills
Experience operating cloud-based, distributed data platforms in complex, matrixed enterprise environments
Strong communication skills, executive presence, and a bias for ownership, reliability, and continuous improvement

~ 22 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Principal Engineer - Python API Development

Fidelity Investments

Jersey City, NJ 07311

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

New, Posted 4 hours ago

~ 1 hr 14 min OnsiteUrgently HiringEducation AssistanceHealth InsuranceRetirement Benefit

Director, Data Engineering

Subway Restaurants

Fairfield, CT 06824

$184,500-$230,600/yr

8–12 years of experience in data engineering or adjacent platform roles
3–5 years of experience leading teams or enterprise-scale data capabilities
Bachelor's degree required (Computer Science, Engineering, Data, or related field)
Advanced degree preferred
Deep understanding of modern data architectures (cloud data platforms, batch/stream processing)
Strong experience leading data engineering teams and platforms in a technology organization
Ability to influence across Product, Analytics, Platform, and Security; proven people leadership and delivery management skills
Experience operating cloud-based, distributed data platforms in complex, matrixed enterprise environments
Strong communication skills, executive presence, and a bias for ownership, reliability, and continuous improvement

~ 16 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Principal Engineer - Python API Development

Fidelity Investments

Hoboken, NJ 07030

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

New, Posted 10 hours ago

OnsiteHealth InsuranceRetirement Benefit

Senior Associate, Data Engineer - Databricks

KPMG

New York, NY 10025

Minimum three years of recent experience as a cloud data lake/warehouse architect, designer, developer, data scientist, or AI / ML engineer
Preferably Databricks certified
Bachelor's degree in Engineering, Information Technology, Computer Science or a related field from an accredited college/university
Experience in leading projects relating to cloud modernization, data migration, data warehousing experience with cloud-based data platforms (Databricks) and experience with (preferably driving) technical workshops with technical and business clients to derive value added services and implementations
Hands-on working knowledge of topics such as data security, messaging patterns, ELT, Data wrangling and cloud computing and proficiency in data integration/EAI and DB technologies, sophisticated analytics tools, programming languages or visualization platforms
Experience designing solutions on cloud infrastructure and services, such as AWS, Azure, or GCP
Hands-on technical experience with SQL and Apache Spark
Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future and travel as needed

~ 26 min OnsiteHealth InsurancePaid Time OffRetirement Benefit

Director of Engineering

Marine Electric Systems

South Hackensack, NJ 07606

Bachelor's degree in Electrical Engineering or a closely related engineering discipline.
Significant experience in electrical engineering, sustaining engineering, production engineering, test engineering, or engineering leadership in a manufacturing environment.
Strong hands-on technical knowledge of electrical and electromechanical systems.
Experience with PCB troubleshooting, electrical testing, components, assemblies, and production support.
Ability to read and interpret drawings, schematics, specifications, technical data packages, and test procedures.
Experience supporting manufacturing, production, repair, or sustainment work.
Ability to make practical engineering decisions with imperfect information.
Strong communication skills and ability to work cross-functionally with production, quality, procurement, sales, and leadership.
Demonstrated ability to mentor junior engineers or technical staff.
Strong organizational skills and ability to create structure in a fast-moving small-company environment.

New, Posted 1 day ago

Lead Software Engineer - Data Streaming/Integration Platforms

Disney Entertainment and ESPN Product & Technology Careers

New York, NY 10025

$155,700-$208,700/yr

HybridFlexible ScheduleHealth InsuranceRetirement Benefit

Senior Technologist, Data Center Fluids

Wayne, NJ 07470

Degree in Chemistry, Engineering, or related technical discipline.
Up to 25% travel should be expected with this role
This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

~ 45 min OnsiteUrgently HiringEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Senior Buyer Planner, Procurement

PNY Technologies

Parsippany, NJ 07054

8+ years of combined experience in procurement, buyer/planner, materials planning, supply planning, supply chain operations, or related roles.
Hands-on experience with ERP/MRP systems, purchase order management, RFQs, supplier coordination, inventory analysis, and production or materials planning.
Proven experience managing suppliers and/or contract manufacturers, including delivery performance, pricing, lead times, quality, and issue resolution.
Advanced Microsoft Excel skills required; experience with Word, Outlook, and PowerPoint required.
Bachelor's degree in Business, Supply Chain, Operations, or a related field preferred; equivalent experience will also be considered.
Power BI experience is a plus.
Experience working in a manufacturing, technology, electronics, hardware, consumer products, or contract manufacturing environment strongly preferred.
Familiarity with consignment inventory and VMI models preferred.

89% of jobs ask for a resume

Don't let the perfect job slip away—upload your resume and we'll personalize your results instantly.

89% of jobs ask for a resume

Don't let the perfect job slip away—upload your resume and we'll personalize your results instantly.

New Product Manufacturing Engineer

CACI International Inc

Florham Park, NJ 07932

~ 50 min Onsite

Ability to work independently with minimal supervision and mentor lower-level professionals.
Must be a US person.
BA/BS degree in a technical discipline from an accredited college or university.
Minimum of five (5) years of experience as a manufacturing engineer or in a related role.
Percentage of Travel Required: Up to 10%
Type of Travel: Local