618 Data Engineer Python Pyspark Databricks jobs in New York,NY

Recommended

Apply Directly

Principal Engineer - Python API Development

Fidelity Investments

Weehawken, NJ 07086

~ 12 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

SmartExplore AI is experimental.

New, Posted 9 hours ago

Recommended

Apply Directly

Senior Associate, Data Engineer - Databricks

KPMG

New York, NY 10025

OnsiteHealth InsuranceRetirement Benefit

Minimum three years of recent experience as a cloud data lake/warehouse architect, designer, developer, data scientist, or AI / ML engineer
Preferably Databricks certified
Bachelor's degree in Engineering, Information Technology, Computer Science or a related field from an accredited college/university
Experience in leading projects relating to cloud modernization, data migration, data warehousing experience with cloud-based data platforms (Databricks) and experience with (preferably driving) technical workshops with technical and business clients to derive value added services and implementations
Hands-on working knowledge of topics such as data security, messaging patterns, ELT, Data wrangling and cloud computing and proficiency in data integration/EAI and DB technologies, sophisticated analytics tools, programming languages or visualization platforms
Experience designing solutions on cloud infrastructure and services, such as AWS, Azure, or GCP
Hands-on technical experience with SQL and Apache Spark
Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future and travel as needed

SmartExplore AI is experimental.

Recommended

Apply Directly

Principal Engineer - Python API Development

Fidelity Investments

Lyndhurst, NJ 07071

~ 23 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

SmartExplore AI is experimental.

Apply Directly

Manufacturing Engineering Manager - Boonton, NJ

Hubbell Incorporated

Boonton, NJ 07005

~ 49 min Onsite

BS in Electrical, Industrial, Mechanical Engineering or similar
5+ years experience in an Electronics, Electro-Mechanical, or relevant manufacturing environment
Proven track record for handling new product launches through PFMEA assembly line creation, ERP setup work etc.
Proven track record of conceptualizing and implementing Test automation framework on the manufacturing floor to reduce takt times and improve process quality,
Must be fluent with mechanical 3D CAD package.
Must be able to read schematics to troubleshoot board level issues
Experience with Electronics and manufacturing of Printed Circuit Board (PCB) Assemblies.
Must possess excellent verbal and written communications skills
An understanding of lean tools and concepts is essential, i.e. time studies, kaizen events, Value Stream Maps, etc
A continuous improvement mindset is critical
Must be familiar with ISO 9000

SmartExplore AI is experimental.

Apply Directly

Manufacturing Engineer- Westbury, NY

Hubbell Incorporated

Westbury, NY 11590

$105,000-$120,000/yr

~ 40 min OnsiteUrgently Hiring

Bachelor's degree in manufacturing engineering/Mechanical Engineering or similar technical area.
3-5 years' Experience in an electronics manufacturing environment where electrical testing of Printed Circuit boards and/or finished goods is performed

SmartExplore AI is experimental.

Apply Directly

Associate or Senior Associate, Fixed Assets / Cost Segregation Engineer (AMCS)

KPMG

New York, NY 10025

OnsiteHealth InsuranceRetirement Benefit

Bachelor's degree from an accredited college/university in engineering, architecture, construction management, or a closely related discipline is required
Minimumone year of recent experience in an engineering firm, corporation, or public accounting firm; background in cost segregation, fixed asset consulting, construction, engineering, or a related technical field is preferred
Understanding of construction processes and building systems, and how project costs translate into asset classifications
Basic knowledge of federal income tax depreciation principles and accounting for capital expenditures, or a demonstrated interest in developing this skillset
Experience reviewing technical drawings, construction documentation, or large project cost datasets
Strong proficiency in Excel (such as advanced formulas, pivot tables, lookups) and experience working with structured data from financial or operational systems; demonstrated experience or strong aptitude with data-wrangling/automation tools (such as Power Query, Alteryx), business intelligence tools (such as Power BI, Tableau), or query/scripting languages (such as SQL, Python, R)
Applicant must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future. KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)

SmartExplore AI is experimental.

New, Posted 1 day ago

Recommended

Apply Directly

AML Compliance Model Developer – Associate

Santander Holdings USA

New York, NY 10012

Onsite

Bachelor's degree in computer science, Information Systems, Data Analytics, Finance, Mathematics, or related field
3–5 years of experience in AML Compliance Technology, AML model development, or a related field within banking or financial services
Strong programming and analytical experience using SAS for data analysis, reporting, model support, and testing
Good working knowledge of Python for data manipulation, scripting, automation, and analytical processing
Strong SQL skills with experience developing complex queries, joins, procedures, and handling large-scale datasets
Experience working with Jira for Agile project tracking, sprint management, and defect lifecycle management
Working knowledge of testing methodologies including functional testing, regression testing, SIT, and UAT
Understanding of AML regulations and compliance frameworks including BSA/AML, OFAC, KYC, and transaction monitoring concepts
Strong analytical, quantitative, and problem-solving skills
Ability to multitask, manage priorities, and work effectively in fast-paced environments
Strong communication, documentation, and stakeholder management skills
Applicants must be legally authorized to work in the United States on a full-time basis without requiring employer sponsorship to commence employment

SmartExplore AI is experimental.

New, Posted 1 day ago

Recommended

Lead Software Engineer - Data Streaming/Integration Platforms

Disney Entertainment and ESPN Product & Technology Careers

New York, NY 10025

$155,700-$208,700/yr

New, Posted 1 day ago

Senior Machine Learning Engineer - News

Disney Entertainment and ESPN Product & Technology Careers

New York, NY 10025

$148,700-$199,400/yr

Apply Directly

Director of Engineering

Marine Electric Systems

South Hackensack, NJ 07606

~ 26 min OnsiteHealth InsurancePaid Time OffRetirement Benefit

Bachelor's degree in Electrical Engineering or a closely related engineering discipline.
Significant experience in electrical engineering, sustaining engineering, production engineering, test engineering, or engineering leadership in a manufacturing environment.
Strong hands-on technical knowledge of electrical and electromechanical systems.
Experience with PCB troubleshooting, electrical testing, components, assemblies, and production support.
Ability to read and interpret drawings, schematics, specifications, technical data packages, and test procedures.
Experience supporting manufacturing, production, repair, or sustainment work.
Ability to make practical engineering decisions with imperfect information.
Strong communication skills and ability to work cross-functionally with production, quality, procurement, sales, and leadership.
Demonstrated ability to mentor junior engineers or technical staff.
Strong organizational skills and ability to create structure in a fast-moving small-company environment.

SmartExplore AI is experimental.