933 Ai Software Engineer Rag Llm jobs in New York,NY

Recommended

Apply Directly

Head of Technology, Intelligence Ventures

Spectrum

New York, NY 10036

OnsiteUrgently Hiring

Deep expertise across the full intelligence platform stack — including distributed data pipelines, ML platform architecture, embedding systems, feature stores, agent-to-agent API design, and LLM-powered application layers — with demonstrated ability to architect and ship all layers as a coherent, production-grade product
Demonstrated experience architecting and operating consumer data intelligence or data product platforms underpinned by complex machine learning systems and built on modern, cloud-native data infrastructure
Hands-on proficiency with Snowflake (including Cortex, Native Apps, and data sharing frameworks), cloud data platforms (AWS, Azure, or GCP), and production ML/AI systems at scale
Experience building agentic AI systems and LLM-powered product interfaces — including agent-to-agent APIs, retrieval-augmented generation architectures, and natural language UIs grounded in proprietary data — with strong product instincts around accuracy, trust, and user experience for non-technical enterprise audiences
Proven ability to translate complex technical architecture into clear executive and partner-facing communications; comfortable engaging at the C-suite level and in strategic partner negotiations with hyperscalers and technology platforms
Strong understanding of privacy-preserving data architecture, including differential privacy, de-identification techniques, zero-copy and clean room frameworks, and the regulatory landscape governing consumer behavioral data
Track record of recruiting and developing exceptional engineering talent in competitive markets; experience building high-performance teams from early-stage through scaled operations
Experience managing external development partners and outsourced engineering resources alongside an internal team in a fast-moving, build-from-scratch environment
Ability to operate in an ambiguous, early-stage environment while maintaining rigorous engineering standards and delivering against aggressive milestones
Experience building externally-consumed data or intelligence platforms — including developer-facing APIs, data marketplace integrations, or partner-accessible data products — with strong instincts around developer experience, access governance, and commercial platform design
Bachelor's Degree in Computer Science, Software Engineering, Electrical Engineering, or a related technical field
Experience leading consumer data intelligence, AI/ML platform, or data product engineering organizations — 10 years
Engineering leadership and team-building experience, including managing senior technical staff — 7 years

SmartExplore AI is experimental.

Recommended

iHire

Applied Researcher I (AI Foundations, LLM Customization, Finetuning, Reinforcement Learning)

Capital One

New York, NY 10001

Recommended

iHire

Applied Researcher I (Multi-agent Systems, Knowledge Graphs/GraphRAG/Graph-of-Thought / GoT, MCP, LangGraph, Agent Protocols)

Capital One

New York, NY 10001

New, Posted 1 day ago

DiversityJobs

Software Engineering/Applications Leadership Advisory - Executive Technology Services for Global Enterprises

Gartner

Newark, NJ 07175

New, Posted 1 day ago

Apply Directly

Senior Vice President, Infrastructure Engineer

BNY

New York, NY 10007

Urgently Hiring

Recommended

ResumeLibrary

CFD & CAD Expert — AI Evaluation & Quality Review

BrainTrust

New York, NY 10001

New, Posted 1 day ago

Apply Directly

Director, Software Engineering (Electronic Trading)

Fidelity Investments

Hoboken, NJ 07030

~ 16 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent.
15+ years of hands-on software design and development experience in the electronic trading domain.
5+ years of technical leadership, managing a team, and mentoring software developers
Experience in building **algorithmic trading** systems for **equities and options**
Experience with**equities and options market data**
Expertise in **C/C++** , **Python** , and **Linux**.
Deep experience with **low latency messaging systems** (e.g., 29West/Ultra-Messaging, Kafka).
Proficiency in **KDB+** or other time-series databases.
Strong background in building **scalable** , **distributed** , **asynchronous** , and **event-driven** applications.
Advanced knowledge of **low latency design patterns** and **performance optimization** techniques.
Experience in **Capital Markets** or **Brokerage systems** , especially **order management**.
Solid understanding of the **FIX protocol** and FIX engines.
Experienced with using **GenAI developer assist tools** (e.g. GitHub Copilot).
Experience with **CI/CD tools** such as GitHub, Maven, Jenkins, Artifactory, and uDeploy.
Experience with deploying applications and services in **AWS**

SmartExplore AI is experimental.

New, Posted 1 day ago

Recommended

DiversityJobs

Manager, Software Project Management (New York, NY - US)

Energy Solutions

New York, NY 10279

New, Posted 1 day ago

Apply Directly

Director, Software Engineering (Electronic Trading)

Fidelity Investments

Jersey City, NJ 07311

~ 22 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent.
15+ years of hands-on software design and development experience in the electronic trading domain.
5+ years of technical leadership, managing a team, and mentoring software developers
Experience in building **algorithmic trading** systems for **equities and options**
Experience with**equities and options market data**
Expertise in **C/C++** , **Python** , and **Linux**.
Deep experience with **low latency messaging systems** (e.g., 29West/Ultra-Messaging, Kafka).
Proficiency in **KDB+** or other time-series databases.
Strong background in building **scalable** , **distributed** , **asynchronous** , and **event-driven** applications.
Advanced knowledge of **low latency design patterns** and **performance optimization** techniques.
Experience in **Capital Markets** or **Brokerage systems** , especially **order management**.
Solid understanding of the **FIX protocol** and FIX engines.
Experienced with using **GenAI developer assist tools** (e.g. GitHub Copilot).
Experience with **CI/CD tools** such as GitHub, Maven, Jenkins, Artifactory, and uDeploy.
Experience with deploying applications and services in **AWS**

SmartExplore AI is experimental.

Apply Directly

Project Engineer

Oerlikon Surface Solutions

Westbury, NY 11590

$75,000-$100,000/yr

~ 40 min OnsiteUrgently HiringEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's degree in materials science or mechanical engineering
3 years job experience in thermal spray or PVD coating technologies
Must be proficient in using business and communications software (preferably Word, Excel, PowerPoint, common Windows operating systems, and Outlook)
Ability to travel 30% travel may be required
Work Location: In person

SmartExplore AI is experimental.