Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

RAG ML Engineer — Retrieval & LLM Orchestration

S&P Global, Inc.

Kensho, S&P Global’s AI innovation hub, seeks a mid-level Machine Learning Engineer to scale RAG systems and LLM orchestration across the company. You will design end‑to‑end pipelines, optimize large-scale retrieval, and collaborate with product teams to deliver context‑aware responses. The role emphasizes hands‑on ML, embedding models, vector databases, and production‑grade systems, with core tech including PyTorch, Transformers, LangChain. #J-18808-Ljbffr S&P Global, Inc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the RAG ML Engineer — Retrieval & LLM Orchestration in New York, NY vacancy
  •  ...tastes, our Taste AI engine sifts through the noise...  ...reporting to the LLM Research Lead, you will...  ...building production-ready ML systems,...  ...features, including retrieval-augmented generation (RAG), agent workflows, and prompt / tool orchestration Integrate LLMs with... 
    Suggested
    Full time
    Remote work
    Flexible hours

    Qloo

    New York, NY
    1 day ago
  • $192k - $260k

     ...their business. Founded by engineers — and customer obsessed — we...  ...to bring enterprise-grade ML and AI personalization to every...  ...'ll have:Evaluate ML and LLM approaches for CustomerLake...  ...including techniques like retrieval-augmented generation (RAG), prompt design, fine-... 
    Suggested
    Work at office
    Local area
    Worldwide

    DataBricks

    New York, NY
    1 day ago
  • General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas Technology & Engineering...  ...developmentExperience designing scalable ML pipelines, inference systems, and retrieval architecturesExperience implementing CI/CD practices and... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Local area
    1 day per week

    Bain & Company

    New York, NY
    4 days ago
  • AI/ML Ops EngineerLocation: Remote / Hybrid (Client-Facing...  ...an experienced AI/ML Engineer to design, deploy, and operate...  ...AI or Large Language Model (LLM) solutions in production environments...  ....* Experience developing Retrieval Augmented Generation (RAG) applications and AI-... 
    Suggested
    Full time
    Contract work
    Local area
    Remote work
    Flexible hours

    Slalom

    New York, NY
    3 days ago
  • $190k - $265k

    Harvey, Inc in New York is seeking a Research Engineer to enhance their large-scale search and retrieval systems. This role is crucial for developing infrastructure...  ...should have over 5 years of experience in ML engineering and a proven track record in elite research... 
    Suggested

    Harvey, Inc

    New York, NY
    3 days ago
  • $235k - $260k

     ...organization.The Principal AI/ML Engineer, Semantic Data will design and...  ...semantic data systems with applied LLM engineering to build grounded,...  ..., including knowledge graphs, retrieval systems, and LLM-powered...  ...retrieval-augmented generation (RAG) systems grounded in semantic... 
    Work at office
    Local area
    Remote work
    1 day per week

    Major League Soccer

    New York, NY
    5 days ago
  •  ...registered architects, engineers, and city planners...  ...for graph-based orchestration and error-tolerant...  ...permitting. Retrieval & knowledge: Partner...  ...-code knowledge (RAG), evaluate vector...  ...backend or ML systems (Python/TypeScript...  ...fuel for CV & LLM models. Full Send... 
    Full time
    Summer work
    Work at office
    Flexible hours

    GreenLite

    New York, NY
    1 day ago
  •  ...architecture changes, prompt engineering, fine-tuning, or rule-...  ...: how agents are orchestrated, how documents are segmented...  ...~2+ years building ML/AI systems in production...  ...agents or multi-step LLM pipelines (not just single...  ..., fine-tuning, RAG, evaluation design ~... 
    Full time

    Triomics

    New York, NY
    1 day ago
  • Senior Vice President AI/ML Software EngineerAt BNY, our culture allows...  ...Vice President AI/ML Software Engineer to lead the architecture and delivery...  ...built on agentic frameworks, retrieval-augmented generation (RAG), and LLM orchestration. This is a hands-on technical leadership... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  •  ...agentic workflows, custom LLM infrastructure, and high-throughput retrieval systems directly...  ...-Augmented Generation (RAG) models, vector storage...  ...Have)6+ years of software engineering and machine learning experience...  ...with advanced LLM orchestration tools, structured... 

    Objective Paradigm

    New York, NY
    4 days ago
  • Vice President AI/ML Software EngineerAt...  ...AI/ML Software Engineer to design and implement...  ...AI systems, RAG pipelines, and intelligent...  ...and vector retrieval to multi-agent extraction...  ...one -- custom orchestration engine, not a...  ...construction for downstream LLM calls - Develop... 
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  • VP - AI/ML Engineer - Compliance EngineeringYOUR IMPACTAre you passionate...  ...textual data suitable for LLM applications.The opportunity to...  ...automating compliance processes, RAG pipelines, and the creation...  ...including but not limited to Retrieval-Augmented Generation (RAG), model... 

    Goldman Sachs

    New York, NY
    3 days ago
  •  .... As a Senior Applied AI / ML Engineer, you'll own AI problems end to...  ...What you'll do Build LLM systems that turn complex, inconsistent...  ...Design agentic workflows that retrieve and reason over fragmented...  ...) Agentic workflows, RAG, or retrieval systems in production... 
    Local area
    Relocation package
    Weekend work

    Confido

    New York, NY
    1 day ago
  • $245k - $272k

     ...Sr. Staff AI/ML Engineer Denver, CO; San Francisco, CA; New York...  ...platform capabilities — agent orchestration, RAG infrastructure, eval tooling...  ...agents across Gusto (e.g., retrieval, routing, prompt management,...  ...Hands-on experience building LLM-based applications and... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    New York, NY
    1 day ago
  •  ...Machine Learning Engineer Kensho is S&P Global...  ..., agents, data retrieval APIs, data...  ...Machine Learning (ML) Team at Kensho is...  ...on developing and orchestrating intelligent agent...  ...agentic design and LLM orchestration, including...  ...utilization, Textual RAG systems Core ML... 
    Work at office
    Remote work
    Worldwide

    S&P Global

    New York, NY
    5 days ago
  •  ...Machine Learning Engineer, Applied AI As a machine learning engineer...  ...work across the full applied ML stack - deploying models,...  ...and embedding models and our LLM-powered features - work reliably...  ...embeddings ecosystem and the retrieval, classification, and similarity... 
    Work at office
    Work from home
    Home office

    CreatorIQ

    New York, NY
    3 days ago
  •  ...Gen AI Engineer-Data Scientist-ML Location: New York, NY (Hybrid)...  ...authority for GenAI and LLM based systems across...  ...multiagent systems, orchestration frameworks, and complex...  ..., autonomous agents, RAG systems,...  ..., TensorFlow, or JAX Retrieval & • Data: RAG pipelines... 

    Damco

    New York, NY
    2 days ago
  •  ...Machine Learning Engineer We are seeking a talented and innovative...  ...and translate them into AI/ML solutions. Deploy and...  .... Experience with Retrieval-Augmented Generation (RAG) architectures. Familiarity...  ...platforms. Knowledge of LLM fine-tuning, prompt engineering... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    1 day ago
  • $235k

     ...Role Summary The Senior AI/ML Engineer is a hands-on technical...  ...frameworks including multi-agent orchestration, tool-calling pipelines, and...  .... Build and optimize RAG (Retrieval-Augmented Generation) pipelines...  ...scale. Integrate LLM-powered agents with internal... 
    Day shift

    CBRE

    New York, NY
    2 days ago
  • $205k - $235k

     ...service line, the EY Growth Platforms AI ML Engineering Director will collaborate with...  ...for agents that integrate LLMs, retrieval-augmented generation (RAG), multi-source data ingestion, and...  ...Weaviate, Chroma), retrieval systems, and LLM fine-tuning.Strong understanding of... 
    Full time
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    3 days ago
  • $281.2k - $401.71k

     ...systems. As part of this shift, we’re creating a shared Agent Engine that powers agent-based experiences across Spotify. You’ll...  ...these areas You have experience with areas such as agent orchestration, LLM infrastructure, evaluation systems, or data pipelines for machine... 
    Remote job
    Full time
    Flexible hours
    Shift work

    Spotify

    New York, NY
    1 day ago
  •  ...Title: MLOps Engineer Job Summary...  ...production-grade AI/ML systems. The ideal...  ...Large Language Model (LLM) deployment...  ...Models (LLMs), and Retrieval-Augmented Generation (RAG). Knowledge of...  ...LlamaIndex, Haystack, and AI orchestration frameworks. Experience... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    1 day ago
  •  ...of the Role: Machine Learning Engineer Location: New York, NY Company...  ...systems—from data ingestion and retrieval to model adaptation and...  ...You’ll Work On Design and build RAG systems over clinical notes, billing...  ...building and shipping LLM + RAG systems in production Hands... 
    Work at office
    3 days per week

    Recruiting from Scratch

    New York, NY
    3 days ago
  •  ...applications, agents, data retrieval APIs, data...  ...always rooted in engineering best practices. As...  ...tightly integrated LLM pipelines that...  ...develop and scale RAG systems across the...  ...on, full‑lifecycle ML role with a strong...  ...retrieval models, LLM orchestration, and system‑level... 
    Work at office
    Worldwide

    S&P Global

    New York, NY
    3 days ago
  •  ...accelerate our momentum. As a Senior AI / ML Engineer , you will help build the core AI systems powering the Confido platform—from LLM-powered document understanding to...  ...documents Develop agentic workflows that retrieve and reason over fragmented enterprise... 
    Full time
    Local area
    Relocation package
    Night shift

    Confido

    New York, NY
    1 day ago
  •  ...opportunity for a data/ML Engineer from LATAM. In‑person...  ...powers our warehouse, LLM‑driven applications, and...  ..., storing, and retrieving semantic representations...  ...engineering techniques, orchestration flows, and model fine‑...  ...augmented generation (RAG) workflows. Partner with... 
    Full time

    Medium

    New York, NY
    1 day ago
  •  ...enterprise AI. The Role As AI/ML Engineer, you will build and own the...  ...Build and maintain RAG pipelines that allow models to...  ...customers require Design and orchestrate a fleet of specialized AI...  ...experience building RAG systems, retrieval architecture, chunking... 
    Permanent employment
    Full time
    Immediate start
    Remote work
    Relocation
    Relocation package

    Linero

    New York, NY
    1 day ago
  •  ...attention to detail. Our engineering team is elite, our...  ...legal teams. As an AI & ML Engineer, you will...  ...and business context, retrieval systems that surface the...  ...through model behavior, orchestration, reliability, UX, and...  ...agentic and workflow-based LLM systems for long-... 
    Full time
    Contract work
    Work at office
    Flexible hours
    Day shift

    Sandstone

    New York, NY
    1 day ago
  • $180k - $250k

     ...strong team includes software engineers, AI researchers, security engineers...  ...re looking for exceptional AI/ML Engineers to help shape and...  ...parts of the system – from LLM-powered classification and detection...  ...fine-tuning, model selection, retrieval strategies, and system design... 
    Full time

    Artemis

    New York, NY
    1 day ago
  •  ...Design, build, and deploy ML models for demand forecasting...  ...preprocessing, feature engineering, model training, evaluation...  ...production deployment Architect RAG systems and LLM integrations that power...  ...AI systems, multi-agent orchestration, NLP, LLMs, and RAG architectures... 
    Full time
    Immediate start

    Decircle

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to RAG ML Engineer — Retrieval & LLM Orchestration. Be the first to apply!