Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

RAG ML Engineer Retrieval & LLM Orchestration

S&P Global HQ North America

Kensho, S&P Global’s AI innovation hub, seeks a mid-level Machine Learning Engineer to scale RAG systems and LLM orchestration across the company. You will design end‑to‑end pipelines, optimize large-scale retrieval, and collaborate with product teams to deliver context‑aware responses.

The role emphasizes hands‑on ML, embedding models, vector databases, and production‑grade systems, with core tech including PyTorch, Transformers, LangChain.

#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the RAG ML Engineer Retrieval & LLM Orchestration in New York, NY vacancy
  •  ...solutions using LLMs, RAG, AI Agents and...  ...Data Science, Python engineering and GenAI solution...  ...focus on RAG, LLM applications and AI...  ...development within AI/ML projects. 2+ years...  ...vector databases, retrieval techniques and...  ...models, multi-agent orchestration or other advanced... 
    Suggested
    Contract work
    Remote work

    Senovo IT

    New York, NY
    3 days ago
  •  ...Gain America Inc. is seeking an AI/ML Engineer to join client projects in the...  ...terms. You will take ML and LLM features from prototype to production, building retrieval-augmented pipelines and deploying...  ...with strong Python, hands-on LLM/RAG experience, and deep learning with... 
    Suggested
    Contract work

    Gain America

    New York, NY
    3 days ago
  •  .... As a Senior Applied AI / ML Engineer, you'll own AI problems end to...  ...What you'll do Build LLM systems that turn complex, inconsistent...  ...Design agentic workflows that retrieve and reason over fragmented...  ...) Agentic workflows, RAG, or retrieval systems in production... 
    Suggested
    Local area
    Relocation package
    Weekend work

    Confido

    New York, NY
    22 hours ago
  • $192k - $260k

     ...their business. Founded by engineers — and customer obsessed — we...  ...to bring enterprise-grade ML and AI personalization to every...  ...'ll have:Evaluate ML and LLM approaches for CustomerLake...  ...including techniques like retrieval-augmented generation (RAG), prompt design, fine-... 
    Suggested
    Work at office
    Local area
    Worldwide

    DataBricks

    New York, NY
    6 days ago
  • $500 per month

     ...Deployed Senior Machine Learning Engineer Adelphi's Vision is to build...  ...a mix of software development, LLM Ops, and secdevops practices, resulting...  ...customers. Build and deploy ML services leveraging LLMs, embeddings, RAG, and agent orchestration into production environments,... 
    Suggested
    Remote work
    Flexible hours

    Adelphi

    New York, NY
    1 day ago
  •  ...M-TECH is looking for a part-time Python/LLM Engineer to develop AI agents focused on automating business processes for small to medium enterprises...  ...in AI automation, particularly in creating applied LLM and RAG solutions tailored for small and medium businesses. As a Python... 
    Part time

    M Tech

    New York, NY
    3 days ago
  • $140k - $294k

     ...intelligent automation and workflow orchestration. We pair that technology with...  .... As our Machine Learning Engineer, you will help accelerate the...  ...scalable AI systems for retrieval, ranking, categorization, and...  ..., build, and operate AI/ML Systems end-to-end: from problem... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    R1 RCM Holdco Inc.

    New York, NY
    20 hours ago
  •  ...Objective Partners seeks an Applied AI / Machine Learning Engineer in New York, NY. This code-first role focuses on architecting agentic workflows, custom LLM infrastructure, and high-throughput retrieval systems to drive business outcomes. You will bridge cutting-edge... 

    Objective Partners

    New York, NY
    3 days ago
  • AI/ML Ops EngineerLocation: Remote / Hybrid (Client-Facing...  ...an experienced AI/ML Engineer to design, deploy, and operate...  ...AI or Large Language Model (LLM) solutions in production environments...  ....* Experience developing Retrieval Augmented Generation (RAG) applications and AI-... 
    Full time
    Contract work
    Local area
    Remote work
    Flexible hours

    Slalom

    New York, NY
    3 days ago
  • $500 per month

    Machine Forward Deployed Learning Engineer Adelphi's Vision is to build...  ...a mix of software development, LLM Ops, and SecDevOps practices, resulting...  ...customers. Build and deploy ML services leveraging LLMs, embeddings, RAG, and agent orchestration into production environments,... 
    Remote work
    Flexible hours

    Adelphi

    New York, NY
    1 day ago
  •  ...Socure's AI-powered orchestration and decisioning platform...  ...with product, engineering, and Workforce GTM. It...  ...evaluation frameworks for LLM-based components....  ...common data science and ML libraries (e.g., pandas...  ...APIs, prompt design, RAG-style retrieval, or evaluation of LLM... 

    Socure Inc

    New York, NY
    4 days ago
  • Grubhub is seeking a Senior Staff Machine Learning Engineer to lead the ML engine behind Discovery: ranking, recommendation, and retrieval systems that determine what diners see in the app. This hands-on leadership role owns model architecture across search ranking, homepage... 

    Grubhub

    New York, NY
    4 days ago
  •  ...Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications. Work with the Northstar Lakehouse and Databricks stack... 

    Cooley

    New York, NY
    1 day ago
  • $200k - $235k

     ...organization.The Principal AI/ML Engineer, Semantic Data will design and...  ...semantic data systems with applied LLM engineering to build grounded,...  ..., including knowledge graphs, retrieval systems, and LLM-powered...  ...retrieval-augmented generation (RAG) systems grounded in semantic... 
    Work at office
    Local area
    Remote work
    1 day per week

    Major League Soccer

    New York, NY
    5 days ago
  •  ...agentic workflows, custom LLM infrastructure, and high-throughput retrieval systems directly...  ...-Augmented Generation (RAG) models, vector storage...  ...Have)6+ years of software engineering and machine learning experience...  ...with advanced LLM orchestration tools, structured... 

    Objective Paradigm

    New York, NY
    9 days ago
  • Senior Vice President AI/ML Software EngineerAt BNY, our culture allows...  ...Vice President AI/ML Software Engineer to lead the architecture and delivery...  ...built on agentic frameworks, retrieval-augmented generation (RAG), and LLM orchestration. This is a hands-on technical leadership... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  •  ...Role: ML Engineer Location: Manhattan, NY Work Model:...  ...Overview The ML Engineer – LLM Platforms & Assistants...  ...services, implementing Retrieval-Augmented Generation (RAG) and semantic search, and...  ...MCP servers and emerging orchestration tools. Apply AWS security... 
    Full time
    Contract work
    Work at office
    Local area
    3 days per week

    Trianz

    New York, NY
    4 days ago
  • Vice President AI/ML Software EngineerAt...  ...AI/ML Software Engineer to design and implement...  ...AI systems, RAG pipelines, and intelligent...  ...and vector retrieval to multi-agent extraction...  ...one -- custom orchestration engine, not a...  ...construction for downstream LLM calls - Develop... 
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  • $130k - $250k

    The Core Engineering The Core Engineering builds and operates...  ...cutting-edge AI/ML techniques, including Large...  ...textual data suitable for LLM applications.The...  ...compliance processes, RAG pipelines, and the creation...  ...including but not limited to Retrieval-Augmented Generation (... 
    Full time
    Temporary work
    Part time

    Goldman Sachs

    New York, NY
    8 days ago
  •  ...Wonder seeks a Staff Machine Learning Engineer in New York to own the end-to-end ranking and...  ...stack, including candidate retrieval, multi-objective ranking, and calibration...  ...models. The role emphasizes production-ready ML systems, transformer models, and online experimentation... 
    Work at office
    3 days per week

    Blue Apron

    New York, NY
    3 days ago
  • $127k - $235k

    Job DescriptionAs a Senior Machine Learning Engineer, you will build and deploy production machine learning and large language model (LLM) systems that extract actionable insights...  ...quantitative field.Experience deploying and operating ML or LLM systems at scale in production... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Thomson Reuters

    New York, NY
    5 days ago
  •  ...experienced Python Backend + AI/ML Engineer specializing in Agentic AI...  ..., multi-agent workflows, LLM orchestration pipelines, and scalable Python...  ..., building vector database retrieval systems, and optimizing Python...  ...-Augmented Generation (RAG) pipelines for enterprise knowledge... 
    Permanent employment
    Full time
    Contract work
    Immediate start

    RaceDog Technologies

    New York, NY
    4 days ago
  • RaceDog Technologies seeks an exceptional Python Backend + AI/ML Engineer specializing in Agentic AI to join our advanced technology...  ...will architect autonomous AI agents, multi-agent workflows, LLM orchestration pipelines, and scalable Python backends. The ideal candidate... 
    Full time

    RaceDog Technologies

    New York, NY
    4 days ago
  • $130k - $160k

     ...AI/ML Software EngineerNew YorkCome build...  ...connected.The RoleAn AI Engineer at Octaura, is a...  ...Protocol (MCP) or similar orchestration frameworks.Build and...  ...for Agentic AI, LLM orchestration, and model...  ...models (LLMs), retrieval-augmented generation (RAG), and agent frameworks... 
    Full time
    Work at office
    Remote work

    Octaura

    New York, NY
    2 days ago
  •  ...The SeventhHire LLC in New York, NY seeks a senior ML researcher to lead LLM evaluation and post-training improvements. You will own experimental design, benchmarks, and data quality as core inputs to model training. Ideal candidates have 6–10 years of AI/ML research,... 

    The SeventhHire LLC

    New York, NY
    4 days ago
  •  ...SaidGig is seeking a senior AI/ML engineer to design, implement, and optimize production models using LLMs, RAG, and prompt engineering. You will build and orchestrate multi-agent systems and deploy secure solutions in trusted cloud environments. The role invites you... 
    Remote work

    SaidGig

    New York, NY
    20 hours ago
  •  ...America is recruiting a AI / ML Engineer for contract and contract-to-...  ...market. Take machine-learning and LLM systems from prototype to...  ...stack: Python, LLMs, PyTorch, RAG, vector databases, MLOps What...  ...-powered features Design retrieval-augmented generation pipelines... 
    Contract work

    Gain America

    New York, NY
    2 days ago
  •  ...Role: AI Engineer / ML EngineerLocation: NYC, NY 10005Contract: 6-12 MonthsYou could be just the...  ...enterprise applications.•Build and enhance AI/LLM workflows, including agentic workflows.•Develop Retrieval-Augmented Generation (RAG) pipelines and improve the accuracy,... 

    Hays CPA LLC

    New York, NY
    20 hours ago
  •  ...applications, agents, data retrieval APIs, data...  ...always rooted in engineering best practices. As...  ...Kensho is looking for ML Engineer interns...  ...GenAI platform, LLM-powered applications...  ...design and LLM orchestration, including context...  ...utilization, Textual RAG systems Core ML... 
    Internship
    Summer internship
    Work at office
    Worldwide

    S&P Global

    New York, NY
    3 days ago
  • $150k - $300k

     ...Goldman Sachs, our Engineers don't just make...  ...end AI pipelines (RAG, Agentic workflows...  ...Pipelines: Build robust Retrieval-Augmented...  ...Micrometer to monitor LLM latency, token usage...  ...or RabbitMQ for orchestrating asynchronous AI agent...  ...focused on AI/ML integration in production... 
    Full time
    Temporary work
    Part time
    Immediate start

    Goldman Sachs

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to RAG ML Engineer Retrieval & LLM Orchestration. Be the first to apply!