Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Expert RAG Engineer

Salvo Software

We are looking for an Expert RAG Engineer to design, build, and own the retrieval-augmented generation systems behind our AI products. Your core work will be architecting production-grade RAG pipelines end to end: ingestion, chunking, embeddings, hybrid retrieval, reranking, evaluation, and serving on top of open-source LLMs (Ollama, llama.cpp) in cloud, on-prem, and air-gapped environments. This is a senior, hands-on role. You’ll define RAG architecture standards, make the key technical decisions on retrieval quality, latency, and cost, and provide technical guidance to AI Developers on the team. You’ll work closely with engineering, product, and client stakeholders to turn complex knowledge sources into reliable, measurable, and secure AI features. Key Responsibilities RAG Architecture & Engineering (core focus) Design and own end-to-end RAG architectures, from document ingestion to grounded, cited responses. Build advanced retrieval strategies: hybrid search (dense + BM25/sparse), reranking (cross-encoders), query rewriting/expansion, metadata filtering, and multi-step or agentic retrieval. Define chunking and indexing strategies for diverse sources, including structured and semi-structured data (XML/XSD, Office formats, PDFs, scanned documents). Select, benchmark, and fine-tune embedding models; manage vector databases (pgvector, Qdrant, Weaviate, Milvus, Azure AI Search, or similar) at scale. Build evaluation frameworks for retrieval and generation quality (View email address on click.appcast.io, MRR, nDCG, faithfulness, answer relevance) and run them continuously as part of CI/CD. Reduce hallucinations through grounding, citation, guardrails, and confidence handling. Implement permission-aware and multi-tenant retrieval so users only access data they’re authorized to see. Develop MCP (Model Context Protocol) integrations that expose RAG systems and internal data sources to LLMs and agents. Optimize LLM serving with Ollama and llama.cpp: quantization (GGUF), GPU/CUDA tuning, batching, caching, and offline/air-gapped deployments. Technical Leadership Set RAG architecture standards, reference implementations, and best practices for the AI department. Review designs and code, and provide technical guidance to AI Developers. Translate client and product requirements into retrieval strategies with clear quality, latency, and cost targets. Evaluate emerging techniques (GraphRAG, long-context vs. retrieval trade-offs, agentic RAG) and recommend what’s worth adopting. DevOps & Infrastructure (supporting) Deploy and scale RAG services on Microsoft Azure and AWS using Docker and Kubernetes. Maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used). Build observability for RAG systems: tracing, retrieval diagnostics, latency, cost, and quality dashboards. Support event-driven ingestion and re-indexing pipelines using Apache Kafka. Troubleshoot across the stack - dig into root causes rather than patching symptoms. Requirements Experience & Core RAG Expertise: 6+ years in backend, ML, or infrastructure with 2+ years building production RAG systems, including end-to-end architecture, hybrid retrieval, reranking, chunking, indexing, and evaluation frameworks. Python & Vector Databases: Expert-level Python programming combined with deep knowledge of embeddings, vector databases, and metrics-driven evaluation. LLM Optimization & Serving: Hands-on experience serving and optimizing open-source LLMs (Ollama, llama.cpp) with quantization, alongside GPU/CUDA troubleshooting and performance tuning. DevOps, Infrastructure & MCP: Strong proficiency in Microsoft Azure, AWS, Docker, Kubernetes, Linux, CI/CD pipelines (Azure DevOps preferred), and Model Context Protocol (MCP). Leadership & Collaboration: Strong communication, technical leadership, and ownership to define architectural standards and collaborate effectively in a distributed, remote environment. Salvo Software

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Expert RAG Engineer in New York, NY vacancy
  • $65 - $75 per unit

     ...Summers , and Jack Dorsey . Position: Propulsion & Effects Engineer Type: Contract Compensation: $65–$75 per task...  ...technical reasoning for correct responses. Collaborate with experts to ensure AI models distinguish between routine and potentially... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    8 days ago
  • $38.85 per hour

     ...New York Public Radio in New York, NY is searching for a Broadcast Engineer to manage live broadcasts and support various production needs within the Programming Department. The ideal candidate will have over 3 years of live audio production experience, proficiency in... 
    Suggested
    Hourly pay
    Full time

    New York Public Radio

    New York, NY
    2 days ago
  • $240k - $290k

    General InformationJob TitleTechnologist, Expert Associate Partner, Tech Insights GroupJob ID108688Work AreasManagement Consulting,...  ...Must have substantial hands-on experience in commercial software engineering and architectureMust demonstrate a practical understanding of... 
    Suggested
    Full time
    Work at office
    Local area
    Worldwide
    Home office
    3 days per week

    Bain & Company

    New York, NY
    4 days ago
  • Clinical Solutions Engineer Do you bring hands-on next-generation sequencing (NGS) experience and an understanding of clinical laboratory operations? Have you helped a clinical laboratory navigate CAP/CLIA requirements and bring a new assay into routine use? Do you want... 
    Suggested
    Work from home
    Worldwide
    Relocation
    Home office

    SOPHiA GENETICS

    New York, NY
    2 days ago
  •  ...and forensic advisory services. We partner with highly qualified experts to deliver objective, evidence-based opinions across a wide...  ...seeking experienced  Accident Reconstructionists/Biomechanical Engineers with testimony experience to join our panel of consulting experts... 
    Suggested
    For contractors
    Remote work
    Flexible hours

    Dane Street, LLC

    New York, NY
    3 days ago
  • $130 per unit

     ..., Larry Summers , and Jack Dorsey . Position: Software Engineer, Go — Codebase Q&A Type: Contract Compensation: $130...  ...passes. Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks.... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    11 days ago
  • $80 - $150 per unit

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer — Agentic Search Systems Type: Contract Compensation: $80–$150 per task Location: Remote Role Responsibilities... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    14 days ago
  •  ...latency, and safety bar that implies. We're engaging senior engineers who have actually shipped agentic systems people who have felt the...  ..., LangGraph, prompt/context engineering, tool/function calling, RAG pipelines. Working knowledge of PyTorch and model... 
    For contractors

    Mindlance

    New York, NY
    23 days ago
  • $100 - $150 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Design precise,... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $165k - $193k

     ...Los Angeles, Chicago, New York City, or Washington D.C. (in-person) Job Summary: The Senior Subject Matter Expert (Mechanical) - Rolling Stock Engineering will oversee and support engineering projects within the rail sector. This role encompasses technical subject... 
    Remote job
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Work from home
    Home office
    Flexible hours
    Night shift

    DB E.C.O. North America

    New York, NY
    6 hours ago
  •  ...Job Description Job Description Job Description: Godot Game Engine Expert Job Type: Contract Location: Remote About the Role We are seeking experienced Godot Game Engine Specialists to contribute to an AI training project. In this role, you will use Godot... 
    Remote job
    Contract work

    YO AI Labs

    New York, NY
    10 days ago
  • $160 per hour

     ...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering / Platform Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    18 days ago
  • $50 - $60 per hour

    Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    29 days ago
  • $85 per hour

     ...Jack Dorsey . Position: CAD / Mechanical Design Writer - Engineering FRQ Type: Contract Compensation: $85/hour Location...  ...grounded in real industry scenarios. Write complete expert-level solutions for each problem. Validate difficulty by... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    14 days ago
  • $45 - $55 per hour

     ...and analyze high-resolution screenshots exceeding 2.5 megapixels to ensure quality. Collaborate independently with mechanical engineers and machine designers to enhance design processes. Develop comprehensive feedback to improve 3D mechanical design and assembly... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  •  ...Forward Deployed Engineer Location: Remote (US) | Type: Contract, Full Time | Experience: 4+ years About the Role We're hiring...  ...telling a VP what's realistic. If you've built an agent or RAG system that impressed people in a demo and then watched it stall... 
    Full time
    Contract work
    Remote work

    Elios AI

    New York, NY
    3 days ago
  • $85 per hour

     ...Jack Dorsey . Position: Fab Safety and Emergency Response Expert Type: Contract Compensation: $85/hour Location:...  ...standards. Qualifications Must-Have ~3+ years as an EHS engineer, emergency response team member, fab facilities or sub-fab engineer... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $200k - $300k

     ...complex, technical environments. They're expanding their engineering team and looking for a Forward Deployed Engineer (FDE) to work...  ...Develop AI-powered solutions , including LLM applications, RAG systems, AI agents and workflow automation where appropriate.... 

    UMATR

    New York, NY
    2 days ago
  •  ...workforce of over 6,000 analysts and delivery experts across our global delivery network. This...  ...for an experienced Forward Deployed Engineer (FDE) who thrives at the intersection of...  ...capabilities, including document processing, RAG, and knowledge graphs where appropriate.... 
    Full time

    Acuity Analytics

    New York, NY
    1 day ago
  •  ...quantitative reasoning, flawed assumptions, or methodological inconsistencies in AI-generated outputs. Provide structured feedback and expert insights to improve AI systems' quantitative finance capabilities. What We’re Looking For ~3+ years of professional experience... 
    Freelance
    Remote work

    Braintrust

    New York, NY
    2 days ago
  • $250k

     ...Senior Software Engineer (TypeScript / React / LLM Systems) • AI Infrastructure • $250,000 • Hybrid (2 days/week) • New York, NY Must...  ...and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows. Develop... 
    Work at office
    Flexible hours
    2 days per week

    Open Talent

    New York, NY
    10 days ago
  •  ...financial reasoning, inaccurate assumptions, or inconsistencies in AI-generated investment analysis. Provide structured feedback and expert insights to improve AI systems' ability to perform private market investment analysis. What We’re Looking For ~3+ years of... 
    Freelance
    Remote work

    Braintrust

    New York, NY
    2 days ago
  •  ...About the Opportunity Our client, a leading AI research organization, is looking for experienced software engineers and quantitative developers with strong functional programming expertise to help evaluate and improve how AI systems write, understand, and solve complex... 
    Freelance
    Remote work

    Braintrust

    New York, NY
    2 days ago
  •  ...Forward Deployed Engineer | Enterprise AI Startup | NYC (Hybrid/Remote) Primis is partnered with a fast-growing enterprise AI startup...  ...experience deploying AI/ML workflows or intelligent applications (LLMs, RAG, agents, forecasting, etc.) ~ Strong Python, plus exposure to... 
    Full time
    Work at office
    Remote work

    Primis

    New York, NY
    1 day ago
  • $50 per hour

     ...Remote contract for PhDs in Chemistry, Chemical Engineering, or related fields. Work on cutting-edge projects with top AI labs while earning...  ...on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation before selection. Assignments:... 
    Contract work
    Remote work
    Flexible hours

    Turing Inc

    New York, NY
    1 day ago
  • $75 per hour

     ...skills and experience — talk with your recruiter to learn more. Base pay range $65.00/hr - $75.00/hr Position: Chemistry Expert (Master’s / PhD) Type: Hourly contract Compensation: $65–$75/hour Location: Remote Commitment: Part-time (15–20 hours... 
    Hourly pay
    Contract work
    Part time
    Remote work

    Crossing Hurdles

    New York, NY
    4 days ago
  • $65 - $75 per hour

     ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Commercial Blasting Engineer Type: Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Flexible hours

    Mercor

    New York, NY
    8 days ago
  • $45 - $55 per hour

    Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  •  ...before you start. On a project you write realistic chemistry tasks and the answer an experienced chemist would give, review other experts' work against an acceptance checklist, and evaluate AI answers for wrong mechanisms, bad stoichiometry and unsafe procedures. Reviewers... 
    Hourly pay

    Sovrano AI

    New York, NY
    2 days ago
  • $135.07k - $221.9k

     ...demonstrate business savvy, being a subject matter expert in your practice area, and leading people...  ...colleagues.We are seeking a Legal Engineer to play a critical role in bringing this...  ...) plus low-code build experience; RAG or MCP familiarity a plus.You willPartner... 
    Full time
    H1b
    Visa sponsorship
    Work visa
    Flexible hours
    3 days per week

    Guardian Life Insurance

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Expert RAG Engineer. Be the first to apply!