Senior Staff Applied AI Engineer - Context Retrieval
$228.6k - $342.8kDatabricks Inc.
P-1549
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
The Mission
Databricks agents are only as good as the context they can retrieve. Whether an agent is answering a question about last quarter's revenue, debugging a failing job, generating SQL against a 10,000-table lakehouse, or summarizing a Wiki page, its quality is bounded by what it can find — and how well it understands what it finds.
We are hiring a Senior Staff Applied AI Engineer to own context retrieval for Databricks agents across SaaS providers . This is a zero-to-one role with two deeply connected charters:
- Build the retrieval stack — query understanding, content understanding, ranking, retrieval, and evaluation — across the Enterprise SaaS data stored across multiple systems.
- Build the search subagents that sit on top of that stack and reason about what context is needed , how to retrieve it , and whether the right thing actually came back — closing the loop between an agent's intent and the substrate that serves it.
If you have deep Information Retrieval wisdom, have shipped retrieval systems for RAG and agentic workloads, and want to build the substrate — and the agents on top of it — that make every Databricks agent measurably smarter, this role is for you.
What You Will Do
- Build the full retrieval stack from scratch. Own the end-to-end system: query understanding, content understanding and indexing, hybrid retrieval, ranking, and evaluation. Make the architectural calls that will define how Databricks agents access context for years to come.
- Retrieve across heterogeneous data — structured and unstructured. Index and rank across structured assets (tables, columns, SQL queries, dashboards, code, notebooks, jobs) and unstructured content (docs, wikis, tickets, chat, images, video, audio). Each modality has its own signals — design retrieval that exploits them rather than flattens them.
- Connect to the SaaS surface area customers actually use. Build connectors and retrieval adapters for the systems where enterprise knowledge lives. Treat each retrieval source with its own freshness, permissions, and ranking signals.
- Optimize for two consumers at once. Retrieval must serve both LLMs (grounded, token-efficient, hallucination-resistant context) and humans (intuitive, explainable discovery). These are different objectives and require different signals — own both.
- Crack query understanding for agents. Agent queries don't look like web queries. Build query rewriting, decomposition, intent classification, and entity resolution tuned for multi-turn agentic workflows.
- Crack content understanding at scale. Build the pipelines that extract structure, entities, embeddings, summaries, and metadata from every supported asset type — and keep them fresh as customer data evolves.
- Build search subagents that reason about retrieval. Design the agentic layer that decides what context is needed , which sources to query , how to decompose and route the search , and — critically — whether the retrieved content is actually sufficient to answer the question . These subagents will plan multi-hop searches, issue follow-up queries when results are weak, ground claims against retrieved evidence, and hand back high-confidence context (or signal failure) to upstream agents. This is where IR meets agentic reasoning.
- Build the evaluation flywheel for both retrieval and subagents. Stand up offline evals (nDCG, MRR, View email address on databricks.com, View email address on databricks.com), LLM-as-judge harnesses, human-in-the-loop labeling, and online experimentation. Extend evaluation beyond ranking metrics to measure subagent decision quality — did it ask the right follow-up? , did it correctly recognize when retrieval failed? , did it ground its answer in the right evidence? . Quality you can't measure is quality you can't ship.
- Set technical direction and grow the team. Set the multi-year roadmap, mentor senior engineers, partner with Research, Product, and Platform leaders, and raise the technical bar across the org.
What We're Looking For
- 10+ years of software engineering experience, with significant time spent building production retrieval, search, or RAG systems at scale.
- Deep Information Retrieval (IR) expertise : lexical retrieval (BM25, Lucene/Elasticsearch/OpenSearch), dense retrieval (embeddings, ANN indexes — FAISS, ScaNN, HNSW), hybrid retrieval, and learning-to-rank.
- Hands-on experience with modern LLM-era retrieval : RAG architectures, query rewriting, re-ranking with cross-encoders, long-context strategies, and grounding techniques that reduce hallucination.
- Experience designing agentic systems on top of retrieval — search planners, multi-hop / iterative retrieval, self-reflection and sufficiency checks, tool-using agents that decide what to fetch and verify what came back.
- Strong grasp of relevance evaluation : nDCG, MRR, View email address on databricks.com, View email address on databricks.com; offline/online experimentation; LLM-as-judge frameworks; building human labeling pipelines.
- Experience working across structured and unstructured data — you've indexed and ranked over tables, code, and documents in the same system, and have opinions about how to do it well.
- Track record of building 0→1 : you've stood up a retrieval system from an empty repo, made the foundational architectural decisions, and grown it into something that customers depend on.
- Demonstrated ability to operate as a technical leader : setting direction across teams, mentoring senior engineers, and influencing roadmap with research, product, and platform partners.
Nice to Have
- Experience building retrieval over enterprise SaaS sources (permissions, freshness, multi-tenancy, ACL-aware indexing).
- Background in agentic systems, tool use, or multi-turn retrieval for LLM agents.
- Contributions to open-source IR/search projects, or publications at SIGIR, KDD, EMNLP, or similar venues.
- Experience training or fine-tuning embedding models, rerankers, or query understanding models.
Why This Role
- Foundational impact. Retrieval is the single biggest lever on agent quality. The stack you build will sit underneath every Databricks agent and every customer-built agent on our platform.
- Greenfield with scale. You get the rare combination of starting from a clean sheet and having immediate access to massive enterprise scale, real customer data, and a world-class research org.
- The right team. You'll work alongside engineers and researchers behind Lakehouse, Apache Spark™, Delta Lake, MLflow, MosaicML, and DBRX.
Location
This role is based in our Mountain View, CA or San Francisco, CA office. Hybrid in-office collaboration expected.
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here .
Local Pay Range
$228,600—$342,800 USD
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram .
Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here .Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
- ...company can become its own AI lab. Goaly is a... ...Superintelligence Labs engineers and researchers. Our mission... ...loop, the tools, the context, the sandbox the agent... ...memory and state, retrieval, and hand-offs between... ...ownership, we encourage you to apply. Equal opportunity...SeniorFull timeH1bWork at officeVisa sponsorshipFlexible hoursDay shift
$152k - $241.5k
NVIDIA is looking for a Senior Applied AI Engineer to help build intelligent software systems that improve... ..., including orchestration, retrieval, evaluation, and monitoring.Partner with... ...Familiarity with model evaluation, prompt and context design, observability, and production...SeniorFull time$150.4k - $277.6k
...9Team: Machine Learning and AI, Software and ServicesLocation... ...closely with Product, Engineering, Finance, Sales, and Leadership... ...learning.We are looking for an Applied AI Engineer to help build... ...will span agent orchestration, context retrieval, evaluation, and production...SeniorRelocation$171k
...Sr. Staff ll, AI Engineer - Search (L7-2) We exist to wow our customers. We know we’re doing the... ...inference, and real-time data pipelines for context enrichment and low-latency serving.... ...conversational interfaces. ~ RAG (Retrieval-Augmented Generation) pipelines. ~ LLM...SeniorTemporary workFlexible hours$132.5k - $338.3k
...era in enterprise AI — one defined not by... ...regulated industries. Our applied research function... ...and production engineering — investigating the... .... You Are: As a Senior Advanced AI Research... ...inference cost reduction, context management at scale, and retrieval architecture design...SeniorFull timeWork experience placementLive inWork at officeLocal areaRelocation$184k - $287.5k
We are looking for a strong engineer to join the DRIVE Road Structure / Online Mapping / Context Fusion team. In this role, you will help craft and guide the future of... ...planning. Are you interested in inventing human-level AI for navigation in the unconstrained world under...SeniorFull timeRemote workShift work$177k - $226k
...landscape of critical care through our rapid seizure detection technology, come join the movement!Position Overview:The Senior Manager, Applied AI Engineering is a senior individual contributor role with broad ownership across Ceribell's internal AI engineering portfolio....SeniorFor contractorsWork at officeLocal areaImmediate startRemote work$174k - $252k
...supply high-value signals to Home Context and HFM.Design, develop, and... ..., Research, and Vertical engineering teams to define target use cases... ...systems for large-scale AI/ML workloads.Preferred qualifications... ...areas, including information retrieval, distributed computing, large...Senior- ...Accenture's Oracle Business Group AI Center of Excellence is one... ....You might come from engineering, consulting, product, or pre-... ...intelligent search and document retrieval at scale Build and extend MCP... ...infrastructure — our federated Model Context Protocol network across...Work experience placementLive inWork at officeLocal area
$188.5k - $282.7k
...accelerates the world’s AI transformation. As AI... ...the role:We want senior engineers who have already shipped... ...integrating custom tooling, context pipelines, automated... ...-facing agent systems.Apply solid software... ...relationships, GraphRAG, hybrid retrieval.Agent frameworks and...Senior$227k - $313k
...Sonatus, we're driving the transformation to AI-enabled software-defined vehicles.... ...Opportunity: Sonatus is seeking a Senior Staff AI Engineer to define and build the next generation... ...AI (e.g., LLMs, agent frameworks, RAG, context engineering, and evaluation). Design...SeniorWork at officeWorldwideFlexible hoursShift work- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...robotic platforms. As a Senior AI/ML Research Engineer, you will... ...anatomy, instruments, actions, and context from intraoperative video,... ...field, with 5+ years of applied AI/ML research experience in...SeniorLocal areaWorldwideFlexible hours
$160k - $245k
...Seekr builds trusted AI for mission-critical decisions. Our... ...either research scientist or engineering backgrounds. Success in this... ...output and what training data, retrieved documents, tools, agent interactions... ...frameworks, RAG, or adjacent applied ML systems. ~ Ability to...SeniorPermanent employmentWork experience placementWork at officeFlexible hours3 days per week- ...ripe for disruption. Zania is building agentic AI for GRC to solve this problem. We're building... ...Brex, and Instacart. Pioneering Technology: Our engineers and GRC experts work at the absolute forefront of applied AI, building agentic systems that will define the...SeniorFull timeWork at officeRelocation packageFlexible hours
$185k - $215k
...In this role you will operate as a Senior AI Systems Engineer setting technical direction across multiple... ...and real-world vehicle logs. Apply modern AI/ML methods (e.g. LLMs/VLMs... ...vector search/embeddings for failure mode retrieval and ML pipeline reliability....SeniorFull timeWork experience placementLocal areaRemote work- ...Role Mission As an AI Engineer at Hippocratic AI, you'll design... ...using state-of-the-art LLMs, retrieval systems, and streaming architectures... ...across diverse healthcare contexts, ensuring systems handle... ...packages that reflect the seniority and scope of the role, along...SeniorFull timeWork at office
$180k - $225k
...future of work is Human + AI and are building an... ...are looking for a Sr Staff Applied AI Engineer to join our team.... ...AI Engineer, GTM is a senior, hands-on AI builder... ...impact use cases using retrieval-augmented generation,... ...through the Model Context Protocol (MCP), and agent...SeniorRemote jobFull timeWork at officeLocal area$150.4k - $277.6k
...10-28SummaryImagine building AI infrastructure at Apple — systems... ...how products are made, how engineers think, and ultimately how... ...AI to the deep organizational context it needs to be genuinely useful... ...scriptsExperience building retrieval pipelines (RAG, embeddings, vector...Relocation$107.5k - $204.5k
...Services team:We are seeking an experienced Applied AI Engineer to design, build, evaluate, and deploy... ...Generative AI, large language models, retrieval, and agentic AI to real-world problems... ...human oversight.Develop retrieval and context-engineering solutions using enterprise...Permanent employmentTemporary workWork experience placementWork at officeRemote workFlexible hours- ...difference at Fiserv.Job TitleStaff Applied AI EngineerAbout Your RoleClover... ..., rollback, audit.Build the retrieval layer (RAG) — agent output... ...ship on evidence, not demos.Engineer multimodal ingestion — photos... ...practical experience.Senior Technical Leadership: 10+ years...Full timeWork at officeMonday to FridayNight shift
$206.5k - $258.1k
...Role Summary Rivian's Applied AI team builds AI products that help engineers across the company design, build... ...and support our vehicles. As a Staff AI Software Engineer... ...orchestration, tool calling, retrieval and grounding, context and memory management, durable...Full timeContract workTemporary workPart timeLocal areaShift work$190k - $286k
...products. Works in the AI Innovation and R&D... ..., quantization, retrieval, agent... ...Understands how model size, context length, caching... ...latency. Reads and applies current research,... ...Applies established engineering and model-governance... ...and tradeoffs to senior and non-technical...SeniorFull timeWork at office$175k - $275k
...reach further.OverviewEast West Bank is seeking an experienced Senior AI Engineering to design, build, and operationalize enterprise-grade AI... ...efficiency)Architect LLM-enabled solutions spanning retrieval-augmented generation, vector search, agentic workflows, MCP...SeniorFull time$174k - $252k
...years of experience with recommendation, retrieval, search, or personalization systems.1 year... ...to launch.Google's software engineers develop the next-generation technologies... ...millions of articles, videos, creator posts and AI-generated content, our retrieval and pre-...Senior$262k - $364k
...groundbreaking multimodal agentic AI solutions for smart... ..., and physical-world context.Lead our most complex,... ...’s degree or PhD in Engineering, Computer Science, or... ...including information retrieval, distributed computing... ...than ever.As a Senior Staff AI Engineer, you will...Senior$198k - $326k
...the team.We’re hiring a Senior Engineering Manager to lead... ...foundation based on using AI/LLMs to innovate in ad... ...that raise the bar for applied ML rigor, system reliability... ...teams to optimize retrieval and serving efficiency... ...with retrieval and context-heavy reasoning (RAG),...SeniorFor contractorsWork experience placementWork at officeFlexible hours$184.7k - $324.8k
...data infrastructure and capabilities that accurately surface relevant information.We're looking for an exceptional Data and Applied AI Engineer with a strong background in distributed data processing, sharp and demonstrable data intuition, and a passion for using data...SeniorWork experience placementRelocation$137.2k - $206.6k
...launch of our commercial service. Overview We’re looking for a Senior AI Engineer to help bring pragmatic, production-grade AI capabilities... ...into production to improve internal workflows (e.g., knowledge retrieval, document automation, quality/process insights, decision...SeniorFull timeTemporary work$65 - $70 per hour
...Ability to design end-to-end AI architecture and build PoCs before... ...(data ingestion embedding retrieval generation) Has built or... ...isolation, secrets) Knows prompt engineering evaluation guardrails... ....com. Message frequency may vary. Msg & data rates may apply....Senior$195k - $204.75k
...related physical artificial intelligence (“AI”) solutions, and other technologies to... ...deployment. • Collaborate with other research engineers to prototype and validate complex... ...distillation, and mixture of experts. Please apply online at: Must put job code SJ2026NZ on...SeniorLocal areaWorldwideVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Applied AI Engineer - Context Retrieval. Be the first to apply!
- senior staff systems engineer Mountain View, CA
- assistant engineer Mountain View, CA
- engineering aide Mountain View, CA
- staff engineer Mountain View, CA
- software engineer staff Mountain View, CA
- senior staff engineer Mountain View, CA
- technology administrator Mountain View, CA
- application operations engineer Mountain View, CA
- application system engineer Mountain View, CA
- application performance engineer Mountain View, CA





