Senior/Staff Software Engineer, Search & Retrieval Infrastructure

Role Description

We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability.

Responsibilities

• Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation
• Design and build optimized indexing pipelines for structured and unstructured data
• Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration
• Improve retrieval quality through evaluation and observability frameworks
• Design APIs for internal and external user and agentic consumers
• Optimize latency, throughput and cost across large-scale inference and retrieval workloads
• Drive technical direction for reliability and security

Qualifications

• Proven track record (typically 6+ years) of shipping production-grade backends for large-scale systems
• Comfortable building high-throughput indexing pipelines that handle both unstructured data and structured schemas
• Direct experience (or deep theoretical knowledge) in semantic search, vector databases, hybrid retrieval strategies, or traditional search engines like Elastic or OpenSearch
• Understanding of Retrieval-Augmented Generation (RAG) patterns, embedding pipelines, hybrid search techniques, query planning, and metadata filtering
• Expert in at least one major language like Go, Rust, C++, Java, or Python
• Familiarity with modern infrastructure tools, such as Kubernetes, cloud-native architectures, observability frameworks, and infrastructure-as-code tools like Terraform or Pulumi
• Ability to design clean, intuitive APIs for both human developers and autonomous agents
• Comfortable in a high-growth environment, preferring "owning a problem" over "executing a ticket"

Requirements

• Experience building multi-tenant SaaS platforms
• Experience with retrieval evaluation frameworks—knowing how to measure "good" search results
• Experience with query planning or agentic reasoning loops (e.g., teaching a system how to break down a complex prompt into multiple specific steps)

Benefits

• Comprehensive health coverage including medical, dental, vision, and mental health resources
• 401(k) Plan
• Equity award
• Flexible time off
• Paid parental leave
• Annual Company Retreat
• WFH Equipment Stipend