Senior Software Engineer, Inference

Responsibilities

• Design and ship customer-facing APIs that expose new model capabilities from prototype through launch and ongoing iteration.
• Scale inference infrastructure to support more than 1 million API users.
• Productionize research techniques into reliable, low-latency, customer-ready services.
• Collaborate with researchers, applied engineers, customers, and product teams to inform product and research direction.
• Contribute to backend services, inference infrastructure, SDKs, and internal tooling as needed.

Requirements

• Strong backend engineering experience, including production machine learning infrastructure and/or customer-facing APIs.
• Curiosity about AI/ML and the ability to understand model behavior well enough to make sound engineering decisions.
• Ability to work effectively amid ambiguous and shifting research and product timelines.
• Strong collaboration skills with researchers, applied engineers, customers, and other stakeholders.

Benefits

• The company emphasizes significant ownership, a lean operating environment, and equal opportunity to succeed.
• U.S. salary range is $190,000–$225,000; compensation may vary outside the U.S. and based on experience, qualifications, and internal equity.