AI Systems Engineer

Salary range: $350,000 - $600,000/year + benefits

Description: Transluce is a fast-moving research lab building the public tech stack for understanding and debugging AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. We are a non-profit with a mission to steer the development of AI for the public good.

About the role: We are looking for an exceptional AI systems engineer to lead the design and development of our core ML stack , building systems that can scale to thousands of GPUs and performantly query trillion-token databases.

As an early member of a highly collaborative team, you will be free to innovate and move fast, building high-impact systems from the ground up. As part of a mission-focused non-profit, your work will have high direct impact (e.g. used by governments to inform AI policy) and cross-organisational reach (open-source tools the entire community can build on).

Core responsibilities:

• Set overall code culture and tooling for a fast-growing org
• Help to solve our core technical challenges across verticals. Examples include:
  • Docent:
    • High-concurrency container-based evals with quick ability to iterate on interventions to agentic trajectories
    • Deterministic sandbox execution of code that can efficiently restore state from checkpoints
  • Interpretability:
    • Inference stacks that are as performant as vLLM but flexible enough to allow complex model introspection and intervention, steering, configurable sampling, etc., and that can scale to 400B+ parameter models
  • Behavior elicitation:
    • Distributed RL training and roll-outs allowing thousands of concurrent rollouts across machines
  • Build great internal tools to speed up the team
• Help tone-set in the organization around best practices for building and path-set on what infra we should build
• Help other team members think through infra challenges

Qualities of a strong candidate:

• Exceptional programmer fluent in Python
• Bare metal optimization: know GPUs, other accelerators in and out (low-level performance + optimization + parallel programming)
• Experience engineering at scale (distributed systems, reliability, architecture design)
• Leader on global code quality and health (designing good primitives, managing complexity and scale)
• Bonus: can set up LLM pipelines, e.g. multiple specialized LLMs interacting with each other in a performant and reliable way
• Bonus: experience with open-source community management

We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.