Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Rust Engineer

BerriAI

Rust Engineer

LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.

About The Role

You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.

This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.

Responsibilities

  • Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
  • Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
  • Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
  • Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
  • Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
  • Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.

What We're Looking For

  • Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
  • Obsessive about performance. You care about latency and throughput at a level most engineers don't.
  • Strong instinct for stability, with a track record of balancing ambitious change against reliability.
  • Major bonus: prior experience leading codebase migrations from another language to Rust.
  • Major bonus: a demonstrated history of shipping performance-critical systems.
  • Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.

Why Join LiteLLM?

  • Own one of the most important technical bets in the company's roadmap.
  • Define the architectural foundation that the entire platform will run on.
  • Fast-paced growth environment with deep technical ownership.
  • Competitive salary, health, dental, and vision benefits.

About LiteLLM

LiteLLM ( is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.

Ready to make LiteLLM the fastest AI gateway ever? Apply now!

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Rust Engineer in San Francisco, CA vacancy
  • $154k - $266k

     ...Employment Type: FullTime Workplace Type: OnSite Department: Engineering, Product, Design Team: Controls Engineering Compensation: $1...  ...program in a variety of modern software languages (Python, JS, Rust, C#, etc.) Exposure to machine vision systems for robotic... 
    Suggested
    Permanent employment
    Full time
    Local area
    Relocation package
    Flexible hours

    Hadrian Automation

    San Francisco, CA
    3 days ago
  •  ...boots. You'll work alongside construction veterans and world-class engineers to solve physical-world problems that simulations can't touch....  ...for dynamic systems ~ Strong programming skills (C++/Rust, Python) ~ Strong data analysis skills ~ Experience with safety... 
    Suggested
    Full time
    For contractors

    bedrock-robotics

    San Francisco, CA
    7 days ago
  • $75 - $105 per hour

     ...Our client, a leading AI research organization, is looking for engineers and computational researchers to help evaluate how AI systems solve...  ...one additional language: JavaScript/TypeScript, Go, C++ or Rust. Practical experience with Git and Docker. Familiarity with... 
    Suggested
    Hourly pay
    Immediate start

    Braintrust

    San Francisco, CA
    3 days ago
  •  ...Kubernetes orchestration, distributed resource lifecycles, and our Rust virtual machine monitor (VMM), the software that runs each...  ...and finish it. Your code reviews and documentation help another engineer understand the guarantees and remaining limitations. You use... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs

    San Francisco, CA
    4 days ago
  •  ...Staff Security Engineer, Risk Engineering San Francisco, CA | New York City, NY | Seattle, WA About the Role The Security Risk...  ...programming skills in Python or at least one systems language such as Go, Rust, or C/C++ Broad knowledge across the core security engineering... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  •  ...and scheduling decision matters. We are looking for systems engineers who want to understand computers all the way down and build infrastructure...  ...for Experience building substantial systems software in Rust, Go, C, C++, or a similar language. Rust is preferred but not... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs

    San Francisco, CA
    4 days ago
  • $174k - $205k

     ...and out of the office. We are seeking a Senior Manufacturing Test Engineer to lead end-to-end test strategy, design, development, and...  ...experience developing manufacturing test software in Python, C, C++, Rust.Bachelor's or Master's degree in Mechanical Engineering,... 
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    Oura

    San Francisco, CA
    4 days ago
  • $160.2k - $425k

     ...never been more important. We're building a new Production Engineering organization to help raise the operational bar across GitHub. Production...  ..., but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python, ~ OR Associate's Degree in Computer Science,... 
    Ongoing contract
    Remote work

    GitHub

    San Francisco, CA
    4 days ago
  •  ...that matter. About the role We're looking for an electrical engineer to own electronics end-to-end at a fast-moving company building...  ...company Firmware development experience (embedded C/C++ or Rust, motor control, communication protocols) Circuit simulation (SPICE... 
    Contract work
    Internship

    Gradient Robotics

    San Francisco, CA
    1 day ago
  •  ...As a Build & Release Engineer, you will own the infrastructure and developer platforms that underpin our engineering workflows. This includes...  ...-based build and test infrastructure that supports C++, Python, Rust, and Typescript-based development. - Infrastructure... 
    Remote work

    Physical Intelligence

    San Francisco, CA
    4 days ago
  • $175k - $200k

     ...bit about us: We are an established, industry-leading organization that is on the lookout for a talented Senior Rust Developer / Senior C++ Engineer! Why join us? As a Senior C++ Software Engineer / Senior Rust Software Developer in our company, we are able... 
    Local area
    Remote work
    Work from home

    Jobot

    San Francisco, CA
    2 days ago
  •  ...by top-tier investors and led by a tight team of operators and engineers from the most respected names in aerospace, defense, and telecom...  ...stack like PX4 or ArduPilot. You write production C++ or Rust today. Our stack is Rust; strong C++ engineers who want to learn... 
    Work at office

    AdAstra

    San Francisco, CA
    7 days ago
  •  ...Software Engineer Kovari develops frontier technology to transform physical businesses. They partner with established operators to change...  ...the stack against them You Should Have Strong C++ or Rust, plus Python Experience with real-time or embedded Linux... 
    Remote work

    Rethink recruit

    San Francisco, CA
    3 days ago
  •  ...is degraded Present key results and changes to the broader engineering team What You'll Bring Your applied math skills stand out...  ...engineering skills, preferably with both embedded software (C, C++, Rust) and technical computing (MATLAB, python, Julia, etc.).... 
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    Local area

    Zipline

    South San Francisco, CA
    2 days ago
  • $236k

     ...Hardware Engineer Bedrock Robotics, Inc. seeks a Hardware Engineer in San Francisco, CA responsible for designing, manufacturing, and...  ...including CAN, LIN, J1939, FlexRay, or Ethernet; (iv) python or C++/C/Rust; and (v) standardization tools and organizations, including ISO,... 
    Work at office
    Remote work
    Work from home
    3 days per week

    CapitalG

    San Francisco, CA
    1 day ago
  • $180k - $250k

     ...Hardware Engineer Title of Role: Hardware Engineer Location: San Francisco, onsite Company Stage of Funding: Venture-Backed — AI...  ...predictive maintenance. Develop software in C/C++, Python, Go, or Rust to optimize hardware performance and functionality.... 
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  • $60 per hour

     ...Pay: up to $60/hour As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps... 
    Hourly pay
    Contract work
    Immediate start
    Remote work

    SuperAnnotate

    San Francisco, CA
    a month ago
  • $183.6k - $297k

     ...and Zillow. Job Summary We're looking for an Infrastructure Engineer to help ensure all components in our platform are optimized and...  ...and mentoring peers. ~ Experience with Go, C++, Java, C#, or Rust. ~ Experience operating Kubernetes clusters. ~ Experience building... 
    Remote work

    PaloAlto Networks

    San Francisco, CA
    4 days ago
  • $185k

    About the RoleThe Engineering Acceleration team builds and operates the foundational systems that engineers use to build, test, and ship ChatGPT...  ...and infrastructure orchestrationPython, Go, TypeScript, Rust, C++, and other languages in a large monorepoTerraform for infrastructure... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...running AI agents. We’re looking for unusually high-potential engineers who want to learn how reliable systems are designed, built,...  ...performance tooling. Production-grade systems software in Rust, Go, C, or C++. Representative projects You might find yourself... 
    Full time
    Internship

    Kindredventures

    San Francisco, CA
    23 hours ago
  •  ...Forces. The Role Specter is hiring an Embedded Software Engineer to own the full on-device software stack for our distributed...  ...Proficiency in writing software for embedded targets using C, C++, Rust, or similar languages. Experience with embedded Linux on System... 
    Full time

    specter

    San Francisco, CA
    7 days ago
  •  ...boots. You'll work alongside construction veterans and world-class engineers to solve physical-world problems that simulations can't touch....  ...programming skills in a systems language such as C++ or Rust, plus fluency in Python for scripting and analysis. Solid foundation... 
    Full time
    For contractors
    Flexible hours

    bedrock-robotics

    San Francisco, CA
    7 days ago
  •  ...IOI, Codeforces, USACO, Putnam) Game development, game jams, engine work, or simulation Performance-sensitive work: profiling, frame...  ..., OpenGL, Vulkan, shaders Working fluency in Go, C++, or Rust Familiarity with video streaming protocols or geospatial applications... 
    Permanent employment
    Full time
    Work at office

    swarmaero

    San Francisco, CA
    7 days ago
  •  ...Forces. The Role Specter is hiring a Software Systems Engineer to build the real-time device software at the heart of our platform...  ...sensor pipelines, or low-level Linux systems work Production Rust (preferred) or C++ in low-latency, embedded, or systems contexts... 
    Full time

    specter

    San Francisco, CA
    7 days ago
  • $320k

     ...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build...  ...AWS, GCP) at scale. Are proficient in Python; experience with Rust is a plus but not required. Strong candidates may also have:... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    11 days ago
  • $300k - $400k

     ...Role We’re looking for generalist infrastructure and systems engineers to help build the systems that power our foundation models and...  ...Proficiency in at least one backend language (we use Python or Rust). Experience operating large‑scale clusters and container orchestration... 
    Full time
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    Thinking Machines Lab

    San Francisco, CA
    11 days ago
  • $206.3k - $388k

    ABOUT THE ROLEWe're looking for a Principal ML Engineer to drive down cost per asset and drive up throughput across the ML pipelines behind...  ...modelsStrong Python, plus a systems-level language (C++, Rust, Go, or Java), and experience with distributed frameworks such as... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    23 hours ago
  • $200k

     ...simple over their lifetime.   Convex has assembled a team of engineers who have built and designed some of the largest platforms in...  ...in SF. ~ Ability to write high quality code (knowledge of Rust is a plus). ~ An enthusiasm for going deep to understand Convex... 
    Full time
    Work at office
    Remote work
    Night shift

    convex-dev

    San Francisco, CA
    7 days ago
  •  ...how to improve. About the role We're looking for a software engineer who loves to build high performance data processing systems. Our...  ...credentials Expert-level understanding of systems programming (C++ or Rust, concurrency, databases, operating systems) Previous... 
    Full time
    Flexible hours

    braintrust

    San Francisco, CA
    7 days ago
  • $160.2k - $425k

     ...United States Overview GitHub is looking for a Principal Systems Engineer to join our Database Infrastructure team. We're a team that...  ...including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python ORAssociate's Degree in Computer Science, Electrical... 
    Ongoing contract
    Remote work

    GitHub

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Rust Engineer. Be the first to apply!