Rust Engineer
LiteLLM AI Gateway
Rust Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built. About The Role You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on. This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration. Responsibilities
About LiteLLM LiteLLM ( is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide. Ready to make LiteLLM the fastest AI gateway ever? Apply now!
- Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
- Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
- Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
- Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
- Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
- Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
- Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
- Obsessive about performance. You care about latency and throughput at a level most engineers don't.
- Strong instinct for stability, with a track record of balancing ambitious change against reliability.
- Major bonus: prior experience leading codebase migrations from another language to Rust.
- Major bonus: a demonstrated history of shipping performance-critical systems.
- Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
- Own one of the most important technical bets in the company's roadmap.
- Define the architectural foundation that the entire platform will run on.
- Fast-paced growth environment with deep technical ownership.
- Competitive salary, health, dental, and vision benefits.
About LiteLLM LiteLLM ( is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide. Ready to make LiteLLM the fastest AI gateway ever? Apply now!
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Rust Engineer in San Francisco, CA vacancy
$200k - $260k
...Rust Engineer (AI DevTool Start-Up) $200,000 - $260,000 + Equity + Benefits + PTO On-site in San Francisco, CA Are you a Rust engineer who obsesses over latency numbers that most engineers wouldn't even notice? Do you want extreme ownership of the most...SuggestedClient Services
San Francisco, CA5 days ago- ...Vortex file format. Our users are AI/ML researchers and AI infra engineers developing models in complex domains, such as weather & climate... ...stack (e.g. PyTorch, CUDA) is also a plus ~ Experience with Rust is a bonus ~ Willingness to work in-person at our NYC, SF,...SuggestedWork at office
Spiral
San Francisco, CA19 days ago - ...our entire product lifecycle hardware-in-the-loop testers for engineering, qualification rigs, and production-floor stations. At Specter,... ...that drives them. Python for orchestration and high-level logic, Rust for low-level hardware communication and performance-critical...SuggestedFull time
S.e. Specter
San Francisco, CA1 day ago - ...automation cell from zero at least once Bachelor's Degree in Engineering from an ABET accredited institution Understanding of the... ...electrical design Programming experience in Python, Embedded Rust If you're driven and have the initiative to tackle any sort...Suggested
Gradient Robotics
San Francisco, CA1 day ago - ~ Senior Software Engineer (Rust) at Symbolica – San Francisco, US Senior Software Engineer (Rust) at Symbolica – San Francisco, US About Us Symbolica is an AI research lab pioneering the application of category theory to enable logical reasoning in machines...SuggestedWork at officeShift work
Victrays
San Francisco, CA3 days ago - ...CEOs/founders. About the role We're looking for a software engineer who loves to build high performance data processing systems. Our... ...Expert-level understanding of systems programming (C++ or Rust, concurrency, databases, operating systems) Previous experience...Full timeFlexible hours
Braintrust
San Francisco, CA1 day ago $200k
...simple over their lifetime. Convex has assembled a team of engineers who have built and designed some of the largest backends in the... ...in SF. ~ Ability to write high quality code (knowledge of Rust is a plus). ~ An enthusiasm for going deep to understand Convex...Full timeWork at officeNight shiftConvex
San Francisco, CA1 day ago- ...Embedded Software Engineer - Embedded Systems & Firmware Company Background: Specter is creating a software-defined “control plane”... ...Proficiency in writing software for embedded targets using C, C++, Rust, or similar languages. Experience with embedded Linux on...Full time
Specter
San Francisco, CA1 day ago $350k
...AI work for their unique needs and goals. We are scientists, engineers, and builders who’ve created some of the most widely used AI... ...Proficiency in at least one backend language (we use Python or Rust). Experience operating large‑scale clusters and container orchestration...Full timeImmediate startVisa sponsorshipWork visaRelocation packageFlexible hoursThinking Machines Lab
San Francisco, CA1 day ago- ...sensors by 10x. Our platform will ultimately become the perception engine for a company’s physical footprint, enabling real-time perimeter... ...sensor network Qualifications: ~5+ years of experience in Rust (preferred) or C++ in low-latency and/or embedded settings ~...Full time
Specter
San Francisco, CA1 day ago - ...AI Systems Engineer - Codex Core Agents Location San Francisco Employment Type Full time Department Applied AI Compensation 230K-385K Offers... ..., cloud platforms, or ML systems. Enjoy working across layers: Rust systems code, Python configuration layers, APIs, agent...Full timeWork at officeLocal areaRelocation packageFlexible hours
Slope
San Francisco, CA3 hours ago - ...discovery. You should have a strong ML foundation, graduate degree preferred, and experience with distributed systems, Python, and Rust. You will ship robust experiments at scale and contribute to AI for science across biology, chemistry, and physics. #J-18808-Ljbffr...
Thesis (YC F25)
San Francisco, CA1 day ago - ...Infinity is seeking an experienced engineer to advance a global inference library in San Francisco. You will own parts of the system from... ...chips and models. You will work with Python and systems languages (Rust/C/C++) and collaborate with teams to push the state of AI...
Infinity Artificial Intelligence Institute
San Francisco, CA1 day ago - ...improve how information is represented and used by AI. This engineering team partners closely with the Granica Research group led by Prof... ..., or next-generation compute frameworks. Fluency in Java, Rust, Go, or C++ , emphasizing simplicity, performance, and...Full timeFlexible hours
Granica
San Francisco, CA1 day ago - ...Antithesis in San Francisco is looking for a Software Engineer to work on Pangolin, an innovative analytics database handling terabytes... ...ensure deployment and reliability. We seek engineers with strong Rust skills, systems programming fundamentals, and a habit of solving...Work at office
Antithesis
San Francisco, CA3 hours ago - ...You'll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can't touch.... ...gigabit ethernet, RF ~ Proficiency in compiled (C/C++/Rust), shell (linux bash), or runtime (Python) languages with ability...Temporary workWork at officeFlexible hours
Bedrock Robotics
San Francisco, CA1 day ago $180k - $250k
...Hardware Engineer Title of Role: Hardware Engineer Location: San Francisco, onsite Company Stage of Funding: Venture-Backed — AI... ...predictive maintenance. Develop software in C/C++, Python, Go, or Rust to optimize hardware performance and functionality....Work at officeRecruiting from Scratch
San Francisco, CA5 days ago$187.5k - $247.5k
...storage and producing battery materials in the U.S. for the first time, all from batteries we already have. Staff Mechanical Design Engineer, EPC Redwood Materials is hiring for a Staff Mechanical Design Engineer to join our Engineering, Procurement, and Construction...Full timeWork experience placement- ...right at home. If you’re looking for something easier -this isn’t it. The Role We’re looking for an experienced Staff Mechanical Engineer to lead new product development from concept through to production. You’ll be part of a small, mission-driven team and have...Full timeWork at officeImmediate startWorldwideFlexible hoursNight shift
- .... If you’re looking for something easier -this isn’t it. The Role We’re looking for a leader for our mechanical/product design engineering team in San Francisco. You'll oversee development of highly complex electromechanical products, including our flagship product (the...Full timeWork at officeImmediate startWorldwideFlexible hoursNight shift
$150k - $250k
...the platform we’re building will adapt to experts across fields: engineering, research, operations, and beyond. About the Role We’re... ...js. Bonus points for experience across the stack with Python or Rust and with adaptive or model-facing UI architectures. What You...Full timeSummer workInternshipRemote workFlexible hoursStealth AI startup
San Francisco, CA4 days ago$2,000 per month
...with you. About The Role As a Founding Principal Software Engineer , you will help build out the next generation data platform to... ...one of the public clouds - 8+ years experience working with Rust - Experience with DevOps / CD Experience building SaaS/PaaS products...Full timeNextdata Technologies Inc
San Francisco, CA1 day ago- Systems Engineer @ Dedalus Labs Mission Dedalus Labs is an AI research neolab building infrastructure for AI agents. We’re building the... ...operating AI agents dramatically simpler. What we look for Fluency in Rust (preferred), Go, C/C++, or similar systems languages. Strong...Work at officeVisa sponsorshipRelocation package
$150k - $207k
...scale energy storage and producing battery materials in the U.S. for the first time, all from batteries we already have. Service Engineer, Energy Storage Position Summary : Redwood Materials is currently searching for a Service Engineer to join as an early...Full timeCasual workWork at officeLocal areaNight shift$300 per month
...deploys AI scientist agents to accelerate science and the development of new medicines. We are an ambitious team run by scientists and engineers from leading institutions across biology, physics, chemistry, and AI. The Role We're hiring our founding Security Operations...Full timeWork at office$160k - $270k
...researchers from OpenAI and DeepMind — is hiring 2-3 Founding Engineers to own the core of its graph-native database platform. Built on... ...programming and distributed systems development Proficiency in Rust and/or Go; deep curiosity to go further Experience designing and...Full timeWork at officeFlexible hours- ...Title: Software Engineer (C++ Systems) Location: San Francisco, CA, United States (Onsite) – Relocation packages are available. Client Industry... ...: AI‑infrastructure industry / GPU Virtualization Skills: C++, Rust Job Description We are looking for a Software Engineer (C++...Work experience placementRelocationWeekend work
SK HR Consultants.com
San Francisco, CA2 days ago $174.5k - $240k
...passionate people to join us as we power the shop local movement. If you believe in community, come join ours. About this role GTM Engineering builds and operates the intelligent systems, integrations, and automations that power Faire's GTM revenue org. We're the AI and...Full timeWork at officeLocal areaRemote workFlexible hours3 days per week- ...engage with the Airport’s Capital Program Support Services Consultant Requirements: ~ Bachelor’s degree and licensure in Civil Engineering, Architecture, Construction Management, and/or similar preferred. ~10+ years recent experience in managing large-scale...Hourly payFull timeFor contractorsImmediate startFlexible hours
AGS Inc.
San Francisco, CA4 days ago - ...the goal of creating the best customer service experience for our users. The Difference You Will Make: As a staff software engineer, you will lead two areas that are critical to Airbnb community support: Automation Platform, a large-scale, widely adopted conversational...Work experience placementFlexible hours
airbnb, Inc.
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Rust Engineer. Be the first to apply!
