Rust Engineer
BerriAI
Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
- Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
- Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
- Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
- Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
- Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
- Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
What We're Looking For
- Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
- Obsessive about performance. You care about latency and throughput at a level most engineers don't.
- Strong instinct for stability, with a track record of balancing ambitious change against reliability.
- Major bonus: prior experience leading codebase migrations from another language to Rust.
- Major bonus: a demonstrated history of shipping performance-critical systems.
- Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Why Join LiteLLM?
- Own one of the most important technical bets in the company's roadmap.
- Define the architectural foundation that the entire platform will run on.
- Fast-paced growth environment with deep technical ownership.
- Competitive salary, health, dental, and vision benefits.
About LiteLLM
LiteLLM ( is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to make LiteLLM the fastest AI gateway ever? Apply now!
$154k - $266k
...Employment Type: FullTime Workplace Type: OnSite Department: Engineering, Product, Design Team: Controls Engineering Compensation: $1... ...program in a variety of modern software languages (Python, JS, Rust, C#, etc.) Exposure to machine vision systems for robotic...SuggestedPermanent employmentFull timeLocal areaRelocation packageFlexible hours- ...boots. You'll work alongside construction veterans and world-class engineers to solve physical-world problems that simulations can't touch.... ...for dynamic systems ~ Strong programming skills (C++/Rust, Python) ~ Strong data analysis skills ~ Experience with safety...SuggestedFull timeFor contractors
$75 - $105 per hour
...Our client, a leading AI research organization, is looking for engineers and computational researchers to help evaluate how AI systems solve... ...one additional language: JavaScript/TypeScript, Go, C++ or Rust. Practical experience with Git and Docker. Familiarity with...SuggestedHourly payImmediate start- ...Kubernetes orchestration, distributed resource lifecycles, and our Rust virtual machine monitor (VMM), the software that runs each... ...and finish it. Your code reviews and documentation help another engineer understand the guarantees and remaining limitations. You use...SuggestedFull timeWork at officeVisa sponsorshipRelocation package
- ...Staff Security Engineer, Risk Engineering San Francisco, CA | New York City, NY | Seattle, WA About the Role The Security Risk... ...programming skills in Python or at least one systems language such as Go, Rust, or C/C++ Broad knowledge across the core security engineering...SuggestedWork at officeVisa sponsorshipFlexible hours
- ...and scheduling decision matters. We are looking for systems engineers who want to understand computers all the way down and build infrastructure... ...for Experience building substantial systems software in Rust, Go, C, C++, or a similar language. Rust is preferred but not...Full timeWork at officeVisa sponsorshipRelocation package
$174k - $205k
...and out of the office. We are seeking a Senior Manufacturing Test Engineer to lead end-to-end test strategy, design, development, and... ...experience developing manufacturing test software in Python, C, C++, Rust.Bachelor's or Master's degree in Mechanical Engineering,...Contract workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$160.2k - $425k
...never been more important. We're building a new Production Engineering organization to help raise the operational bar across GitHub. Production... ..., but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python, ~ OR Associate's Degree in Computer Science,...Ongoing contractRemote work- ...that matter. About the role We're looking for an electrical engineer to own electronics end-to-end at a fast-moving company building... ...company Firmware development experience (embedded C/C++ or Rust, motor control, communication protocols) Circuit simulation (SPICE...Contract workInternship
- ...As a Build & Release Engineer, you will own the infrastructure and developer platforms that underpin our engineering workflows. This includes... ...-based build and test infrastructure that supports C++, Python, Rust, and Typescript-based development. - Infrastructure...Remote work
$175k - $200k
...bit about us: We are an established, industry-leading organization that is on the lookout for a talented Senior Rust Developer / Senior C++ Engineer! Why join us? As a Senior C++ Software Engineer / Senior Rust Software Developer in our company, we are able...Local areaRemote workWork from home- ...by top-tier investors and led by a tight team of operators and engineers from the most respected names in aerospace, defense, and telecom... ...stack like PX4 or ArduPilot. You write production C++ or Rust today. Our stack is Rust; strong C++ engineers who want to learn...Work at office
- ...Software Engineer Kovari develops frontier technology to transform physical businesses. They partner with established operators to change... ...the stack against them You Should Have Strong C++ or Rust, plus Python Experience with real-time or embedded Linux...Remote work
- ...is degraded Present key results and changes to the broader engineering team What You'll Bring Your applied math skills stand out... ...engineering skills, preferably with both embedded software (C, C++, Rust) and technical computing (MATLAB, python, Julia, etc.)....Full timeSummer workInternshipSummer internshipWork at officeLocal area
$236k
...Hardware Engineer Bedrock Robotics, Inc. seeks a Hardware Engineer in San Francisco, CA responsible for designing, manufacturing, and... ...including CAN, LIN, J1939, FlexRay, or Ethernet; (iv) python or C++/C/Rust; and (v) standardization tools and organizations, including ISO,...Work at officeRemote workWork from home3 days per week$180k - $250k
...Hardware Engineer Title of Role: Hardware Engineer Location: San Francisco, onsite Company Stage of Funding: Venture-Backed — AI... ...predictive maintenance. Develop software in C/C++, Python, Go, or Rust to optimize hardware performance and functionality....Work at office$60 per hour
...Pay: up to $60/hour As an hourly paid, fully remote Rust Engineer for AI Data Training, you will review AI-generated Rust code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps...Hourly payContract workImmediate startRemote work$183.6k - $297k
...and Zillow. Job Summary We're looking for an Infrastructure Engineer to help ensure all components in our platform are optimized and... ...and mentoring peers. ~ Experience with Go, C++, Java, C#, or Rust. ~ Experience operating Kubernetes clusters. ~ Experience building...Remote work$185k
About the RoleThe Engineering Acceleration team builds and operates the foundational systems that engineers use to build, test, and ship ChatGPT... ...and infrastructure orchestrationPython, Go, TypeScript, Rust, C++, and other languages in a large monorepoTerraform for infrastructure...Work at officeLocal areaRemote workFlexible hours- ...running AI agents. We’re looking for unusually high-potential engineers who want to learn how reliable systems are designed, built,... ...performance tooling. Production-grade systems software in Rust, Go, C, or C++. Representative projects You might find yourself...Full timeInternship
- ...Forces. The Role Specter is hiring an Embedded Software Engineer to own the full on-device software stack for our distributed... ...Proficiency in writing software for embedded targets using C, C++, Rust, or similar languages. Experience with embedded Linux on System...Full time
- ...boots. You'll work alongside construction veterans and world-class engineers to solve physical-world problems that simulations can't touch.... ...programming skills in a systems language such as C++ or Rust, plus fluency in Python for scripting and analysis. Solid foundation...Full timeFor contractorsFlexible hours
- ...IOI, Codeforces, USACO, Putnam) Game development, game jams, engine work, or simulation Performance-sensitive work: profiling, frame... ..., OpenGL, Vulkan, shaders Working fluency in Go, C++, or Rust Familiarity with video streaming protocols or geospatial applications...Permanent employmentFull timeWork at office
- ...Forces. The Role Specter is hiring a Software Systems Engineer to build the real-time device software at the heart of our platform... ...sensor pipelines, or low-level Linux systems work Production Rust (preferred) or C++ in low-latency, embedded, or systems contexts...Full time
$320k
...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build... ...AWS, GCP) at scale. Are proficient in Python; experience with Rust is a plus but not required. Strong candidates may also have:...Work at officeLocal areaVisa sponsorshipFlexible hours$300k - $400k
...Role We’re looking for generalist infrastructure and systems engineers to help build the systems that power our foundation models and... ...Proficiency in at least one backend language (we use Python or Rust). Experience operating large‑scale clusters and container orchestration...Full timeVisa sponsorshipWork visaRelocation packageFlexible hours$206.3k - $388k
ABOUT THE ROLEWe're looking for a Principal ML Engineer to drive down cost per asset and drive up throughput across the ML pipelines behind... ...modelsStrong Python, plus a systems-level language (C++, Rust, Go, or Java), and experience with distributed frameworks such as...Full timeTemporary workLocal areaWorldwide$200k
...simple over their lifetime. Convex has assembled a team of engineers who have built and designed some of the largest platforms in... ...in SF. ~ Ability to write high quality code (knowledge of Rust is a plus). ~ An enthusiasm for going deep to understand Convex...Full timeWork at officeRemote workNight shift- ...how to improve. About the role We're looking for a software engineer who loves to build high performance data processing systems. Our... ...credentials Expert-level understanding of systems programming (C++ or Rust, concurrency, databases, operating systems) Previous...Full timeFlexible hours
$160.2k - $425k
...United States Overview GitHub is looking for a Principal Systems Engineer to join our Database Infrastructure team. We're a team that... ...including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python ORAssociate's Degree in Computer Science, Electrical...Ongoing contractRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Rust Engineer. Be the first to apply!







