L Rust Engineer LiteLLM · San Francisco, CA posted 2 months ago
Rustify
# Rust EngineerLiteLLM · San Francisco, CA · Senior · HybridView & Apply## About the RoleYou’ll own LiteLLM’s migration from Python to Rust, end to end.This is a high-stakes, high-visibility role where you will:* Plan the migration directly with the CTO* Restructure the existing codebase so it is ready for an incremental move to Rust* Lead a gradual, stability-first rollout* Drive LiteLLM toward becoming the lowest-latency, highest-throughput AI gateway in the category* Ensure performance improvements never compromise the reliability our enterprise customers depend onThis is a single-owner mandate. You will be the person responsible for leading the entire Python-to-Rust migration.## Responsibilities* Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through production rollout* Plan the migration alongside the CTO and sequence the work to minimize risk to live, high-volume traffic* Design and execute a gradual rollout with stability as the top constraint* Restructure the existing codebase to enable a clean, incremental migration* Drive improvements across latency, throughput, and resource efficiency at more than 1 billion requests per month* Collaborate across teams to align the migration with backend priorities across performance, reliability, and security
#J-18808-Ljbffr
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the L Rust Engineer LiteLLM · San Francisco, CA posted 2 months ago in San Francisco, CA vacancy
$45.76k - $49.92k
...Structural Engineering Intern | San Francisco, CA 100% Employee-Owned · Big-firm resources, local-team relationships, ONE IMEG culture This posting is for Summer 2027 Internship opportunities. IMEG... ...Education ~ Completed at least 2 years towards a Bachelor of Science...SuggestedHourly payPermanent employmentFull timeContract workSummer workInternshipSummer internshipLocal areaFlexible hours$95k - $125k
...self-starting Project Engineer to support K-12 and... ...projects in San Francisco. This person will be... ...contractor/subcontractor monthly pay applications.... ...have.A minimum of 2 years as a Construction... ...or less than the posted range, depending on... ...ordinance and CA law. Turner & Townsend...SuggestedFull timeFor contractorsFor subcontractorTurner & Townsend
San Francisco, CA6 days ago$20 - $50 per hour
...Silicon Valley Business Journal and the San Francisco Business Times. We’re looking for... ...company that is known for its excellence in engineering, passion for progress, and dedication... ...resolve hardware failures 1-3 times a month(potentially more) Reports to a...SuggestedFor contractorsRelocation packageFlexible hoursWeekend workCobalt AI, LLC
San Francisco, CA11 days ago$134.9k - $202.5k
...design practice. Our architects, engineers, interior designers,... ...progression.Pursuant to the San Francisco Fair Chance Ordinance, we will... ...Pay Range:• Locations in NYC & CA (Bay Area) & NJ (RP)-$134,900... ...PositionTravel: YesSchedule: Full timeJob Posting: 04/05/2026 03:05:11Req ID: 1...SuggestedFor contractorsWork at officeStantec
San Francisco, CA2 days ago$166k - $343k
Pre-Sales Systems Engineer - Higher Education and State Government (Sacramento/San Francisco, CA)This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company...SuggestedFull timeWork experience placementLocal areaImmediate startRemote workWork from homeHewlett Packard Enterprise
San Francisco, CA4 days ago$220k - $290k
...Sales Engineer - San Francisco San Francisco, California, United... ...calls, and helped manage $2.8B in cloud spend... ...in the San Francisco, CA area What You Will... ...TGIF-Off / 4 days Monthly, quarterly, and annual... ...may involve fake job postings, unsolicited emails, or...Local areaImmediate startRemote workFlexible hoursShift work$192.5k - $240.5k
.... Box is headquartered in Redwood City, CA, with offices across the United States,... .... WHY BOX NEEDS YOU The Solutions Engineering Team at Box includes solutions engineers... ...configuration. This role is in the San Francisco office, supporting Enterprise clients to...Full timeWork experience placementLive inWork at officeShift work3 days per weekBox
San Francisco, CA7 days ago$26.4 - $31.2 per hour
...Type: X-Ray San Francisco , CA SkyBridge Healthcare is currently seeking Radiation Technologist with X-Ray experience for a 13-week contract... ...: 1 year full time X-Ray experience within the last 2 years. SkyBridge Healthcare offers industry leading benefits...Weekly payPermanent employmentFull timeContract workRelocation package$166k - $343k
...Pre-Sales Systems Engineer This role has been designated as 'Remote/Teleworker', which means you will primarily work from home.... ...transformation. Location: Candidates must reside in the Sacramento or San Francisco area and have the ability to travel to customer sites within...Work experience placementRemote workWork from home$46 - $50 per hour
...a full-time Roving Building Engineer for our Portfolio properties in San Francisco, specifically in the East Bay.... ...Compensation: $46 - $50 Per Hour + $250 Monthly Car Allowance Schedule:... ...Painting is highly desired. Valid CA Driver's License & Insurance....Hourly payFull timeMonday to FridayAction Property Management
San Francisco, CA5 days ago- ...Pre-Sales Solutions Engineer Deepgram is seeking a Pre-Sales Solutions Engineer to join our Applied Engineering team. While you... ...evolution of our pre-sales methodology. This role is based in San Francisco, where many of our customers and partners are located. Being...Work at officeRemote work
$212k - $292k
...Cloudflare Customer Engineer At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world... ...Internet. Project Galileo: Since 2014, we've equipped more than 2,400 journalism and civil society organizations in 111 countries...Temporary workLocal areaFlexible hours- ...Sales Engineer (Enterprise) Sales Engineer (Enterprise) San Francisco About the Role Seeking a motivated Sales Engineer to join our growing technical sales team... ...broader team on our product. Qualifications 2+ years of Sales Engineering, Solutions...Work at officeFlexible hours
$3,500 per week
...experienced ALLIED-ECHO-Echo Technologist for a 13-week contract in San Francisco, California — earn up to ($2768 - $2914 per week) while... ...a leading facility. Most candidates will need to have at least 2 years of recent experience in the specialty. Apply & Call us...Contract workImmediate startShift workVoyage Health
San Francisco, CA5 days ago$126.5k - $169.6k
Job Posting Title:Manager, Production Engineering (ILM-San Francisco)Req ID:10159541Job Description:We are looking for an ambitious and kind leader who reflects the... ...timePrimary City, State, Region, Postal Code:San Francisco, CA, USAAlternate City, State, Region, Postal Code:...Full timeWork experience placementLocal areaHulu
San Francisco, CA3 days ago- ...Description Job Description Benefits: Employee discounts Health insurance Paid time off Security / Integration Engineer –SanFrancisco, CA Local to CA Needed Only GC & USC Role summary. The technical anchor of the engagement. Builds...Local area
DELTASOFT SOLUTIONS LLC
San Francisco, CAa month ago $347k
...seeking an Performance Modeling Engineer to support the development... ...early-career engineers with 1-2 years of experience in... ...systems.This role is based in San Francisco, CA. We use a hybrid work model of... ...OpenAI that you believe this job posting is non-compliant, please...Work at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA2 days ago$115k - $172k
...Job Description Summary Field Engineer 2 Mammography/X-Ray Job Description GE HealthCare is a leading global medical technology... ...may be different by site. This position will be located in San Francisco, CA. For this specific location the pay range is $115K - 172K...Contract workRemote workVisa sponsorshipWork visaRelocation packageFlexible hoursGE Healthcare
San Francisco, CA19 hours ago$115k - $172k
...Field Engineer 2 Mammography/X-Ray GE HealthCare is a leading global medical technology and digital solutions innovator. Our mission... ...may be different by site. This position will be located in San Francisco, CA. For this specific location the pay range is $115K - 172K...Contract workVisa sponsorshipWork visaFlexible hoursGE
San Francisco, CA3 days ago$140k - $210k
...re looking for a Lead People Technology Engineer to be the first dedicated AI engineer within... ...or data engineering experience, with 2+ years building AI/ML or LLM-powered delivering... ...process. All our legitimate job postings can be found on our official career site....Full timeShift workKlaviyo
San Francisco, CA1 day ago$110k - $182k
...Sales Engineer, San Francisco (Enterprise) Remote - San Francisco, California Join the company that's building the telemetry infrastructure... ...concept sessions Document interesting use cases in blog posts and product documentation Up to 30% Travel We are a remote...Temporary workLive inRemote workFlexible hours$150k - $200k
...Job Description Job Description Sales Engineer – AI / Fintech (San Francisco) Looking for experienced Sales Engineers who combine technical depth with strong sales, customer, and demo skills. Join a small but thriving AI fintech selling complex enterprise technology...Syndesus
San Francisco, CA5 days ago$180k - $250k
...Senior Software Engineer, Robotics Platform About Nimble Nimble is an AI robotics company building the autonomous supply chain to... ...proficiency in at least one of the following programming languages: Rust, Python, C++. Strong fundamentals in backend services,...Local areaFlexible hoursNimble
San Francisco, CA3 days ago$115k - $172k
...Field Engineer 2 Mammography/X-Ray GE HealthCare is a leading global medical technology and digital solutions innovator. Our mission... ...may be different by site. This position will be located in San Francisco, CA. For this specific location the pay range is $115K - 172K...Contract workVisa sponsorshipWork visaRelocation packageFlexible hours- ...Customer Service Engineer Lumenis is a global medical technology company known for innovative, energy-based solutions and exceptional... ...performs reliably in clinical environments. Location: San Francisco Employment: Type: Full-Time Travel: 60%+ We are...Full time
- Cooling Ce A Cooling CE is responsible for installation, commissioning, scheduled and emergency service on Liebert Air products. The Cooling CE is required to establish, promote and maintain excellent rapport with all customers, co-workers, sales representatives and...Temporary workWork at officeLocal areaFlexible hoursWeekend workAfternoon shift
$137k - $207k
...for a Senior Forward-Deployed Engineer to join our Professional... ...more than 3-4 days every other month.What you will do:Build production... ...engineering with at least 2 years in a customer-facing technical... ...your space as needed.The San Francisco, CA base pay range for this role...Remote workWork from homeWorldwideFlexible hoursVercel
San Francisco, CA6 days ago$2,393 per week
...Technician / Technologist Location: Oakland, CA Agency: Cynet Health Pay: $2,393 per week Shift Information: Days - 5 days x 8 hours Contract Duration: 26 Weeks Start Date: 10/12/2026 About the Position Job Title: Music Therapist Profession...Full timeContract workShift workCynet Health
Oakland, CA3 days ago- ...Location: San Francisco, CA Work Model: In-person (occasional... ...client travel ~1-2x/month) Industry: AI transformation... ...AI strategy and AI engineering. A preferred... ...Engineer, you'll be a post-sale, client-facing software... ...sites roughly 1-2 times per month as required...
talentpluto
San Francisco, CA19 hours ago - ...software company based in San Francisco, CA. Investors include... ...sharp, customer-focused engineers who are excited to work... ...issues that are discovered post-launch. WHO YOU ARE... ...special advocates) ~$2,500 annual... ...office setup ~$50 a month effective work reimbursement...Work at officeRemote workFlexible hours
Binti Inc
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to L Rust Engineer LiteLLM · San Francisco, CA posted 2 months ago. Be the first to apply!
