Staff Software Engineer, ML Training and Inference Infrastructure
$228k - $285kRivian
Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.
Role Summary
As a Staff Software Engineer, ML training and inference infrastructure , you will be a member of the Perception team at Rivian, which develops advanced machine learning algorithms that directly impact safety critical self-driving features of our category defining vehicles.
We are looking for candidates with deep knowledge and strong enthusiasm towards establishing a state-of-art ML infrastructure for training and inference of large autonomous driving models; and optimizing the training and inference performance.
Responsibilities
- Optimize the performance of Deep Learning training workload on NVIDIA GPU systems on a large scale
- Optimize the latency of model inference and model pre- and post-processing on onboard systems
- Design, train, and deploy large deep learning models that can leverage the vast amount of labeled and unlabeled data
Qualifications
- PhD in CS/CE/EE, or equivalent, in industry experience
- Deep knowledge of PyTorch
- Knowledge of model training framework (e.g. PyTorch Lightning, ray, etc.)
- In-depth knowledge of transformer architecture and ways to accelerate the training and inference of transformer models
- Experience of performing large scale distributed training of models
- A track record of profiling models and doing detective work to improve model training and inference speed
Preferred Skill Requirements:
- Experience with CUDA or Triton language for writing custom ops
- Knowledge of Nvidia TensorRT
- Knowledge of NCCL
- Experience with edge computing systems
- A track record of efficiently solving complex problems collaboratively on larger teams
Pay Disclosure
Salary Range for California Based Applicants: $228,000.00 - $285,000.00 (actual compensation will be determined based on experience, location, and other factors permitted by law).
Benefits Summary : Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of employment
Equal Opportunity
Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.
Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at View email address on ev.careers .
Candidate Data Privacy and Technology
Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.
Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian affiliates; and (iii) Rivian’s service providers, including providers of background checks, staffing services, and cloud services.
Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.
How We Use AI in Our Hiring Process: To ensure transparency, we want candidates to know that Rivian uses iCIMS Talent Cloud Artificial Intelligence (TCAI) and AI-enabled tools to assist with screening, reviewing, organizing and highlighting profiles and applications that match the key requirements for each role.
AI does not make hiring decisions: Qualified candidate applications are reviewed by a member of our team, and all decisions throughout the process are made by humans. We use AI to support efficiency and consistency, not to replace human judgment. We are committed to a fair, thoughtful, and equitable experience for every candidate.
Participation in AI profile matching is entirely voluntary. If you prefer that your profile not be used in this process, you can opt out at any time. Opting out means your profile will be excluded from automated matching and will not be surfaced for additional roles through this system. Your current application remains active and will not be affected in any way.
Please note that we are currently not accepting applications from third party application services.
$228k - $285k
...shares a love of the outdoors and a desire to protect it for future generations. Role Summary As a Staff Software Engineer, ML training and inference infrastructure, you will be a member of the Perception team at Rivian, which develops advanced machine learning...TrainingFull timeContract workLocal area$207k - $300k
...and optimize AI inference workloads across... ...distributed fleet infrastructure layers to methodically... ..., Computer Engineering, Electrical Engineering... ...of experience in software development.... ...workloads using standard ML profilers (e.g.,... ...education or training. US: $207000 - $3...Training- ...deliver industry-leading training and inference speeds; over 10 times... ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize... ...and rack-scale AMD GPU infrastructure, to make this new serving... ...or another open-source ML systems project.Experience...Training
$207k - $300k
...Interfaces (APIs), Software Development Kits... ...Software Engineers, specifically around... ...including Android ML, ML Compiler, and... ...decision making), ML infrastructure, or... ...hardware-accelerated ML inference techniques.Understanding... ...education or training. US: $207000 - $3...TrainingShift work$190.9k - $232.8k
...1285About This RoleAs a staff software engineer for GenAI inference, you will lead the architecture... ..., distributed inference infrastructure - orchestrate across... ...understanding of ML inference internals: attention... ...certifications and training, and specific work location...TrainingLocal areaWorldwide- ...leader in AI cloud infrastructure serving tens of thousands... ...groundbreaking AI training and inference possible.The Lambda Infrastructure Engineering organization forges... ...seeking a seasoned Staff Storage Software Engineer with deep... ...in HPC, AI/ML infrastructure, or...TrainingWork at officeLocal areaWork from homeFlexible hours
$190k - $265k
...world's best data and AI infrastructure platform so our... ...business. Founded by engineers — and customer-obsessed... ...apps, AI agents, model training, model serving, and Vector... ....The Foundation Model Inference team is the backbone... ...platform, infra, and ML teams to deliver seamless...TrainingLocal areaWorldwide$198k - $326k
...LinkedIn's AI model training, feature engineering and serving with... ...infra, compute software, and hardware to... ....Model Training Infrastructure: As an engineer... ...GPU based inference for a large variety... ...hundreds of new ML models per quarter... ...scale.As a Sr. Staff Software Engineer...TrainingFor contractorsWork at officeFlexible hours$190k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks... ...ranging from post-training open source LLMs to... ..., AI Research Infrastructure, you will be developing... ...‑scale training and inference experiment workloads... ...scientists, ML engineers, and platform...TrainingLocal areaWorldwide$198k - $326k
...signals throughout the ML lifecycle, process... ...continuous model training, evaluation, and... ..., and enforceable engineering capabilities.As a Sr. Staff Software Engineer, you will... ...of AI Governance infrastructure. You will solve... ...evaluation, validation, inference, or deployment....TrainingFor contractorsWork at officeFlexible hours$193.93k - $352.29k
...fungible is the infrastructure that decides... ...inside Nuro's own engineering organization,... ...against the training pipelines... ...You5+ years of software engineering experience... ...experience. Staff-level... ...under the hood at inference. Attention and... ...Experience with ML training or research...TrainingImmediate startFlexible hours$198k - $326k
...team. LinkedIn’s AI Infrastructure organization is responsible... ...layer between model training and production... ...for a Senior Staff Software Engineer with deep expertise... ...infrastructure, and large-scale inference. This is a highly... ...closely with ML, infrastructure, and...TrainingFor contractorsWork at officeFlexible hours- ...deliver industry-leading training and inference speeds; over 10 times... ...the RoleWe're hiring a Staff Engineer to own major areas of the... ...Influence. Partner with ML, Product, Infrastructure, and Platform teams to translate... ...years of experience in software engineering, with...Training
$320k
...committed researchers, engineers, policy experts, and... ...role: The Safeguards ML Inference Path team designs,... ...operates the production infrastructure that powers Claude's... ...combination of education, training, and/or experience... ..., we expect all staff to be in one of our offices...TrainingWork at officeVisa sponsorshipFlexible hours$210k - $300k
...economical commerce. We're training robot AGI to power a... ...team of the world's best engineers and operators. If you are... ...We're looking for a Software Engineer to join our ML Infrastructure team. In this role, you'... ...build the training and inference systems that power our general...TrainingLocal areaFlexible hours- ...deliver industry-leading training and inference speeds; over 10 times... ...the RoleWe're hiring a Staff Engineer to help lead, drive, and... ...and maintain production software, with responsibilities spanning... ...Influence. Partner with ML, Product, Infrastructure, and Cloud teams to...Training
$262k - $364k
...coach a distributed engineering team, fostering... ...deploy scalable software and advanced... ...HPC, RDMA, and ML workloads.Strategic... ...ahead of training and inference advancements.Collaborative... ...Learning Infrastructure.Google's software... ...GDS).As a Senior Staff Software Engineer...TrainingRemote workWorldwide- ...physical world. Critical infrastructure is constrained by labor... ...the Role At Watney, ML Infrastructure engineers turn data collected from a... ...systems will require larger training runs with more data, expanded... ...ll Do Own training and inference infrastructure Build...Training
$91.35 per hour
...world's best data and AI infrastructure platform so our... ...business. Founded by engineers — and customer-obsessed... ...apps, AI agents, model training, model serving, and Vector... ....The Foundation Model Inference team is the backbone... ...platform, infra, and ML teams to deliver seamless...TrainingFull timeLocal areaWorldwide$207k - $300k
...Google e.g., Borg team, ML teams, HW platform... ...Warsaw.Develop junior engineers on the team.Minimum qualifications... ..., and launching software products.5 years of... ...large-scale infrastructure, distributed systems or... ...relevant education or training. US: $207000 - $300000...Training$207k - $300k
...coach a distributed team of engineers.Facilitate alignment and clarity... ..., and enhance large scale software solutions.Minimum... ...and developing large-scale infrastructure, distributed systems or networks... ..., and relevant education or training. US: $207000 - $300000 (USD)...Training$207k - $300k
...of highly complex ML pipelines and distributed... ...and mid-level engineers, fostering a... ...of experience in software development.5 years... ...decision making), ML infrastructure, or specialization... ...technology forward.As a Staff Software Engineer... ...education or training. US: $207000 - $30...TrainingImmediate start$257k - $386k
...economy and are looking for a Senior/Staff Software Engineer, Data Infrastructure to support our mission.This role is... ...pipeline, analytics workload, and ML system at Patreon runs on.You'll... ...Experience supporting ML/AI workflows, training pipelines, or evaluation systems.We...TrainingWork at officeLocal areaRemote workWorldwideFlexible hours2 days per week$193.93k - $352.29k
...driving technology. In an ML-first system, the... ...and diversity of its training and evaluation data. The... ...scalable and reliable data infrastructure. This infrastructure... ...closely with system engineers to thoroughly validate... ...across broader software organizationA bachelor...TrainingImmediate startFlexible hours$157.5k - $225k
....RoleWe are looking for a Senior Staff Software Engineer - Test Automation Infrastructure (ZIA Core) to join our team. This... ...Foundational understanding of AI/ML technologies and experience leveraging... ..., and relevant education or training.The base salary range listed for...TrainingFull timeWork at officeLocal area3 days per week$207k - $300k
...generation control planes and software infrastructure for highly-available ML network fabrics.Design... ...and Cloud with senior engineers and product managers.... ...technology forward.As a Staff Engineer on the ML Network... ...relevant education or training. US: $207000 - $300000 (...TrainingWorldwide$176.5k
...and role: Core Infrastructure builds and... ...products and our inference-driven features.... ...team of Senior, Staff, and Principal engineers building the Content... ...loves owning software end-to-end: design... ...stakeholders in ML, search, product... ...relevant education or training; and other...TrainingFull timeFor contractorsLocal areaHome officeFlexible hours$170k - $216k
...states. The Simulation Infrastructure team creates reliable... ...the Waymo Driver's software stack at a massive... ...of customers Software Engineers, Product, Data... ...Build and evolve ML inference infrastructure for simulations... ...experience, relevant training and education, and skill...TrainingFull timeRemote work$235.7k - $277k
...a separate system to run inference or build an agent, our customers... ...events at scale.As an engineer, you'll own delivery of... .... This is production infrastructure serving live inference, so... ...don't need a background in ML research or model training — this role is about...TrainingLive in$262k - $365k
Train task-specific models of in app AI (tiny Gemma... ...Google's on-device ML infrastructure (e.g., LiteRT, LiteRT... ...of on-device model inference via optimizations in... ...years of experience in software development.7 years of... ...’s degree or PhD in Engineering, Computer Science, or...Training
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, ML Training and Inference Infrastructure. Be the first to apply!
- software sales representative California
- embedded software California
- software applications developer California
- entry level software sales California
- software technology California
- software implementation project manager California
- software support California
- government software California
- software engineer - cloud services California
- software qa California



