Software Engineer II, Autonomy Evaluation & Metrics Platform
$142k - $177.5kRivian
Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.
Role Summary
Rivian’s Autonomy Eval Infrastructure team builds the software that helps engineers understand
and improve the ML models behind our driving systems and gives release teams evidence they
can trust. Within Autonomy’s AI Platform organization, we connect model development with
evaluation workflows, metrics, triage and visualization across simulation and real-world vehicle
data.
As a metrics-platform engineer, you will build backend services, Python libraries and data
pipelines that turn model outputs into reproducible measurements and useful comparisons.
Working alongside Perception, Planning and Systems engineers, you will learn how models
behave, investigate regressions and help turn evaluation findings into better models and data,
as well as trusted release scorecards.
You will own well-scoped components from implementation through deployment and operation,
with support from senior engineers on design and complex trade-offs. Joining this newly formed
team offers the opportunity to help shape a shared platform while developing your software
engineering and distributed-systems skills.
Responsibilities
- Build and test services, APIs and libraries for registering metric definitions, computing
results and retrieving them consistently across engineering tools. - Implement scalable metric-processing pipelines with safe retries, incremental
computation and backfills. Make missing inputs, failed jobs and incomplete results
visible. - Capture code, metric, model, dataset and scenario versions so a reported result can be
traced to its inputs and reproduced. - Build tools for comparing model versions and exploring results by scenario, geography,
vehicle platform and operating conditions, using consistent aggregation and
denominators. - Work with model developers to run evaluation experiments, inspect predictions and
investigate failure patterns. Help translate findings into targeted evaluation datasets and
regression tests. - Integrate metrics into evaluation workflows, CI regression checks and release
scorecards, and connect results to recordings and triage tools for investigation. - Improve automated tests, performance, observability and deployment tooling. Debug
production issues and document the components you support. - Work with engineers in Palo Alto, London and Belgrade to turn user needs into
maintainable software, participate in design and code reviews, and deliver improvements
iteratively.
Qualifications
- 2+ years of software engineering experience, or equivalent demonstrated experience
building and maintaining substantial software systems. - Strong Python programming skills and a solid foundation in data structures, algorithms,
software design and debugging. - Practical SQL skills, with AI coding tools expected to support writing and refining
queries; ability to validate query logic, results and performance. - Experience building backend services, reusable libraries or data-processing pipelines
with automated tests, version control and code review. - Ability to reason about APIs, data models and component design, explain trade-offs, and
identify failure cases such as duplicate, delayed or missing data. - Experience with cloud services, containers and CI/CD, and an understanding of how
software is deployed and monitored in production. - Care with data correctness and basic statistical reasoning, including sample sizes, rates
and variability; curiosity about how measurements reflect real driving behavior. - Clear written communication and a collaborative approach to gathering requirements,
asking for feedback and resolving technical problems. - Bonus Points
Hands-on experience with ML models using PyTorch or similar frameworks, such as
running inference or analyzing prediction errors; experience in autonomy, robotics or
simulation. - Experience with distributed data processing or analytical storage, such as Spark,
Databricks, Delta Lake or comparable systems. - Experience with AWS, Docker and GitLab CI, or with developer tools, experiment
tracking, data lineage or results visualization.
Prior autonomy or robotics experience is welcome but is not required for this role.
Pay Disclosure
Salary Range for California Based Applicants: $142,000-$177,500 (actual compensation will be determined based on experience, location, and other factors permitted by law).
Benefits Summary: Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of employment, and Rivian covers most of the premiums.
Equal Opportunity
Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.
Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at View email address on ev.careers.
Candidate Data Privacy and Technology
Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.
Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian affiliates; and (iii) Rivian’s service providers, including providers of background checks, staffing services, and cloud services.
Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.
How We Use AI in Our Hiring Process: To ensure transparency, we want candidates to know that Rivian uses iCIMS Talent Cloud Artificial Intelligence (TCAI) and AI-enabled tools to assist with screening, reviewing, organizing and highlighting profiles and applications that match the key requirements for each role.
AI does not make hiring decisions: Qualified candidate applications are reviewed by a member of our team, and all decisions throughout the process are made by humans. We use AI to support efficiency and consistency, not to replace human judgment. We are committed to a fair, thoughtful, and equitable experience for every candidate.
Participation in AI profile matching is entirely voluntary. If you prefer that your profile not be used in this process, you can opt out at any time. Opting out means your profile will be excluded from automated matching and will not be surfaced for additional roles through this system. Your current application remains active and will not be affected in any way.
Interview Integrity & AI Policy
Our interview process is designed to evaluate your personal technical foundation, real-time problem-solving logic, and structured capabilities. Therefore, the use of assistive generative AI tools to formulate or deliver your solutions during live interview sessions is not permitted . We care most about how you think — how you make sense of unclear requirements, weigh trade-offs, and explain why you chose one approach over another. We value your unique human perspective, your authenticity, and the journey it takes to reach a solution.
Please note that we are currently not accepting applications from third party application services.
$144.7k - $221.4k
...Organization The Evaluation team builds and evolves... .... We develop metrics, automated... ...Partnering with Autonomy, Simulation, Systems... ...core evaluation platforms, turn system-level... ...clear feedback for engineering and leadership, and... ...driving software performance at interfaces...PlatformFull timeWork at officeLocal areaWork from homeRelocationRelocation packageFlexible hours- ...experiences.The Evaluation team builds and evolves... .... We develop metrics, automated... ...Partnering with Autonomy, Simulation, Systems... ...core evaluation platforms, turn system-level... ...autonomous driving software performance across... ...autonomy, systems engineering, simulation, and...PlatformFull timeLocal areaWork from home
$194k - $349k
...s most advanced AI-native platform. We work on large scale distributed... ...through flexibility and autonomy while also being expected... .... This is a Sr. Software Development Engineer II (SDE) role in the CTIO... ...telemetry for model training, evaluation and on-device inference,...PlatformPermanent employmentWork experience placementWork at officeLocal areaRemote work- ...autonomous defense platforms. At the core of our... ...building an AI-forward autonomy stack for contested... ...denied. As an Autonomy Software Engineer, you will design,... ...rapid iteration.Develop evaluation pipelines, metrics, and tooling for... ...citizen or national, (ii) U.S. lawful,...PlatformPermanent employmentWork experience placementWork at officeLocal areaNight shift
$162k - $203k
...developing embedded software for Rivian's next-... ...driving platform. You will design,... ...to enable Rivian's autonomy stack. The ideal candidate... ...degree in Electrical Engineering, Computer... ...collect performance metrics from the customer... ...recruiting system; (ii) carrying out, analyzing...PlatformFull timeContract workWork experience placementLocal area- ...generation autonomous defense platforms. At the core of our... ...RoleMach Industries is seeking a Software Engineer, Mission Autonomy to develop the software... ...automation, and mission evaluation.Develop software for mission... ....S. citizen or national, (ii) U.S. lawful, permanent...PlatformPermanent employmentWork experience placementWork at officeLocal area
$160.36k - $291.15k
...we’re building a universal autonomy platform: self-driving for all... ...About the TeamThe Systems Engineering team is responsible for the... ...includes designing performance metrics, evaluation methods, and criteria for... ...intersection of hardware, software, and robot operations,...PlatformWork experience placementImmediate startFlexible hours$171k
...long-tail driving data. Autonomy is now a data race—and... ...sensor dependencies and evaluation metrics for the stack.Dataset... ...Collaboration: Partner with platform, product, and security engineering teams to enable the... ...working experience in software engineering.Bachelor’s...PlatformFull timeWork experience placementWork at officeRemote work$180k - $260k
...validate and prove our autonomy performance at scale... ...for a deeply technical software engineer to join the Autonomy Validation... ...robust internal platforms for validation —... ...system behavior should be evaluated.Systems and data engineers, to ensure metrics, safety thresholds,...PlatformLocal area$165.2k - $223.6k
...the RoleTwitch's Enterprise Platform & Technology (EPT) organization is looking for a Software Development Engineer II to build agentic AI... ...human-in-the-loop approvals, evaluation, and auditabilityBuild on... ...and services (CloudWatch metrics, logs, alarms, tracing)Cross...PlatformFlexible hours$206.5k - $258.1k
...Summary Rivian Autonomy is building an... ...hundreds of ML engineers a training platform they can trust at... ...seeking a Staff Software Engineer to help... ...that trains and evaluates our autonomous driving... ..." a first-class metric and drive it... ...system; (ii) carrying out, analyzing...PlatformFull timeContract workTemporary workPart timeLocal areaShift work$206.5k - $258.1k
...Summary Rivian's Autonomy org needs a Staff Software Engineer, Compute & Storage... ...compute and storage platform that every autonomy... ..., simulation base evaluation / validation, and autonomy... ...as a primary metric: eliminate GPU... ...recruiting system; (ii) carrying out, analyzing...PlatformFull timeContract workTemporary workPart timeLocal areaShift work$153.2k - $234.1k
...the Autonomous Vehicle software by designing,... ...robust processes for evaluation and validation of our... ...work closely with AI/ML Engineers, Simulation Engineers,... ...assessment on ML-driven autonomy through creative problem... ...Proactively scope and identify metrics needed to improve our...Full timeLocal areaWork from homeFlexible hours$206.5k - $258.1k
...Summary Rivian Autonomy is building an... ...hundreds of engineers develop, test, and ship software. We are seeking... ...evolve the agent platform behind that... ...with a rigorous evaluation loop so that every... ...success metrics; quantify run-to... ...recruiting system; (ii) carrying out,...PlatformFull timeContract workTemporary workPart timeLocal areaShift work- ...combining rigorous engineering with learning... ...Robotics Simulation Software Engineer to build... ...simulation tools used for autonomy development, debugging, and evaluation. This role is... ...testing, metrics, and visualization... ...Experience with simulation platforms such as Isaac Sim,...PlatformLocal area
$171k
...world, long-tail driving data. Autonomy is now a data race—and Uber... ...can match.We are seeking a Software Engineer II to build the data... ...deployment, and help keep the platform reliable and efficient as data... ...health of what you build: metrics, alerting, on-call, and well...PlatformFull timeWork at officeRemote work$123.7k - $254.67k
...around the world come to our platform to find creative ideas,... ...recruiting process here.Job Title: Software Engineer II, Data Analytics and... ...to datasets, insights and metric investigations across cross... ...track record of critically evaluating and verifying AI-assisted work...PlatformWork at officeLocal areaRemote workRelocationRelocation package- ...are building a new platform from the ground up... ...production-ready autonomy systems. We value rigorous engineering without unnecessary... ...a Senior Autonomy Software Engineer to serve... ...production code, train and evaluate models, analyze... .... Define metrics for autonomy performance...PlatformLocal area
$184k - $287.5k
...Autonomous Vehicles.We are looking for an experienced engineer to join our Planning and Control team to work on metrics and evaluation. In this role you will enable rapid planner... ..., and evaluation of our Autonomous Vehicle software.Build compelling, data driven evaluation...Full timeRemote work$237.6k - $401.7k
...Machine Learning and AI, Software and ServicesLocation:... ...can be and lead the platform that defines how we... ...of the Siri Agentic Evaluation Engineering organization, you will... ...also have meaningful autonomy in how you get there.... ...changes affect key metrics such as accuracy, latency...PlatformRelocation$152k - $190k
...the intelligent finance platform that enables companies... ...bill pay, and travel software, Brex enables founders... ...to grow your career.Engineering at BrexEngineering at... ...and operate with high autonomy and deep collaboration... ...ll be encouraged to be metric and data-driven and to...PlatformWork at officeRemote workWork from home$171k
...combines multiple disciplines of Software Engineering (Backend, Distributed... ...leverages the Experimentation platform to determine how new features impact key business metrics. Virtually all Engineers, Scientists... ...and Go + Java core evaluation librariesWork on high scale...PlatformFull timeWork at officeRemote work$193.93k - $291.15k
...why we’re building a universal autonomy platform: self-driving for all roads and... ...RoleWe’re looking for an Autonomy Engineer focused on onboard autonomy—the software that runs on the robot/vehicle/embedded... ...: structured logs, traces, metrics, event recording, and tools to...PlatformLocal areaImmediate startFlexible hours$155k - $235k
Epsilon C5I ( focused on software development and systems engineering for complex command, control... ...Senior Software Engineer II, with 8+ years of... ...capabilities into a mature Platform as a Service (PaaS) solution... ...decisions, including the evaluation and implementation of appropriate...PlatformLocal area$143.7k - $194.4k
...looking for an experienced Software Development Engineer to build and scale our QAS... ...existing data sets and evaluate emerging technologies in the... ...data streams and develop metrics from them to measure the customer... ...log analytics platforms such as Splunk or OpenSearchAmazon...PlatformInternshipLocal areaFlexible hours$95k - $110k
DescriptionThe Software Engineer II position will support software development for ATEC's surgical navigation and robotics platform. They will support activities for software development... ...clinical prototyping, testing, and formal evaluation in cadaveric surgical lab...PlatformFull timeLocal areaVisa sponsorshipWork visa$165.2k - $223.6k
...most complex eCommerce platforms, where operational... ...improvements with minimal engineering effort from partner... ...centralized scheduling, software performance profiling,... ...manifest at scale.- Design metrics and measure... ...process enhancements.- Evaluate and integrate generative...PlatformInternshipLocal areaFlexible hours$165.2k - $223.6k
...the AWS Neuron SDK, the software development kit used to... ...software boundary, our engineers build systematic... ...As a Software Engineer II - AI/ML, you will design... ...architecture, you'll create metrics, implement automation and... ..., TensorRT or similar platforms in production...PlatformInternshipLocal areaFlexible hours$184.7k - $324.8k
...Number: 200668738Team: Software and ServicesLocation:... ...for a Senior Software Engineer to help build the next... ...Siri User Experience Metrics team is at the heart of... ...Experience across Apple platforms including iOS, macOS,... ...with a high degree of autonomy and have a track...PlatformRelocation$84.3k - $105.4k
...line of outdoor lighting productsThe Software Engineer II designs, develops, tests, and maintains... ..., web, desktop, and embedded software platforms.Established engineering practices to solve... ...by company policy and performance metrics. If you need to, you can access your pay...PlatformFull timeCasual workWork at officeRemote workWork visaRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II, Autonomy Evaluation & Metrics Platform. Be the first to apply!
- software engineer internship remote California
- software engineer remote California
- graduate software developer no experience California
- information technology software engineer California
- senior software engineer remote California
- rust software engineer California
- part time software developer California
- junior software developer remote California
- software engineer travel California
- startup software engineer California



