Staff Software Engineer, AI Developer Productivity — Agent Platform & Evaluation
$206.5k - $258.1kRivian
About Rivian
Rivianis on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.
Role Summary
Rivian Autonomy is building an Applied General AI team to make AI a dependable part of how hundreds of engineers develop, test, and ship software. We are seeking a Staff Software Engineer to own and evolve the agent platform behind that effort, spanning code generation and review, debugging, CI triage, operational support, and knowledge retrieval across our cloud, data, simulation, and vehicle-software ecosystem.
Autonomy operates one of Rivian’s largest engineering data platforms, including petabyte-scale sensor data and ML training pipelines. This creates an unusually rich environment for agent systems: complex real-world workflows, valuable telemetry signals, and outcomes that can be objectively tested.
You will pair a production-grade agent platform with a rigorous evaluation loop so that every expansion of agent autonomy is supported by measured results on real Rivian work, not demos or anecdotes. Success means reducing the quality-adjusted effort required to complete important workflows while maintaining explicit security, reliability, software-quality, and developer-experience guardrails.
As an early member of the team, you will help define its technical direction, operating model, and future hiring. You will build on an existing in-house multi-agent system with real users and partners across all of Rivian Autonomy and beyond.
Responsibilities
Agent platform
- Architect and build the core runtime for autonomous agents operating on Rivian systems, including orchestration, isolated execution, tool and skill frameworks, durable state and context management, model routing, policy enforcement, and end-to-end tracing.
- Establish an execution and permission model with isolated workspaces, short-lived task-scoped credentials, human-in-the-loop approval gates, network and data-access controls, and complete audit trails.
- Deliver capabilities across the engineering lifecycle, including code generation and review, debugging, test and CI failure attribution, documentation and knowledge retrieval, and operational triage, integrated with Slack, GitLab, Kubernetes, AWS, Databricks, and adjacent systems.
- Own the reliability of the platform and the lifecycle of long-running agent work, including recovery, cancellation, resource controls, and human escalation.
Evaluation and continuous improvement
- Instrument agent workflows to capture traces, tests, diffs, review dispositions, task outcomes, and what engineers keep, modify, or reject. Build evaluation sets from representative Rivian engineering tasks and calibrate model-based grading against human judgment.
- Define repeatable, per-workflow success metrics; quantify run-to-run variance; and automatically detect regressions as models, prompts, context, and tools evolve.
- Design controlled rollouts that measure changes in engineering effort, cycle time, rework, quality, reliability, and developer experience. Measurements will evaluate tools and workflows, not individual engineer performance.
- Drive improvement through systematic experiments over prompts, context construction, tools, models, and inference budgets. Use the results to determine where agents earn greater autonomy and where they should be constrained.
Technical strategy and adoption
- Define the technical strategy and roadmap for AI developer productivity across Autonomy, including build-versus-buy decisions, platform boundaries, security standards, and prioritization of the workflows with the greatest measurable impact.
- Work directly with engineers to identify high-friction workflows and understand where agents fail in practice. Turn those findings into improvements to context, tools, skills, interfaces, documentation, and enablement.
- Track credible advances in LLMs and agent systems and validate promising techniques on Rivian tasks before adopting them. Guide model tiers, reasoning depth, sampling, and verification strategies within explicit latency, reliability, and spend budgets.
- Lead architecture across organizational boundaries, communicate recommendations to engineering leadership, and mentor engineers building on the platform.
Qualifications
- 6+ years of software engineering experience or equivalent demonstrated experience and impact, including substantial backend or distributed-systems work across cloud infrastructure, service design, storage, queuing, or secure execution.
- Staff-level technical leadership: you identify the problems worth solving, shape strategy across teams, make pragmatic tradeoffs, and drive ambiguous initiatives from evidence to production.
- Hands-on experience building and operating LLM applications, agent systems, or closely related developer infrastructure beyond prototypes, including tool use, orchestration, retrieval, context management, and production failure modes.
- Demonstrated rigor in evaluating ML, LLM, or other nondeterministic systems. You have designed metrics or experiments for a real product, understand statistical variance, and can defend or challenge whether a measured improvement is real.
- Strong understanding of the cost, latency, quality, and reliability tradeoffs that drive agent-system design.
- Strong programming skills in Python and experience with at least one additional relevant language such as Go, Rust, C++, or TypeScript.
- Strong communication and developer empathy, with a track record of building platforms or tools that engineers adopt and trust.
- Self-directed in ambiguous problem spaces and comfortable defining scope where no established playbook exists.
Bonus Points
- Experience building evaluation harnesses, benchmark or task suites, or calibrated model-graded evaluations.
- Production experimentation experience, including A/B testing, causal inference, or offline-to-online metric correlation.
- Experience with MCP or other agent-interoperability protocols, plugin and skill frameworks, LLM gateways, or model-routing layers.
- Background in developer experience and tooling design for engineers.
- Experience with AWS, Kubernetes, GitLab-based CI/CD, and large
Pay Disclosure
The salary range for this role is $206,500-$258,100 for San Francisco Bay Area based applicants. This is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting. An employee’s position within the salary range will be based on several factors including, but not limited to, specific competencies, relevant education, qualifications, certifications, experience, skills, geographic location, shift, and organizational needs.
We offer a comprehensive package of benefits for full-time and part-time employees, their spouse or domestic partner, and children up to age 26, including but not limited to paid vacation, paid sick leave, and a competitive portfolio of insurance benefits including life, medical, dental, vision, short-term disability insurance, and long-term disability insurance to eligible employees. You may also have the opportunity to participate in Rivian’s 401(k) Plan and Employee Stock Purchase Program if you meet certain eligibility requirements. Full-time employee coverage is effective on their first day of employment. Part-time employee coverage is effective the first of the month following 90 days of employment. More information about benefits is available at rivianbenefits.com.
Equal Opportunity
Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.
Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at View email address on click.appcast.io.
Candidate Data Privacy and Technology
Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.
Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian affiliates; and (iii) Rivian’s service providers, including providers of background checks, staffing services, and cloud services.
Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.
How We Use AI in Our Hiring Process: To ensure transparency, we want candidates to know that Rivian uses iCIMS Talent Cloud Artificial Intelligence (TCAI) and AI-enabled tools to assist with screening, reviewing, organizing and highlighting profiles and applications that match the key requirements for each role.
AI does not make hiring decisions: Qualified candidate applications are reviewed by a member of our team, and all decisions throughout the process are made by humans. We use AI to support efficiency and consistency, not to replace human judgment. We are committed to a fair, thoughtful, and equitable experience for every candidate.
#J-18808-Ljbffr- ...highly skilled Staff Software Engineer to join the Virtualization... ...to improve developer productivity, modernize... ...production‑grade AI capabilities that... ...engineering, calibration, platform, and software... ..., retrieval, evaluation, observability,... ..., coding agents, or domain‑specific...PlatformLocal areaRelocationRelocation packageFlexible hours
- .... LinkedIn's Core AI is building the Evaluation Operating System (... ...), a foundational Agent Evaluation platform that defines how all... ...agents and GenAI products at LinkedIn are... ...LinkedIn AI Agents. As a Staff Engineer, you will own the... ...and performance. Develop experimentation...PlatformWork at officeFlexible hours
$175k - $287k
...global workforce. Our products help people make... ...LinkedIn’s Core AI is building the Evaluation Operating System (... ...), a foundational Agent Evaluation platform that defines how all... ...AI Agents. As a Staff Engineer, you will own the... ...and performance. Develop experimentation and...PlatformFor contractorsWork experience placementWork at officeFlexible hours$193.93k - $352.29k
...opportunity for AI to drive... ...autonomy platform: self-... ...AI company developing Level 4 autonomous... ...trusted — evaluation,... ...that lets AI agents operate... ...Nuro's own engineering organization... ...system in production — a fleet... ...years of software engineering... ...experience. Staff-level...PlatformImmediate startFlexible hours$245.4k - $429.45k
...the world come to our platform to find creative... ...the people behind the product.Discover a career where... ...Possible.At Pinterest, AI isn't just a feature,... ...process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions... ..., distillation, evaluation, and high-scale CPU/...PlatformWork at officeLocal areaRemote workRelocationRelocation package$207k - $290k
...and advanced AI. Born at X (the... ...innovation engine behind Waymo,... ...and analytical platforms that make the... ...seeking a Staff Software Engineer / Technical... ...and Developer Productivity team.In this... ...and automated agents can build and... ...agents, LLM evaluations, or high-performance...PlatformFull timeFlexible hours- ...areMoveworks: the Agentic AI Assistant platform that empowers the... ...Moveworks’ Reasoning Engine and natural language... ...DescriptionThe RoleMoveworks' AI agents don't just generate... ...layer of our agent evaluation platform: the rubrics... ...and run isolation at production dataset...PlatformContract workWork at officeRemote workFlexible hours
- ...era, we seek AI-native... ...observability platform built on the... ...Cloud and engineered for scale.... ...root cause of production issue and... ...are hiring a Staff Frontend Software Engineer on... ...for how AI agents, real-time... ..., and developer tooling come... ...tooling and evaluation pipelines,...PlatformImmediate start
- ServiceNow is hiring for Moveworks' AI agent evaluation platform team in Mountain View. You will design and build the judgement layer that scores... ...AI. Preferred candidates have 8+ years building production backend systems, strong Python or Go, and experience with...Platform
- Rubrik, Inc. in Palo Alto seeks senior software engineers to own end-to-end agent systems, designing production-grade AI agents, integrating with internal platforms, and shipping with guardrails. You’ll lead product discovery, build multi-agent workflows, and drive reliability...Platform
- ...Autonomy is building an Applied General AI team to empower engineers with a production-grade agent platform. We seek a Staff Software Engineer to own and evolve the agent platform... ...-world agent workflows, telemetry-driven evaluation, and rigorous guardrails for security and...Platform
- Clera is hiring a product engineering role in Palo Alto to build AI-powered productivity software on-site. You will join a product engineering... ...team and turn advances in agent systems into reliable... ...shaping both the underlying platform and the experiences built on...Platform
- ...new era, we seek AI-native thinkers... ...for autonomous agents, semantic models... ...As a Senior Product Manager for the... ...intersection of platform engineering, developer ecosystems, and... ...prioritization and evaluate third-party agent... ...frontier of enterprise software—defining how...PlatformRemote workShift work
$190.9k - $334.1k
...all started when engineer Fred Luddy... ...ServiceNow is the AI control tower for... ...ServiceNow AI platform brings together... ..., Voice AI Agent Engineering designs... ...automated evaluation that the result... ...from traditional software engineering, where... ...them usable in production. Design AI-...PlatformWork at officeLocal areaImmediate startRemote workFlexible hours$188.5k - $255k
...technology platform that powers... ...worldwide using products such as... ...OverviewIntuit's 8,000+ developers build... ...shift to AI-native, Done... ...looking for a Staff PM who can... ...PDX builds is evaluated against one... ...Rate, MTTR, Agent-Driven Proficiency... ..., or engineering leader gets...PlatformWorldwideShift work$206.5k - $258.1k
...Rivian’s Applied AI team builds AI products that help engineers across the... ...vehicles. As a Staff AI Software Engineer specializing... ...standards and evaluation practices... ...Platform architecture.... ...Define and own the agent platform architecture... ...capabilities developed for one application...PlatformFull timeContract workTemporary workPart timeLocal areaShift work- ...Senior/Staff Software Engineer, Agent About OpenArt OpenArt is an AI storytelling and visual creation platform used by millions of creators worldwide... ...quality shows up in the product within days. Founder... ...planning, orchestration, evaluation), set the engineering...PlatformWorldwideVisa sponsorship
$207k - $300k
...that powers our AI/ML applications... ...creative data engines, generation and... ...model training, evaluation, and rapid... ...deployment.Partner with Product Management,... ...experience in software development.5 years... ...building and developing large-scale... ...infrastructure or platforms.Preferred...Platform- ...experiences.The Evaluation team builds... ...ecosystem that powers developing and scaling GM... ...evaluation platforms, turn system-... ...driving software performance across... ..., systems engineering, simulation, and... ...developing Python in production team... ...Background in modeling agent interaction...PlatformFull timeLocal areaWork from home
$157.1k - $246.5k
...Organization: The Evaluation team builds and... ...ecosystem that powers developing and scaling GM’s... ...core evaluation platforms, turn system-... ...autonomous vehicle software validation. Lead... ...Autonomy, Systems Engineering, Simulation, and... ...owned evaluation products into regular development...PlatformFull timeLocal areaWork from homeFlexible hours$135k - $185k
...Intelligence platform shaping the... ...by advanced AI, recommendation... ..., product innovators,... ...an excellent engineer to join our... ...designing, developing, and optimizing... ...systems (AI Agents) that run a... ...offline/online evaluation that keep optimization... ....Strong software-engineering...PlatformFull timeWork experience placementLocal areaWork from home$205.5k - $278k
...financial technology platform that powers... ...using products such as TurboTax... ...seeking a Senior Staff Product Manager... ...and roadmap for Agent Runtime capabilities... ...foundational AI runtime that enables... ...rapidly build, evaluate, and operate... ...with AI, Engineering, and Experience...PlatformWork at officeWorldwide3 days per week$262k - $364k
...environments that allow developers to test complex agent behaviors,... ...reproducible evaluation... ...and scale the platform infrastructure... ...the metrics engines and dashboards... ...metrics for production health.Integrate... ...experience in software development.7... ...comprehensive AI platform in the...Platform- ...care navigation with AI. Our platform helps patients find... ...We’re hiring a Product Manager for Agent Intelligence to own... ...of product, data, evaluation, and AI quality. You... ...partner closely with engineering, design, operations... ...agent performance. Develop human-in-the-loop...Platform
$210k - $250k
...modern technology platform to deliver care... ...and products that define this... ...scaled remotely. AI-native engineering. We expect every... ...of how we build software. Low-ego, high-... ...AI systems, the evaluation practices that keep... ...scale — retrieval, agents, evaluation, latency...PlatformWork at officeRemote workVisa sponsorship2 days per week$243k - $328.5k
...building an AI-driven expert platform that transforms... ...accounting products into intelligent... ...our developers and business... ...Manager for the Agent Development Platform... ...Agent Software Development Lifecycle... ...Monitor and evaluate frontier... ...closely with engineering, architecture...Platform$166.5k - $291.4k
...Staff Software Engineer, AI-Native Developer Platform Full-time Employee Type: Regular... ...that improve developer productivity, accelerate application... ...and observability. Evaluate and adopt emerging AI technologies... ...integrating GenAI, AI agents, MCP, LLM-powered...PlatformFull timeWork at officeImmediate startRemote workFlexible hours- Otter.ai is seeking a Senior AI Agent & LLM Engineer to build and improve the AI systems behind Otter’s conversational... ...from ambiguous problems to production solutions with a focus on quality... ...knowledge extraction, indexing, evaluation datasets, and release gates for scalable...
- ...shaping the future of product innovation as a... ...agentic platform engineering by delivering a high-quality AI agent builder platform... ...the foundational developer platform that engineering... ...Familiarity with evaluating and instrumenting... ...and the software delivery life cycle...Platform
- ...outside firms. AI Engineer – AI Agents & Generative AI... ..., and support production-grade AI Agents... ...multiple enterprise AI platforms. The ideal... ...strong Python/software engineering... ...Models (LLMs). Develop AI agents capable... ...Develop testing and evaluation processes for AI...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, AI Developer Productivity — Agent Platform & Evaluation. Be the first to apply!
- machine learning ai engineer Palo Alto, CA
- ai developer Palo Alto, CA
- ai engineer remote Palo Alto, CA
- ai ml engineer Palo Alto, CA
- ai prompt engineer Palo Alto, CA
- senior ai engineer Palo Alto, CA
- ai engineer Palo Alto, CA
- executive protection agent Palo Alto, CA
- commissioning agent Palo Alto, CA
- remote chat agent Palo Alto, CA



