Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, AI Developer Productivity — Agent Platform & Evaluation

$206.5k - $258.1k

Rivian

About Rivian

Rivianis on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.

As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.

Role Summary

Rivian Autonomy is building an Applied General AI team to make AI a dependable part of how hundreds of engineers develop, test, and ship software. We are seeking a Staff Software Engineer to own and evolve the agent platform behind that effort, spanning code generation and review, debugging, CI triage, operational support, and knowledge retrieval across our cloud, data, simulation, and vehicle-software ecosystem.

Autonomy operates one of Rivian’s largest engineering data platforms, including petabyte-scale sensor data and ML training pipelines. This creates an unusually rich environment for agent systems: complex real-world workflows, valuable telemetry signals, and outcomes that can be objectively tested.

You will pair a production-grade agent platform with a rigorous evaluation loop so that every expansion of agent autonomy is supported by measured results on real Rivian work, not demos or anecdotes. Success means reducing the quality-adjusted effort required to complete important workflows while maintaining explicit security, reliability, software-quality, and developer-experience guardrails.

As an early member of the team, you will help define its technical direction, operating model, and future hiring. You will build on an existing in-house multi-agent system with real users and partners across all of Rivian Autonomy and beyond.

Responsibilities

Agent platform

  • Architect and build the core runtime for autonomous agents operating on Rivian systems, including orchestration, isolated execution, tool and skill frameworks, durable state and context management, model routing, policy enforcement, and end-to-end tracing.
  • Establish an execution and permission model with isolated workspaces, short-lived task-scoped credentials, human-in-the-loop approval gates, network and data-access controls, and complete audit trails.
  • Deliver capabilities across the engineering lifecycle, including code generation and review, debugging, test and CI failure attribution, documentation and knowledge retrieval, and operational triage, integrated with Slack, GitLab, Kubernetes, AWS, Databricks, and adjacent systems.
  • Own the reliability of the platform and the lifecycle of long-running agent work, including recovery, cancellation, resource controls, and human escalation.

Evaluation and continuous improvement

  • Instrument agent workflows to capture traces, tests, diffs, review dispositions, task outcomes, and what engineers keep, modify, or reject. Build evaluation sets from representative Rivian engineering tasks and calibrate model-based grading against human judgment.
  • Define repeatable, per-workflow success metrics; quantify run-to-run variance; and automatically detect regressions as models, prompts, context, and tools evolve.
  • Design controlled rollouts that measure changes in engineering effort, cycle time, rework, quality, reliability, and developer experience. Measurements will evaluate tools and workflows, not individual engineer performance.
  • Drive improvement through systematic experiments over prompts, context construction, tools, models, and inference budgets. Use the results to determine where agents earn greater autonomy and where they should be constrained.

Technical strategy and adoption

  • Define the technical strategy and roadmap for AI developer productivity across Autonomy, including build-versus-buy decisions, platform boundaries, security standards, and prioritization of the workflows with the greatest measurable impact.
  • Work directly with engineers to identify high-friction workflows and understand where agents fail in practice. Turn those findings into improvements to context, tools, skills, interfaces, documentation, and enablement.
  • Track credible advances in LLMs and agent systems and validate promising techniques on Rivian tasks before adopting them. Guide model tiers, reasoning depth, sampling, and verification strategies within explicit latency, reliability, and spend budgets.
  • Lead architecture across organizational boundaries, communicate recommendations to engineering leadership, and mentor engineers building on the platform.

Qualifications

  • 6+ years of software engineering experience or equivalent demonstrated experience and impact, including substantial backend or distributed-systems work across cloud infrastructure, service design, storage, queuing, or secure execution.
  • Staff-level technical leadership: you identify the problems worth solving, shape strategy across teams, make pragmatic tradeoffs, and drive ambiguous initiatives from evidence to production.
  • Hands-on experience building and operating LLM applications, agent systems, or closely related developer infrastructure beyond prototypes, including tool use, orchestration, retrieval, context management, and production failure modes.
  • Demonstrated rigor in evaluating ML, LLM, or other nondeterministic systems. You have designed metrics or experiments for a real product, understand statistical variance, and can defend or challenge whether a measured improvement is real.
  • Strong understanding of the cost, latency, quality, and reliability tradeoffs that drive agent-system design.
  • Strong programming skills in Python and experience with at least one additional relevant language such as Go, Rust, C++, or TypeScript.
  • Strong communication and developer empathy, with a track record of building platforms or tools that engineers adopt and trust.
  • Self-directed in ambiguous problem spaces and comfortable defining scope where no established playbook exists.

Bonus Points

  • Experience building evaluation harnesses, benchmark or task suites, or calibrated model-graded evaluations.
  • Production experimentation experience, including A/B testing, causal inference, or offline-to-online metric correlation.
  • Experience with MCP or other agent-interoperability protocols, plugin and skill frameworks, LLM gateways, or model-routing layers.
  • Background in developer experience and tooling design for engineers.
  • Experience with AWS, Kubernetes, GitLab-based CI/CD, and large

Pay Disclosure

The salary range for this role is $206,500-$258,100 for San Francisco Bay Area based applicants. This is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting. An employee’s position within the salary range will be based on several factors including, but not limited to, specific competencies, relevant education, qualifications, certifications, experience, skills, geographic location, shift, and organizational needs.

We offer a comprehensive package of benefits for full-time and part-time employees, their spouse or domestic partner, and children up to age 26, including but not limited to paid vacation, paid sick leave, and a competitive portfolio of insurance benefits including life, medical, dental, vision, short-term disability insurance, and long-term disability insurance to eligible employees. You may also have the opportunity to participate in Rivian’s 401(k) Plan and Employee Stock Purchase Program if you meet certain eligibility requirements. Full-time employee coverage is effective on their first day of employment. Part-time employee coverage is effective the first of the month following 90 days of employment. More information about benefits is available at rivianbenefits.com.

Equal Opportunity

Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.

Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at View email address on click.appcast.io.

Candidate Data Privacy and Technology

Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.

Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian affiliates; and (iii) Rivian’s service providers, including providers of background checks, staffing services, and cloud services.

Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.

How We Use AI in Our Hiring Process: To ensure transparency, we want candidates to know that Rivian uses iCIMS Talent Cloud Artificial Intelligence (TCAI) and AI-enabled tools to assist with screening, reviewing, organizing and highlighting profiles and applications that match the key requirements for each role.

AI does not make hiring decisions: Qualified candidate applications are reviewed by a member of our team, and all decisions throughout the process are made by humans. We use AI to support efficiency and consistency, not to replace human judgment. We are committed to a fair, thoughtful, and equitable experience for every candidate.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, AI Developer Productivity — Agent Platform & Evaluation in Palo Alto, CA vacancy
  •  ...highly skilled Staff Software Engineer to join the Virtualization...  ...to improve developer productivity, modernize...  ...production‑grade AI capabilities that...  ...engineering, calibration, platform, and software...  ..., retrieval, evaluation, observability,...  ..., coding agents, or domain‑specific... 
    Platform
    Local area
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Mountain View, CA
    1 day ago
  •  .... LinkedIn's Core AI is building the Evaluation Operating System (...  ...), a foundational Agent Evaluation platform that defines how all...  ...agents and GenAI products at LinkedIn are...  ...LinkedIn AI Agents. As a Staff Engineer, you will own the...  ...and performance. Develop experimentation... 
    Platform
    Work at office
    Flexible hours

    Linkedin3

    Mountain View, CA
    5 days ago
  • $175k - $287k

     ...global workforce. Our products help people make...  ...LinkedIn’s Core AI is building the Evaluation Operating System (...  ...), a foundational Agent Evaluation platform that defines how all...  ...AI Agents. As a Staff Engineer, you will own the...  ...and performance. Develop experimentation and... 
    Platform
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    LinkedIn

    Mountain View, CA
    1 day ago
  • $193.93k - $352.29k

     ...opportunity for AI to drive...  ...autonomy platform: self-...  ...AI company developing Level 4 autonomous...  ...trusted — evaluation,...  ...that lets AI agents operate...  ...Nuro's own engineering organization...  ...system in production — a fleet...  ...years of software engineering...  ...experience. Staff-level... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $245.4k - $429.45k

     ...the world come to our platform to find creative...  ...the people behind the product.Discover a career where...  ...Possible.At Pinterest, AI isn't just a feature,...  ...process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions...  ..., distillation, evaluation, and high-scale CPU/... 
    Platform
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    2 days ago
  • $207k - $290k

     ...and advanced AI. Born at X (the...  ...innovation engine behind Waymo,...  ...and analytical platforms that make the...  ...seeking a Staff Software Engineer / Technical...  ...and Developer Productivity team.In this...  ...and automated agents can build and...  ...agents, LLM evaluations, or high-performance... 
    Platform
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    1 day ago
  •  ...areMoveworks: the Agentic AI Assistant platform that empowers the...  ...Moveworks’ Reasoning Engine and natural language...  ...DescriptionThe RoleMoveworks' AI agents don't just generate...  ...layer of our agent evaluation platform: the rubrics...  ...and run isolation at production dataset... 
    Platform
    Contract work
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    2 days ago
  •  ...era, we seek AI-native...  ...observability platform built on the...  ...Cloud and engineered for scale....  ...root cause of production issue and...  ...are hiring a Staff Frontend Software Engineer on...  ...for how AI agents, real-time...  ..., and developer tooling come...  ...tooling and evaluation pipelines,... 
    Platform
    Immediate start

    Snowflake

    Menlo Park, CA
    1 day ago
  • ServiceNow is hiring for Moveworks' AI agent evaluation platform team in Mountain View. You will design and build the judgement layer that scores...  ...AI. Preferred candidates have 8+ years building production backend systems, strong Python or Go, and experience with... 
    Platform

    Servicenow

    Mountain View, CA
    19 hours ago
  • Rubrik, Inc. in Palo Alto seeks senior software engineers to own end-to-end agent systems, designing production-grade AI agents, integrating with internal platforms, and shipping with guardrails. You’ll lead product discovery, build multi-agent workflows, and drive reliability... 
    Platform

    Rubrik, Inc.

    Palo Alto, CA
    3 days ago
  •  ...Autonomy is building an Applied General AI team to empower engineers with a production-grade agent platform. We seek a Staff Software Engineer to own and evolve the agent platform...  ...-world agent workflows, telemetry-driven evaluation, and rigorous guardrails for security and... 
    Platform

    Rivian

    Palo Alto, CA
    1 day ago
  • Clera is hiring a product engineering role in Palo Alto to build AI-powered productivity software on-site. You will join a product engineering...  ...team and turn advances in agent systems into reliable...  ...shaping both the underlying platform and the experiences built on... 
    Platform

    Clera

    Palo Alto, CA
    3 days ago
  •  ...new era, we seek AI-native thinkers...  ...for autonomous agents, semantic models...  ...As a Senior Product Manager for the...  ...intersection of platform engineering, developer ecosystems, and...  ...prioritization and evaluate third-party agent...  ...frontier of enterprise software—defining how... 
    Platform
    Remote work
    Shift work

    Snowflake

    Menlo Park, CA
    2 days ago
  • $190.9k - $334.1k

     ...all started when engineer Fred Luddy...  ...ServiceNow is the AI control tower for...  ...ServiceNow AI platform brings together...  ..., Voice AI Agent Engineering designs...  ...automated evaluation that the result...  ...from traditional software engineering, where...  ...them usable in production. Design AI-... 
    Platform
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $188.5k - $255k

     ...technology platform that powers...  ...worldwide using products such as...  ...OverviewIntuit's 8,000+ developers build...  ...shift to AI-native, Done...  ...looking for a Staff PM who can...  ...PDX builds is evaluated against one...  ...Rate, MTTR, Agent-Driven Proficiency...  ..., or engineering leader gets... 
    Platform
    Worldwide
    Shift work

    Intuit

    Mountain View, CA
    4 days ago
  • $206.5k - $258.1k

     ...Rivian’s Applied AI team builds AI products that help engineers across the...  ...vehicles. As a Staff AI Software Engineer specializing...  ...standards and evaluation practices...  ...Platform architecture....  ...Define and own the agent platform architecture...  ...capabilities developed for one application... 
    Platform
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Shift work

    Rivian Automotive

    Palo Alto, CA
    1 day ago
  •  ...Senior/Staff Software Engineer, Agent About OpenArt OpenArt is an AI storytelling and visual creation platform used by millions of creators worldwide...  ...quality shows up in the product within days. Founder...  ...planning, orchestration, evaluation), set the engineering... 
    Platform
    Worldwide
    Visa sponsorship

    OpenArt

    San Carlos, CA
    1 day ago
  • $207k - $300k

     ...that powers our AI/ML applications...  ...creative data engines, generation and...  ...model training, evaluation, and rapid...  ...deployment.Partner with Product Management,...  ...experience in software development.5 years...  ...building and developing large-scale...  ...infrastructure or platforms.Preferred... 
    Platform

    Google

    Mountain View, CA
    4 days ago
  •  ...experiences.The Evaluation team builds...  ...ecosystem that powers developing and scaling GM...  ...evaluation platforms, turn system-...  ...driving software performance across...  ..., systems engineering, simulation, and...  ...developing Python in production team...  ...Background in modeling agent interaction... 
    Platform
    Full time
    Local area
    Work from home

    General Motors

    Sunnyvale, CA
    2 days ago
  • $157.1k - $246.5k

     ...Organization: The Evaluation team builds and...  ...ecosystem that powers developing and scaling GM’s...  ...core evaluation platforms, turn system-...  ...autonomous vehicle software validation. Lead...  ...Autonomy, Systems Engineering, Simulation, and...  ...owned evaluation products into regular development... 
    Platform
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  • $135k - $185k

     ...Intelligence platform shaping the...  ...by advanced AI, recommendation...  ..., product innovators,...  ...an excellent engineer to join our...  ...designing, developing, and optimizing...  ...systems (AI Agents) that run a...  ...offline/online evaluation that keep optimization...  ....Strong software-engineering... 
    Platform
    Full time
    Work experience placement
    Local area
    Work from home

    News Break

    Mountain View, CA
    2 days ago
  • $205.5k - $278k

     ...financial technology platform that powers...  ...using products such as TurboTax...  ...seeking a Senior Staff Product Manager...  ...and roadmap for Agent Runtime capabilities...  ...foundational AI runtime that enables...  ...rapidly build, evaluate, and operate...  ...with AI, Engineering, and Experience... 
    Platform
    Work at office
    Worldwide
    3 days per week

    Intuit

    Mountain View, CA
    2 days ago
  • $262k - $364k

     ...environments that allow developers to test complex agent behaviors,...  ...reproducible evaluation...  ...and scale the platform infrastructure...  ...the metrics engines and dashboards...  ...metrics for production health.Integrate...  ...experience in software development.7...  ...comprehensive AI platform in the... 
    Platform

    Google

    Sunnyvale, CA
    1 day ago
  •  ...care navigation with AI. Our platform helps patients find...  ...We’re hiring a Product Manager for Agent Intelligence to own...  ...of product, data, evaluation, and AI quality. You...  ...partner closely with engineering, design, operations...  ...agent performance. Develop human-in-the-loop... 
    Platform

    Sage Care

    Palo Alto, CA
    1 day ago
  • $210k - $250k

     ...modern technology platform to deliver care...  ...and products that define this...  ...scaled remotely. AI-native engineering. We expect every...  ...of how we build software. Low-ego, high-...  ...AI systems, the evaluation practices that keep...  ...scale — retrieval, agents, evaluation, latency... 
    Platform
    Work at office
    Remote work
    Visa sponsorship
    2 days per week

    Midi Health

    Palo Alto, CA
    19 hours ago
  • $243k - $328.5k

     ...building an AI-driven expert platform that transforms...  ...accounting products into intelligent...  ...our developers and business...  ...Manager for the Agent Development Platform...  ...Agent Software Development Lifecycle...  ...Monitor and evaluate frontier...  ...closely with engineering, architecture... 
    Platform

    Intuit, Inc.

    Mountain View, CA
    2 days ago
  • $166.5k - $291.4k

     ...Staff Software Engineer, AI-Native Developer Platform Full-time Employee Type: Regular...  ...that improve developer productivity, accelerate application...  ...and observability. Evaluate and adopt emerging AI technologies...  ...integrating GenAI, AI agents, MCP, LLM-powered... 
    Platform
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    10 hours ago
  • Otter.ai is seeking a Senior AI Agent & LLM Engineer to build and improve the AI systems behind Otter’s conversational...  ...from ambiguous problems to production solutions with a focus on quality...  ...knowledge extraction, indexing, evaluation datasets, and release gates for scalable... 

    Otter.ai

    Mountain View, CA
    1 day ago
  •  ...shaping the future of product innovation as a...  ...agentic platform engineering by delivering a high-quality AI agent builder platform...  ...the foundational developer platform that engineering...  ...Familiarity with evaluating and instrumenting...  ...and the software delivery life cycle... 
    Platform

    Aumni

    Palo Alto, CA
    19 hours ago
  •  ...outside firms. AI Engineer – AI Agents & Generative AI...  ..., and support production-grade AI Agents...  ...multiple enterprise AI platforms. The ideal...  ...strong Python/software engineering...  ...Models (LLMs). Develop AI agents capable...  ...Develop testing and evaluation processes for AI... 
    Platform

    United Global Technologies

    Menlo Park, CA
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, AI Developer Productivity — Agent Platform & Evaluation. Be the first to apply!