Senior Software Engineer, Agent Evaluation Platform
Moveworks
Moveworks is seeking a Senior Software Engineer to own the judgment layer of the Agent Eval Platform. You will design scoring, calibration, and validation for multi-step agent trajectories in enterprise environments.
You will build orchestration at scale, enhance observability with OpenTelemetry, and create stateful simulation environments to ensure reproducible runs. The role offers ownership across eval orchestration, observability, and simulation, with strong collaboration across teams.
#J-18808-LjbffrVacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Agent Evaluation Platform in Mountain View, CA vacancy
$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the... ...simulated, and optimized across different accelerator platforms. We are looking for an AI-native engineer who can...PlatformSeniorFull time$185k - $230k
The OpportunityWe are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on... ...spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale...PlatformSeniorPermanent employment- ...CoreWeave is hiring a Software Engineer to help build and scale Weave, its observability and evaluation platform for AI agents. You’ll design core functionality, gather feedback from users, and work with cutting-edge AI builders to iteratively improve the product experience...PlatformSenior
Weights & Biases
Sunnyvale, CA4 hours ago $161.3k - $274.2k
...areMoveworks: the Agentic AI Assistant platform that empowers the entire... ...with Moveworks’ Reasoning Engine and natural language... ...DescriptionThe RoleMoveworks' AI agents don't just generate text — they... ...judgement layer of our agent evaluation platform: the rubrics, the judges...PlatformSeniorContract workWork at officeRemote workFlexible hours- ...NVIDIA in Santa Clara, CA, is seeking a Senior Software Engineer for Agent Simulation and Evaluation in Finance. You will design AI-native systems to automate... ...simulation, evaluation, and reporting across GPU and LPU platforms. Responsibilities include building experiments...PlatformSenior
Nvidia Corporation in
Santa Clara, CA4 hours ago - ...NVIDIA is seeking a Senior Software Engineer for Agent Simulation & Evaluation to help build agentic systems and provide performance analytics across GPU and LPU platforms. The role emphasizes Python tooling, AI agents, and collaboration with inference, hardware, runtime...PlatformSenior
NVIDIA Gruppe
Santa Clara, CA4 hours ago $185k - $230k
...Senior Software Engineer, AI Agent & LLM Mountain View, CA The Opportunity We are looking for a Senior AI Agent & LLM... ...Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale....PlatformSeniorPermanent employmentContract workFor contractorsFor subcontractorWork at officeOtter.ai
Mountain View, CA4 hours ago$129.4k - $198.4k
...About the Organization:The Evaluation team builds and evolves the... ...shape GM’s core evaluation platforms, turn system-level results into... ...used for autonomous vehicle software validation. Develop and maintain... ...interpretable insights to engineering teams and leadership,...PlatformSeniorFull timeLocal areaRemote workWork from homeFlexible hours$144.7k - $221.4k
...the Organization The Evaluation team builds and evolves... ...GM’s core evaluation platforms, turn system-level results... ...clear feedback for engineering and leadership, and help... ...autonomous driving software performance at interfaces... ...in modeling agent interaction and contributing...PlatformSeniorFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$204k - $259k
...Senior Software Engineer, Quantitative EvaluationsWaymo is an autonomous driving technology company... ...also be applied to a range of vehicle platforms and product use cases. The Waymo... ...simulation across 15+ U.S. states.The Planner Evaluation team works on one of the key...PlatformSeniorFull timeRemote workWaymo
Mountain View, CA5 hours ago$204k - $259k
...also be applied to a range of vehicle platforms and product use cases. The Waymo Driver... ...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the... ...constraints. Collaborate with other engineers, data scientists, statisticians and the...PlatformSeniorFull timeRemote workWaymo
Mountain View, CA4 hours ago- ...About the Organization: The Evaluation team builds and evolves the... ...shape GM's core evaluation platforms, turn system-level results into... ..., explainable insights to engineering and leadership, including trend... ...reviews, and by following software-engineering best practices....PlatformSeniorLocal areaWork from home
$193.93k - $352.29k
...a universal autonomy platform: self-driving for all... ...output can be trusted — evaluation, verification, and the... ...platform that lets AI agents operate autonomously inside Nuro's own engineering organization, under the... ....About You5+ years of software engineering experience...PlatformSeniorImmediate startFlexible hours$173.5k - $331.05k
...Adobe Unified Platform is building the system... ...that changes how software gets made at Adobe... ...through autonomous agents, and improves with... ...thousands of Adobe engineers and provides the... ...work, use tools, evaluate outcomes, and improve... ...are looking for a Senior Software Engineer...PlatformSeniorAdobe
San Jose, CA4 hours ago$143.2k - $243.4k
...DescriptionIt all started when engineer Fred Luddy wrote code... .... Our ServiceNow AI platform brings together any AI... ..., and reusable software components with a strong... ...in production — multi-agent orchestration, tool... ...structured outputs, and model evaluation in production settings...PlatformSeniorWork experience placementWork at officeImmediate startRemote workFlexible hours$173.5k - $331.05k
...Adobe Unified Platform is building the system... ...that changes how software gets made at Adobe... ...through autonomous agents, and improves with... ...thousands of Adobe engineers, and it's the... ...work, use tools, evaluate their own outcomes... ...are looking for a Senior Software Engineer...PlatformSeniorTemporary workLocal areaAdobe Systems GmbH
San Jose, CA4 hours ago$152k - $241.5k
...make a lasting impact on the world.We are seeking a Software Engineer - Scientific Evaluation to own a shared platform for classical testing, scientific benchmarking,... ...PyTorch integrations, scientific models, and AI agents. This hands-on role combines production software...PlatformSeniorFull time$262k - $364k
...search and summarization agents, alongside modular... ...queries.Design automated evaluation frameworks to improve... ....Lead the Data and AI engineering track. Guide designs,... ...and testing/launching software products.Experience architecting... ...Google Cloud Business Platform (GCBP) drives 10X...PlatformSenior- ...Otter.ai is seeking a Senior AI Agent & LLM Engineer in Mountain View, CA. You will build and improve AI systems behind Otter'... ...AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform for scalable, reliable operation. You’ll move from...PlatformSenior
Otter.ai
Mountain View, CA4 hours ago $182k - $242k
...most powerful end-to-end platform to develop, deploy,... ...performance training clusters, agent building, and... ...at the intersection of software, hardware, and AI,... ...experimentation at scale. The engineering team is responsible... ...The Role As a Senior Full Stack Engineer on...PlatformSeniorPermanent employmentTemporary workCasual workWork at officeFlexible hoursWeights & Biases
Sunnyvale, CA4 hours ago- ...NVIDIA seeks a Software Engineer - Scientific Evaluation to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, and Python ecosystems. You will design infrastructure and indicators to deliver reproducible results, manage GPU resources...PlatformSenior
NVIDIA Gruppe
Santa Clara, CA4 hours ago - ...NVIDIA is seeking a Software Engineer - Scientific Evaluation to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, Python, and PyTorch ecosystems. You will shape the architecture and deliver scalable infrastructure for reproducible...PlatformSenior
NVIDIA
Santa Clara, CA4 hours ago - ...NVIDIA is seeking a Senior Software Engineer - Scientific Evaluation (Finance) to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, Python, and PyTorch ecosystems. The role covers production software engineering, rigorous measurement...PlatformSenior
Nvidia Corporation in
Santa Clara, CA4 hours ago - ...ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for multi-turn agent scenarios, implement calibration against human labels, and drive scalable...PlatformSenior
Servicenow
Mountain View, CA4 hours ago $248k - $349k
Senior Staff Software Engineer, Agent Protocol, Cloud AI 2 days ago Be among the first 25 applicants Get AI... ...infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine... ...field. 5 years of experience in platform development in major SaaS vendors....PlatformSeniorFull time$262k - $365k
...architecture, and implementation strategies for the Gemini Enterprise Agent Platform (Agent Registry, skills, and AI applications), balancing... ...technical contributions.Lead, empower, and grow a team of software engineers by providing technical guidance, navigating complex...PlatformSeniorTemporary workShift work$204k - $259k
...applied to a range of vehicle platforms and product use cases. The... ...core to our autonomous driving software. We help our partners by... ...driving. We are looking for engineers with ML system expertise to... ...by the rollouts. Build evaluations, analyze experimental results...PlatformSeniorFull timeRemote workWaymo
Mountain View, CA23 hours ago$204k - $259k
...applied to a range of vehicle platforms and product use cases. The... ...U.S. states. The Onboard Software Performance team ensures that... ...high scale performance evaluation, debugging and software change... ...of experience as a software engineer or similar roles ~5 years...PlatformSeniorFull timeWork at officeRemote workWaymo
Mountain View, CA23 hours ago$174k - $252k
...technologies for SWE Agents. Strong collaboration... ...years of experience with software development in Python.... ...deployment, model evaluation, optimization, data processing... .... Google's software engineers develop the next-... ...(AIR) organization in Platforms and Devices (P&D), that...PlatformSenior$174k - $252k
...systems using advanced simulation tools to evaluate hardware/software trade-offs and guide next-generation... ..., compiler developers, systems engineers, and TPU architects to analyze and optimize... ...implement a unified ML Accelerator Platform Performance Estimation Methodology...PlatformSeniorWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Agent Evaluation Platform. Be the first to apply!
Related searches
- senior robotics software engineer Mountain View, CA
- software system engineer Mountain View, CA
- intel software engineer Mountain View, CA
- software developer fintech Mountain View, CA
- new graduate software engineer Mountain View, CA
- software development engineer aws Mountain View, CA
- information technology software engineer Mountain View, CA
- graduate software developer no experience Mountain View, CA
- software developer internship no experience Mountain View, CA
- ngo software engineer Mountain View, CA