Staff ML Evaluation & Calibration Engineer
ServiceNow
Moveworks' AI agents don't just generate text — they act, plan, and change state in enterprise systems. You will own the central problem of scoring agent trajectories across multi-step interactions, turning complex behavior into meaningful judgments that train and improve the system. This role focuses on designing reliable evaluation signals, combining deterministic validators with probabilistic LLM judgments, and calibrating a process reward model that informs improvements while guarding #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff ML Evaluation & Calibration Engineer in Mountain View, CA vacancy
- ...LinkedIn is seeking a Staff Engineer to own the end-to-end technical vision and execution of the Evaluation Operating System (EOS). You will design large-scale evaluation infrastructure... ...You will collaborate with AI product teams, ML engineers, and infrastructure partners to...Suggested
Linkedin3
Mountain View, CA3 days ago - ...high-speed inference.About the RoleAs a Staff GPU Inference SDET, you will be the... ...Development team. Working closely with engineering leads and cross-functional systems infrastructure... ...building workload replay tools, ML evaluation pipelines, or MLPerf Inference benchmark...Suggested
Cerebras Systems
Sunnyvale, CA2 days ago - ...technologies while collaborating with Engineering and Product Management. We are looking... ...About the Role We're seeking a Staff Security ML Researcher to develop machine learning... ...techniques and predictive modeling to evaluate breach likelihood, attack exposure, and...SuggestedWork at office
Illumio
Sunnyvale, CA2 hours ago $132k - $189k
...production and new technology cameras. Evaluate the correlation between figures Of merit... ...correct implementation of tests and calibrations; to thoroughly examine the factory data... ...qualifications:Bachelor’s degree in Electrical Engineering, Mechanical Engineering, Computer...SuggestedContract workGoogle
Mountain View, CA3 days ago- ...backends, and multi-tenant environments.Evaluate, benchmark, and select next-generation network... ..., and operational visibility.Mentor engineers and cross-functional teams on advanced network... ...center networks, preferably for HPC, AI/ML, or large-scale cloud infrastructure.Deep...SuggestedWork at officeLocal areaWork from homeFlexible hours
Lambda Labs
San Jose, CA2 days ago $175k - $265k
...Role Overviewd-Matrix is seeking a Senior Staff ML Researcher to join our Algorithms team... ...computing, and AI hardware. You will invent, evaluate, and implement algorithmic techniques... ...with mathematicians, ML researchers, ML engineers, compiler engineers, and hardware...d-Matrix
Santa Clara, CA5 days ago$197k - $285k
...manage cross-domain technical risks.Support engineering teams during design, validation and manufacturing readiness.Mentor engineering staff in system-level thinking, architecture... ...or network designDeep understanding of AI/ML accelerators and energy efficient compute...Work at officeLocal area3 days per weekAurora Innovation
Mountain View, CA2 days ago- ...scalable compute platforms optimized for AI/ML, simulation, and high-throughput... ...and maintainability across infrastructure.Evaluate emerging CPU, GPU, and accelerator technologies... ...total cost.Collaborate with product and engineering teams to map workload requirements to compute...Work at officeLocal areaWork from homeFlexible hours
Lambda Labs
San Jose, CA2 days ago $188k - $274k
...audio and ecosystem interoperability across Google’s platforms.Evaluate the critical trade-offs between power, cost, and form factor.... ...products.Minimum qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Physics, a related field, or equivalent...Google
Mountain View, CA1 day ago$262k - $364k
...Senior Staff Tech Lead, YouTube Agentic Video Editing and Generation... ...of experience with applied ML and GenAI/agentic systems.... ...Experience architecting and evaluating industry-leading Video Editing... ...actionable technical roadmaps and engineering metrics. Proven ability to...Work at officeGoogle Inc.
Mountain View, CA2 hours ago- ...Apptronik seeks a seasoned Staff Technical Program Manager to lead the first TPM in Sunnyvale, CA. This high-autonomy role spans ML ops, perception, and strategic partnerships, driving cross-functional programs and serving as the primary interface to a key AI partner....
Perot Jain
Sunnyvale, CA3 days ago $237.6k - $401.7k
...Software and Services Apple Services Engineering (ASE) powers AI and machine learning experiences... ...leader to lead AI Safety Engineering & Evaluation within the Human-Centered AI... ...effectiveness as the team matures. AI/ML Evaluation & Safety Assessment: Lead the...RelocationApple Inc.
Cupertino, CA2 days ago- ...headquarters 3 days per week. The role: Sr. Staff, ML Researcher - LLM Algorithmic... ...mathematicians, ML researchers, and ML engineers who create and apply advanced algorithmic... ...processes and maintain a consistent and fair evaluation of all applicants. Thank you for your...3 days per week
Entrada Ventures
Santa Clara, CA2 hours ago $197k - $285k
...Hardware & Embedded Engineering Mountain View, CA Senior Staff System Architect Who we are Aurora’s mission is to deliver the benefits of self-driving... ..., and/or network design Deep understanding of AI/ML accelerators and energy efficient compute design Background...Work at officeLocal area3 days per weekAustralian Competition and Consumer Commission
Mountain View, CA2 hours ago$207k - $300k
...architecture.Preferred qualifications:Deep technical proficiency ML workload performance modeling on pre-silicon systems,... ...compilers, AI research, and cloud infrastructure).Google's software engineers develop the next-generation technologies that change how billions...WorldwideGoogle
Mountain View, CA4 days ago$139.6k - $225.78k
...Job SummaryYour CareerAs a Sr Staff Security Researcher, you will... ...dynamic analysis, reverse engineering, exploitability analysis, and... ...build reliable harnesses and evaluation pipelines, analyze large-scale... ...Computer Science, Cybersecurity, AI/ML, Systems, Programming...Full timeWork at officePalo Alto Networks
Santa Clara, CA2 days ago$189.24k - $266.76k
...operating system. About the Role As a Sr. Staff Firmware Security Architect, you will own... ...enough, hold review authority over the engineers who implement it, and defend the design... ...schemes for firmware (LMS/XMSS, ML-DSA) and crypto-agility design. Consumer...42dot
Sunnyvale, CA1 day ago- ...Rivian seeks a Staff Software Engineer to design and build the ML training platform powering autonomous driving models. You will shape the control plane that schedules jobs across clusters, the storage/I O layer, observability, and the training framework. The role requires...
Rivian
Palo Alto, CA1 day ago - ...programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.Full-cycle ownership. You can... ..., Math, or equivalent practical experience building backend or ML systems.Who Thrives HereYou don’t need a roadmap to start...Full timeWork at officeRelocation package
Inworld AI
Mountain View, CA2 days ago $236k - $329k
...prioritize, and lead the execution of initiatives integrating AI/ML capabilities into core SAP supply chain platforms to enhance... ...technical liaison across key business stakeholders (e.g., Cloud, Core Engineering, Finance, Logistics), securing executive alignment on complex...Google
Sunnyvale, CA2 days ago$121.49k - $182k
...looking for an experienced Senior Staff Business Systems Analyst to... ...processes (statistical and ML-based forecasting, demand sensing... ...'s degree in Business, Engineering, Computer Science, Supply Chain... ...Our interviews are designed to evaluate your individual experience, thought...Permanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA4 days ago- ...Walmart Inc. in Sunnyvale, CA is seeking a Staff Software Engineer to lead scalable platform capabilities and drive cloud-native, AI/ML integrated solutions. You will mentor teams, define frontend architecture, and collaborate across Product, UX, backend, and data teams...
Jobleads-US
Sunnyvale, CA1 day ago $215k - $263k
...journey. POSITION SUMMARY We are seeking a Staff Analyst to partner closely with the CMO... ...with Marketing, Product, and Engineering to translate business needs into actionable... ...reviewed by EarnIn’s hiring team for internal evaluation purposes only. These recordings will not...Full timeWork at officeLocal area2 days per weekEarnin
Mountain View, CA4 days ago$202.5k - $274k
...Job OverviewWe’re looking for a creative and enthusiastic Staff Design System Engineer to join our Design Technology group. A design system... ...contributions, or systems-level engineering.Deep expertise in evaluating potential AI solutions, finding opportunities to...WorldwideIntuit
Mountain View, CA5 days ago$202.5k - $274k
...software applications with AI technologyCoach and mentor junior engineers on best practices of software engineering, leveraging AI to... ...and effective outcomesLaunch AI integrations in production and evaluate their impact on software performance and user satisfaction, using...Work experience placementWorldwideIntuit
Mountain View, CA5 hours ago$209k - $313k
...initiatives across groups such as Sales, Marketing, Product, Engineering, Support, and Data Science.What You’ll DoDesign, implement, and... ...industry trends, and program performance to identify opportunities, evaluate solutions, prioritize initiatives, and continuously improve...Full timeLive inWork at officeLocal areaSnap
Palo Alto, CA3 days ago- Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...You Will DoWe are looking for senior/staff engineers to join our GenAI Search Platform... ...new prototypes to customers at scale, evaluate and iterate on ranking improvements in a...Work at officeImmediate startRemote workFlexible hours
Moveworks
Mountain View, CA2 days ago - ...Job Description We are seeking a highly experienced Staff High-Power Laser Assembly Development Engineer to lead the development, optimization, and industrialization... ..., and laser operating characteristics. Develop, evaluate, and implement assembly tooling, automation...Temporary work
Nokia
Sunnyvale, CA4 days ago $205.5k - $278k
...We’re looking for a Senior Staff Product Manager to lead product... ...turn our product into a powerful engine for acquisition, conversion,... ...Balance AI impact with trust: Evaluate AI experiences for growth impact... ...Engineering, Data Science, AI/ML, and Marketing, and partner...Intuit, Inc.
Mountain View, CA2 days ago- ...Program Manager (TPM) at the Senior Staff level to serve as a horizontal... ...a TPM is an Outcome Owner—an engineer at heart with the programmatic... ...foundational platforms and ML infrastructure to maximize... ...and analysis, to support the evaluation process. Artificial intelligence...Work at officeFlexible hoursShift work
Devopsroles
Palo Alto, CA2 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff ML Evaluation & Calibration Engineer. Be the first to apply!
Related searches
- staff security engineer Mountain View, CA
- staff engineer Mountain View, CA
- senior staff systems engineer Mountain View, CA
- engineering aide Mountain View, CA
- senior staff engineer Mountain View, CA
- technology administrator Mountain View, CA
- software engineer staff Mountain View, CA
- assistant engineer Mountain View, CA
- senior ml engineer Mountain View, CA
- machine learning software engineer Mountain View, CA