Senior AI Evaluation & Testing Lead
Google is seeking a leader in AI testing and evaluation within the Trust and Safety ecosystem. You will design novel, data-driven evaluation methods for emerging AI products and partner with DeepMind and Data Science to push the boundaries beyond standard benchmarks. You will define safety standards, mentor analysts, and coordinate with engineering teams to build scalable evaluation infrastructure. The role requires a researcher mindset and technical agility to translate insights into #J-18808-Ljbffr Google
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Evaluation & Testing Lead in Seattle, WA vacancy
- Apple Inc. in Seattle, WA is seeking a Sr Engineering Specialist on the AIML Evaluation team to ensure evaluation projects run clean from design through delivery. You will understand how well our products perform and advocate for changes that matter, collaborating with...Senior
- Apple is seeking a Sr Engineering Specialist for the AIML Evaluation team. You will manage evaluation projects from design through delivery, ensuring quality and alignment with customer experience. You will partner with Tooling Engineering, Program Management, Operations...Senior
- ...seeks a highly skilled researcher to ensure AI features perform across languages and cultures. You will drive multilingual evaluation development from design to implementation,... ...scripts. You will shape evaluation methodology, test across dialects and cultures, and...Senior
- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...SeniorRemote jobFull time
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model...SeniorRemote jobFull time
- DESCRIPTION In this role, you’ll help ensure Apple’s AI features work well across languages and cultures. Your goal is to make our evaluation tooling multilingual from the start so that engineers building AI features can design, test, and ship across the world from day one. It’...SeniorWork experience placement
$126.2k - $264.1k
What You’ll DoAs a Senior Principal Network Reliability... ...infrastructure scalability.Lead complex engineering initiatives supporting AI infrastructure, new OCI... ...customer issues.Evaluate emerging technologies and... ...health mandates, and/or drug testing requirements.Range and benefit...SeniorTemporary workFlexible hours$100 per hour
...This Role Actually Is You will assess how AI coding agents behave in real-world... ...correctness. What You’ll Be Doing Evaluate AI-generated coding interactions end-to-end... ...evaluation workflows Experience mentoring senior engineers or defining engineering standards...SeniorContract workImmediate startG2i
Seattle, WA11 days ago- Principal or Senior Principal, Anthropic AI SolutionsAI Systems & Platforms | Anthropic Business Unit****... ...problems. As the Anthropic Partner Solution Lead, you’ll partner with cross-functional... ...integrations) and the ability to evaluate and guide implementation at a...SeniorTemporary workWork at officeLocal area
$100 per hour
...experienced software engineer (SR+) to help evaluate the quality of interactions with modern... ...Role Actually Is You will assess how AI coding agents behave in real-world scenarios... ...workflows Experience mentoring senior engineers or defining engineering standards...SeniorContract workImmediate startG2i
Seattle, WA11 days ago$117.2k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce... ...Engineer - Public Cloud (Senior/Lead/Principal) Note: By... ...and reliably.Critically evaluate code (Human or AI-generated... ...development methodology and Test Driven...SeniorFull time$229k - $281k
MissionAs a AI Accelerated Engineering Lead, you will guide teams in the shift toward... ...pairing on code, pressure-testing ideas with real users, and... ...practices such as evaluation harnesses, code-review agents... ...locations: San Francisco* Senior Principal: $229,000-$281,0...SeniorTemporary workLocal areaShift work$117.2k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce... ...all levels: Mid Level, Senior, Lead and Principal.IN... ...design, implementation, and testing to ensure we build products... ...and reliably.Critically evaluate code (Human or AI-...SeniorFull timeFlexible hours3 days per week- Job Title: Senior Machine Learning Engineer100% Remote Full Time As a Senior Member of Technical Staff... ...ML systems that power a proactive, long-horizon AI product.Own work end-to-end: data preparation, training, evaluation, inference, and iteration.Turn research ideas into...SeniorFull timeRemote work
- ...Senior Test Lead King, Washington Job Summary Data Validation & Verification: Validate transformation logic against business rules and documented specifications. Perform source-to-target data reconciliation — verifying completeness, accuracy, and consistency....Senior
Hcltech
Kenmore, WA1 day ago $175k - $230k
Slalom Build in Seattle is seeking a Senior Principal for their Data & AI team on the Amazon Account. This role drives innovation and execution in data offerings and requires significant consulting experience in the field. A successful candidate will have a proven track...Senior$128.7k - $214.6k
...Symetra's Individual Life Division (ILD) is seeking a full-time Test Automation Lead. This is a hands-on, division-level technical leadership role... ...for test artifacts and traceability. Experience with AI-assisted testing implementation. Experience with observability...Full timeImmediate startRemote workWork from homeFlexible hoursShift workSymetra
Bellevue, WA1 day ago$251k - $352k
Senior Principal Engineer, Infrastructure Base pay range $251,000.0... ...based pricing, our expansion into AI and security products, and our... ...Company Technical Leadership Lead large cross‑company programs... ...critical platform components, evaluating vendor solutions against...SeniorFull timeContract workImmediate startRemote work- Oliver Wyman is seeking a Senior Systems Test Lead in the Greater Seattle Area for a full-time hybrid role. You will manage integration, verification, and validation of onboard system software and provide mentorship to junior engineers, guiding them through verification...SeniorFull time
$225.6k - $381.6k
AIML - Sr Manager, Evaluation - Data Science & Insights Seattle, Washington... ...States Machine Learning and AI Apple is where individual... ...committing to the values that lead to great work. Every new product... ...agentic features. Description As a Senior Manager on the Data Science...SeniorRelocation- Alstom in Seattle is seeking a Senior Manager to drive testing and commissioning of advanced rail solutions. You will own complex projects, ensuring... ...legacy of urban mobility. Key responsibilities include leading test strategies, cross-functional collaboration, and rigorous...Senior
- ...operations across multiple systems and platforms. We are seeking a Principal AI Engineer to define architecture and technical strategy for highly scalable AI systems. The role covers leading model serving, optimizing workloads, mentoring engineers, and shaping product...SeniorRemote job
$100k - $150k
...Automation Test Lead -Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected...Full timeH1bLocal areaRemote workVisa sponsorshipEarly shiftBright Vision Technologies
Bellevue, WA1 day ago- ..., data, analytics, and AI solutions that accelerate... ...at scale. As the Senior Principal / Principal Engineer... ...flagging, automated testing, chaos engineering, and... ...deployment practices Lead engineering maturity initiatives... ..., consent, and vendor evaluation for identity solutions...SeniorWork at office
- NPAworldwide is seeking a Test Lead to plan, coordinate, and oversee testing for a Dayforce HR/Payroll implementation in the Seattle area. You will define the test strategy, manage resources, and ensure coverage across HR/Payroll modules while collaborating with functional...Senior
$148.5k - $260.1k
About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer... ...Ready to level-up your career at the company leading workforce transformation in the agentic... ...trust, with strong engineering around evaluation, observability, and iteration. High bar,...Senior- The Allen Institute for AI in Seattle, WA is seeking a Senior Software Engineer to build the foundational architecture behind AI research agents. You... ..., and execution frameworks for researchers to build, evaluate, and scale intelligent systems. This role emphasizes developing...Senior
- ...enterprise risk programs and ensure comprehensive risk oversight. In this role, you will leverage AI-enabled tools and collaborate with executive leadership to evaluate risks and recommend responses. The position involves developing risk treatment plans and improving...Senior
- Unity Technologies is expanding its ML, AI, and Product recruiting team. You will run full-cycle recruiting, partner with hiring managers... ...function. You will build trusted relationships with managers, evaluate technically strong talent (including roles outside your...Senior
- ...Engineer to drive architecture across Flight Search, Pricing, and Shopping platforms. You will mentor teams, shape API design, and advance AI/ML-enabled solutions for fast, reliable travel experiences. Strong emphasis on scalable, secure systems and data-driven decisions....Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Evaluation & Testing Lead. Be the first to apply!
Related searches
- test automation lead Seattle, WA
- testing lead Seattle, WA
- senior maintenance supervisor Seattle, WA
- senior lead project manager Seattle, WA
- senior robotics software engineer Seattle, WA
- senior devops engineer remote Seattle, WA
- senior sas administrator Seattle, WA
- senior IT manager Seattle, WA
- senior director of client services Seattle, WA
- senior contracts analyst Seattle, WA