Lead AI Evaluation & Testing Methodologist
Google’s Novel Testing team in the US seeks a senior researcher to lead emergent AI testing methodologies and evaluation frameworks. You will design high-impact experiments and partner with engineering to scale insights across products. You will collaborate with data science and engineering to build prototype testing approaches, translate findings into scalable infrastructure, and mentor analysts while advancing safety practices. #J-18808-Ljbffr Google
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead AI Evaluation & Testing Methodologist in Kirkland, WA vacancy
$171k - $247k
...experience. 10 years of experience in AI testing or research, data analytics, data science... ...spans from designing first-of-their-kind evaluations for Google's most ambitious product bets... ...evaluation. In this role, you will lead the development of novel testing methodologies...SuggestedTemporary work- ...-end conversational flows for chatbots, virtual assistants, and AI-powered support systems. Translate business requirements and... ...and prototypes to communicate design intent. Apply usability testing insights and performance analytics to iterate and improve experiences...SuggestedRemote work
Blink UX
Bellevue, WA3 days ago $112.9k - $271k
...cutting-edge technology — including AI, cloud, and intelligent... ...strategic client pursuits and lead a complex delivery at rapid pace... ...CRM, and data warehouses. Evaluate and select Marketplace solutions... ..., system configuration, testing, deployment, support, and value...SuggestedFull timeContract workWork experience placementLive inWork at officeLocal area$66.8k - $116.8k
...integrate innovative solutions and programs that lead to improvements in our last mile delivery network and drive AI adoption across corporate and frontline teams.... ...and prioritization pipeline: crowdsource ideas, evaluate against impact and effort, and spot patterns that...SuggestedWork at officeFlexible hoursShift workDay shift$172.5k - $260.1k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...Ready to level-up your career at the company leading workforce transformation in the agentic... ...tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout...SuggestedFull time$128.4k - $215.8k
...s) posted. No relocation is offered. The Lead Digital Customer Growth professional is a... ...the delivery lifecycle. Support intake evaluation, roadmap development, backlog prioritization... .... Support experimentation, A/B testing, and performance optimization activities....Temporary workWork at officeLocal areaRelocation$200k - $250k
Customer Engineering Lead Bellevue • Dallas Deployment & Transformation In office... ...human to act. Auger solves them. Our AI detects disruptions, evaluates trade-offs, and executes decisions... ...the integration, the write-back, the testing, the go/no-go call, and the cutover....Full timeLive inWork at officeShift work$153.75k - $256.24k
...Lead Pharmacist Fred Hutchinson Cancer Center is an independent, nonprofit organization... ...conjunction with your manager, provide evaluations and feedback on pharmacy personnel... ...Fred Hutch conducts pre-employment drug testing for this pharmacy role. All offers of employment...Relocation packageFlexible hoursShift work- UiPath is seeking a Principal Applied Scientist to lead research and development of frontier AI systems for enterprise automation. You will design, train, and evaluate large foundation models and agentic AI components that operate enterprise software at scale. You will...Worldwide
- Salesforce seeks a Lead Researcher to shape Tableau analytics with domain expertise in analytics, semantics, data prep, and data... ..., and business teams. Role emphasizes generative and evaluative research, AI tooling, and ethical stewardship, with opportunities to mentor...
- UiPath is seeking a Principal Applied Scientist to lead the research and development of frontier AI systems that combine foundation models, multimodal reasoning... ...engineering—designing new algorithms, training and evaluating large models, and shipping systems to enterprise...
- iSpot.tv, Inc. is seeking a Full-Stack Engineer to help architect AI-augmented workflows that connect a visionary UI with high-... ...pipelines, technical leadership, and driving quality with AI-enabled testing and observability; the role offers equity and competitive...
- ...new smart tech like IoT, automation, and AI. We even built our own platform, myConcerto... ...Are:A senior Oracle Utilities Integration Lead who brings both the architectural vision and... ....Establish and manage integration testing strategy and execution, including integration...Full timeWork experience placementLive inWork at officeLocal areaRemote work
- ...to meet business needs, performing necessary SAP configurations, writing detail specifications for development of custom programs, testing and post-go live support.Prior experience in high tech or software industries with good understanding of accounting concepts.Knowledge...Contract workWork experience placement
$248.39k
...renewable energy. Key responsibilities include: Lead and direct the development of analysis, evaluation, design, and development of approaches and... ...protected by applicable law. Background Check and Drug Testing Information CDM Smith Inc. and its divisions and...Work experience placementH1bLocal areaCDM Smith
Bellevue, WA4 days ago- ...SharePoint Lead Developer Our client is a global technology consulting and digital solutions company that enables enterprises across... ...mentorship to junior developers Participate in code reviews, testing, and deployment activities Required Skills Qualifications...Local area
E-Solutions
Redmond, WA5 days ago - ...years of strong networking experience; IP infra, 4G,5G core and RAN and cloud technologies. Plan design network connections and prepare test plans to do extensive testing of the network architecture for IP infra, 4G,5G core and RAN knowledge on deployment, configuration...
Yantran LLC
Redmond, WA5 days ago $154.9k - $193.6k
...system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve some of... ...or regulations.UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.Minimum wageFull timeWork experience placementWork at officeLocal areaRemote work$117.2k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...up your career at the company leading workforce transformation in the... ...and reliably.Critically evaluate code (Human or AI-generated) for... ...Agile development methodology and Test Driven DevelopmentExperience...Full time$94.4k - $266.3k
...global professional services company with leading capabilities in digital, cloud and... ...new smart tech like IoT, automation, and AI. We even built our own platform, myConcerto... ...Support the planning and execution of testing cycles, as well as perform cutover activities...Work experience placementLive inWork at officeLocal areaAccenture
Kirkland, WA3 days ago$63.14k - $84.86k
...Bellevue College is focused on inspection, testing, servicing, electronics, and temperature... ...and work activities. • Hire, train, evaluate, and take corrective action HVAC technicians... ..., specifications and user manuals. • Lead installation, repair and alterations of HVAC...For contractorsWork experience placementFor subcontractorWork at officeLocal areaRemote workRelocation packageMonday to FridayShift workRotating shiftWeekend workWeekday workGovernmentJobs.com
Bellevue, WA5 days ago$163.38k - $269.57k
...so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform... ...to work for people.Job DescriptionCIO Strategic Initiatives GTM Lead Overview As the CIO Strategic Initiatives GTM Lead, you will drive...Work at officeImmediate startRemote workFlexible hoursShift work- A technology company based in Redmond is seeking a Senior Technical Talent Sourcer to build relationships and a talent pipeline across various domains. The role involves collaborating with recruitment teams, organizing events, and developing engagement strategies to attract...
- Salesforce is seeking a Senior Manager of AI & Workforce Intelligence to own the design, development, and automation of intelligent systems providing real-time workforce visibility for a 5,000+ person engineering organization. You will build dashboards and automation across...
- ...a Revenue Enablement Manager to own programs, content, and tools that keep Crusoe's GTM team selling effectively as we introduce new AI infrastructure products. This hands-on role involves running concurrent workstreams, SKO logistics, onboarding curricula, and continuous...
- Akvelon, Inc. is seeking a Senior Product Manager - AI Product Transformation to lead the integration of AI across our products and solutions in Bellevue, Washington. You will own the strategy and roadmap for AI-powered transformation, identify opportunities in Generative...
- T-Mobile, headquartered in Bellevue, WA, seeks a cost and licensing lead for enterprise AI initiatives. You will design showback/chargeback models, build cost-optimization tooling, and own OpenAI/Anthropic/Glean license management to ensure spending is efficient and accountable...
- CoreWeave is seeking an experienced Technical Program Manager focused on inference to lead programs spanning inference platform delivery, customer onboarding, launch readiness, and runtime optimization. You will partner with engineering, product, infrastructure, and GTM...
$177.81k - $203.99k
...highly experienced Associate Director, Quality Control, Biologics to lead the QA strategy and execution. This role demands oversight of GMP QC activities, ensuring compliance while managing external testing labs and supporting clinical development. The ideal candidate will...$141k - $205k
Google is seeking a Cloud AI Capacity Planning leader to deliver critical business planning support and financial analytics to Capacity Planning and PM teams. You will manage a portfolio addressing intricate issues and provide insights for resource allocation. Individual...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Evaluation & Testing Methodologist. Be the first to apply!
