Senior AI Quality Lead: Regression & Evaluation
$176k - $253kHarper Group
Harper Group, an AI-native commercial insurance company in San Francisco, is looking for a Senior Member of Technical Staff focused on AI Quality. This role involves converting agent quality assessments from vague estimations to concrete metrics, ensuring agents are evaluated, tested, and monitored effectively. Candidates should have experience in building software evaluation frameworks and strong communication skills. The position offers a competitive compensation package of $176,000–$253,000, along with comprehensive benefits and a high-performance work environment. #J-18808-Ljbffr Harper Group
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Quality Lead: Regression & Evaluation in San Francisco, CA vacancy
$167.3k - $261.4k
...Fixed Term) RAND’s Center on AI, Security, and Technology (... ...strategic leader to serve as Senior Research Lead - AI Security Portfolio.... ...research, cyber capability evaluation, and infrastructure development... ...uphold RAND's commitment to high‑quality, rigorous analysis while...QualitySeniorFixed term contractRemote workWork from home- Mercor is seeking a Document/deck production QA Evaluator to join our remote team, evaluating AI-generated artifacts for quality. Candidates should have over 5 years of experience in QA, fluency in English, and strong proficiency in Microsoft Office and Google Workspace...QualitySeniorRemote jobWork at office
$124k - $280k
...expertise, and network to deliver quality results. You motivate and... ..., and experiences you need to lead and deliver value at this level... ...products and implementations. As a Senior Manager, you lead large... ...closely with team members. We evaluate these factors thoughtfully to...QualitySeniorFull timeH1bPwC
San Francisco, CA18 days ago$167.3k - $261.4k
Senior Research Lead - AI Security Portfolio page is loaded## Senior Research Lead - AI Security Portfoliolocations... ...security research, cyber capability evaluation, and infrastructure development. Your... ...is built on our commitment to high-quality, rigorous analysis and objectivity....QualitySeniorFixed term contractWork experience placementRemote workWork from home$77k - $202k
...and in the future. As a Senior Associate, you'll work as part... ...work and that of others for quality, accuracy and relevance. Know... ...record of success with leading efforts to understand, assess... ...closely with team members. We evaluate these factors thoughtfully to...QualitySeniorFull timeWork experience placementH1bPwC
San Francisco, CA28 days ago$148.5k - $260.1k
...Salesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce transformation... ...looking for a Lead or Senior Data Modeler to serve as... ...Own data model design quality across your assigned Salesforce... ...recruiters assess and evaluate candidates' resumes and...QualitySeniorDay shiftAfternoon shiftSalesforce
San Francisco, CA15 hours ago$148.5k - $260.1k
...Salesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce transformation... ...Enterprise Security is hiring a Senior and Lead Security... ...performing in-depth and high-quality security assessments of... ...systems - building, evaluating, or securing them ~...QualitySeniorSalesforce.Com Inc
San Francisco, CA4 days ago$208k - $300k
...Learning Engineer - Model Evaluations, Public Sector San Francisco... ...shaping the future of AI at Scale. Machine Learning... ...for continuous monitoring, regression testing, and quality assurance for ML systems.... ...technologies that power the world’s leading models, and help...QualitySeniorFull time$195k - $269k
Integrated Solutioning Lead What You’ll Do Lead integrated... ..., operations, data, AI, experience, and... ...clear solution intent, quality expectations, and measurable... ...relationships with senior client stakeholders by... ...clarify business priorities, evaluate solution options, and...QualitySeniorTemporary workLocal area- Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5+...QualitySenior
$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST), part... ...work will inform analysis delivered to senior government and industry leaders.... ...is built on our commitment to high-quality, rigorous analysis and objectivity....QualityWork experience placementRemote workWork from homeEmployment Opportunities Inc
San Francisco, CA7 days ago$117.2k - $313.7k
...Salesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce transformation... ...Engineer - Public Cloud (Senior/Lead/Principal) Note... ...Build and ship high-quality, production-grade software... .... Critically evaluate code (Human or AI-generated...QualitySeniorSalesforce
San Francisco, CA1 day ago$50 - $150 per hour
A leading AI company is seeking a software engineer to review and evaluate model-generated code. This contract role requires several years of software engineering experience... ...at notable tech firms. You will assess code quality and provide feedback, working 10-20 hours a...QualitySeniorHourly payContract workFlexible hours- Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for... ..., extensive experience in ML/AI systems, and strong leadership... ...impact ... operations to ensure quality and efficiency in AI applications...QualitySeniorRemote job
- ...tech-driven company in San Francisco seeks a Senior Engineering Manager to lead and scale an engineering team working on an innovative AI product. You will define the technical... ...product leaders, and ensure delivery of high-quality solutions. The ideal candidate has over 5...QualitySenior
$120k - $200k
A leading technology firm is seeking a Lead Python Developer with over 7 years of experience... ...Team in building a next-generation AI-powered financial assistant platform. The... ...successful candidate will design and develop high-quality software components, gather requirements,...QualitySeniorRemote job$204k - $259k
...The mission of the Waymo AI Foundations team is to develop... ...hierarchical learning, and robust evaluation. This role follows a hybrid... ...schedule and you will report to a Senior Staff Software Engineer.... ...learning (RL), for evaluating the quality, safety, and realism of...QualitySeniorFull timeTemporary workRemote workWaymo
San Francisco, CA3 days ago- ...dedicated member for our ML Data Team to lead video data preparation and evaluation. This role includes defining dataset... ...processes, and enhancing data quality through collaboration. Ideal candidates... ...have over 5 years of experience in AI data operations, proficiency in...QualityFlexible hours
- ...Senior AI Engineer Disney Entertainment and ESPN Product & Technology is... ..., governance, observability, and evaluation, so teams can deliver high-quality AI solutions quickly—without reinventing... ..., output validation, and quality regression testing. ~ Strong collaboration...QualitySenior
The Walt Disney Studios
San Francisco, CA3 days ago $150.1k - $304.7k
Salesforce, Inc. is looking for a Lead/Principal Technical Writer in San Francisco. This... ...impactful enablement content that supports AI-powered initiatives for clients like the U... ...management skills. The position emphasizes high-quality writing and collaboration with various...QualitySenior$160k - $220k
...Senior Lead, Underwriting Denver, CO or San Francisco, CA or Madison... ...MGT is the first AI-driven, neo-insurer focused on... ...section below) Portfolio Quality & Loss Analytics Own... ...comfortable reading loss runs, evaluating portfolio mix, and spotting adverse...QualitySeniorShift workMGT Insurance
San Francisco, CA3 days ago$13 per hour
...Salesforce is the #1 AI CRM, where humans... ...at the company leading workforce transformation... ...experienced Senior, Lead, and Principal... ...the engineering quality bar through pragmatic... ...that prevent regressions and keep code healthy... ...reliably Critically evaluate code (human or AI-...QualitySeniorSalesforce.Com Inc
San Francisco, CA3 days ago$96.8k - $306.4k
...Description The Senior Principal AI Agent / ML Software Engineer... ...technical strategy, lead multi-team execution... ..., memory, retrieval, evaluation, guardrails, and... ...monitoring, eval suites, regression testing,... ...ability to contribute high-quality production code, reviews...QualitySeniorTemporary workFlexible hoursOracle
San Francisco, CA3 days ago- ...intelligence to power the AI economy. We partner with leading AI labs and enterprises to... ...About the Role As a Senior Growth Lead , you will own... ..., owning outcomes across quality, speed, and throughput... ...Optimize Sourcing Channels: Evaluate, experiment with, and scale...QualitySeniorWork at officeRelocation package
Mercor Alabaster
San Francisco, CA3 days ago $141.9k - $190.3k
...responsible for Disney's industry-leading ad technology and... ...Summary: We're hiring a Senior AI Engineer to build the AI... ..., observability, and evaluation, so teams can deliver high-quality AI solutions quickly—without... ...validation, and quality regression testing. * Strong...QualitySeniorDisney Entertainment and ESPN Product & Technology Careers
San Francisco, CA5 days ago$240k - $280k
...our team is building its AI-native future. About the role As a Senior Software Engineer on... ...responsible for building the evaluation infrastructure that... ...accuracy, reliability, regressions, and edge cases in AI... ...Create and curate high-quality datasets, golden test cases...QualitySeniorHourly paySentry
San Francisco, CA4 days ago$160k - $220k
...About Actively AI Actively AI is... ...without being asked. Leading enterprises... ...re looking for a Senior / Staff Software Engineer... ...Own retrieval quality end to end. Build and maintain evaluation infrastructure using... ...techniques, catching regressions before they affect...QualitySeniorWork at officeShift workActively AI
San Francisco, CA12 days ago$150k - $180k
...Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that... ...(Observe → Reason → Act → Evaluate). This is not a classic “train... ...Own AgentOps: eval harnesses, regression suites, online... ...outcomes (CPA/ROAS, pacing, quality, margin). Add observability...QualitySeniorZeta Global
San Francisco, CA3 days ago$180k - $280k
...$1T/year industry. If AI has automated coding, marketing... ...Act as the technical lead for day-to-day... ...setting standards for quality and reliability. Build... ...Build observability and evaluation workflows so we can understand... ...agent behavior, catch regressions, and measure whether...QualitySeniorWork at officeRelocation packageShift workdaydream Labs, Inc
San Francisco, CA15 hours ago- Overview This Senior Data Scientist will drive causal... ...workflows, and deliver high-quality, governed... ...observational methods, leveraging regression- and ML-based... ...Incorporate generative AI capabilities into visualization... ...experience building and evaluating machine learning models...QualitySeniorLocal areaImmediate startShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Quality Lead: Regression & Evaluation. Be the first to apply!
Related searches
- senior office manager San Francisco, CA
- senior automation controls engineer San Francisco, CA
- senior accounts payable San Francisco, CA
- senior brand designer San Francisco, CA
- senior financial advisor San Francisco, CA
- senior underwriter San Francisco, CA
- senior cost analyst San Francisco, CA
- senior business analyst contract San Francisco, CA
- senior php developer remote San Francisco, CA
- senior app developer San Francisco, CA