Senior AI Quality Lead: Regression & Evaluation
$176k - $253kHarper Group
Harper Group, an AI-native commercial insurance company in San Francisco, is looking for a Senior Member of Technical Staff focused on AI Quality. This role involves converting agent quality assessments from vague estimations to concrete metrics, ensuring agents are evaluated, tested, and monitored effectively. Candidates should have experience in building software evaluation frameworks and strong communication skills. The position offers a competitive compensation package of $176,000–$253,000, along with comprehensive benefits and a high-performance work environment. #J-18808-Ljbffr Harper Group
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior AI Quality Lead: Regression & Evaluation in San Francisco, CA vacancy
$176k - $253k
Harper is seeking a Senior Member of Technical Staff, AI Quality, in San Francisco. Your main goal will be to turn agent quality... ...metrics, ensuring high standards through robust evaluation processes. You'll build capability regression evaluation suites, design grading systems,...QualitySenior$167.3k - $261.4k
Senior Research Lead - AI Security Portfolio page is loaded## Senior Research Lead - AI Security Portfoliolocations... ...security research, cyber capability evaluation, and infrastructure development. Your... ...is built on our commitment to high-quality, rigorous analysis and objectivity....QualitySeniorFixed term contractWork experience placementRemote workWork from home$192k - $250k
...looking for a builder to help lead our ‘AI for Work’ efforts. Together... .... That means building, evaluating vendors, and continuously evolving... ...in productivity, output quality, and the experiences we deliver... ...‑stakes discussions with senior leaders, using structured thinking...QualitySeniorHourly payImmediate startFlexible hoursShift work$146.2k - $261.4k
...Description RAND’s Center on AI, Security, and... ...analysis projects, and leading multidisciplinary teams... ...will build systems to evaluate how AI models perform across... ...analysis delivered to senior government and industry... ...our commitment to high‑quality, rigorous analysis and...QualityFixed term contractWork experience placementRemote workWork from homeDormont Manufacturing Company
San Francisco, CA4 days ago$195k - $269k
Integrated Solutioning Lead What You’ll Do Lead integrated... ..., operations, data, AI, experience, and... ...clear solution intent, quality expectations, and measurable... ...relationships with senior client stakeholders by... ...clarify business priorities, evaluate solution options, and...QualitySeniorTemporary workLocal area$117.2k - $313.7k
...Salesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce transformation... ...Engineer - Public Cloud (Senior/Lead/Principal) Note... ...Build and ship high-quality, production-grade software... .... Critically evaluate code (Human or AI-generated...QualitySeniorSalesforce.Com Inc
San Francisco, CA2 days ago- Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5+...QualitySenior
$148.5k - $260.1k
Senior & Lead Security Engineer - Secure AI Salesforce is the #1 AI CRM, where humans with agents drive customer... ...Lead by performing in-depth and high-quality security assessments of emerging... ...) and agentic systems — building, evaluating, or securing them Familiarity...QualitySenior- Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured...QualitySeniorHourly payWork at officeRemote work
- Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for... ..., extensive experience in ML/AI systems, and strong leadership... ...impact ... operations to ensure quality and efficiency in AI applications...QualitySeniorRemote job
- ...tech-driven company in San Francisco seeks a Senior Engineering Manager to lead and scale an engineering team working on an innovative AI product. You will define the technical... ...product leaders, and ensure delivery of high-quality solutions. The ideal candidate has over 5...QualitySenior
$204k - $235k
OutSystems, Inc. is seeking a Senior AI Quality Engineer to lead quality management within their AI-integrated product ecosystem. In this role, you will define testing strategies, implement automation processes, and mentor junior engineers. The ideal candidate will have...QualitySenior$197k - $291k
A global technology leader in San Francisco seeks a Software Engineer to lead high-quality software infrastructure development. The role involves driving AI/ML solutions, collaborating with cross-functional teams, and requires extensive experience in full-stack development...QualitySeniorFull time$148.5k - $260.1k
...Salesforce Salesforce is the #1 AI CRM, where humans with agents... ...up your career at the company leading workforce transformation in... ...We are looking for a Lead or Senior Data Modeler to serve as a trusted... .... Own data model design quality across your assigned Salesforce...QualitySeniorDay shiftAfternoon shift$120k - $140k
...of enterprise conversational AI deployments, from pre-sales Statements... ...while maintaining rigorous quality standards. Ellipsis Health... ...shadow agents. Prompt Evaluation & Optimization: Apply a strong... ...methodologies including Sanity, Smoke, Regression, and Functional testing -...QualitySeniorRemote workFlexible hours- ...Senior AI Engineer Disney Entertainment and ESPN Product & Technology is... ..., governance, observability, and evaluation, so teams can deliver high-quality AI solutions quickly—without reinventing... ..., output validation, and quality regression testing. ~ Strong collaboration...QualitySenior
The Walt Disney Studios
San Francisco, CA4 days ago - ...Senior Software Engineer - AI Core Engineering Disney Entertainment and ESPN Product &... ...governance, observability, and evaluation, so teams can deliver high-quality AI solutions quickly—without reinventing... ...validation, and quality regression testing. ~ Strong...QualitySenior
Walt Disney Company
San Francisco, CA4 days ago - ...Mobile, responsible for owning the mobile experience to help clients reach mental health goals. You will lead product development, defining a strategy that emphasizes quality, trust, and engagement. The ideal candidate has over 8 years in product management, experienced with...QualitySenior
$150.1k - $304.7k
Salesforce, Inc. is looking for a Lead/Principal Technical Writer in San Francisco. This... ...impactful enablement content that supports AI-powered initiatives for clients like the U... ...management skills. The position emphasizes high-quality writing and collaboration with various...QualitySenior$125k - $130k
Senior Quality Assurance Engineer Location: San Francisco, CA Compensation... ...tools like JMeter and k6 to evaluate application scalability under... ...testing support. Execute regression testing across various mobile... ...Opportunity to build cutting‑edge AI solutions in a high‑growth...QualitySeniorWork at officeLocal areaFlexible hours$13 per hour
...Salesforce is the #1 AI CRM, where humans... ...at the company leading workforce transformation... ...experienced Senior, Lead, and Principal... ...the engineering quality bar through pragmatic... ...that prevent regressions and keep code healthy... ...reliably Critically evaluate code (human or AI‑...QualitySenior- ...Overview This Senior Data Scientist will drive causal... ...workflows, and deliver high-quality, governed... ...observational methods, leveraging regression- and ML-based... ...Incorporate generative AI capabilities into visualization... ...experience building and evaluating machine learning models...QualitySeniorLocal areaImmediate startShift work
Tonal
San Francisco, CA5 days ago $200k - $240k
...blockchain analytics and AI solutions to help law... ...scalable AI deployments. Senior or Staff ML Systems... ...workflows for model training, evaluation, and deployment using... ...and agents, including regression testing, cost... ...Looking For Write high‑quality, maintainable software,...QualitySenior- Mercor is seeking a Program management / implementation planning Evaluator to assess AI-generated materials for quality assurance. The ideal candidate will have 5+ years of experience, a strong command of English, and proficiency in Microsoft Office and Google Workspace...QualityRemote jobContract workWork at office
- ...The Role We're hiring Senior Backend + Applied AI Engineers to build the core systems... ..., only the teams who ship quality products & features at... ...in terms of evals, model regression tests, traceability, and exception... ...patterns and evaluation frameworks the team standardizes...QualitySeniorWork at officeLocal areaRelocation package
Klarity Intelligence, Inc.
San Francisco, CA1 day ago $200k - $250k
...organization, building production AI agents that solve real... ...is measured by the volume and quality of marketing work that agents... ...reliability, observability, evaluation, and cost efficiency of LLM-powered... ...property and client data, regression suites, and offline...QualitySeniorWork experience placementRemote workJLL Technology Solutions (formerly BRG)
San Francisco, CA2 days ago$141.9k - $190.3k
...responsible for Disney's industry-leading ad technology and... ...Summary: We're hiring a Senior AI Engineer to build the AI... ..., observability, and evaluation, so teams can deliver high-quality AI solutions quickly—without... ...validation, and quality regression testing. * Strong...QualitySeniorDisney Entertainment and ESPN Product & Technology Careers
San Francisco, CA1 day ago$192k - $250k
TaskRabbit is seeking an AI Productivity and Business Automation Lead to spearhead AI initiatives aimed at enhancing operational efficiency. This role... ...partnering with business leaders, conducting process evaluations, and implementing AI-driven solutions to improve workflows...SeniorFlexible hours$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Enjoy the flexibility of remote work and the freedom to set your own schedule... ...Responsibilities: Give AI chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced by AI models...QualitySeniorHourly payContract workFor contractorsWork experience placementRemote workData Annotation
San Francisco, CAmore than 2 months ago- ...intelligence to power the AI economy. We partner with leading AI labs and enterprises to... ...offices. About the Role As a Senior Growth Lead , you will own... ..., owning outcomes across quality, speed, and throughput... ...Optimize Sourcing Channels: Evaluate, experiment with, and...QualitySeniorWork at officeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Quality Lead: Regression & Evaluation. Be the first to apply!
Related searches
- senior game producer San Francisco, CA
- senior electronic design engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA
- senior java software engineer San Francisco, CA
- senior specialist San Francisco, CA
- senior research manager San Francisco, CA
- senior director corporate development San Francisco, CA
- senior software test engineer San Francisco, CA
- sr project engineer San Francisco, CA
- senior electrical designer San Francisco, CA