Senior Evaluation Quality & Operations Lead
Harvey
Harvey is seeking a Senior Operator in Evaluation Operations to own the quality bar behind human evaluations as we scale globally. You will set standards for what good looks like, collaborate with ALR, Product, Engineering, and AI Research, and produce actionable analysis to guide product decisions. You will develop guidelines, calibrate a distributed pool of raters, and build repeatable evaluation templates and dashboards to monitor quality across jurisdictions and languages. #J-18808-Ljbffr Harvey
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Evaluation Quality & Operations Lead in San Francisco, CA vacancy
$150.1k - $227k
...your career at the company leading workforce transformation in... ...strategy. The Digital Success and Operations Senior Lead owns the end-to-end... ...platform KPIs (uptime, stream quality, registration throughput),... ...prototypes etc., and the ability to evaluate AI capabilities in vendor...QualitySeniorFull timeContract work$155.4k - $233.2k
...transforming how legal and professional services operate. By combining frontier agentic AI, an... ...getting started. Role Overview We’re looking for a senior operator to own the quality bar behind Harvey’s human evaluations. As we scale globally, the volume of eval work...QualitySeniorContract work- ...transforming how legal and professional services operate. Role Overview We’re looking for a... ...‑minded operator to build and scale the evaluation engine behind Harvey’s platform. As we... ...‑attorney pipeline, ensuring evaluation quality meets legal standards Work with...QualitySeniorContract work
- Mercor is partnering with a leading AI research organization to evaluate how well AI systems perform real-world marketing work. You will define what excellent... ...justifications. This role focuses on evaluating quality rather than producing deliverables, requiring 5+ years...QualitySenior
- A leading microbial sciences company is seeking a Senior Scientist or Senior R&D Manager to optimize methods for producing microbial cell banks. The role involves... ...managing R&D projects, ensuring microbial stock quality, and collaborating across disciplines. Candidates...QualitySeniorFull timeVisa sponsorship
- Obsidian seeks experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across grey-area topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and...QualitySenior
$204k - $259k
...public roads and tens of billions in simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded...QualitySeniorFull timeRemote workWaymo
San Francisco, CA1 day ago- Coinbase is seeking a senior operations professional to elevate the FCM operating model for US derivatives businesses. You will lead cross-functional efforts with Product, Engineering,... ...reducing manual work, improving control quality, and ensuring operational resilience...QualitySenior
- Mercor seeks expert Evaluators in User/customer research and feedback synthesis to review AI-generated artifacts (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a...QualitySeniorRemote jobHourly pay
- Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured...QualitySeniorHourly payWork at officeRemote work
- Third Rock Ventures seeks an experienced Director/Senior Director of Clinical Operations to lead the first-in-human program for a stealth-stage biopharmaceutical... ...execution, manage timelines, CRO relationships, and quality across the study lifecycle. Reporting to the VP of...QualitySenior
$186k - $233k
...Francisco, CA. The ideal candidate will have over 10 years of experience in Clinical Quality Assurance or Compliance within the pharmaceutical industry. Responsibilities include leading GCP system developments and inspections, authoring SOPs, and collaborating on audits...QualitySeniorRemote work$210k - $255k
...years of experience in revenue operations, strategy & operations,... ...working with and influencing senior stakeholders or executivesTeam... ...our accountability, empathy, quality, and responsiveness. We build... ...job description. We strive to evaluate all applicants consistently without...QualityFull timeFlexible hours- Expedia Group is seeking a Senior Manager, Design Operations to lead operational programs across design teams in Seattle, New York, San Jose, or San Francisco... ...enable designers to move from insight to impact while maintaining quality and velocity. #J-18808-Ljbffr Expedia, Inc.QualitySenior
- Google is seeking a UX Program Manager to lead multi-disciplinary UX programs, coordinating with Engineering, Product Management, and... ...actionable insights to ensure on-time delivery while maintaining a high quality bar. This role emphasizes collaboration across many UX...QualitySenior
- ...Specialist III to oversee both forward and reverse logistics operations. This role involves managing resources, developing operational... ...will have 5-8 years of logistics experience, strong leadership qualities, and the ability to drive process improvements. The position requires...QualitySeniorFull time
- ...internal AI agents and workflows, own how we evaluate whether they're actually working, and... ...beyond) faster and more effective.Own quality, not just adoption: You'll build the evaluation... ...technical engineer and a non-technical operator about the same problem.You care as much...QualityWork at office
Squint
San Francisco, CA3 days ago - ...Product Sr. Manager to provide senior leadership and strategic... ...domestic ground transportation operations. You will own end-to-end service... ...define growth strategies, lead cross-functional teams, optimize... ..., and ensure safety and quality while delivering profitable results...QualitySenior
$229.9k - $262.4k
Senior Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) Overview At Capital One, we are creating responsible... ...teams to deliver our industry leading capabilities with... ...systems, take pride in the quality of your work, and also share...QualitySeniorFull timePart timeLocal area$124k - $280k
...Business Process Controls - Senior Manager, you will play... ...and skills to deliver quality results. You will... ...role at PwC, you will lead large projects,... ...processes, and maintain operational excellence, interacting... ...across various industries- Evaluating compliance with...QualitySeniorFull timeH1b$90k - $115k
...seeking a Warehouse Manager for their South San Francisco facility to enhance operational performance in fulfillment operations. This leadership role involves overseeing a large team, ensuring quality standards, and facilitating scaling processes. Responsibilities cover...QualitySenior- ...national news. We’re the leading free news streaming... ...looking for a Growth Operations & Analytics Lead to... ...tests, know how to evaluate statistical significance... ...thinkers with access to quality news. Be part of... ...directly with founders and senior leaders—no bureaucracy...QualityLocal area
Haystack News
San Francisco, CA21 days ago $215k - $265k
...foundational role on Sierra's Operations team, sitting at the... ...Marketing Operations and Analytics Lead, you'll own two things: the measurement... ...—and aren't—generating high-quality opportunities.Performance... ...standards the team uses to evaluate new programs; translate...QualityFull timeFlexible hours$80 - $150 per hour
...to apply for the Strategy & Operations Lead, Mid-Level role at Jobright.... ...growth strategy: Analyze and evaluate pricing and packaging... ...move fast, and maintain high quality standards. You bring solutions... ...is currently Growth Stage. Seniority level Seniority level Mid-Senior...QualityFull timeSeasonal workWork at office$160k - $220k
...AI economy. We partner with leading AI labs and enterprises to provide... ...work alongside researchers, operators, and AI companies at the... ...: Support vendor master data quality and PO accuracy, and help troubleshoot... .... Comfort building with and evaluating AI tools and agents, with the...QualityWork at officeRelocation package$105k - $175k
...'ll sit on our Growth Operations team, working across Marketing... ...efficient. This is a senior IC, hands-on, deeply... ...like enrichment, lead routing, account... ...monitoring that catches data quality issues, broken... ...prompted, automated, evaluated, or deployed AI tools...QualityLive inWork at office3 days per week- ...corporate offices. About the Role The Client Operations Lead is an introductory leadership position... ...operations, ensuring efficiency and quality across all areas of the business. The... ...quality standards for services, and evaluate customer satisfaction Support the client...QualityLocal areaShift workNight shiftWeekend workDay shift
$180.8k - $226k
Growth Strategy & Operations Lead, Generative AI As Scale AI continues its historic growth trajectory... ...systems so that experts can be evaluated, activated, and ramped onto customer projects... .... Our products provide the high-quality data and full-stack technologies that power...QualityFull time$220k - $285k
...role Anthropic's legal team operates at the frontier of some of the... ...looking for a Discovery Operations Lead to join our Litigation and... ...spend, cycle time, review quality and use it to drive decisions... ...discovery vendor programs, including evaluation, contracting, SLAs, pricing...QualityWork at officeVisa sponsorshipFlexible hours$120k - $150k
...are looking for a strategic and operationally focused Talent Acquisition Operations Lead to serve as the functional lead... ...consistency across recruiting platforms. Evaluate and recommend new technologies... ...proposition, and attract high‑quality talent. Base Pay Salary Range $...QualityContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Evaluation Quality & Operations Lead. Be the first to apply!
Related searches
- operations leader San Francisco, CA
- operations lead San Francisco, CA
- clinical operations lead San Francisco, CA
- network operations center team lead San Francisco, CA
- senior technical analyst San Francisco, CA
- senior associate attorney San Francisco, CA
- senior developer San Francisco, CA
- sr industrial security specialist San Francisco, CA
- senior aws cloud engineer San Francisco, CA
- senior manager business development San Francisco, CA