Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SRE Evaluator - Incident Management - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI-generated work products.
  • Apply deep subject-matter expertise in Incident management , reliability , and SRE to grade outputs.
  • Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Incident management , reliability , or SRE .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 28 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management - AI Trainer in San Francisco, CA vacancy
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $119k - $299.93k

     ...Applicable Specialism Assurance Management Level Senior Manager Job...  ...The Opportunity As part of the AI Engineering team within the Digital...  ...and teams for testing and evaluation of AI-enabled systems,...  ...monitoring, evaluation, and incident response - Establishing rigorous... 
    Suggested
    Full time
    H1b

    PwC

    San Francisco, CA
    5 days ago
  • $8 - $65 per hour

     ...eager to shape the future of AI? Large‑scale language models...  ...democratize world‑class office management, keep pace with evolving...  ...to our prompt engineering and evaluation metrics. A bachelor's or masters...  ...Administrative Specialist - AI Trainer Employment type: Contract... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Work at office
    Remote work

    Remote

    San Francisco, CA
    2 days ago
  • $8 - $65 per hour

     ...eager to shape the future of AI? Large‑scale language models...  ...as inventory systems, vendor management, SOP development, cost‑control...  ...to our prompt engineering and evaluation metrics. A bachelor's or...  ...General Operations Specialist - AI Trainer Employment type: Contract... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Remote work

    Remote

    San Francisco, CA
    1 day ago
  • $70 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  •  ...Our Client Our client is a fast-growing AI technology company transforming the food...  ...control, logistics, and supply chain management. Built by industry experts with deep experience...  ...~ Direct experience managing production incidents end to end, from detection through... 
    Permanent employment
    Full time

    Onbench

    San Francisco, CA
    5 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .... Position: General and Operations Managers Type: Contract Compensation: $...  ...+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  •  ...About Bishop-Mccormick Bishop-McCormick is a premier global management consulting firm dedicated to navigating the complexities of...  ...across various consulting engagements. Algorithmic Auditing: Evaluate existing client models for bias, efficiency, and scalability,... 

    Bishop-Mccormick

    San Francisco, CA
    2 days ago
  • $123.2k - $218k

     ...science areas for 2020 – usage forecasting, product analytics, user behavior, and funnel analysis. Work closely with Product Management, Sales, Customer Success and other stakeholders to understand product usage patterns and trends and to make data-driven decisions... 

    NEON Inc

    San Francisco, CA
    2 days ago
  • $80 - $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...security operations center monitoring , incident response and forensics , vulnerability management , and security architecture design . Build tasks... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • DataAnnotation is seeking an experienced Management Consultant to train AI models on real business problems. You’ll craft client-style briefs, critique...  ...are solid and actionable. The role involves evaluating strategy, market research, leadership communications, and... 
    Remote job

    DataAnnotation

    Berkeley, CA
    2 days ago
  •  ...people’s lives. With intelligent agreement management, Docusign unleashes business-critical...  ...money, and opportunity. Using the Docusign AI-native IAM platform, companies can create...  ...contribute to improving system reliability and incident responseSupport Microsoft Fabric, Data... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  • $10 - $30 per hour

     ...Wholesale Trade Specialist - Freelance AI Trainer Project at Meridial Back to jobs...  ...provide their expertise for an AI benchmark evaluation project. As AI models increasingly...  ...B2B distribution strategies, inventory management workflows, and wholesale pricing models... 
    Hourly pay
    Part time
    For contractors
    Freelance
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $10 - $30 per hour

     ...Application for Information Specialist - Freelance AI Trainer Project at Meridial Back to jobs...  ...their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade data management strategies, information retrieval systems,... 
    Hourly pay
    Part time
    For contractors
    Freelance
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  •  ...Human Resource Specialist - Freelance AI Trainer Project at Meridial Back to jobs...  ...evolving labor laws, and streamline talent management for companies everywhere. That training...  ...improvements to our prompt engineering and evaluation metrics. A bachelor's or master’s... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $148k - $185k

     ...reducing accident frequency, saving lives, and managing costs to enhance the safety and...  ...innovations and resolving pain points with AI automation solutionsDeliver scalable, reliable...  ...reviews, production on-call support and incident triaging process.Invest in the... 
    Hourly pay
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    2 days ago
  • $188.75k - $242.68k

     ...We own laptop security, cloud security, AI security, detection and response, and red...  ...them. You'll build the guardrails, identity management, and detection systems that let Plaid use...  ...build to.Your impact: fewer AI-related incidents, faster AI shipping, and controls that scale... 
    Work experience placement
    Work at office
    Local area

    Plaid Financial

    San Francisco, CA
    2 days ago
  • $200k - $250k

    About Distyl AI Distyl is an applied AI technology company partnering...  ...behavior, code quality, evaluations, integrations, and production...  ..., and participating in incident reviews and production quality...  ...team over time. Prior people management experience is strongly preferred... 
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    13 hours ago
  • $100 - $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...00–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $164.7k - $266k

     ...business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped...  ...Automation Center of Excellence (CoE) that delivers enterprise-grade AI and automation solutions using platforms such as AWS, GEAP, UiPath... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    Unavailable

    San Francisco, CA
    5 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Management Consulting Expert Type: Contract...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...meaning "light." Arine illuminates the possibilities with medication management to deliver comprehensive economic and health outcomes. Based...  ...(SaaS). We combine cutting edge data science, machine learning, AI, and deep clinical expertise to introduce a patient‑centric view... 

    latitude

    San Francisco, CA
    3 days ago
  • $124k - $280k

     ...on developing and implementing advanced AI and ML solutions to drive innovation and...  ...health system and health plans. As a Senior Manager, you will drive use case development...  ...collaborating closely with team members. We evaluate these factors thoughtfully to establish a... 
    Full time
    H1b

    PwC

    San Francisco, CA
    2 days ago
  •  ...Application for Garment Manufacturing QC Specialist - Freelance AI Trainer Project at Meridial Back to jobs Garment Manufacturing...  ...practitioners who understand how garments are actually produced and evaluated. We’re looking for Garment Manufacturing QC Specialists... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work
    Worldwide

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $200k - $260k

     ...platform healthcare organizations use to build their own clinical AI agents. Our mission is to make excellent care accessible to...  ...across the patient journey, from intake and scheduling to medication management and clinical decision support. Our agents have supported more... 
    Full time
    Work at office
    Flexible hours

    Concurrence

    San Francisco, CA
    10 days ago
  • $240k - $260k

     ...quality, and consistent service, incorporating AI tools and outcome-focused strategies...  ...align with desired client outcomes. Delivery Management* Engages in billable client delivery roles...  ...: Experience with modern operations (SRE) and working with top partners like AWS, Microsoft... 
    Temporary work
    Local area

    Slalom

    San Francisco, CA
    2 days ago
  • $152k - $190k

     ...combining global corporate cards and banking with intuitive spend management, bill pay, and travel software, Brex enables founders and...  ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense... 

    Brex

    San Francisco, CA
    13 hours ago
  • $251k - $335k

     ...organization-wide adoption.Applied AI Engineers serve as trusted...  ...the RoleWe are seeking a Manager to build, lead, and develop a...  ...engineers through architecture and evaluation decisions, engaging directly...  ...launches, production incidents, complex integrations, and high... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SRE Evaluator - Incident Management - AI Trainer. Be the first to apply!