Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SRE Evaluator - Incident Management

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise in Incident management , reliability , and SRE .
  • Work independently and asynchronously to meet deadlines and ensure high-quality assessments.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Incident management , reliability , or SRE .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management in San Francisco, CA vacancy
  • $80 - $120 per hour

     ..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    27 days ago
  •  ...Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience... 
    Suggested

    Welo Data

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    27 days ago
  • $80 - $120 per hour

    Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract... 
    Suggested
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

    Mercor is seeking an IP / trademark / copyright law Evaluator with a strong background in relevant legal experience. This remote role involves evaluating AI-generated artifacts and collaborating with AI research teams to enhance quality. The ideal candidate has over 5 years... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Strong written and verbal communication skills. Must remain available & responsive throughout the review process with the Senior Managing Directors, Managing Directors and clients. Education and Work Requirements: ~ Bachelor’s degree Active... 
    Work at office
    Remote work
    Home office

    Integra Realty Resources

    San Francisco, CA
    2 days ago
  • Welo Data is seeking Data Labeling Associates in San Francisco to evaluate AI systems focused on Arabic language nuances. The role includes model evaluation, identifying biases in datasets, and ensuring quality across global AI workflows. Candidates should have native... 

    Welo Data

    San Francisco, CA
    1 day ago
  • $85 per hour

     ..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    26 days ago
  • $70 per hour

     ...Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning. Provide structured written feedback to improve AI model outputs... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    27 days ago
  • $85 per hour

     ..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $15 - $20 per hour

     ...Role Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $50 per hour

     ...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location...  ...critical thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Spanish... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • Merchant Mariner Course Evaluator (Deck) This vacancy is for a GS - 2101 - 12, Merchant Mariner Course Evaluator (Deck) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER COURSE APPROVALS BRANCH.

    US Government Jobs

    Oakland, CA
    4 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!