Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SRE Evaluator - Incident Management - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI outputs.
  • Apply deep subject-matter expertise in Incident management , reliability , and SRE .
  • Work independently and asynchronously to meet deadlines and enhance model performance.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Incident management , reliability , or SRE .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management - AI Trainer in San Francisco, CA vacancy
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $225k - $290k

     ...reliability and observability frameworks; and institutionalizing incident management practices that promote a culture of accountability and...  ...reliability, quality, and observabilityExperience leveraging AI tools and methodologies to design and implement the solutionsDeep... 
    Suggested
    Flexible hours

    Circle

    San Francisco, CA
    1 day ago
  •  ...people’s lives. With intelligent agreement management, Docusign unleashes business-critical...  ...management (CLM). What you'll do As an AI Agentic Engineer on the Platform AI...  ...EUS operations tickets (service requests, incidents, and routine tasks) using frameworks like... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  • $148k - $185k

     ...reducing accident frequency, saving lives, and managing costs to enhance the safety and...  ...innovations and resolving pain points with AI automation solutionsDeliver scalable, reliable...  ...reviews, production on-call support and incident triaging process.Invest in the... 
    Suggested
    Hourly pay
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    10 hours ago
  • $200k - $250k

    About Distyl AI Distyl is an applied AI technology company partnering...  ...behavior, code quality, evaluations, integrations, and production...  ..., and participating in incident reviews and production quality...  ...team over time. Prior people management experience is strongly preferred... 
    Suggested
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    1 day ago
  • $128k - $160k

     ...and highly motivated Data Scientist to join the Central Market Management team and lead key initiatives that enhance the quality of our...  ...ended scopeDefine and implement a robust attribution framework to evaluate the performance of high-stakes decisionsAct as a technical... 
    Hourly pay
    Temporary work
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    4 days ago
  • $123.2k - $218k

     ...development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high...  ..., user behavior and funnel analysis.Work closely with Product Management, Sales, Customer Success and other stakeholders to understand... 
    Work at office
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $146.4k - $235.38k

     ...countries use Docusign solutions to accelerate the process of doing business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were disconnected from business... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    10 hours ago
  •  ..., scalable cloud platforms optimized for AI/ML workloads.Partner with AI teams to translate...  ...infrastructure requirements.Monitor, manage, and optimize cloud resources for...  ...refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing... 
    For contractors

    JP Morgan Chase

    San Francisco, CA
    1 day ago
  • $120k - $139k

    Company DescriptionSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional...  ...infrastructure, data center compliance (security, resilience, incident response, environmental, workplace safety), and... 
    For contractors
    Local area
    Worldwide
    Visa sponsorship

    Sia Partners

    San Francisco, CA
    10 hours ago
  • $120.8k - $151k

     ...combining global corporate cards and banking with intuitive spend management, bill pay, and travel software, Brex enables founders and...  ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    10 hours ago
  • $132.7k - $206.8k

     ...business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped...  ...AWS SNS)Experience with Claude Code, Cortex Coco, VSCode copilot, AI enabled SDLC development modelsExperience building BI Dashboards... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  • $116.2k - $229.1k

    Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a...  ...Recruiting for this role ends on 08/15/2026. Work you'll do As a Data Management Engineer III on the AI & Data team, you will be responsible for... 
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    2 days ago
  • $186.1k - $300.55k

     ...people’s lives. With intelligent agreement management, Docusign unleashes business-critical...  ...Manager (IAM) and next-generation Agentic AI features. You will serve as the primary...  ...Engineering roadmapsDeep expertise in evaluating LLM-based product features and optimizing... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    2 days ago
  • $133.1k - $236.4k

     ...exposure to cross functional organizations and access to senior management. What you'll do A Finance Data Scientist within Adobe’s Creativity...  ...process, optimizing and refining by leveraging automation and AI/ML techniques. This role has the opportunity to present and showcase... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    10 hours ago
  • $123.2k - $218k

     ...development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high...  ...user behavior and funnel analysis. Work closely with Product Management, Sales, Customer Success and other stakeholders to understand... 
    Work at office
    Local area
    Worldwide

    Colorwave Inc

    San Francisco, CA
    2 days ago
  • $155k - $180k

     ...and consumer devices) and our cross-disciplinary skills (embedded AI, high-tech manufacturing automation, eco-design, industrial...  ...requirements, as well as ensuring proper technical follow-up and management of projects for the assigned scope. As an integral part of the project... 
    Full time

    Kickmaker

    San Francisco, CA
    10 hours ago
  •  ...Forward Deployed AI Engineer The opportunity We are looking for a Forward Deployed...  ..., and built pioneering lab data management systems as well as high throughput protein...  ...understand the unique data challenges and evaluation paradigms of biological modelling. You... 
    Full time
    Shift work

    Latent Labs

    San Francisco, CA
    10 hours ago
  • $147k - $184k

    Ironclad is the leading AI contracting platform that transforms agreements into assets. Contracts move faster, insights surface instantly...  ...Wave and Gartner Magic Quadrant for Contract Lifecycle Management, a Fortune Great Place to Work, and one of Fast Company’s Most Innovative... 
    Full time
    Contract work

    Ironclad

    San Francisco, CA
    4 days ago
  •  ...through smart automation and AI-driven improvements....  ...reliability and rapid incident responseEstablish...  ...engineering teams and managing work across time zonesYou...  ...alerting systems, and SRE practices for data infrastructureWork...  ...this information to evaluate your application for... 
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    1 day ago
  •  ...designers, user researchers, copywriters and web developers who collaborate closely with each other and with Engineering and Product Management to create innovative, and usable, products that people love to use. Responsibilities: Conduct quantitative user studies,... 
    Contract work

    US Tech Solutions

    San Francisco, CA
    2 days ago
  • $241.2k - $344.5k

     ...Duck Creek Technologies’ enterprise data, artificial intelligence (AI), and generative AI (GenAI) capabilities. Define and execute...  ..., including model development, deployment, and lifecycle management. Establish and scale enterprise capabilities for machine learning... 
    Visa sponsorship
    Flexible hours

    Duck Creek Technologies LLC.

    San Francisco, CA
    10 hours ago
  • $164.7k - $266k

     ...people’s lives. With intelligent agreement management, Docusign unleashes business-critical...  ...What you'll do We are seeking an AI Engineer who can operate at the intersection...  ...practices for data access and governance, model evaluation and guardrails and security, compliance,... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    2 days ago
  • $171k - $240k

     ...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables...  ...and control spend effortlessly. Brex’s AI-native automation and world-class...  ...production environments.Experience building evaluations to measure and improve the quality, reliability... 
    Work at office
    Remote work
    Work from home
    Shift work

    Brex

    San Francisco, CA
    10 hours ago
  •  ...teams to do this. These teams bring product management, design, and engineering together with...  ...role. You Are You are an exceptional AI-native software engineer who has built and...  ...and constraints, establish tests and evaluations, and review generated output with rigor.... 
    Permanent employment
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    3 days ago
  •  ...Who We Are At Serval, we're building the AI platform for IT teams. Our goal is to...  ...onboarding/offboarding, software access management, and the long tail of employee requests....  ...selection and fine-tuning to inference and evaluation pipelines. Integrate AI capabilities... 
    Full time

    Serval

    San Francisco, CA
    10 hours ago
  •  ...Data and Analytics professionals define strategies, develop and deliver solutions that enable the collection, processing and management of information from one or more sources, and the subsequent delivery of information to audiences in support of key business processes... 
    Work experience placement

    ClifyX

    San Francisco, CA
    2 days ago
  • $160k - $175k

     ...based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical, physical, and environmental aspects of the grid that... 
    Local area

    Gridware

    San Francisco, CA
    3 days ago
  •  ...based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical, physical, and environmental aspects of the grid that... 
    Local area

    Gridware

    San Francisco, CA
    28 days ago
  • $171k - $240k

     ...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables...  ...and control spend effortlessly. Brex’s AI-native automation and world-class...  ...product gets sharper.Stand up feedback and evaluation loops that let us quickly gather product... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SRE Evaluator - Incident Management - AI Trainer. Be the first to apply!