SRE Evaluator - Incident Management
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise in Incident management , reliability , and SRE .
- Work independently and asynchronously to meet deadlines and ensure high-quality assessments.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management , reliability , or SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote workFlexible hours- ...Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience...Suggested
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience...SuggestedRemote jobHourly payContract workWork at office$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract...SuggestedRemote jobContract workWork at office$80 - $120 per hour
Mercor is seeking an IP / trademark / copyright law Evaluator with a strong background in relevant legal experience. This remote role involves evaluating AI-generated artifacts and collaborating with AI research teams to enhance quality. The ideal candidate has over 5 years...Remote jobHourly payWork at office- ...Strong written and verbal communication skills. Must remain available & responsive throughout the review process with the Senior Managing Directors, Managing Directors and clients. Education and Work Requirements: ~ Bachelor’s degree Active...Work at officeRemote workHome office
- Welo Data is seeking Data Labeling Associates in San Francisco to evaluate AI systems focused on Arabic language nuances. The role includes model evaluation, identifying biases in datasets, and ensuring quality across global AI workflows. Candidates should have native...
$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Remote jobContract workSummer workWork at office$70 per hour
...Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning. Provide structured written feedback to improve AI model outputs...Contract workSummer workRemote work$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$15 - $20 per hour
...Role Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity,...Contract workSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$50 per hour
...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location... ...critical thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Spanish...Contract workSummer workRemote work- Merchant Mariner Course Evaluator (Deck) This vacancy is for a GS - 2101 - 12, Merchant Mariner Course Evaluator (Deck) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER COURSE APPROVALS BRANCH.
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!
- work from home web search evaluator San Francisco, CA
- education evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- operations management specialist San Francisco, CA
- sales management training program San Francisco, CA
- management development program San Francisco, CA
- medical director utilization management San Francisco, CA


