SRE Evaluator - Incident Management
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Apply deep subject-matter expertise in Incident management , reliability , and SRE .
- Work independently and asynchronously to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management , reliability , or SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management in San Francisco, CA vacancy
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA10 days ago- ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants...SuggestedWork at officeRemote work
Obsidian
San Francisco, CA2 days ago $50 - $70 per hour
...Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned written...SuggestedContract workSummer workRemote workFlexible hoursMercor
San Francisco, CA25 days ago$400 per month
...lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured... ...accepted work. Who Should Apply 2+ years of professional DevOps, SRE, or Cloud Engineering experience. Experience with AWS, Azure, GCP...SuggestedMercor Inc
San Francisco, CA18 hours ago$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...SuggestedContract workSummer workRemote workMercor
San Francisco, CA10 days ago- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...Remote jobHourly payWork at office
$150 per hour
...comfortable having your judgment reviewed and calibrated against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume or relevant professional background...Contract workSummer workRemote workMercor
San Francisco, CA10 days ago$120 - $175 per hour
Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote workMercor
San Francisco, CA29 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA5 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA10 days ago$100 - $150 per hour
...Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering context. Identify factual, aesthetic, and presentation...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA10 days ago$150 per hour
...Develop grading criteria by breaking clinical questions into discrete, checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and appropriate escalation advice. Annotate clinical reasoning by...Contract workSummer workRemote work$100 - $150 per hour
...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of... .... ~ Deep fluency in outbound prospecting, discovery, deal management, and structured sales methodologies. ~ Exceptionally strong...Contract workSummer workRemote work$170 - $190 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role...Contract workWork experience placementSummer workRemote work$16 per hour
...Compensation: $16/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards. Score the quality of musical training data . Write music...Contract workSummer workImmediate startRemote work$50 per hour
...Contract Compensation: $50–$200/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate the effectiveness of AI systems in handling personalized, real-world tasks. Use AI tools extensively to assess the utility,...Contract workSummer workRemote work$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote work$100 - $150 per hour
...requirements into product solutions, delivering tailored demos, handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on experience with technically complex B2B software — SaaS , cloud infrastructure, cybersecurity...Contract workSummer workRemote work$70 - $110 per hour
...Compensation: $70–$110/hour Location: Remote Duration: 4–6 weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated clinical assessments , treatment plans, and patient education materials for quality and accuracy. Compare AI-...Hourly payContract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!
Related searches
- ai evaluator San Francisco, CA
- education evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- emergency disaster management San Francisco, CA
- agency management specialist San Francisco, CA
- provider data management San Francisco, CA
- pain management San Francisco, CA