SRE Evaluator - Incident Management - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Apply deep subject-matter expertise in Incident management , reliability , and SRE .
- Work independently and asynchronously to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management , reliability , or SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management - AI Trainer in San Francisco, CA vacancy
$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....SuggestedContract workSummer workRemote workMercor
San Francisco, CA27 days ago$10 - $30 per hour
...Application for Information Specialist - Freelance AI Trainer Project at Meridial Back to jobs... ...their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade data management strategies, information retrieval systems,...SuggestedHourly payPart timeFor contractorsFreelanceRemote workInvisible Technologies
San Francisco, CA29 days ago$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote...SuggestedRemote jobContract workSummer workWork at office- Remote is seeking secretaries and administrative specialists for an AI training and evaluation role. You will handle office management tasks, calendar coordination, document preparation, data entry, and customer service to support model testing and prompt evaluation. The...SuggestedRemote jobFor contractorsWork at office
$188.3k - $266k
...people’s lives. With intelligent agreement management, Docusign unleashes business-critical... ...money, and opportunity. Using the Docusign AI-native IAM platform, companies can create... ...contribute to improving system reliability and incident response Support Microsoft Fabric,...SuggestedPermanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA5 days ago$8 - $65 per hour
...eager to shape the future of AI? Large‑scale language models... ...as inventory systems, vendor management, SOP development, cost‑control... ...to our prompt engineering and evaluation metrics. A bachelor's or... ...General Operations Specialist - AI Trainer Employment type: Contract...Hourly payContract workFor contractorsRemote work$8 - $65 per hour
...eager to shape the future of AI? Large‑scale language models... ...democratize world‑class office management, keep pace with evolving... ...to our prompt engineering and evaluation metrics. A bachelor's or masters... ...Administrative Specialist - AI Trainer Employment type: Contract...Hourly payContract workFor contractorsWork at officeRemote work- ...Application for Garment Manufacturing QC Specialist - Freelance AI Trainer Project at Meridial Back to jobs Garment Manufacturing... ...practitioners who understand how garments are actually produced and evaluated. We’re looking for Garment Manufacturing QC Specialists...Hourly payContract workPart timeFor contractorsFreelanceImmediate startRemote workWorldwide
Invisible Technologies
San Francisco, CA29 days ago $70 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workImmediate startRemote work$148k - $185k
...reducing accident frequency, saving lives, and managing costs to enhance the safety and... ...innovations and resolving pain points with AI automation solutionsDeliver scalable, reliable... ...reviews, production on-call support and incident triaging process.Invest in the...Hourly payWork experience placementWork at officeLocal area3 days per weekLyft
San Francisco, CA4 days ago$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work- ...Our Client Our client is a fast-growing AI technology company transforming the food... ...control, logistics, and supply chain management. Built by industry experts with deep experience... ...~ Direct experience managing production incidents end to end, from detection through...Permanent employmentFull time
Onbench
San Francisco, CA2 days ago $200k - $250k
About Distyl AI Distyl is an applied AI technology company partnering... ...behavior, code quality, evaluations, integrations, and production... ..., and participating in incident reviews and production quality... ...team over time. Prior people management experience is strongly preferred...Work at office3 days per weekDistyl AI
San Francisco, CA2 days ago$188.75k - $242.68k
...We own laptop security, cloud security, AI security, detection and response, and red... ...them. You'll build the guardrails, identity management, and detection systems that let Plaid use... ...build to.Your impact: fewer AI-related incidents, faster AI shipping, and controls that scale...Work experience placementWork at officeLocal areaPlaid Financial
San Francisco, CA4 days ago- DataAnnotation is seeking an experienced Management Consultant to train AI models on real business problems. You’ll craft client-style briefs, critique... ...are solid and actionable. The role involves evaluating strategy, market research, leadership communications, and...Remote job
$152k - $190k
...combining global corporate cards and banking with intuitive spend management, bill pay, and travel software, Brex enables founders and... ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense...Brex
San Francisco, CA2 days ago- Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology. The flagship product—an AI-driven, non-invasive cardiac test supported by the ACC/AHA Chest Pain...Local areaWorldwideRelocation
HeartFlow
San Francisco, CA2 days ago $251k - $335k
...organization-wide adoption.Applied AI Engineers serve as trusted... ...the RoleWe are seeking a Manager to build, lead, and develop a... ...engineers through architecture and evaluation decisions, engaging directly... ...launches, production incidents, complex integrations, and high...Work at officeLocal areaFlexible hoursOpenAI
San Francisco, CA2 days ago- ...Human Resource Specialist - Freelance AI Trainer Project at Meridial Back to jobs... ...evolving labor laws, and streamline talent management for companies everywhere. That training... ...improvements to our prompt engineering and evaluation metrics. A bachelor's or master’s...Hourly payContract workPart timeFor contractorsFreelanceImmediate startRemote work
Invisible Technologies
San Francisco, CAa month ago $10 - $30 per hour
...Wholesale Trade Specialist - Freelance AI Trainer Project at Meridial Back to jobs... ...provide their expertise for an AI benchmark evaluation project. As AI models increasingly... ...B2B distribution strategies, inventory management workflows, and wholesale pricing models...Hourly payPart timeFor contractorsFreelanceRemote workInvisible Technologies
San Francisco, CAa month ago- ...We're aiming to make data development and management workflow at Stripe a breeze with emphasis... ...datasets for Stripe products and AI agents. Responsibilities Deliver infrastructure... ..., direction, requirements setting, and incident response processes) for your reports...Full time
Stripe
San Francisco, CA8 days ago $146.4k - $235.38k
...people’s lives. With intelligent agreement management, Docusign unleashes business-critical... ...money, and opportunity. Using the Docusign AI-native IAM platform, companies can... ...multi-agent orchestrationImplement robust Evaluations (e.g., Arize) to monitor and improve model...Contract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA1 day ago$300k
...client is one of the world's largest privately held investment management firms, overseeing hundreds of billions in assets and investing heavily... ...up. This includes cloud migration, data platform modernization, AI enablement, and the development of next-generation investment...Huxley Associates
San Francisco, CA3 hours ago$125 per hour
We’re looking for an experienced Management Consultant to help train AI models. You’ll test the newest models on business problems from your own practice, judge what they produce with a consultant’s eye, and tell us exactly where they hold up and where they fall apart....Full timeRemote workFlexible hours$221k - $258k
...technology companies, across AI, bio + healthcare, consumer,... ...dynamism. a16z has $100B+ under management across multiple funds.We’ve... ...emerging AI applications, including evaluating, testing, and deploying new... ...path forwardParticipate in incident response and root-cause...Work at office3 days per weeka16z
San Francisco, CA4 days ago$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...00–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Contract workSummer workWork at officeRemote work$164.7k - $266k
...business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped... ...Automation Center of Excellence (CoE) that delivers enterprise-grade AI and automation solutions using platforms such as AWS, GEAP, UiPath...Contract workWork at officeLocal areaRemote work2 days per weekUnavailable
San Francisco, CA2 days ago$269k - $314k
...in seed to venture to growth-stage technology companies, across AI, bio + healthcare, consumer, enterprise, fintech, frontier, games... ...building toward American dynamism. a16z has $100B+ under management across multiple funds.We’ve established a team that is defined by...a16z
San Francisco, CA2 days ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Management Consulting Expert Type: Contract... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a...Contract workSummer workWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SRE Evaluator - Incident Management - AI Trainer. Be the first to apply!
Related searches
- evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- education evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- ai trainer San Francisco, CA
- vp talent management & organizational development San Francisco, CA
- talent management leader San Francisco, CA
- director quality management San Francisco, CA