Incident Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management / reliability / SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY21 days ago$70 - $110 per hour
...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...SuggestedHourly payContract workSummer workImmediate startRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedContract workSummer workWork at officeRemote work- ...or an alternative application process. Adjunct-Emergency Management (Subject Matter Experts) Contracts - Main Adjuncts Reading, PA, US Subject... ...Emergency Operations and Planning : Emergency operations plans, incident command systems, continuity of operations, crisis...Suggested
€3,553 per month
...and Retail branches worldwide, as well as expert support in the risk area across business... ...advisor and hands‑on expert for senior management and business stakeholders. You will help... .... Connect lessons learned from testing, incidents, controls and risk assessments to...SuggestedFull timeWork at officeImmediate startWork from homeWorldwideHome officeFlexible hours$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NYa month ago- AI Trainer Jobs in the United States seeks a graduate-level physicist to review AI-generated solutions to university- and graduate-level physics problems across mechanics, electromagnetism, thermodynamics, and beyond. You will read a model's step-by-step reasoning, identify...
$40 - $65 per hour
Crossing Hurdles is seeking a British English Voice Expert to evaluate short British English audio recordings and assess naturalness, pronunciation, and accents. The role is remote and paid per hour. You will provide structured feedback to support AI training and evaluation...Remote jobHourly payContract work$30 - $50 per hour
Review and improve AI answers written in Polish so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the chart what good looks like. What you will do Rate Polish AI responses for accuracy, fluency, tone and instruction...Remote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours$18 - $45 per hour
...experienced Finance - Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland... ...information. This is not a traditional trading, portfolio management, or investment advisory position. Instead, you'll...Extra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours- Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models....Remote jobContract workFreelance10 hours per weekFlexible hours
- micro1 is seeking VA-accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits topics. You’ll use your claims experience to check that questions sound like real veterans and families and that answers are correct and useful. Accuracy...Remote jobFor contractors
- Vettedlance seeks a bilingual reviewer to rate Spanish AI responses for accuracy, fluency and instruction-following. You will rewrite or correct weak answers, fact-check claims, and flag unsafe or invented content while maintaining clear tone. The role is remote, part-time...Remote jobHourly payWeekly payContract workPart time10 hours per week
- Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This part-time role emphasizes concise feedback and strong written communication. Applicants should be fluent in English and have...Remote jobPart time
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity, usefulness, and technical accuracy, with a focus on JSON structure and formatting. The role combines language fluency, customer service judgment,...For contractorsRemote workFlexible hours
- YO AI Labs is seeking an experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in photography, cinematography, camera operation, and video production....Remote jobWorldwide
- ...Anesthesiologist Type: Contract Compensation: $350/hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and safety. Check each answer against the patient chart and...Full timeContract workSummer workImmediate startRemote workFlexible hours
Mercor
New York, NY14 days ago - Vettedlance is seeking a meticulous Polish language reviewer to enhance AI answers. You will rate Polish responses for accuracy, fluency, and tone, rewrite weak answers, and ensure factual correctness. You will also fact-check claims, flag unsafe content, and craft prompts...Remote jobHourly payPart timeFlexible hours
$70 per hour
...cover these: 4+ years in nonprofit program management, philanthropy, or community-based... ...impact reports, or program logic models Expert-level document, spreadsheet, and slide craftsmanship... ...Expert Ethos ⢠Generalist $100 /hr Incident Management / SRE & Reliability Lead...Hourly payImmediate startRemote workFlexible hours- ...seeking an experienced Senior Health and Safety Advisor to provide expert guidance across the organisation and foster a strong safety... ...audits, assess compliance, identify improvements, investigate incidents and deliver training. #J-18808-Ljbffr Sheffield Hallam University
$30 per hour
Vetto is building a global AI wellness platform and is recruiting professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing...Hourly pay- Globik AI is seeking HR and recruitment professionals to evaluate AI-generated hiring, workplace, employee, and talent-management content. You will review AI-driven HR responses, assess usefulness, and identify biased or unsupported recommendations, while ensuring consistency...
- Create challenging prompts and evaluate large language model responses for accuracy, reasoning, and usefulness. This worldwide, part-... ...requires strong English writing, analytical thinking, and team management experience. 100% Remote Contract, part-time Engagement Remote...Contract workPart timeFor contractorsRemote workWorldwide
- AuraOne, Inc. is seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. The...Remote jobFor contractors
$90 per hour
Casino Gaming Operations AI Evaluator (Table Games Managers) Review AI-generated gaming content using table games management experience. This flexible, remote U.S. contractor role offers up to $90 per hour and may involve 5 to 20 hours weekly when projects are active....Hourly payContract workPart timeFor contractorsRemote workFlexible hours$70 per hour
...clear, board- or public-ready writing Expert-level document, spreadsheet, and slide... ..., or humanities scholarship to create, evaluate, and refine AI-generated documents, spreadsheets... ...Expert Ethos Generalist $100/hr Incident Management / SRE & Reliability Lead Expert Ethos Generalist...Hourly payImmediate startRemote workFlexible hours$90 per hour
OpenTrain AI, Inc. is seeking a Casino Gaming Operations AI Evaluator with table games management experience for a remote U.S. contractor role. Pay is up to $90/hr with flexible, asynchronous scheduling requiring 5 to 20 hours per week when projects are active. The role...Remote jobFor contractorsFlexible hours- Management Consultant — AI Workflow Evaluator is a remote evaluation track for reviewing management consultant ai workflow evaluation prompts and responses... ...Enterprise operations AI evaluation Rubric writing Expert review Work model Remote — US-eligible. Remote · Independent...Hourly payFor contractorsRemote work10 hours per week
- ...), Salto (Brazil), Borgo a Mozzano (Italy), as well as Mainz (Germany). Your Contribution Global Supply Chain Projects: Management of international projects aimed at improving and optimizing supply chain processes within the Business Unit Flat Glass - including...Local areaWorldwideFlexible hours
SCHOTT AG
New York, NY2 days ago $90 per hour
...find experienced IT compliance managers who can help train their... ...information security to create, evaluate, and refine AI-generated documents... ...diligence questionnaires, incident response and breach... ...regulatory or audit framework Expert-level document, spreadsheet,...Immediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- fulfillment expert New York, NY
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- nurse evaluator New York, NY