Incident Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management / reliability / SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY27 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY21 days ago$70 - $110 per hour
...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...SuggestedHourly payContract workSummer workImmediate startRemote workMercor
New York, NY27 days ago$120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedRemote jobContract workSummer workWork at office$100 - $120 per unit
...Jack Dorsey . Position: Baseball Fan Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100$120 per... ...team stats rules challenges schedules broadcasts highlights and expert-style analysis. Run the same question on two AI products side...SuggestedFull timeContract workWork experience placementSummer workRemote workMercor
New York, NY8 days ago$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote workMercor
New York, NY4 days ago- About Archangel Health AI Archangel Health AI is at the forefront of training, evaluating, and refining next-generation artificial intelligence for healthcare. The platform connects verified Healthcare Professionals (HCPs) with AI development tasks to ensure medical AI...Remote jobSecond jobShift workWeekend work
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
- National University seeks a Records Evaluator I to analyze student records for transfer credit eligibility and degree requirements. You will prepare evaluations, run SOAR reports, and advise students, advisors, faculty, and staff on transfer policies and degree progress...Remote job
- We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate...
$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour... ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other...Contract workSummer workImmediate startRemote workMercor
New York, NY13 days ago$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Contract workSummer workImmediate startRemote workFlexible hoursMercor
New York, NY7 days ago$50 per hour
...Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases...Contract workSummer workRemote workMercor
New York, NY14 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY4 days ago$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/hour Location... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Contract workSummer workImmediate startRemote workMercor
New York, NY13 days ago$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against...Contract workSummer workImmediate startRemote workMercor
New York, NYa month ago$50 per hour
..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...critical thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Hindi and...Contract workSummer work10 hours per weekMercor
New York, NY14 days ago$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote workMercor
New York, NY24 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY7 days ago- ...Production Support to oversee production support and strategic enhancements. You will lead an offshore development team and coordinate incident response on weekends as needed. Requires 10+ years in .NET with MVC, strong C#, JavaScript, HTML5, REST APIs, and experience with...Remote jobWeekend work
$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote workMercor
New York, NY13 days ago$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote workWork from homeFlexible hoursProlific
New York, NY2 days ago- ...crucial role in providing accurate and insightful valuations, which are essential for our clients' investment decisions and risk management strategies.Job Responsibilities:Generate daily valuations of interest rate derivatives including Swaps (Vanilla, Basis, Inflation...Daily paidWorldwide
JP Morgan Chase
New York, NY5 days ago $55k - $175k
Team: Product Management & AlliancesCity: New York CityState: NY Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history,...Work at officeLocal areaRemote workWork from home3 days per weekVeeva Systems
New York, NY3 days ago$75k - $80k
...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized Vocational Assessment Plans (IVAP) process, and assesses the work skills, abilities, work readiness, and vocational potential through...Fedcap Rehabilitation Services
New York, NY1 day ago- ...Rochester (St. Mary's Campus) seeks a per diem Behavioral Health clinician to provide emergency mental health evaluations, crisis intervention, milieu management and disposition planning for patients in a variety of clinical or community settings. Under physician...Daily paid
- ...Result of Service The Expert will serve with a Panel reporting to the Sanctions Committee and the Security Council. The Expert comes under the overall guidance and management of the Subsidiary Organs Branch of the Security Council Affairs Division of the Department...Full timePart timeFor contractorsWork experience placementWork at officeLocal areaWork from home
United Nations
New York, NY3 days ago - Department of Health and Social Services (DHSS) is seeking a Management Analyst III to serve as the Program Evaluator for the Tobacco Prevention and Control Program. The role involves conducting highly complex studies and analyzing statewide health surveillance data for...Work at office
$207k - $300k
...missing scientific knowledge and false assumptions.Build Science evaluations by assessing industry benchmarks to measure data strategy... ...the domain authority to enforce vendor quality, and converting expert contributions into usable training data.Minimum qualifications...Google
New York, NY5 days ago- ...assistant on small/medium projects for our Delay and/or Quantum experts involved in domestic and international arbitration and... ...transport, commercial and residential sectors. You’ll support with managing team members, drafting expert reports and attending client meetings...
Kroll
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- program evaluator New York, NY
- quality evaluator New York, NY
- evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY