Incident Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management / reliability / SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY8 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...SuggestedContract workSummer workLocal areaRemote workMercor
New York, NY1 day ago$150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...consistent. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...SuggestedContract workSummer workRemote workMercor
New York, NY5 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...SuggestedContract workSummer workRemote workMercor
New York, NY7 days ago$50 per hour
..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...critical thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Hindi and...SuggestedContract workSummer work10 hours per weekMercor
New York, NY8 days ago$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote workMercor
New York, NY2 days ago- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Remote jobContract workFlexible hours
- ...is seeking a Production Support Analyst to join the Production Management team, supporting Client Portfolio Risk and Margin across desks... ...and business challenges with global follow-the-sun coverage, incident management, root cause analysis, and corrective measures. Applicants...
- Handshake AI is seeking experienced CAD professionals with 2+ years of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-based...Remote jobHourly payContract workFlexible hours
- ...PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and... ...PythonExcellent communication skills to interact with clients, portfolio managers, traders, research, and salesStrong client service mindset...
- Globalchannelmanagement is seeking a Sr Privacy Project Program Manager to establish and oversee a comprehensive privacy program,... ..., strong cross-functional leadership, and the ability to drive incident response, audits, and ongoing program enhancements across healthcare...
$55k - $175k
Team: Product Management & AlliancesCity: New York CityState: NY Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history,...Work at officeLocal areaRemote workWork from home3 days per week- Astreya is seeking an experienced AV support professional to manage escalated incidents, validate ticket quality, and guide L1/L2 teams. The role covers advanced AV troubleshooting across networks, Dante-based audio, and cross-functional collaboration to restore services...
$55 - $65 per hour
...Location: Remote Role Responsibilities Review and evaluate AI-generated clinical outputs based on nursing flowsheet documentation... ...assessment data for AI training datasets . Provide expert feedback on nursing assessments and documentation practices....Contract workSummer workRemote workMercor
New York, NY7 days ago$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote jobWork from homeFlexible hours$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management & Innovation Employment Type Permanent Full-Time Location(s) New York, San Francisco Description & Requirements...Permanent employmentFull timeWork at officeLocal areaHome office3 days per week- ...solutions that help organizations transform faster and become more resilient. Underpinned by technology, data, analytics, AI, change management, talent and sustainability capabilities, our Strategy & Consulting services help architect and accelerate all aspects of an...Full timeLive inWork at officeLocal area
- ...assistant on small/medium projects for our Delay and/or Quantum experts involved in domestic and international arbitration and... ...transport, commercial and residential sectors. You’ll support with managing team members, drafting expert reports and attending client meetings...
$90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise...Contract workSummer workRemote workMercor
New York, NY2 days ago- Ncr Eduservices seeks an Academic Evaluator (Math) to assess mathematics teaching sessions from home. Ideal candidates will have strong mathematical knowledge, sharp analytical skills, and the ability to provide objective feedback to ensure high instructional quality. The...Remote jobFull time
- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
$261k - $290k
...calls for a single, dedicated owner to realize its full potential.We are creating a dedicated Director role as a GitHub Subject Matter Expert (SME) — the accountable owner who turns that momentum into results. GitHub is the tip of the spear for our Zero Legacy and Azure...Temporary workLocal area- ...description of the Position: The agency has a number of clinics, hospitals and outpatient facilities. The candidate will be responsible for managing projects related to updating and/or implementing new systems, software, and hardware.Provide a list of the day-to-day tasks to be...
$60 - $75 per hour
...A leading information services firm is seeking a Remote Archivist to design questions and evaluate AI responses related to archival management. This position requires strong experience as an archivist and the ability to work independently in a fully remote environment...Hourly payRemote workCrossing Hurdles
New York, NY3 days ago- ...Initial Therapeutics, Inc. is looking for a Field Reimbursement Manager to join their Neurology Field team in New York. This key role supports the launch of a rare disease therapy, requiring expertise in reimbursement across various settings. The ideal candidate will have...
Initial Therapeutics, Inc.
New York, NY23 hours ago $90k - $200k
...Kroll's Expert Services Kroll's Expert Services practice provides valuation, economic... ...methodology, and overall project management as dictated by the needs of the client or... ...engagement teams in the development and evaluation of valuation analysis, including determining...Temporary workKroll
New York, NY1 day ago$100 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Management Consultant Talent Network Type: Contract Compensation... ...analyses, strategy recommendations, and financial models. Evaluate AI-generated or human-created work against established criteria...Contract workSummer workRemote workMercor
New York, NY5 days ago- ...Job Description Job Description Management Consultant Job Type: Contractor Location: Remote – United States Job Overview... ...You will apply your consulting expertise to create, review, and evaluate strategic analyses, executive presentations, and client-ready...For contractorsRemote work
YO AI Labs
New York, NY2 days ago $80k - $110k
Position Overview Job Title: Operations Expert Corporate Title: Analyst- Assistant Vice President Location: New York, NY ALL ROLES... ...well as the Deposit business with a combined $70bn assets under management (AUM). Operations is responsible for managing middle and back‑...Work at officeWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- sql expert New York, NY
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY