Remote SRE Evaluator & AI Artifact QA
RemoteLeads
New York, NY
- Remote job
RemoteLeads seeks an experienced contractor to evaluate AI-generated artifacts and provide structured feedback. You will review documents, spreadsheets, and decks for accuracy, identify errors, and apply incident management and SRE best practices to grade outputs. The role is remote, hourly, with a flexible schedule and weekly payments. Candidates must have 5+ years in incident management or SRE, strong English, and proficiency in Microsoft Office and Google Workspace. #J-18808-Ljbffr RemoteLeads
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote SRE Evaluator & AI Artifact QA in New York, NY vacancy
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...Incident management / reliability / SRE Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote workContract workSummer workWork at officeMercor
San Francisco, CA27 days ago- ...Mercor is seeking expert Evaluators in Market research / competitive intelligence to review AI-generated artifacts for accuracy, rigor, and domain quality. This is a remote, hourly engagement that allows work from anywhere in the United States. You will apply deep SME...Remote workHourly pay
Mercor
New York, NY12 hours ago - ...is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets,... ...for accuracy and quality. This is a remote, hourly engagement. Ideal candidates... ...and Google Slides. You will assess artifacts against domain rubrics, identify errors...Remote jobHourly payWork at office
- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity tags and documenting next steps for model training. The role requires experience...Remote jobHourly payFor contractorsFlexible hours
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobFull time
- Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context....Remote jobFor contractorsLocal area
- AuraOne, Inc. seeks a Rates Trader - AI Evaluation specialist to audit AI outputs within rates trader operations. You will review workflows... ..., flag risks, and capture next steps for model training. This remote contract role requires reliable async availability of at least...Remote jobHourly payContract work10 hours per week
$50 - $70 per hour
Mercor is seeking a Generalist Expert to review and assess documents and AI-generated outputs. This contract-remote role requires a US/Canada base and strong written English, with flexible hours and independence across docs, slides, and sheets. Compensation ranges from...Remote jobHourly payContract workFlexible hours$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical... ...defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while...Remote jobPart timeFlexible hours- Mercor is seeking a Product launch / experiment readiness Evaluator for a contract, remote role. You will evaluate AI-generated artifacts against rubrics, provide structured feedback, and apply domain expertise to grade outputs. Remote work with asynchronous deadlines....Remote jobContract workWork at office
- ...Mercor is seeking expert Evaluators in Operations / inventory / capacity planning to review AI-generated outputs for accuracy and quality. This is a remote, hourly engagement that requires sharp... ...knowledge. You will evaluate artifacts against domain rubrics, identify...Remote workHourly pay
Mercor
San Francisco, CA12 hours ago - Mercor is seeking a contract Evaluator in the humanities/arts domain to assess AI-generated artifacts against domain rubrics. Remote work arrangement allows asynchronous collaboration with researchers. You will identify factual, aesthetic, and presentation errors in documents...Remote jobContract work
- Mercor offers a remote contract opportunity for a Media/Journalism/Communications Evaluator. You will assess AI-generated artifacts, identify errors, and provide structured feedback to improve model outputs. The role requires 5+ years in media or related fields, native...Remote jobContract work
$80 - $120 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Francisco, the company offers a remote contract role for Spreadsheet QA / workbook maintenance, with... ...compensation of $80-$120/hour. You will evaluate AI-generated artifacts against quality rubrics and...Remote jobContract workWork at office- Mercor is a remote contractor role focusing on evaluating AI-generated artifacts within real estate, hospitality, and events. You will assess quality against rubrics, spot factual, presentation, and aesthetic errors, and deliver structured feedback to help improve AI models...Remote jobFor contractorsWork at office
$80 - $120 per hour
Weekday AI is seeking experienced Evaluators to review AI-generated artifacts for data quality and CRM operations. This is a fully remote, hourly engagement. You will apply deep subject-matter knowledge to grade documents, presentations, and spreadsheets, provide structured...Remote jobHourly payWeekly payFor contractorsWeekday work$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...$70–$110/hour Location: Remote Duration: 4–6 weeks... ...week Role Responsibilities Evaluate AI-generated financial plans... ...and other financial management artifacts for quality and accuracy. Compare...Remote workHourly payContract workSummer workWork at officeImmediate startMercor
New York, NY2 days ago$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations... ...and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This...Remote jobContract workFlexible hours- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
MERIT Beauty
New York, NY2 days ago - ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
Virtual Vocations Inc
United States1 day ago - ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote workHourly payFor contractors10 hours per week
AI Trainer Jobs
New York, NY2 days ago $14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...optimization or data analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments. Pay...Remote workHourly payPart timeImmediate startWork from home10 hours per weekFlexible hoursWelo Data
New York, NY5 days ago$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hoursWelo Data
United States2 days ago- MERIT Beauty recherche des annotateurs francophones en freelance, travaillant à distance, pour évaluer du contenu généré par l’IA. Le candidat idéal devra examiner du contenu en français, identifier les dérives de message et les hallucinations, et fournir des retours structur...Remote workFreelance
MERIT Beauty
New York, NY12 hours ago - ...Obsidian is building a team of native Spanish speakers to evaluate AI-narrated audiobooks for US / North American Spanish. This remote, part-time role (~20 hours/week) focuses on listening critically, flagging narration issues, and logging precise error spans to improve...Remote workPart time
Obsidian
New York, NY12 hours ago - ...Welocalize is seeking a Maps Visual Design Relevance Evaluator - English (US) to assess the aesthetic quality, readability, and polish... ...icons not properly masked or labels that are too small. This is a remote freelance engagement with US eligibility requirements. #J-188...Remote workFreelance
Welocalize
Idaho12 hours ago - ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants must...Remote workWork at office
Mercor
San Francisco, CA12 hours ago - ...Frontier AI Lab is seeking a Gmail & Google Calendar AI Assistant Evaluator to work remotely as a contractor in the United States. You will perform everyday digital tasks, give clear AI instructions, and review results for accuracy. The role focuses on evaluating AI assistants...Remote workFor contractors
Remotebridge
Kentucky12 hours ago - ...Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured...Remote workHourly payWork at office
Obsidian
San Francisco, CA12 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote SRE Evaluator & AI Artifact QA. Be the first to apply!
Related searches
- work from home web search evaluator New York, NY
- evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- c++ remote New York, NY
- senior devops engineer remote New York, NY