Remote AI Evaluation Specialist — Operations QA
AuraOne
New York, NY
- Remote job
AuraOne is seeking an AI Evaluation Specialist for remote review of AI outputs across operations, focusing on workflow adherence, policy alignment, and stakeholder fit. You will grade tone, escalation logic, and provide clear next steps to help the modeling team improve. This contractor role requires direct experience with AI evaluation operations, ability to apply multi-page rubrics consistently, and strong written reasoning. #J-18808-Ljbffr AuraOne
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist — Operations QA in New York, NY vacancy
$45 - $185 per hour
...workflows. This role supports an AI research initiative focused on evaluating how effectively AI assistants complete... ..., information systems, research, operations, behavioural science,... ...Independent contractor role ~Fully remote within the United States ~Expected...Remote workOperationsHourly payWeekly payContract workPart timeFor contractorsTrial period24-MAG
Remote3 days ago$60 - $85 per hour
...About the job Remote | Licensed Chemical Engineer & AI Evaluation Specialist - $60-$85/hour We are sharing a specialised part-time consulting opportunity for... ...experience in process design, process safety, plant operations, technical documentation, and industry-standard...Remote workOperationsHourly payFull timeContract workPart time10 hours per weekFlexible hours24-MAG LLC
New York, NY20 days ago$20 per hour
...Coordinator to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve... ...Management & Patient Finance, Pharmacy Operations (Pharm Tech), Laboratory... ...Full-time or part-time remote position Choose which projects...Remote workOperationsHourly payFull timePart timeFor contractorsFlexible hoursDataAnnotation
New York, NY3 days ago$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote jobPart timeFlexible hours$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure... ...systems and scenarios. This flexible, remote project is ideal for those with excellent... ...to detail. Candidates should be adept at evaluating scenarios and documenting findings. The role...Remote workFlexible hoursMindrift
Dallas, TX1 day ago$70 - $100 per hour
...technical talent with leading AI research labs.... ...0/hour Location: Remote Commitment: 10–20+... ...Role Responsibilities Evaluate and compare AI-generated... ...finance, consulting, operations, or executive support.... ...Familiarity with document QA for formatting fidelity...Remote workOperationsContract workSummer workWork at officeImmediate startMercor
Dallas, TX5 days ago- AuraOne seeks an Air Traffic Control Evaluation Specialist to review AI outputs within operations workflows. You will assess tone, policy adherence, and stakeholder... ...recommended next steps for model training. This remote contractor position requires direct ATC evaluation...Remote jobOperationsFor contractors10 hours per week
$20 per hour
A leading AI quality assurance company is seeking individuals to develop prompts and test AI chatbots. This role allows for remote work and flexible scheduling, making it ideal for small business... ...high-quality responses, and evaluating AI model outputs. A bachelor's degree...Remote workHourly payFreelanceFlexible hoursDataAnnotation
Wisconsin3 days ago$50 per hour
...Generalist AI Evaluation Specialist is a remote review track for evaluating AI outputs across generalists specialist operations workflows. Reviewers grade workflow correctness, policy adherence... ...experience training, calibrating, or QA-ing operations teams. Familiarity...Remote jobOperationsFor contractorsWork experience placement10 hours per week$20 per hour
...technology company is seeking a Denial Management Coordinator to enhance AI models by providing complex healthcare-related challenges. This... ...fields, including Revenue Cycle Management and Pharmacy Operations. Candidates must have fluency in English and a healthcare-related...Remote workOperationsHourly payFor contractorsFlexible hoursDataAnnotation
Oregon, WI3 days ago$150k - $185k
...capabilities to build AI-enabled tools, workflow... ...support the company's operations, project delivery, technology... ...-assisted development, QA automation, software... ...documentation. ~Evaluate software quality across... ...workflows. Benefits ~Remote work environment built...Remote workOperationsFull timeFlexible hoursEXANTE360 INC
Remote1 day ago$120 - $175 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to... ...production judgment to assess safe operations on real machines. ~ Written English fluency...Remote workOperationsContract workSummer workMercor
Detroit, MI1 day ago$20 per hour
...sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As... ...Deliverables & Scope Operate autonomously to design complex evaluation... ...: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payTemporary workFor contractorsFreelanceMeridial
Remote2 days ago$80 per hour
...part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour...Remote jobPart timeFlexible hours$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates... ...analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive...Remote jobFlexible hours- AuraOne is seeking a Remote Mobile App Evaluation Specialist contractor to review AI outputs within mobile app evaluation workflows. You will assess tone, escalation... ...stakeholder fit using a structured rubric, flag operational risks, and document the next steps to guide...Remote jobOperationsFor contractors10 hours per week
- ...York Tech is seeking an AI Enablement & Solutions Specialist to accelerate the responsible... ...solutions that improve operations, enhance academic and... ...Enablement & Solutions Specialist evaluates emerging capabilities,... ...is eligible for a hybrid/remote work arrangement, with...Remote workOperationsWork at officeLocal areaWorldwide
- ...seeking an Investor Relations Expert - AI Content Review (Remote) to remotely review and score AI outputs within investor relations operations workflows. The contractor role focuses on... ...compliance, tone, and escalation logic across QA batches to support training of the...Remote jobOperationsFor contractors
$500 per month
...AI Automation Engineer Tort Experts is building an AI-first operating model. The AI Automation Engineer will design, build, and maintain... ...Client Services, Finance, and QA. This is a highly hands-on... ...outcomes. Availability: Remote, 9am - 5pm ET What You'll Do...Remote workOperationsWork from homeFlexible hoursTort Experts
United States3 days ago$25 - $30 per hour
...DataAnnotation is seeking analytical and detail-oriented individuals to help train AI chatbots. In this role, you will develop and evaluate complex prompts while working on your schedule from home. Ideal candidates should have excellent writing and research skills. This...Remote workHourly payFor contractorsWork from homeDataAnnotation
New York, NY3 days ago$65k - $145k
...Title: AI Adoption Specialist Clearance : Active TS Required, Q Clearance... ...available Location : fully remote Compensation : DOE ($65... ...AI technologies into their operations.... ...Assessing readiness : Evaluating the organization's data infrastructure...Remote workOperationsFull timeAugust Schell
United Statesa month ago$80 per hour
...technical talent with leading AI research labs. Headquartered in... ...$55–$80/hour Location: Remote Role Responsibilities Develop... ...problems in your domain. Evaluate and improve AI model... ...Intelligence, Machine Learning, or Operations Research . Focus on automated...Remote workOperationsContract workSummer workMercor
San Francisco, CAa month ago- ...To support AI development, the part-time AI Evaluation Specialist will review and assess AI-generated outputs for quality and usability while collaborating with teams to refine evaluation standards in a remote contract role. Key responsibilities Review and critically...Remote workContract workPart time
Virtual Vocations Inc
United States2 days ago $150k - $200k
...AI Enablement Specialist Wilson Sonsini is the premier legal advisor to technology, life sciences... ...legal service delivery through the evaluation and implementation of AI technology and... ...-driven tools, and support internal operations and legal work Support the development...Remote workOperationsWork experience placementWorldwideWilson Sonsini
United States3 days ago- ...EUA is seeking a Technology & AI Specialist to help drive the adoption... ...support day-to-day technology operations, improve user experience,... ...AI Solutions Support the evaluation, implementation, and adoption... ...issues through remote support, in-person assistance...Remote workOperationsFull time
EUA
Milwaukee, WI11 days ago - ...for. We are seeking an AI / BIM Specialist to help advance how our teams... ..., coordination, and operations workflows Support and evolve... ...should not be applied Test, evaluate, and help pilot emerging... ...What We Offer ~ Remote Work (up to 2 days per week...Remote workOperationsFull timePart timeSummer holidayFlexible hours2 days per week
Hickok Cole
Washington DC4 days ago $80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote workOperationsContract workSummer workWork at office$171k - $240k
...finance teams to accelerate operations, gain real-time visibility, and... ...spend effortlessly. Brex’s AI-native automation and world-class... ...four weeks per year of fully remote work! Responsibilities... ...environments. Experience building evaluations to measure and improve the...Remote workOperationsFull timeWork at officeWork from homeShift workBrex Inc.
Remote17 hours ago$171k - $240k
...finance teams to accelerate operations, gain real-time visibility, and... ...spend effortlessly. Brex’s AI-native automation and world-class... ...four weeks per year of fully remote work! Responsibilities... ...sharper. Stand up feedback and evaluation loops that let us quickly...Remote workOperationsFull timeWork at officeWork from homeBrex Inc.
San Francisco, CA17 hours ago$20 per hour
A technology company focused on AI is seeking individuals for a remote position teaching AI chatbots. This role allows you to work flexibly, developing prompts and evaluating AI responses while managing your own schedule. Candidates should possess strong writing and research...Remote workHourly payDataAnnotation
Santa Fe, NM4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Specialist — Operations QA. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- operations coordinator remote New York, NY
- remote appointment scheduler New York, NY
- head of marketing remote New York, NY
- content designer remote New York, NY
- remote coordinator New York, NY
- remote merchandiser New York, NY
- remote broker New York, NY
- remote insurance verification jobs New York, NY