Remote AI Agent Evaluation Specialist
$80 per hourMindrift
Providence, RI
- Remote job
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work on complex systems, ensuring quality assurance and logical problem-solving. Ideal candidates are analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive pay up to $80/hour, allowing integration with academic or professional commitments. #J-18808-Ljbffr Mindrift
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Specialist in Providence, RI vacancy
$20 - $30 per hour
...As an Image Evaluation Generalist, you will play a pivotal role in supporting an image assessment... ...to the training of next-generation AI systems. Your expertise will be essential... ...ambiguities or gaps. Operate independently in a remote environment, delivering high-quality,...Remote workHourly payFor contractorsSaidGig
Indianaa month ago$125 per hour
...QGIS specialists leverage their expertise in geographic information systems... ...data analysis to support AI research through flexible,... ...based work. This role involves evaluating AI-generated content and providing... ...Work Terms This position is remote and allows for asynchronous...Remote workFlexible hoursSaidGig
United States4 days ago- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote workPart time
Mind Rift
Brooklyn, NY1 day ago $80 per hour
...-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and... ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/...Remote workPart timeFlexible hoursMind Rift
Raleigh, NC5 days ago$60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote workPart timeFlexible hoursMind Rift
Kansas City, MO1 day ago$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote workFreelanceMind Rift
Austin, TX5 days ago- ...SWE Agent Evaluation Specialist is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written...Remote jobHourly payFor contractors10 hours per week
$80 per hour
...Do The Mindrift platform connects specialists with AI projects from major tech... ...design realistic and structured evaluation scenarios for LLM‑based agents. You'll create test cases that simulate... ...needs Take part in a flexible, remote, freelance project that fits around...Remote workFreelanceFlexible hours$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... .... Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-...Remote workContract workSummer workWork at officeMercor
Houston, TX5 days ago$80 per hour
...intelligence to ethically shape the future of AI. What We Do The Mindrift platform,... ...servers and internal tools for running and evaluating agent behavior. You’ll implement base methods... ...project needs Take part in a flexible, remote, freelance project that fits around your...Remote workPart timeFreelanceFlexible hoursMind Rift
New York, NY5 days ago- ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts... ...to retrain. Why this role matters AI data reviewers help turn it helpdesk... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote jobHourly payFor contractors10 hours per week
$60 - $90 per hour
...Join a leading AI lab''s cutting-edge GenAI team to be at the core... ...the next generation of agentic evaluation benchmarks for frontier models and needs specialists who can find where those models... ...benchmark tasks. This role is fully remote within the United States, at...Remote workHourly payFull timeContract workPart timeFreelanceSaidGig
United States3 days ago$15 - $25 per hour
...Role Overview As a Health Care Specialist, you will leverage your... ...training of next-generation AI systems. Your insights will be... ...exceptional attention to detail when evaluating medical information.... ...multitask and work efficiently in a remote environment. Strong...Remote workHourly payPart timeFor contractorsFlexible hoursSaidGig
United States4 days ago$1,750 - $2,150 per month
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...,750–$2,150 per completed task Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related to threat analysis,...Remote workHourly payFull timeContract workSummer workMercor
Remote10 hours ago$15 - $25 per hour
...As a Legal Specialist, you will leverage your legal expertise to contribute... ...training of next-generation AI systems. Your insights will... ...to support structured legal evaluations. Prepare concise written... ...priorities and deadlines in a remote environment. Strong...Remote workHourly payContract workPart timeFor contractorsSaidGig
United States3 days ago$25 - $30 per hour
...DataAnnotation is seeking a Certified Coding Specialist (CCS) to join their team and help train AI models. This role requires expertise in healthcare to evaluate AI performance and improve model quality. Applicants should have fluency in English and a medical or healthcare...Remote workHourly payFor contractorsDataAnnotation
Boston, MA4 days ago- ...To support program evaluation and advanced analytics, the full-time Program Evaluation Specialist will lead the design and implementation of evaluations, utilizing quantitative and qualitative methodologies to generate actionable insights for health and civilian programs...Remote workFull time
Virtual Vocations Inc
United States3 days ago $100k - $115k
...is seeking a detail-oriented Program Evaluation Specialist to support program evaluation, implementation... ...-grade platforms and mission-ready AI to federal agencies at commercial speed... ...security clearances, due to the nature of the work. Job Locations US-RemoteRemote workContract workLMI
United States8 days ago$152k - $240k
...control spend effortlessly. Brex’s AI-native automation and world-... ...’ll do We're building AI agents to automate and augment... ...four weeks per year of fully remote work! Responsibilities:... ..., and data sources. Define evaluation frameworks, success metrics, and...Remote workFull timeWork at officeWork from homeBrex Inc.
New York, NY10 hours ago$80 - $120 per hour
...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should...Remote workHourly payContract workWork at officeMercor Inc
New York, NY1 day ago$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $60–$90/hour Location: Remote Commitment: 15–40 hours/week... ...specialized cybersecurity topics. Evaluate and annotate model responses for technical...Remote workFull timeContract workSummer workImmediate startMercor
Remote10 hours ago- ...drive revenue performance. About the Role AI agents are becoming central to how CaptivateIQ... ...SDK, LLM orchestration layer, and the evaluation and observability infrastructure that underpins... ...in‑office 3 days per week) – Austin, TX Remote – Raleigh, NC Remote – Nashville, TN...Remote workWork at officeFlexible hoursShift work3 days per week
CAPTIVATEIQ INC
Austin, TX5 days ago $200k - $320k
...technical depth and a passion for AI-driven product development.... .... This is a full-time remote opportunity, with preference for... ...production-ready LLM pipelines and AI agent systems Develop AI-driven... ...new product initiatives Evaluate and recommend AI architectures...Remote workFull timeVisa sponsorshipVirco Talent
Remote10 hours ago$177.1k
...seeking an innovative and product-driven AI Agent Engineer to design, build, and... ...lifecycle management. Building automated evaluation harnesses and observability pipelines to... ...approach is centered around our offices and remote work environments. The work style of each...Remote workFull timeWork at office$1,150 - $1,450 per month
...technical talent with leading AI research labs. Headquartered in... ...task Location: Remote Role Responsibilities Build... ..., grant applications, program evaluations, health-assessment reports, policy... ...stakeholders to challenge frontier AI agents. Collaborate with other...Remote workHourly payFull timeContract workSummer workMercor
Philadelphia, PA8 days ago$8 - $65 per hour
...Video Production Specialist - Freelance AI Trainer Project United States of America Are you a video... ...improvements to our prompt engineering and evaluation metrics. A bachelor’s or master’s... ...type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level #J-...Remote workHourly payContract workFor contractorsFreelanceImmediate startInvisible Agency
Nashville, TN5 days ago$202.5k - $247.5k
...sharing localhost or running AI workloads in production. We... ...worth your time. About the Agent Team Our Agent team... ...AWS. Engineers develop by using remote development tools and/or ssh to... ...and actual compensation will be evaluated based on factors including,...Remote workPermanent employmentFull timeWork at officeLocal areaImmediate startHome officeFlexible hoursNgrok
Remote10 hours ago$80 - $150 per hour
...Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates...Remote workHourly payWork from homeProlific
Denver, CO10 hours ago- ...eager to shape the future of AI? Large-scale language models... ...We’re looking for literature specialists and avid readers with strong... ...factual accuracy and coherence; evaluate the depth and validity of... ...Freelance / Contract Workplace type: Remote Seniority level: Entry Level...Remote workHourly payContract workFor contractorsFreelance
Meridial Marketplace, by Invisible
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!
Related searches
- remote chat agent Providence, RI
- ai scientist Providence, RI
- remote data entry no experience Providence, RI
- remote accounts receivable Providence, RI
- remote prior authorization Providence, RI
- remote insurance Providence, RI
- junior data engineer remote Providence, RI
- remote data analyst intern Providence, RI
- remote 3d animation Providence, RI
- remote from anywhere Providence, RI