Remote AI Agent Evaluation Analyst
$80 per hourMindrift
Saint Paul, MN
- Remote job
A leading AI consultancy is seeking QA professionals for autonomous AI agents focused on validating complex task structures. This flexible, project-based opportunity is ideal for analysts and students looking to utilize their analytical skills. The role involves reviewing evaluation tasks, identifying inconsistencies, and defining behaviors for AI agents. Ideal candidates will have strong attention to detail and experience with scenario design. Competitive rates up to $80/hour based on expertise. #J-18808-Ljbffr Mindrift
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Analyst in Saint Paul, MN vacancy
$60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform... ...thrive in ambiguity, enjoy remote asynchronous work, and want to... ...modern AI systems are tested and evaluated, we want to hear from you.... ...QA experts for autonomous AI agents in a project focused on validating...Remote workFreelanceFlexible hours$55 per hour
A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention... ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/...Remote jobPart timeFlexible hours$60 per hour
A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote jobFreelance$50 per hour
...ethically shape the future of AI. About the project We're on the... ...for QAs for autonomous AI agents for a new project focused on validating... ..., policy logic, and agent evaluation frameworks. Throughout the... ...needs. Take part in a flexible, remote, freelance project that fits around...Remote workHourly payPart timeFreelanceInternshipFlexible hours- iMerit, an EXL company, is seeking detail-oriented analysts to evaluate and rank AI-generated responses to image-based prompts. You will review responses... ...rationale to feed model improvements. This is a fully remote, independent contractor engagement lasting three weeks...Remote jobFor contractorsFlexible hours
- Synthires is seeking experienced Signals Intelligence professionals to support AI training and evaluation on a remote, project-based basis. You will apply SIGINT expertise to craft realistic scenarios and assess AI outputs against established intelligence workflows. The...Remote job
$70 per hour
Synthires is seeking evaluators to join our AI research and evaluation team. You will assess AI-generated responses, judge quality and reasoning... ...critical reading, and meticulous attention to detail. This remote, project-based role offers flexible hours and competitive pay...Remote jobFlexible hours$84k - $167k
...of clinical research. Make an Impact as a Senior Business Analyst, AI Evaluation & Value Realization at Worldwide Help turn promising AI... ...toward implementation. Where You'll Work This is a remote role open to candidates based in the US. You will collaborate...Remote workHourly payFull timeContract workWorldwide$35 per hour
...iMerit, an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will review... ...contractor engagement for the length of the project. Fully remote with flexible scheduling around agreed deadlines. Tasks...Remote workFor contractorsFlexible hours- Alignerr Corp. seeks a Health Informatics Analyst (AI Training) to evaluate AI-generated healthcare content, clinical workflows, and EHR outputs for... ...help AI systems reason about health data. The role is a remote, hourly contract offering 10-40 hours per week, with flexible...Remote jobHourly payContract work10 hours per weekFlexible hours
$35 per hour
...Operations · Location: Norway We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge... ...engagement for the length of the project. Fully remote with flexible scheduling around agreed deadlines. Tasks include...Remote workFor contractorsFlexible hours- Turing, a fast-growing AI company, is seeking a detail-oriented Business Analyst to support a project evaluating chatbot responses for quality and consistency. You will gather... ...to stakeholders. This is a 16-week, fully remote assignment with collaboration across cross-...Remote job
- Codefeast is seeking a Business Analyst for Educational Raters (Gemini) to work remotely on AI evaluation, data annotation, and educational content projects. You will analyze content, summarize information, verify claims, and develop training scenarios to improve model...Remote jobFor contractorsImmediate start
- AuraOne is seeking an AI Training Expert for a fully remote, US-eligible contractor role. You will review AI training evaluation prompts and outputs, label edge cases, and provide structured feedback to help retrain the model. Responsibilities include evaluating model...Remote jobFor contractors
$35 per hour
AI Trainer Jobs in the United States is seeking detail oriented analysts to evaluate and rank AI generated responses to text prompts. You will judge answers on accuracy, relevance... ...$35 per hour for a 3-week project, fully remote with flexible scheduling around deadlines....Remote jobHourly payFor contractorsFlexible hours- OpenTrain AI, Inc. is seeking an entry-level contractor to evaluate how AI agents understand instructions, analyze information, reason through problems, and complete... ...and the ability to work 20+ hours weekly as a remote contractor. #J-18808-Ljbffr OpenTrain AI, Inc.Remote workFor contractorsFreelance
- Crewlia is seeking an AI Data Analyst for a remote hourly contract in the United States and Canada. You will assess AI-generated data and content... ...with flexible hours and clear project guidelines. You will evaluate outputs against source materials, documenting rationales...Remote jobHourly payContract workFlexible hours
- Seoulstart is seeking a Data Analyst (AI Evaluation) to join our remote team in the United States. You will review datasets and outputs for quality, apply evaluation rubrics, and provide clear feedback to improve AI training data. The role emphasizes attention to detail...Remote jobHourly pay
$55 per hour
A cutting-edge technology firm is seeking analysts and researchers for a part-time opportunity focused on evaluating AI systems. This remote role pays up to $55/hour, allowing flexibility to fit around other commitments. Ideal candidates possess strong analytical skills...Remote jobPart time- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
$80 per hour
A leading AI consultancy is searching for QA analysts to validate AI agents in a project focused on improving complex tasks. This opportunity is a flexible, remote, part-time role ideal for curious thinkers... ...identify inconsistencies in AI evaluation. Competitive compensation...Remote jobPart timeFlexible hours$60 per hour
...company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires... ...candidates can work flexibly and remotely, earning rates up to $60/hour. This position is ideal for analysts or students looking to contribute...Remote jobFlexible hours$60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote jobPart timeFlexible hours$80 per hour
...-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and... ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/...Remote jobPart timeFlexible hours- TURING ENTERPRISES, INC. is seeking a detailed QA Analyst to evaluate and compare responses from multiple chatbots. You will review outputs... ...and provide final assessments for each task. This freelance, remote role spans a defined number of evaluation tasks over a 16-week...Remote jobContract workFreelance
- Crossing Hurdles is seeking a Business Analyst for a remote, short-term contract. The role involves evaluating chatbot outputs against criteria, conducting structured analyses... ..., and delivering clear assessments to enhance AI response quality. You will collaborate with...Remote jobTemporary work
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$56.08k
...opportunity for a curious, hard-working analyst eager to show how data informs... ...collaboration, the Data and Evaluation Analyst supports PCOA in... ...Road, Tucson, AZ 85716); some remote work may be available.... ...costs and funding decisionsApply AI tools responsibly to improve analytical...Remote workFull timeContract workTemporary workPart timeFor subcontractorWork at officeLocal areaImmediate startMonday to FridayShift workWeekend workAfternoon shift- HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE PERSONAL CONTEXT, AND DELIVER HELPFUL CONVERSATIONS. Location: Remote Type: Independent contractor / Part-time Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create...Remote workPart timeFor contractors
- Turing is seeking a detail-oriented Business Analyst to support a remote, project-based evaluation of chatbot responses. The role involves gathering requirements, mapping processes, and delivering assessments across multiple tasks over a defined 16-week period. The position...Remote jobFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluation Analyst. Be the first to apply!
Related searches
- agent Saint Paul, MN
- tsa agent Saint Paul, MN
- work from home chat agent Saint Paul, MN
- import export agent Saint Paul, MN
- commissioning agent Saint Paul, MN
- state farm agent Saint Paul, MN
- executive protection agent Saint Paul, MN
- airport agent Saint Paul, MN
- cruise agent Saint Paul, MN
- telemarketer - state farm agent team member Saint Paul, MN