Remote AI Agent Evaluator & Logic QA Analyst
$80 per hourMindrift
- Remote job
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift
$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong... ...will review AI evaluation tasks, identify inconsistencies... ...behaviors for agents. Ideal applicants... ...evaluation or logic puzzles and good communication...Remote jobFreelance- ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality... ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs...Remote jobHourly payFor contractors10 hours per week
$40 - $100 per hour
About OpenTrain OpenTrain AI is the hiring and contracting organization... ...technical conclusions. Remote contract engagement Part-time... ...About AI Training and Scientific Evaluation AI training is the human side... ...assess scientific accuracy, logical soundness, completeness, clarity...Remote workHourly payContract workPart timeFor contractors$60 per hour
...Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly... ...data accuracy, validating citations, and assessing experimental logic. A BS, MS, or PhD in Biology or a related field is required,...Remote jobHourly payWork from homeFlexible hours$80 per hour
...opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI.... ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can...Remote workPart timeFlexible hours$55 - $65 per hour
...convert FTE. This is a remote role but candidates... ...SailPoint and would want a QA Test Analyst who has experience... ...vulnerabilities• Ability to evaluate IAM processes and... ...other’s ideas, think logically and intuitively• Ability... ...Intelligence (AI): We may use Artificial...Remote workLong term contractContract workTemporary workWork at officeLocal area$186.1k - $292.81k
...Recognized by industry analysts like Forrester and G2... ...revenue performance. AI agents are becoming central... ...orchestration layer, and the evaluation and observability... ...partners in a remote-first environment.... ...software with complex domain logic. Familiarity with Python...Remote workFlexible hoursShift work$80 per hour
...technology firm is seeking QAs for autonomous AI agents to validate and improve task structures... ...systems, ensuring quality assurance and logical problem-solving. Ideal candidates are... ...attention to detail and experience in evaluating scenarios. This flexible, project-based...Remote jobFlexible hours- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
$80 per hour
...A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for... ...include reviewing evaluation tasks, identifying inconsistencies... ...up to $80/hour, this flexible remote position allows candidates to influence...Remote workFlexible hours$20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hours$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per week$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hours- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote workWork at office
- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
$125 per hour
...Engagement (Corp-to-Corp) | Remote with International... ...that matter most — across AI and digital... ...engaging a Principal AI Agent Architect to lead the most... ...including comparative evaluations across the Enterprise tier... ...value sizing, sequencing logic, and dependency mapping...Remote workHourly payTemporary work$60 per hour
...shape the future of AI. What We Do The Mindrift... ...in ambiguity, enjoy remote asynchronous work,... ...are tested and evaluated, we want to hear from... ...Overview We are seeking QA experts for autonomous AI agents in a project focused... ...structures, policy logic, and agent...Remote workFreelanceFlexible hours$112.09k - $160.33k
...Burlington, VT (hybrid) or remote About OhMD... ...OhMD is an AI patient communication platform... ...OhMD AI, our AI voice agent. It picks up on the first... ...conversation flows, decision logic, escalation rules, edge... ...made Familiarity with evaluating agent quality in a structured...Remote workLive in- ...20 nationalities from our offices and remotely, who truly enjoys their work. We are looking... ...engineers to build fast across BJAK's AI Finance Agent. This role is for product-minded... ...product. Thinks about user flow, backend logic and business process together. Moves...Remote workFull time
$1,500 - $2,000 per month
Builder Lead Converter AI Agent Specialist Builder Lead Converter is... ...Design AI agent logic and workflows Deploy, test,... ...frameworks, guardrails, and evaluation logic Optimize AI agents for... ...earlier in the day This is a remote position, but collaboration during...Remote workFor contractorsWork at officeMonday to Friday$20 - $26 per hour
Prolific is seeking fluent Kannada speakers to act as evaluators. You will assess how naturally and authentically AI captures Kannada speech, by listening to audio clips and comparing text and voice. This fast-paced project pays $20-26 per hour and may require about one...Remote jobHourly payWork from homeFlexible hours- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect... ...Infrastructure Location: Remote (US Preferred) Compensation... ...orchestration, simulation logic, and multi-role... ...Develop and refine test plans, evaluation pipelines, and debug tools...Remote workFull timeWork at office
$50 per hour
Prolific seeks Product Designers and UX Specialists to help train AI models using your expertise. You'll evaluate AI-generated designs and ensure usability and accessibility while working from home. Ideal candidates hold a BS, MS, or PhD in a relevant field and have at...Remote jobWork from homeFlexible hours$20 - $26 per hour
Prolific seeks fluent Kannada speakers to act as evaluators for AI language data. You will assess text and voice segments, rate naturalness, and help identify cultural nuances. A PayPal account is required to receive payments for tasks priced at $20-$26 per hour. Responsibilities...Remote jobHourly payWork from homeFlexible hours- ...Purple Drive ServiceNow Developer with AI agent experience Share Dallas, TX Overview: Must Have Technical/Functional Skills:... ...Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and usability...Remote work
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobHourly pay- YO AI Labs is seeking an Investment & Finance Expert to work remotely as a contractor. The role focuses on evaluating AI outputs related to valuation, financial modeling, markets, and investments, and crafting expert prompts plus reference answers to improve model reasoning...Remote jobFor contractors
- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
- Harris Computer is seeking a Quality Assurance Analyst to join our team in Maryland. You will design, implement, and execute test plans... ...feature demonstrations for customers and internal stakeholders. AI-assisted tools may be used to improve efficiency. #J-18808-Ljbffr...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!



