Remote AI Agent Evaluator & Logic QA Analyst
$80 per hourMindrift
- Remote job
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift
$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong... ...will review AI evaluation tasks, identify inconsistencies... ...behaviors for agents. Ideal applicants... ...evaluation or logic puzzles and good communication...Remote jobFreelance- ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality... ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs...Remote jobHourly payFor contractors10 hours per week
$20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...Remote workHourly payFlexible hours$100 - $125 per hour
...Actuary) Engagement Type: Freelance/ 1099 Contractor, Remote Compensation: $100-$125 per hour Commitment:... ...insurance workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical reasoning, and business relevance Work on use cases...Remote jobHourly payFor contractorsFreelanceWork at officeImmediate startFlexible hours$40 per hour
An AI training company in the United States is looking for a Statistician to help improve AI models. You will evaluate the mathematics logic behind chatbots and assess their performance. Candidates should... ...will be considered for this remote contract role. #J-18808-LjbffrRemote workHourly payContract work$112.09k - $160.33k
...Burlington, VT (hybrid) or remote About OhMD OhMD is an AI patient communication... ...and OhMD AI, our AI voice agent. It picks up on the first... ...conversation flows, decision logic, escalation rules, edge case... ...made Familiarity with evaluating agent quality in a structured...Remote workLive in- ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
$80 per hour
...technology firm is seeking QAs for autonomous AI agents to validate and improve task structures... ...systems, ensuring quality assurance and logical problem-solving. Ideal candidates are... ...attention to detail and experience in evaluating scenarios. This flexible, project-based...Remote jobFlexible hours$80 per hour
...opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI.... ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can...Remote jobPart timeFlexible hours$40 per hour
...tech firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This... ...choosing their projects and schedules, earning $40+ per hour. Remote work is available for candidates in the US and select...Remote workHourly pay$60 per hour
...shape the future of AI. What We Do The Mindrift... ...in ambiguity, enjoy remote asynchronous work,... ...are tested and evaluated, we want to hear from... ...Overview We are seeking QA experts for autonomous AI agents in a project focused... ...structures, policy logic, and agent...Remote workFreelanceFlexible hours$14.5 per hour
...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences... ...you—choose your hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from home anywhere in...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hours$40 per hour
A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity...Remote workHourly pay- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
- ...practical, fast-moving AI Operations Specialist to... ...deploy autonomous AI agents, data synchronizations,... ...field, deconstruct their logic dependencies, and... ...time automation streams, evaluate agent output qualities,... ...Location Context: 100% remote-first full-time operational...Remote workFull timeLocal areaWork from home
- ...engagement to design and build an AI agent system that manages a complex,... ...ML Engineers, a Lead Business Analyst, and the Engagement Director,... ..., model services, business logic, and user-facing applications... ...anywhere, forever - We are a fully remote and global team. We trust you...Remote workContract work
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote workWork at office
$1,500 - $2,000 per month
Builder Lead Converter AI Agent Specialist Builder Lead Converter is... ...Design AI agent logic and workflows Deploy, test,... ...frameworks, guardrails, and evaluation logic Optimize AI agents for... ...earlier in the day This is a remote position, but collaboration during...Remote workFor contractorsWork at officeMonday to Friday$40 per hour
...cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical... ...industry. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you...Remote workHourly payFull timePart time- ...QA Analyst Location: Richmond, VA, Hybrid Rate: Best competitive rate Local candidates... ...when requested! Current team is 100% remote with some in person meetings in Richmond... ...with use cases a plus. Experience with logical data flows a plus. Experience working with...Remote workContract workLocal area
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hours$40 per hour
...annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement.... .... This independent contract position offers remote work with flexible scheduling and hourly pay starting...Remote workHourly payContract workFlexible hours$25 - $30 per hour
...seeking analytical, detail-oriented professionals to help train AI chatbots. This independent contractor role allows you to work from... ...projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication...Remote workHourly payFor contractorsWork from home$112k - $216k
...ambitious team building AI that transforms how... ...together. As part of the AI agents team, you'll work at... ...Build LLM-as-a-judge evaluations and AI observability —... ...data model and LLM/agent logic to APIs and (where... ...the option to be fully remote in all locations across...Remote workFull timeWork from home$25 - $30 per hour
...DataAnnotation is seeking contractors to assist in training AI chatbots. This flexible role allows you to choose projects based on your schedule while working from home. Ideal candidates will manage business communications and possess excellent writing and research skills...Remote workHourly payFor contractorsWork from homeFlexible hours$25 - $30 per hour
...looking for analytical and detail-oriented independent contractors in New York to help train AI chatbots. You will manage various tasks, write high-quality responses, and evaluate AI models based on guidelines. This role offers flexibility as you can choose projects and...Remote workHourly payContract workFor contractorsWork from home- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect... ...Infrastructure Location: Remote (US Preferred) Compensation... ...orchestration, simulation logic, and multi-role... ...Develop and refine test plans, evaluation pipelines, and debug tools...Remote workFull timeWork at office
- A leading AI research accelerator is looking for a detail-oriented Business Analyst to support evaluation and annotation workflows. The role involves performing evaluations, fact... ...opportunity to contribute to impactful research. Remote work is available with a minimum...Remote workFlexible hours
- ...Senior Software Engineer, Agents on our Delivery team,... ...customers: ~Own AI agents for your assigned... ...discovery, design, build, evaluation, launch, and live operation... ...enforces that business logic strictly. ~Design... ...— we’ll fund them. ~Remote by design: Distributed...Remote workFull timeFlexible hours
$20 - $26 per hour
Prolific is looking for an AI Trainer who is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in pronunciation. Candidates must possess...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!




