Remote: AI Agent Evaluation Specialist
$55 per hourPart-time
Mindrift
A cutting-edge technology firm is seeking analysts and researchers for a part-time opportunity focused on evaluating AI systems. This remote role pays up to $55/hour, allowing flexibility to fit around other commitments. Ideal candidates possess strong analytical skills and a firm grasp of structured data formats. Applicants with experience in consulting, logic puzzles, or research are encouraged to apply. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote: AI Agent Evaluation Specialist in South Carolina vacancy
$120k - $145k
...Summary The Senior Systems Specialist is responsible for installing... ...technical expert, providing support remotely and, as needed, at production... ...routine analysis to include evaluation of hardware and software... ...Microsoft Copilot Administration - Agent building, Prompt Engineering...Remote workFull timeContract workWork at officeWorldwideHome office$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive...Remote jobFlexible hours- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
$60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote jobPart timeFlexible hours$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$80 per hour
...-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and... ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/...Remote jobPart timeFlexible hours$60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform... ...thrive in ambiguity, enjoy remote asynchronous work, and want to... ...modern AI systems are tested and evaluated, we want to hear from you.... ...QA experts for autonomous AI agents in a project focused on validating...Remote workFreelanceFlexible hours$80 per hour
...ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from... ...realistic and structured evaluation scenarios for LLM‑based agents. You’ll create test cases... ...Take part in a flexible, remote, freelance project that fits...Remote workTemporary workPart timeFreelanceFlexible hoursMindrift
Wisconsin1 day ago$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...Remote jobHourly payContract workFreelanceFlexible hours$60 per hour
A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote jobFreelance$85 per hour
...project estimation, construction planning, and solar design to evaluate AI-generated content and produce expert training data that... ...workflows and cost estimation. This is hourly contract work, fully remote and flexible, suitable to take on alongside other professional...Remote workHourly payContract workPart timeFlexible hoursSaidGig
United Statesmore than 2 months ago- ...French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly...Remote workHourly payFor contractorsFreelance
Meridial
United States2 days ago $55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical... ...should be adept at evaluating scenarios and documenting findings...Remote jobFlexible hours- ...SWE Agent Evaluation Specialist is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written...Remote jobHourly payFor contractors10 hours per week
- ...Expert Codebase Evaluation Specialist - Coding Agent Review is a remote evaluation track for reviewing codebase evaluation evaluation prompts and responses against... ...team can use to retrain. Why this role matters AI data reviewers help turn codebase evaluation...Remote jobHourly payFor contractors10 hours per week
$80 - $100 per hour
...Role Overview Help train and evaluate AI coding agents by contributing real-world STEM workflows, problem examples, and candid feedback. In this... ...AI systems Work Terms Contractor position, fully remote. The engagement supports a customer project focused on improving...Remote workHourly payFor contractorsSaidGig
United States5 days ago$80 per hour
Get AI‑powered advice on this job and more exclusive features. This opportunity is... ...servers and internal tools for running and evaluating agent behavior. You’ll implement base methods... ...project needs Take part in a flexible, remote, freelance project that fits around your...Remote workFreelanceFlexible hours$80 per hour
...technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking,... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while...Remote jobPart timeFlexible hours$125 per hour
...Role Overview ParaView Specialists apply hands-on experience with scientific visualization... ..., and large dataset analysis to evaluate AI-generated outputs and guide AI systems... ...Comfortable working asynchronously with remote research teams and providing clear, detailed...Remote workHourly payFull timeContract workPart timeFor contractorsFlexible hoursSaidGig
United States17 hours ago$60 - $75 per hour
...Applied Biology Benchmark Specialist - AI Evaluation is a remote review track for evaluating AI outputs across biology reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method...Remote jobFor contractors10 hours per week$152k - $240k
...control spend effortlessly. Brex’s AI-native automation and world-... ...’ll do We're building AI agents to automate and augment... ...four weeks per year of fully remote work! Responsibilities:... ..., and data sources. Define evaluation frameworks, success metrics, and...Remote workFull timeWork at officeWork from homeBrex Inc.
New York, NY17 hours ago$1,750 - $2,150 per month
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...,750–$2,150 per completed task Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related to threat analysis,...Remote workHourly payFull timeContract workSummer workMercor
Remote17 hours ago$60 - $90 per hour
...benchmark tasks used to strengthen model evaluation. Typical probes require one to two days of... ..., focused effort. You will work remotely with researchers in a tight feedback loop... ...research, research engineering, security, or AI evaluation. Proven ability to identify...Remote workHourly payFull timeFreelanceSaidGig
United States3 days ago$200k - $320k
...technical depth and a passion for AI-driven product development.... .... This is a full-time remote opportunity, with preference for... ...production-ready LLM pipelines and AI agent systems Develop AI-driven... ...new product initiatives Evaluate and recommend AI architectures...Remote workFull timeVisa sponsorshipVirco Talent
Remote17 hours ago$180k - $225k
...sharing localhost or running AI workloads in production. We... ...worth your time. About the Agent Team Our Agent team... ...AWS. Engineers develop by using remote development tools and/or ssh to... ...and actual compensation will be evaluated based on factors including,...Remote jobPermanent employmentFull timeWork at officeLocal areaImmediate startHome officeFlexible hoursNgrok
United States17 hours ago$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Security Engineer (Coding Agent Experience) Type: Contract... ...: $85/hour Location: Remote Role Responsibilities Use... ...agents to complete and evaluate complex security engineering...Remote workContract workSummer workMercor
San Francisco, CAa month ago$112.09k - $160.33k
...Location: Burlington, VT (hybrid) or remote About OhMD OhMD is an AI patient communication platform used... ...— and OhMD AI, our AI voice agent. It picks up on the first ring, handles... ...choices you made Familiarity with evaluating agent quality in a structured way...Remote workLive inOhMD
Burlington, VT10 days ago$85 per hour
...estimation, construction planning, and solar design expertise to evaluate AI-generated outputs and create expert training data that... ...contract work on a project-by-project basis. Location: fully remote. Schedule: asynchronous with no minimum hour requirement; when...Remote workHourly payContract workFlexible hoursSaidGig
United States2 days ago$80 - $150 per hour
...Design, run, and refine agentic AI workflows that simulate real... ...use your domain experience to evaluate and train next-generation AI systems... ...models and evaluates AI agents. Experts from domains such as... ...type: Contractor. Location: Remote. Engagement focus: contribute...Remote workHourly payFor contractorsSaidGig
Remote16 days ago$162.8k - $244.2k
...Fortune 500 company and a leading AI platform for managing people, money, and agents, we’re shaping the future of work... ...-on with agent architectures, evaluation frameworks, and customer workflows... ...both worlds: in-person time and remote. Our approach enables our teams to...Remote workFull timeWork at officeHome officeFlexible hoursWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote: AI Agent Evaluation Specialist. Be the first to apply!
Related searches
- remote chat agent South Carolina
- ai scientist South Carolina
- remote coordinator South Carolina
- remote broker South Carolina
- remote design intern South Carolina
- remote accounts receivable South Carolina
- immediate hire remote South Carolina
- remote senior business analyst South Carolina
- remote insurance South Carolina
- remote customer service chat South Carolina