Remote AI Evaluation Specialist
micro1
New York, NY
- Remote job
micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings. Role: AI Product Evaluator (Contractor). You will evaluate AI models and agents, document findings in reports, and reset usage limits as required. #J-18808-Ljbffr micro1
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist in New York, NY vacancy
- ...company, who manages all applications and next steps. Our partner is looking for a Personal Injury Law & AI Evaluation Specialist based in the United States. In this remote contract role, you will combine your legal expertise with emerging artificial intelligence...Remote workContract workFor contractorsFlexible hours
$30 per hour
...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for...Remote workSelf employmentWork from homeProlific
New York, NY2 days ago- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ5 days ago $10 - $18 per hour
Jobgether SRL seeks a language professional for a flexible, remote engagement to evaluate and improve AI Tamil interactions. You will translate prompts from English into Tamil and assess AI responses for accuracy, tone, and cultural relevance. Ideal candidates bring linguistics...Remote jobHourly payTemporary workFlexible hours$18 per hour
...Speech AI Evaluation Specialist - Chinese Simplified (USA) Remote RWS – TrainAI / Temporary/Contract / Remote apply for this job We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified...Remote workHourly payExtra incomeTemporary workPart timeFreelanceImmediate startWork from home10 hours per weekFlexible hoursRWS
Berkshire, MA7 days ago$18 per hour
We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified (USA) . Job Type: Freelance... ...-home parent, gig worker, or professional seeking flexible remote work? Are you interested in shaping the development and...Remote workHourly payExtra incomePart timeFreelanceImmediate startWork from home10 hours per weekFlexible hours- Partner Company is seeking a skilled evaluator to test new AI model versions across diverse topics and evaluate responses against quality standards... ..., and provide clear, actionable feedback. This six-month remote contract offers full-time scheduling and comprehensive...Remote jobFull timeContract work
- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...Remote job
- A leading research accelerator is seeking a Geospatial Expert to enhance AI systems through advanced geospatial analysis. This entry-level, remote role involves evaluating geospatial datasets and supporting tasks aligned with crisis management and agriculture. Candidates...Remote jobContract work
- AuraOne, Inc. is seeking an independent contractor to remotely review japanese generalist evaluation prompts and responses, applying a versioned rubric to assign severity tags. You will compare paired outputs, provide rationales, and flag issues like hallucinations or...Remote jobFor contractors
- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote jobFor contractorsFlexible hours
$30 - $90 per hour
...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens... ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key...Remote workHourly payContract workFor contractorsSaidGig
Californiaa month ago- ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models. The role requires clear American...Remote jobFor contractors
- ...AI Evaluation Specialist Role Type: Contractor Location: Remote US Canada UK Ireland Australia New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project....Remote workFull timeFor contractors
YO AI Labs
Washington DC5 days ago - Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability. Responsibilities include assessing accuracy, helpfulness, and instruction...Remote jobFor contractors
- Mercor is seeking an Electrical & Electronics Expert for a remote, part-time contract role at $50/hour, supporting 15-20 hours per week. You will evaluate AI models on visual document understanding within the Electrical & Electronics domain and author tasks with clear...Remote jobContract workPart time
- ...Title: AI voice Evaluation Specialist Location: Remote - USA Duration: 4+ Months Project - W2 Regular hours Good Quality Headphone Is Must And Native English Speakers Only. A heavy accent will not work. Previous experience is Speech Annotation...Remote workFull time
E-Solutions INC
South Dakota4 days ago - AuraOne is seeking a Humanities Evaluation Specialist to remotely review AI outputs within operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, and document actionable next steps to guide the training team. The role is remote...Remote jobHourly payFor contractorsFlexible hours
$25 - $30 per hour
...Bilingual Italian AI Evaluation Specialist is a remote Italian specialist track for evaluating italian evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale...Remote workFor contractors10 hours per weekAuraOne Human Data
Remotemore than 2 months ago$20 - $60 per hour
...Contribute research-driven evaluation content that helps improve next-generation AI systems. This remote contract role centers on creating challenging questions, researching defensible answers, testing model performance, and refining content to probe advanced reasoning...Remote workHourly payContract workFor contractorsSaidGig
United Statesa month ago$40 per hour
...Settings Reject All Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up AI EVALUATION SPECIALIST Sign up now Up to $40/hr Depending on the project Associate's , Bachelor's Remote Part-time Flexible hours About Handshake AI Overview...Remote workTemporary workPart timeFlexible hoursHandshake
San Francisco, CA7 days ago$30 per hour
...Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up HINDI AI EVALUATION SPECIALIST (SINGAPOREAN DIALECT) Sign up now Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview...Remote workPart timeLocal areaFlexible hoursHandshake
San Francisco, CA5 days ago- ...an experienced Employment Law Specialist to contribute to a project focused... ..., and reliability of advanced AI systems. In this contractor... ...employment law scenarios, evaluate AI-generated legal analyses and... ...written English LOCATION: Remote — United States only Key...Remote workContract workFor contractors
$30 per hour
Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr ProlificRemote jobWork from home- ...company, who manages all applications and next steps. Our partner is looking for an Employment Law & AI Evaluation Specialist based in the United States. In this remote contract role, you will apply your legal expertise to help improve the accuracy, reliability, and...Remote workContract workFor contractorsFlexible hours
$34 per hour
...annotation role. You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these... ...of extension Important : This is a 100% onsite position — remote work is not available for this role. To be considered,...Remote workFull timeContract workVisa sponsorship- ...partner company, who manages all applications and next steps. Our partner is looking for a Tax Law & AI Evaluation Specialist based in the United States. In this remote contract role, you will leverage your legal expertise to help improve the accuracy, reliability,...Remote workContract workFlexible hours
$60 per hour
Prolific seeks Computer Science Specialists to join its Expert Network to train and evaluate AI models. You will pass a quick test, then join as a participant and earn by completing paid tasks, sometimes requiring uninterrupted one-hour blocks. Pay can reach up to $60/hr...Remote jobWork from homeFlexible hours- Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote jobWork from homeFlexible hours
$60 per hour
Prolific is looking for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Specialist. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- software engineering manager remote New York, NY
- remote recruitment consultant New York, NY
- remote data manager New York, NY
- business intelligence analyst remote New York, NY
- benefits specialist remote New York, NY
- junior angular developer remote New York, NY
- remote video game New York, NY
- remote typing work New York, NY