Evaluation Specialist
AI Trainer Jobs
AuraOne is seeking a Spanish Language Expert to remotely review Spanish prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. This is a contractor role with hourly pay to be confirmed after the interview. You will work asynchronously for at least 10 hours per week, across multi-page rubrics. Ideal candidates have evaluation or annotation experience with Spanish language content and a keen eye for detail, #J-18808-Ljbffr AI Trainer Jobs
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Evaluation Specialist in New York, NY vacancy
$90.58k - $114.59k
Position InformationNY HELP: YesAgency: Mental Health, Office ofTitle: Mental Hygiene Program Evaluation Specialist 3 (NY HELPS), Kingsboro Psychiatric Center, P27987Occupational Category: Health Care, Human/Social ServicesSalary Grade: 23Bargaining Unit: PS&T - Professional...SuggestedPermanent employmentFull timeWork at officeRemote workState of New York, USA
New York, NY4 days ago$50 per hour
...Spanish (Mexico) Audio Evaluation Specialist is a remote evaluation track for reviewing spanish generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...SuggestedFor contractorsRemote work10 hours per weekAI Trainer Jobs
New York, NY4 days ago$20 - $40 per hour
AI Trainer Jobs seeks remote Swift Evaluators to review swift evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining to improve model quality. This remote contractor...SuggestedRemote jobHourly payFor contractors- AuraOne is seeking an OCR and Document Understanding Model Evaluator for a remote evaluation track. Reviewers assess document annotation prompts and responses against a quality rubric, labeling edge cases and providing structured feedback for retraining. You will compare...SuggestedRemote jobFor contractors
- AuraOne is seeking an experienced remote contractor to evaluate instruction tuning reward model outputs according to a versioned rubric. You will compare paired responses, label edge cases, and write structured feedback for the modeling team to retrain. Responsibilities...SuggestedRemote jobHourly payFor contractors
- AuraOne is seeking a Voice Actor: CX Agent Voice Cloning (Indonesian Bahasa - Female) for a remote evaluation track reviewing prompts and responses against our quality rubric. Reviewers label edge cases and provide structured feedback for retraining. You will compare paired...Remote jobFor contractors10 hours per week
- Weekday 1 is seeking analytical professionals to evaluate AI-generated responses across a variety of topics in a fully remote contractor role. You will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback to...For contractorsRemote workWeekday work
- AI Trainer Jobs is seeking a Portuguese Audio Recording Expert (Portugal) for a remote evaluation track. You will review prompts and responses, compare outputs, and provide structured feedback to retrain models. As an independent contractor, you will label edge cases,...Remote jobHourly payFor contractors
- micro1 is seeking Humanities Evaluation Specialists to support an AI training project. Remote contractors will craft challenging humanities questions, verify sources, and design prompts that demand deep interpretation and analytical reasoning. The role involves evaluating...Remote jobFor contractors
$90.58k - $114.59k
The State of New York - Mental Health, Office of, at Kingsboro Psychiatric Center, seeks a Mental Hygiene Program Evaluation Specialist 3 for NY HELPS. This full-time role evaluates mental health programs, analyzes data, and supports evidence-based improvements within a...Permanent employmentFull timeWork at office- Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior...Hourly payFor contractorsRemote work10 hours per week
- AuraOne seeks a Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) for a remote evaluation track to review Hindi prompts and responses against our quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback for retraining...Remote jobFor contractors
- ...contractor, you’ll work asynchronously, roughly 10 hours per week, with hourly compensation discussed after interview. Remote work available for US-eligible candidates; prior evaluation, annotation, or Uyghur bilingual experience is highly #J-18808-Ljbffr AI Trainer JobsRemote jobHourly payFor contractors10 hours per week
- micro1 is seeking Humanities Evaluation Specialists to support an AI training project requiring research, critical analysis, question development, and evaluation. No prior AI experience is required. As a remote contractor, you will create challenging humanities questions...Remote jobFor contractors
- AuraOne is seeking a Tongan Bilingual Expert for a remote evaluation track to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model. As a remote contractor, you will...Remote jobFor contractors
- AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with...Remote jobFor contractors
- ...feedback to retrain models. This is a remote, contractor-based position with US eligibility considerations. The role emphasizes meticulous evaluation, consistent rubric application, and the ability to name issues clearly with rationale. #J-18808-Ljbffr AI Trainer JobsRemote jobFor contractors
- YO AI Labs seeks a Humanities Evaluation Specialist to support an AI training project entirely remotely. You will create challenging humanities questions and high-quality answers, and research using authoritative sources with proper citations. Design prompts that require...Remote job
- AI Trainer Jobs seeks a Generalist - English & Telugu evaluator to review prompts and responses from AuraOne's data-labeling rubric. You will compare outputs, label edge cases, and provide structured feedback for model retraining. Applicants should have prior evaluation...Remote jobFor contractors10 hours per weekFlexible hours
- AuraOne is seeking remote evaluators to review exocentric video recorder outputs and judge them against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. This contractor role emphasizes written...For contractorsRemote work
- AI Trainer Jobs is seeking a Hindi Audio Recording Expert for a remote evaluation track. You will review Hindi prompts and responses against AuraOne's rubric, compare paired outputs, label edge cases, and provide structured feedback to retrain models. You will help turn...Remote job10 hours per week
- Humanities Evaluation Specialist role for a remote contractor project. The specialist will create rigorous humanities questions, verify sources, and craft prompts that require deep interpretation and analytical reasoning. You will evaluate AI-generated responses for accuracy...Remote jobContract workFor contractors
$85 per hour
Open Source Issue Evaluation Specialist is a remote review track for evaluating AI outputs across open source issue evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document...Hourly payFor contractorsWork experience placementRemote work10 hours per week- ...compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking a Cantonese Bilingual Expert for a remote evaluation track. Reviewers compare cantonese prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model. This contractor role offers hourly...Remote jobHourly payFor contractors10 hours per weekFlexible hours
- AuraOne is seeking a Meeting Audio Conversation Evaluator for a remote contractor role. You will review audio annotation prompts and responses, label edge cases, and provide structured feedback to help retrain the model. Evaluate outputs against a quality rubric and document...Remote jobFor contractors
- AuraOne is seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and label issues using a versioned rubric to aid retraining. This role focuses on assessing pronunciation, voice quality, and conversation...Remote job
- ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...Full timeRemote work
- AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining. You will work as a contractor, reviewing...Remote jobFor contractors
$45 - $70 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Behavioral Health Expert, AI Safety and Model Evaluation Type: Contract Compensation: $45–$70/hour Location: Remote Commitment: 20–40 hours/week Role...Contract workSummer workRemote workWeekday workMercor
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!
Related searches
- senior safety specialist New York, NY
- reentry specialist New York, NY
- grocery specialist New York, NY
- localization specialist New York, NY
- agency management specialist New York, NY
- restaurant specialist New York, NY
- outreach specialist New York, NY
- renovation specialist New York, NY
- generation specialist New York, NY
- senior program specialist New York, NY