Health & Fitness AI Evaluator: Safety & Quality
Revelo
Revelo is seeking a Health & Fitness Specialist in LLM Training to evaluate AI-generated health, wellness, and exercise content for safety, accuracy, and quality. You will analyze prompts and responses to ensure alignment with exercise science and medical standards. This freelance, flexible, part-time role involves safety audits, comparative assessments, and writing brief rationales for chosen outputs, helping AI models improve in health domains. Remote work possible within the United States. #J-18808-Ljbffr Revelo
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Health & Fitness AI Evaluator: Safety & Quality in New York, NY vacancy
- OpenTrain AI, Inc. is seeking a Registered Nurse AI Evaluation Expert to review and create clinical content used to train AI systems. You will apply nursing judgment to ensure accuracy, safety, and clarity across patient education, triage guidance, and clinical documentation...QualityRemote jobPart time
- Gramian Consultancy is seeking an experienced Quality & Patient Safety Nurse to contribute to an AI training and evaluation project focused on clinical quality, patient safety, documentation review, adverse-event analysis, and healthcare process improvement. The role involves...QualityRemote jobFor contractors
- ...Energetic Materials Explosives Engineering AI Safety Hazmat Safety What this pays Rates are... ...stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US... ...research, technical review, or quality assurance is a plus. Candidates may qualify...QualityHourly payContract workFor contractorsRemote work
- ...with utilization management nursing expertise to develop AI evaluation tasks and clinical scenarios. The role focuses on creating... ...build longitudinal clinical tasks, assess documentation quality and patient safety, and calibrate rubrics across fast-paced review cycles....QualityRemote jobFor contractors
$70 per hour
Mindrift invites US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Participation is part-time and project-based... ...and treating multiple systems and scoring reasoning quality across blind reads. Compensation is task-based, up to $...QualityHourly payPart time$85 per hour
Process Safety Engineer AI Training Evaluator Review AI-generated content on EHS, process safety, and energy compliance using your professional experience... ...and assess AI-generated content about environmental health and safety, process safety, and energy compliance. Review...Hourly payContract workRemote workFlexible hours- Sword Health is seeking a QA-focused software tester to join our AI-driven product teams. You’ll design and execute test plans across mobile, backend, APIs, and AI features, ensuring quality and safety in clinical workflows. You’ll collaborate early in discovery, translate...Quality
- Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and...Remote jobWeekly payFor contractorsFlexible hours
$20 - $160 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...and Jack Dorsey . Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour...QualityContract workSummer workRemote work$60 - $70 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: AI Safety Practitioner Type: Contract... ...Role Responsibilities Evaluate AI-generated responses for safety... ...compliance, and overall quality. Review content involving misinformation...QualityContract workSummer workRemote work$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology... ...companies to provide datasets that are high-quality, ethically sourced, relevant, diverse,... ...a flexible, remote job that can easily fit around other commitments. Pay Rate:...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY3 days ago- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance... ...prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs... ...can use to retrain. Why this role matters AI data reviewers help turn pharmacovigilance...QualityHourly payFor contractorsRemote work10 hours per week
AuraOne, Inc.
New York, NY15 hours ago - ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini... ...on your experience as an everyday user. Assess response quality and provide feedback following the study’s guidelines....QualityFull timePart timeImmediate start
Braintrust
New York, NY2 days ago $35 - $45 per hour
ManpowerGroup seeks a Bilingual Linguist (Spanish/English) for expert evaluation of AI outputs. This remote, part-time role offers 20 hours per week... ...responses, MT output, and speech transcripts for linguistic quality, cultural appropriateness, and consistency with terminology,...QualityRemote jobHourly payPart time$156k - $227k
Lead frontier safety post deployment testing strategy and execution... ...organization.Experience working with AI or in an AI lab/startup... ...and implementing testing and evaluations of cutting edge AI systems.Demonstrated... ...and accelerate high-quality product innovation for billions...QualityGoogle
New York, NY3 days ago- AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against... ...calibrate scores weekly to maintain high reviewer quality. Applicants must be able to work asynchronously...QualityRemote jobFor contractors
- OpenTrain AI, Inc. is seeking an Education Professional AI Response Evaluator. This remote, contract, part-time role involves creating education-focused prompts and... ...education and archival contexts to judge language quality and real-world task performance. Candidates in...QualityRemote jobContract workPart time
- ...fails and explain why, as well as review other experts' items for quality and difficulty. The role is remote and hourly, part-time with... ...English writing and LaTeX fluency are required to produce clear, publishable materials for AI evaluation. #J-18808-Ljbffr VettedlanceQualityRemote jobHourly payPart time10 hours per week
- AuraOne is seeking a remote evaluation contractor to review Gmail and Google Calendar AI Assistant outputs against our quality rubric. You will label issues, compare responses, and contribute structured feedback to help retrain the model. This role requires strong attention...QualityRemote jobHourly payFor contractors10 hours per week
- Anyone AI Inc. is seeking multilingual coding experts to evaluate AI-generated responses on a part-time remote contract lasting up to 3 months. This opportunity... ...technical content for clarity, correctness, and quality, validating JSON structure and giving actionable guidance...QualityRemote jobContract workPart time
- Remotebridge is seeking Cantonese Language Evaluators to join a remote contractor team. You... ...evaluate Cantonese text and speech to train AI systems, providing feedback and... ...internal systems and contribute to high-quality language data processes. Ideal candidates...QualityRemote jobFor contractors
- AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm... ...policies. You will grade tone, escalation logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor...QualityRemote jobFor contractors10 hours per weekFlexible hours
- Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted... ...status. You will contribute to high-quality datasets for models, design role-...QualityRemote jobFor contractorsFreelanceFlexible hours
- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality rubric. You will label edge cases, provide structured feedback, and inform retraining efforts through precise rationale. The role supports a contractor...QualityRemote jobFor contractors
- ...is seeking native Dutch speakers for a remote contract role to evaluate AI-powered healthcare receptionist interactions. You will role-... ...mispronunciations and incorrect function calls, and use detailed labeling guidelines to ensure high-quality evaluations. #J-18808-Ljbffr AlignerrQualityRemote jobContract workFlexible hours
- BAM Ventures is seeking contract, remote Japanese Language Evaluators to assess AI-generated content with keen attention to naturalness, alignment... .... You will review outputs in Japanese for consistency and quality, ensuring messages are culturally appropriate and factual....QualityRemote jobContract workImmediate start
- ...seeking Mandarin-speaking experts for a 4-week remote language evaluation project. You will evaluate AI-generated Mandarin content, write and rewrite prompts, and refine responses to improve dataset quality. This is a freelance contract with flexible weekly hours and no...QualityRemote jobContract workFreelanceWork from homeFlexible hours
- Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts up to 3 months and supports frontier... ...and technical content for clarity, correctness, and quality. Validate JSON structure and provide clear feedback...QualityRemote jobContract workPart timeFor contractors
- Remolity, Inc. is seeking experienced professionals to evaluate business presentation slide decks for AI training. This remote study pays weekly and targets high-quality corporate communication and slide design. You will review decks, compare their clarity and structure...QualityRemote jobWeekly pay
- AuraOne, Inc. is seeking a Pharmacovigilance Safety Evaluator for a remote, contractor role. You will review model outputs against a rubric, label edge cases, and provide structured feedback to retrain the system. The work requires clear written reasoning and reliable...QualityRemote jobFull timeFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Health & Fitness AI Evaluator: Safety & Quality. Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY