Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Medical Translation AI Evaluator

AuraOne, Inc.

Medical Translation AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap. Why this role matters Clinical review AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows. Responsibilities Review AI outputs against current clinical review clinical guidelines and standard of care for Medical Translation AI Evaluator assignments. Grade differential reasoning, dosing, and red-flag handling on a structured rubric. Flag patient-safety issues with severity tags that match clinical-incident taxonomies. Capture the corrected clinical reasoning so the modeling team can train on it. Adjudicate disputed cases against published evidence or specialty guidelines. Maintain reviewer-quality scores in weekly inter-rater calibration cycles. Qualifications Active or recent license / board certification in clinical review or an adjacent specialty for Medical Translation AI Evaluator work. Hands-on clinical experience reading patient cases and writing structured assessments. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that cites guidelines, evidence, or standard of care. Reliable async availability for at least 10 hours per week. Example tasks Grade a model's differential-diagnosis reasoning on a clinical review case and write a 2-3 sentence assessment. Flag a dosing miscalculation with the right severity tag and corrected dose. Adjudicate a disputed case between two reviewers using current specialty guidelines. Audit a 25-case batch for rubric consistency and report drift to the program lead. Nice to have Prior work as a guideline reviewer, peer reviewer, or clinical educator. Familiarity with AI-assisted clinical decision support and its failure modes. Bilingual clinical experience for non-English patient cases. Skills Clinical reasoning Guideline review Patient-safety assessment Structured clinical writing Clinical review Localization review Cultural context Language evaluation Medical Translation Work model Remote - US-eligible. Remote, Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation Hourly rate confirmed after the interview process. Application process Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement. Active or recent license / board certification in clinical review or an adjacent specialty for Medical Translation AI Evaluator work. Hands-on clinical experience reading patient cases and writing structured assessments. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that cites guidelines, evidence, or standard of care. Reliable async availability for at least 10 hours per week. #J-18808-Ljbffr AuraOne, Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Medical Translation AI Evaluator in New York, NY vacancy
  • $15 - $35 per hour

    Volga Partners is seeking Medical AI Evaluators who are currently pursuing medical education or completing supervised clinical training in General Practice, Family Medicine, Internal Medicine, NP, or PA pathways. You will evaluate AI interpretations of medical scenarios... 
    Medical
    Remote job
    Hourly pay
    For contractors
    Traineeship
    Flexible hours

    Volga Partners

    New York, NY
    2 days ago
  • $70 per hour

    Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. We’re seeking US-...  ...) to evaluate clinical EHR vignettes for our medical AI evaluation program, primarily in general and... 
    Medical
    Hourly pay
    Permanent employment
    Part time

    Mindrift

    New York, NY
    2 days ago
  • Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20-40 hours per week with at least 4 hours overlap during PST business hours... 
    Medical
    Remote job
    Part time
    For contractors

    Crossing Hurdles

    New York, NY
    8 hours ago
  • $18 per hour

     ...Flexible schedule, approximately 10-15 total hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance Qualifications: Native-level fluency... 
    Suggested
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    23 hours ago
  • $18 per hour

    AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible...  ...Ideal for professionals with experience in linguistics, translation, localization, or related language-focused fields. What... 
    Suggested
    Remote job
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    New York, NY
    23 hours ago
  • $18 per hour

    Description: Interact with an AI assistant in Telugu. Translate English prompts into Telugu and use them to interact with the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality... 
    Hourly pay
    Temporary work
    Freelance
    Immediate start
    Remote work
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • Mercor is seeking experienced Medical and Health Services Managers to evaluate and improve AI-generated healthcare operations content and workflows. You will leverage your expertise in directing clinical services, personnel, budgets, and compliance across healthcare facilities... 
    Medical

    Mercor

    New York, NY
    3 days ago
  • Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignettes with questions, score reasoning quality, and provide concise rationales. This is a part-time, project-based opportunity focused on... 
    Medical
    Part time

    Mindrift

    New York, NY
    3 days ago
  • $37.5 per hour

     ...looking to create a golden data set for AI generated ad copy for various advertisers...  ...In this role you will be responsible for evaluating advertising copy generated by a large language...  ...role may include the following: Medical, dental & vision Critical Illness, Accident... 
    Medical
    Contract work
    Temporary work
    Remote work

    TEKsystems

    New York, NY
    2 days ago
  • $70 per hour

    Mindrift invites US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Participation is part-time and project-based, with tasks centered on diagnosing and treating multiple systems and scoring reasoning quality across blind reads.... 
    Medical
    Hourly pay
    Part time

    Mindrift

    New York, NY
    2 days ago
  • Job Profile Evaluate AI-generated surgical content for procedural, anatomical, and clinical accuracy. Review pre/post-operative protocols and decision-making, flag patient safety risks, and validate outputs against surgical research and clinical guidelines. Desired Candidate... 
    Medical
    Freelance

    Biz Tech Consultants

    New York, NY
    3 days ago
  • $130 per hour

    Turing is seeking US-based dermatologists to review AI-generated dermatology content for accuracy and safety. You will analyze medical images and case summaries, offering structured feedback to improve AI performance. A strong dermatology background and US licensure are... 
    Medical
    Hourly pay
    Contract work
    Part time

    Braintrust

    New York, NY
    3 days ago
  • Mercor is seeking experienced MDs or DOs to evaluate health AI models remotely in the United States. You will review outputs across diagnoses...  ...care workflows, and provide structured feedback to ensure medical accuracy and safety. The role requires an active US license,... 
    Medical
    Remote job
    Part time
    For contractors

    Benture

    New York, NY
    23 hours ago
  • Crossing Hurdles is seeking Medical Experts to review AI-generated medical content remotely on a part-time basis. The role requires an MD or equivalent and US medical licensure, with at least 1 year post-residency experience. You will assess diagnoses, treatment plans,... 
    Medical
    Remote job
    Contract work
    Part time

    Crossing Hurdles

    New York, NY
    4 days ago
  • $160k - $210k

    BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products Location New York Business Area Product...  ...(exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k... 
    Medical
    Price work
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    23 hours ago
  • $75k - $80k

     ...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized...  ..., based on the results of the IVAP assessments and other medical, mental health, substance abuse and psychosocial assessments.... 
    Medical

    Fedcap Rehabilitation Services

    New York, NY
    4 days ago
  • What You’ll Do T he Vocational Evaluator is responsible for the timely completion of a comprehensive Individual Vocational Assessment and...  ...jobs/job families, based on the results of the IVAP and other medical, mental health, substance abuse, and psychosocial assessments.... 
    Medical

    The Fedcap Group

    New York, NY
    23 hours ago
  •  ...seeking a Part-Time Clinician (Nurse Practitioner or Physician Assistant) to provide in-home health evaluations. Visiting members in their own homes, you will review medical history, perform a physical exam and support gaps in care. Visits last about 45 minutes, with... 
    Medical
    Part time

    8205 Signify Health Medical Associates, PLLC

    New York, NY
    1 day ago
  • $125.1k - $208.5k

    LSEG Evaluated Pricing Service is an independent, global evaluated pricing source covering over 3.0 million fixed income securities and...  ...includes offerings of: Annual Wellness Allowance, Paid time‑off, Medical, Dental, Vision, Flex Spending & Health Savings Options,... 
    Medical
    Part time
    Internship

    LSEG (London Stock Exchange Group)

    New York, NY
    3 days ago
  • $30 - $41.5 per hour

     ...Health SCHEDULE: Rotating SUMMARY Provides emergency mental health evaluations, crisis intervention, milieu management and dispositional...  ..., religion, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity or expression... 
    Medical
    Hourly pay
    Daily paid
    Work at office
    Local area
    Immediate start
    Flexible hours

    105 Unity Hospital of Rochester

    New York, NY
    8 hours ago
  • $155 per hour

    Position: Medical Experts - General Physician Type: Contract Compensation: $155/h Location: Remote Commitment...  ...overlap during PST Role Responsibilities Review AI-generated medical text for accuracy and completeness Evaluate diagnoses and treatment plans for medical cases... 
    Medical
    Remote job
    Contract work
    Part time

    Crossing Hurdles

    New York, NY
    4 days ago
  • $125.1k - $208.5k

    Evaluator, Securitized Products page is loaded## Evaluator, Securitized Productslocations: USA-New York-28 Liberty Streettime type: Full...  ...includes offerings of: Annual Wellness Allowance, Paid time-off, Medical, Dental, Vision, Flex Spending & Health Savings Options,... 
    Medical
    Part time
    Internship

    London Stock Exchange Group

    New York, NY
    2 days ago
  • RWS is seeking a part-time, remote Search Quality Rater to help improve AI-driven search results. You will evaluate queries and provide feedback on text, audio, images, and videos to refine data used by leading search engines and platforms. This role offers a flexible schedule... 
    Remote job
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm policies. You will grade tone, escalation logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor... 
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    AuraOne, Inc.

    New York, NY
    1 day ago
  • SaidGig seeks a life sciences task designer to help train future AI systems by creating expert-level evaluation tasks from authentic research artifacts. You will craft problems that require multi-step reasoning and rigorous rubrics, testing AI agents on real data and protocols... 
    Remote job
    Contract work

    SaidGig

    New York, NY
    23 hours ago
  • Innodata India seeks skilled Audio Speech Evaluators Experts to assess speech quality and conversational performance with an AI bot, following established guidelines. Candidates should be near-native English speakers with strong listening and analytical skills, capable... 

    Innodata India

    New York, NY
    1 day ago
  • AuraOne, Inc. seeks a Medicine Expert (MD) for a remote clinical-review track evaluating AI outputs in clinical review. You will grade differential reasoning, dosing logic, and guideline adherence, flag patient-safety issues, and document corrected reasoning to train the... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    1 day ago
  • $30 per hour

     ...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems...  ...stakeholders. Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    1 day ago
  • $20 - $26 per hour

    Prolific seeks fluent Marathi speakers to act as evaluators, listening to AI-generated audio and comparing text and voice snippets to assess naturalness...  ...0-$26. Candidates may have backgrounds in linguistics or translation, and must have a quiet workspace and a PayPal account for... 
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    New York, NY
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Medical Translation AI Evaluator. Be the first to apply!