Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Healthcare Administrative Professional AI Evaluator

$75 per hour

OpenTrain AI, Inc.

Use your healthcare administration experience to write prompts and evaluate AI responses for accuracy, relevance, and professional context. This remote U.S. contract role pays up to $75 per hour and offers flexible, primarily asynchronous work. Remote Hourly · $75/hr The work You will help improve AI systems by creating prompts based on healthcare administration workflows and reviewing the responses they produce. Your feedback will focus on whether each response is relevant, accurate, and appropriate for real-world healthcare administrative work. The work is remote and primarily asynchronous. You will work independently as project assignments become available. Write prompts based on healthcare administration tasks and professional language. Review AI responses for relevance, accuracy, and fit with healthcare administration contexts. Use experience from medical office administration, community health work, or related settings. Interpret real-world healthcare administrative tasks and language. What it pays and takes This is a part-time contract role for candidates in the United States. The work requires practical healthcare administration experience and reliable participation in asynchronous AI research projects. Pay: Up to $75 per hour. Time: 20+ hours per week. Location: Remote and open to candidates in the United States. Language: Professional fluency in English. Experience: At least four years in healthcare administration or a related role. Relevant backgrounds include medical secretary, administrative assistant, and community health worker experience. You must be able to work independently and participate reliably in primarily asynchronous work. About AI training work AI training is the human work behind systems that understand and produce text. People write examples and review model responses so AI can become more accurate, useful, and appropriate for professional settings; subject‑matter experience helps reviewers judge that work well. #J-18808-Ljbffr OpenTrain AI, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Healthcare Administrative Professional AI Evaluator in New York, NY vacancy
  • German Voice AI Evaluator (Healthcare Front Desk Conversations) What if your native German fluency could help teach AI how to handle a real...  ...data annotation, or QA testing Background in healthcare administration, customer service, or call centre work Familiarity with... 
    Suggested
    Contract work
    Work at office
    Remote work
    Flexible hours

    Alignerr Corp.

    New York, NY
    3 days ago
  • Alignerr is seeking native German speakers in the New York area to evaluate a healthcare AI receptionist by role-playing as a patient and recording conversations. You will assess how well the AI listens, responds, and takes action, then provide structured feedback. This... 
    Suggested
    Remote job
    Contract work
    Flexible hours

    Alignerr Corp.

    New York, NY
    3 days ago
  • Aston Carter is seeking a Healthcare Operations AI Trainer to apply real‑world medical coding, billing, and revenue cycle expertise in remote AI training projects. You will evaluate AI outputs, develop rubrics, and identify issues to improve accuracy and compliance across... 
    Suggested
    Remote job

    Talentify

    New York, NY
    4 days ago
  •  ...experienced Quality & Patient Safety Nurse to contribute to an AI training and evaluation project focused on clinical quality, patient safety, documentation review, adverse-event analysis, and healthcare process improvement. The role involves creating and reviewing complex... 
    Suggested
    Remote job
    For contractors

    Gramian Consulting Group

    New York, NY
    1 day ago
  • Medix Staffing Solutions, Inc. seeks licensed healthcare professionals for the role of Clinical AI Specialist / Medical AI Evaluator. This fully remote, 1099 contract position allows you to contribute to evaluating AI models in medical contexts with complete scheduling... 
    Suggested
    Remote job
    Contract work

    Medix Staffing Solutions, Inc.

    New York, NY
    1 hour ago
  •  ...people. Headway's mission is to fix this by building a new mental healthcare system everyone can access. We started by solving the biggest...  ...foundations to enable this at scale, and building much of it with AI. We aren't just a billing layer; we are becoming the platform... 

    Headway

    New York, NY
    1 day ago
  • Turing is seeking a remote contractor in the United States with utilization management nursing expertise to develop AI evaluation tasks and clinical scenarios. The role focuses on creating realistic cases, evaluating model responses and ensuring clinically defensible standards... 
    Remote job
    For contractors

    Braintrust

    New York, NY
    1 day ago
  • $65 per hour

    Prolific is seeking Registered Nurses to help train and evaluate AI models. You will be invited to join as a Domain Expert participant with pay up to $65/hr for completed AI tasks, many requiring about an hour of uninterrupted work. Flexible hours and remote work from home... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 hour ago
  • OpenTrain AI, Inc. is seeking a Registered Nurse AI Evaluation Expert to review and create clinical content used to train AI systems. You will apply nursing judgment to ensure accuracy, safety, and clarity across patient education, triage guidance, and clinical documentation... 
    Remote job
    Part time

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that...  ...Part-time Job function ~ Information Technology, Administrative, and Quality Assurance Industries ~ Technology, Information... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  •  ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available... 
    Full time
    Part time
    Immediate start

    Braintrust

    New York, NY
    2 days ago
  • $80 per hour

    Develop and map analytic cases to defined taxonomies across multiple evaluation areas. Author complex test cases to evaluate model performance on source handling and analytic rigor. Assess and grade AI-generated responses based on reasoning, source use, and practical... 
    Remote job

    Crossing Hurdles

    New York, NY
    1 day ago
  • Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You... 
    Remote job
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak-like prompts, document failures with reproduction steps, and map each incident to the applicable policy clause to enable rapid... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and... 
    Remote job
    Weekly pay
    For contractors
    Flexible hours

    Recruitment Room

    New York, NY
    1 day ago
  •  ...Latin America) language specialist to help shape the future of AI by evaluating and challenging language models. You will engage with the...  ..., contract-based, and appropriate for mid-senior level professionals with a Master’s or PhD in Spanish linguistics or related field... 
    Remote job
    Contract work

    Invisible Technologies Inc.

    New York, NY
    2 days ago
  • Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses. - Location: Remote - Type: Independent contractor / Part-time - Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create high... 
    Part time
    For contractors
    Remote work

    OpenKrill

    New York, NY
    4 days ago
  • Handshake is seeking Tamil-speaking evaluators based in Singapore or Malaysia to help personalize AI responses. This is not a traditional role; you’ll evaluate and rank AI replies to improve future models, working remotely on a flexible, asynchronous, part-time basis.... 
    Remote job
    Part time
    Flexible hours

    Handshake

    New York, NY
    2 days ago
  • Zekai is seeking experienced finance professionals fluent in German to train and evaluate AI agents on realistic professional tasks. You will create and review realistic work within digital workspaces, drafting tasks in German and defining success criteria grounded in German... 
    Remote job
    Hourly pay
    Part time

    Confidential

    New York, NY
    3 days ago
  •  ...to detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability collaboration...  ...train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    For contractors
    Remote work
    Shift work

    Micro1

    New York, NY
    1 day ago
  • $30 - $60 per hour

    Frontier AI Lab in the United States is seeking a part-time, contract-based AI Safety & Evaluation Specialist to test and review privacy-related behavior of AI agents. You will test privacy-focused scenarios, report potential disclosures of personal or sensitive data, identify... 
    Remote job
    Hourly pay
    Contract work
    Part time
    For contractors

    Remotebridge

    New York, NY
    1 day ago
  • $129k

    Reviews HCP-facing Voice AI sales calls and judges their sales effectiveness, professionalism, messaging, and compliance. The part...  ...on experience selling to healthcare professionals.* Contract* Fully...  ...responsibilities* Listen to and evaluate AI-led sales calls with healthcare... 
    Contract work
    Part time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    We Love AI Jobs

    New York, NY
    11 hours ago
  • Globik AI is seeking HR and recruitment professionals to evaluate AI-generated hiring, workplace, employee, and talent-management content. You will review AI-driven HR responses, assess usefulness, and identify biased or unsupported recommendations, while ensuring consistency... 

    Globik AI

    New York, NY
    3 days ago
  • LILT seeks detail-oriented human reviewers to support AI training and evaluation. You will work as an independent contractor across tasks like evaluating prompts, reviewing text, and analyzing multimedia content. Your work depends on applying local cultural context, brand... 
    Remote job
    For contractors
    Local area

    LILT

    New York, NY
    2 days ago
  • AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model... 
    Remote job

    AuraOne Human Data

    New York, NY
    1 day ago
  • $25 - $35 per hour

    Assess how AI-generated versions differ from the original images and document visual...  ...graphic design or photo editing, image evaluation, data annotation, image comparison, and...  ...OpenTrain AI OpenTrain AI connects experienced professionals with paid, part-time AI training work:... 
    Remote job
    Hourly pay
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    4 days ago
  • LILT is seeking detail-oriented human reviewers with a strong understanding of local cultural context to support a range of AI training and evaluation projects. You will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and... 
    For contractors
    Local area
    Remote work
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier (by Scale AI)

    New York, NY
    4 days ago
  • $85 per hour

    OpenTrain AI, Inc. is seeking a Process Safety Engineer AI Training Evaluator to review AI-generated content on environmental health and safety, process safety, and energy compliance. This remote, flexible project pays up to $85 per hour and requires strong written communication... 
    Remote job
    Hourly pay
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • Vettedlance is seeking a meticulous evaluator to rate and rewrite AI model responses in Modern Standard Arabic. You will assess accuracy, fluency and cultural fit, and compare pairs of replies to explain your choices. You will also craft original Arabic prompts and gold... 
    Remote job
    Hourly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Healthcare Administrative Professional AI Evaluator. Be the first to apply!