Healthcare Administrative Professional AI Evaluator
$75 per hourOpenTrain AI, Inc.
Use your healthcare administration experience to write prompts and evaluate AI responses for accuracy, relevance, and professional context. This remote U.S. contract role pays up to $75 per hour and offers flexible, primarily asynchronous work. Remote Hourly · $75/hr The work You will help improve AI systems by creating prompts based on healthcare administration workflows and reviewing the responses they produce. Your feedback will focus on whether each response is relevant, accurate, and appropriate for real-world healthcare administrative work. The work is remote and primarily asynchronous. You will work independently as project assignments become available. Write prompts based on healthcare administration tasks and professional language. Review AI responses for relevance, accuracy, and fit with healthcare administration contexts. Use experience from medical office administration, community health work, or related settings. Interpret real-world healthcare administrative tasks and language. What it pays and takes This is a part-time contract role for candidates in the United States. The work requires practical healthcare administration experience and reliable participation in asynchronous AI research projects. Pay: Up to $75 per hour. Time: 20+ hours per week. Location: Remote and open to candidates in the United States. Language: Professional fluency in English. Experience: At least four years in healthcare administration or a related role. Relevant backgrounds include medical secretary, administrative assistant, and community health worker experience. You must be able to work independently and participate reliably in primarily asynchronous work. About AI training work AI training is the human work behind systems that understand and produce text. People write examples and review model responses so AI can become more accurate, useful, and appropriate for professional settings; subject‑matter experience helps reviewers judge that work well. #J-18808-Ljbffr OpenTrain AI, Inc.
- German Voice AI Evaluator (Healthcare Front Desk Conversations) What if your native German fluency could help teach AI how to handle a real... ...data annotation, or QA testing Background in healthcare administration, customer service, or call centre work Familiarity with...SuggestedContract workWork at officeRemote workFlexible hours
- Alignerr is seeking native German speakers in the New York area to evaluate a healthcare AI receptionist by role-playing as a patient and recording conversations. You will assess how well the AI listens, responds, and takes action, then provide structured feedback. This...SuggestedRemote jobContract workFlexible hours
- Aston Carter is seeking a Healthcare Operations AI Trainer to apply real‑world medical coding, billing, and revenue cycle expertise in remote AI training projects. You will evaluate AI outputs, develop rubrics, and identify issues to improve accuracy and compliance across...SuggestedRemote job
- ...experienced Quality & Patient Safety Nurse to contribute to an AI training and evaluation project focused on clinical quality, patient safety, documentation review, adverse-event analysis, and healthcare process improvement. The role involves creating and reviewing complex...SuggestedRemote jobFor contractors
- Medix Staffing Solutions, Inc. seeks licensed healthcare professionals for the role of Clinical AI Specialist / Medical AI Evaluator. This fully remote, 1099 contract position allows you to contribute to evaluating AI models in medical contexts with complete scheduling...SuggestedRemote jobContract work
- ...people. Headway's mission is to fix this by building a new mental healthcare system everyone can access. We started by solving the biggest... ...foundations to enable this at scale, and building much of it with AI. We aren't just a billing layer; we are becoming the platform...
- Turing is seeking a remote contractor in the United States with utilization management nursing expertise to develop AI evaluation tasks and clinical scenarios. The role focuses on creating realistic cases, evaluating model responses and ensuring clinically defensible standards...Remote jobFor contractors
$65 per hour
Prolific is seeking Registered Nurses to help train and evaluate AI models. You will be invited to join as a Domain Expert participant with pay up to $65/hr for completed AI tasks, many requiring about an hour of uninterrupted work. Flexible hours and remote work from home...Remote jobWork from homeFlexible hours- OpenTrain AI, Inc. is seeking a Registered Nurse AI Evaluation Expert to review and create clinical content used to train AI systems. You will apply nursing judgment to ensure accuracy, safety, and clarity across patient education, triage guidance, and clinical documentation...Remote jobPart time
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that... ...Part-time Job function ~ Information Technology, Administrative, and Quality Assurance Industries ~ Technology, Information...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available...Full timePart timeImmediate start
$80 per hour
Develop and map analytic cases to defined taxonomies across multiple evaluation areas. Author complex test cases to evaluate model performance on source handling and analytic rigor. Assess and grade AI-generated responses based on reasoning, source use, and practical...Remote job- Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You...Remote jobFor contractorsFreelanceFlexible hours
- AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak-like prompts, document failures with reproduction steps, and map each incident to the applicable policy clause to enable rapid...Remote jobFor contractors
- Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and...Remote jobWeekly payFor contractorsFlexible hours
- ...Latin America) language specialist to help shape the future of AI by evaluating and challenging language models. You will engage with the... ..., contract-based, and appropriate for mid-senior level professionals with a Master’s or PhD in Spanish linguistics or related field...Remote jobContract work
- Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses. - Location: Remote - Type: Independent contractor / Part-time - Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create high...Part timeFor contractorsRemote work
- Handshake is seeking Tamil-speaking evaluators based in Singapore or Malaysia to help personalize AI responses. This is not a traditional role; you’ll evaluate and rank AI replies to improve future models, working remotely on a flexible, asynchronous, part-time basis....Remote jobPart timeFlexible hours
- Zekai is seeking experienced finance professionals fluent in German to train and evaluate AI agents on realistic professional tasks. You will create and review realistic work within digital workspaces, drafting tasks in German and defining success criteria grounded in German...Remote jobHourly payPart time
- ...to detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability collaboration... ...train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...For contractorsRemote workShift work
$30 - $60 per hour
Frontier AI Lab in the United States is seeking a part-time, contract-based AI Safety & Evaluation Specialist to test and review privacy-related behavior of AI agents. You will test privacy-focused scenarios, report potential disclosures of personal or sensitive data, identify...Remote jobHourly payContract workPart timeFor contractors$129k
Reviews HCP-facing Voice AI sales calls and judges their sales effectiveness, professionalism, messaging, and compliance. The part... ...on experience selling to healthcare professionals.* Contract* Fully... ...responsibilities* Listen to and evaluate AI-led sales calls with healthcare...Contract workPart timeFor contractorsRemote work10 hours per weekFlexible hours- Globik AI is seeking HR and recruitment professionals to evaluate AI-generated hiring, workplace, employee, and talent-management content. You will review AI-driven HR responses, assess usefulness, and identify biased or unsupported recommendations, while ensuring consistency...
- LILT seeks detail-oriented human reviewers to support AI training and evaluation. You will work as an independent contractor across tasks like evaluating prompts, reviewing text, and analyzing multimedia content. Your work depends on applying local cultural context, brand...Remote jobFor contractorsLocal area
- AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model...Remote job
$25 - $35 per hour
Assess how AI-generated versions differ from the original images and document visual... ...graphic design or photo editing, image evaluation, data annotation, image comparison, and... ...OpenTrain AI OpenTrain AI connects experienced professionals with paid, part-time AI training work:...Remote jobHourly payPart timeFor contractorsFlexible hours- LILT is seeking detail-oriented human reviewers with a strong understanding of local cultural context to support a range of AI training and evaluation projects. You will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and...For contractorsLocal areaRemote workFlexible hours
- Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set...Remote jobWeekly payFreelanceFlexible hours
$85 per hour
OpenTrain AI, Inc. is seeking a Process Safety Engineer AI Training Evaluator to review AI-generated content on environmental health and safety, process safety, and energy compliance. This remote, flexible project pays up to $85 per hour and requires strong written communication...Remote jobHourly payFlexible hours- Vettedlance is seeking a meticulous evaluator to rate and rewrite AI model responses in Modern Standard Arabic. You will assess accuracy, fluency and cultural fit, and compare pairs of replies to explain your choices. You will also craft original Arabic prompts and gold...Remote jobHourly payContract workPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Healthcare Administrative Professional AI Evaluator. Be the first to apply!
- human resources operations assistant New York, NY
- administrative assistant remote New York, NY
- operations assistant part time New York, NY
- administrative associate New York, NY
- part-time administrative assistant work from home New York, NY
- administrative assistant no experience New York, NY
- virtual administrative assistant New York, NY
- administrative medical assistant New York, NY
- executive team assistant office manager New York, NY
- temporary admin assistant New York, NY


