Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Radiology QA & AI Evaluation Lead

$175 per hour

Trainpeer

Annapolis, MD
  • Remote job

Remote, part-time contract radiology expert to collaborate with a leading AI lab by writing challenging radiology questions, building rubrics, and providing correct solutions to evaluate LLM performance. Project runs ~2–3 months with 10–40 hrs/week available. US-based MD (top university) and practicing radiologist with 3+ years experience Strong attention to detail and excellent written/verbal communication Ability to author complex radiology Q&A and create scoring rubrics Availability for 10+ hrs/week (up to 40) for 2–3 months; comfortable working fully remote/asynchronous PK/PD Module expert: Translational / Clinical Pharmacology Decision-Maker $175 - $250/hr Seeking a senior translational/clinical pharmacology decision-maker to lead FIH dose rationale, SAD/MAD design, and Phase 2 dose selection, and to codify real-world dosing heuristics into AI-ready decision memos and rubrics. 10+ years in translational/clinical pharmacology (biopharma/biotech or specialized consulting) Personally led FIH starting dose selection plus SAD/MAD escalation for multiple assets Experience with Phase 2 dose selection and exposure–response-driven dose optimization Strong nonclinical-to-clinical translation skills (GLP tox, PK/PD, potency, MoA) Governance/IND experience defending dose/exposure rationale to leadership/regulators; able to write high-quality dose justification memos Able to formalize expert judgment into explicit decision rules/rubrics and articulate unwritten heuristics (including when to override models) Medical Expert (Lab) $130 - $200/hr U.S.-based MDs or Fellows with strong lab-panel expertise are needed to partner with a top AI lab to create and score diagnostic lab cases, helping evaluate and improve medical AI systems. Remote, async contract (20–40 hrs/week) for 3+ months with paid training required. U.S.-based practicing MD or current Fellow Strong experience with medical lab panels and lab-based clinical reasoning 2+ years of clinical experience Excellent English communication and strong analytical/detail orientation Able to work remote/asynchronous and complete paid 2–3 hour training Interest in evaluating and advancing AI in medicine $150 - $200/hr Lead PK/PD and exposure–response modeling to support dose selection by building quantitative plausibility checks and evaluation rubrics that flag non-credible fits and risky extrapolations. Contract, part-time, remote role focused on deliverables like rubrics, “golden” fits, and error taxonomies. 8–12 years in pharmacometrics/quantitative pharmacology (pharma/CRO/consulting) Expert hands-on PK/PD, exposure–response, and population PK modeling (QSP a plus) Strong model fitting/parameter estimation and sensitivity analysis; ability to identify implausible parameter spaces Proficient with NONMEM, Monolix, or equivalent tools Able to assess dose–exposure predictions, detect high-risk extrapolations, and interpret results for translational/clinical decisions Experience designing quantitative model evaluation rubrics/sanity checks, defining failure conditions, and producing “golden” fit examples and error taxonomies #J-18808-Ljbffr Trainpeer

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Radiology QA & AI Evaluation Lead in Annapolis, MD vacancy
  • $146.2k - $261.4k

     ...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER) Division...  ...Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness... 
    Remote work
    Work experience placement
    Work from home

    Employment Opportunities Inc

    Santa Monica, CA
    5 days ago
  • Tanaq Management Services LLC is seeking a Public Health Evaluation Program Manager to lead the Translation, Health Education and Evaluation Branch (THEEB...  ...drives evaluation planning, performance monitoring, and QA across DDT-funded contracts, with national scope and... 
    Remote job

    Tanaq Management Services LLC

    Atlanta, GA
    1 day ago
  • $40 per hour

    DataAnnotation is seeking a Chemistry Instructor to help train AI models in the United States. This position involves providing complex chemistry questions to AI chatbots and evaluating their performance. Ideal candidates should hold a strong knowledge of chemistry and... 
    Remote job
    Hourly pay
    Work from home

    DataAnnotation

    Phoenix, AZ
    4 days ago
  • $40 per hour

    DataAnnotation is seeking an expert Chemistry Instructor to assist in training AI models, specifically evaluating their logic and problem-solving capabilities. This position offers flexibility, allowing work from home and on your own schedule. A solid background in general... 
    Remote job
    Hourly pay
    Work from home

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

    DataAnnotation is seeking a Chemistry Instructor located in the United States to train AI models by evaluating complex chemistry responses from chatbots. The role requires expertise in chemistry, with a flexible work schedule from home and hourly pay starting at $40. You... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    DataAnnotation

    Louisiana, MO
    4 days ago
  • Zones is hiring expert Evaluators in Public health communications to review AI-generated work products for accuracy and rigor. This remote, full-time role involves assessing documents, spreadsheets, and slide decks, and providing structured feedback to improve AI outputs... 
    Remote job
    Full time

    LeaderStat

    Auburn, WA
    1 day ago
  • $50 - $60 per hour

     ...company is seeking an M&A Integration Manager to train AI models. This role involves evaluating AI chatbots and improving their logic and performance....  ...financial analysis and modeling. This position offers flexible remote work and a competitive hourly pay range of $50-$60.... 
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Nashville, TN
    1 day ago
  • DataAnnotation is seeking a Corporate Attorney to assist in training AI models by providing legal expertise and evaluating chatbot responses. This independent contractor position offers flexible project selection, allowing you to work from home at your own schedule. The... 
    Remote job
    Hourly pay
    For contractors
    Work from home
    Flexible hours

    DataAnnotation

    Nashville, TN
    2 days ago
  • $80 per hour

     ...thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent...  ...to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects... 
    Remote work
    Flexible hours

    Mind Rift

    New York, NY
    4 days ago
  • $60 per hour

     ...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors... 
    Remote work
    Freelance

    Mind Rift

    Austin, TX
    4 days ago
  • $60 per hour

     ...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and...  ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define... 
    Remote work
    Part time
    Flexible hours

    Mind Rift

    Kansas City, MO
    5 days ago
  • $80 per hour

    Mercor is seeking a Coding Manager to lead our coding operations in San Francisco. The...  ...inpatient coding. This role involves evaluating AI-generated coding assignments, conducting...  ...offers competitive compensation of $80/hour and is remotely located. #J-18808-Ljbffr Mercor
    Remote job

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Role: Sr./Lead SDET (QA Automation) Location: 100% Remote Project Duration: Until December Total Experience Required: 10+ years...  ...upgrade existing ones as needed. Contribute to AI-driven QA automation strategies. Work with Observability... 
    Remote work

    Spruce Infotech

    United States
    3 days ago
  • $55 per hour

    A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention to...  ...review tasks and define clear standards. This remote, flexible opportunity offers rates up to $5... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    2 days ago
  • $40 per hour

    A leading AI research firm is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbot outputs and improve their performance. This remote role offers flexibility in project selection and work schedules, along with hourly payment starting at $40+, plus potential... 
    Remote work
    Hourly pay

    DataAnnotation

    United States
    5 days ago
  • $80 per hour

    A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This...  .... Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and defining...  ...With rates up to $80/hour, this flexible remote position allows candidates to influence... 
    Remote job
    Flexible hours

    Mindrift

    Phoenix, AZ
    2 days ago
  • $80 per hour

    A tech company specializing in AI is seeking QAs for autonomous AI agents to validate...  ...opportunity allows contributors to work remotely while engaging in a complex AI project. Ideal...  ...to detail, facilitating AI testing and evaluation without needing a coding background. The... 
    Remote job
    Flexible hours

    Mind Rift

    Houston, TX
    11 hours ago
  • Mercor is seeking a Program management / implementation planning Evaluator to assess AI-generated materials for quality assurance. The ideal...  ...proficiency in Microsoft Office and Google Workspace. This remote position involves providing structured feedback on AI outputs... 
    Remote job
    Contract work
    Work at office

    Mercor Inc

    San Francisco, CA
    11 hours ago
  • A technology consulting firm in Canada seeks an AI QA Trainer for LLM Evaluation. This remote role involves evaluating large-scale language models through testing and improvement processes. The ideal candidate will have experience in QA for ML systems, strong programming... 
    Remote job
    Hourly pay

    Invisible Expert Marketplace

    New York, NY
    2 days ago
  • $55 per hour

    A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the...  ...systems and scenarios. This flexible, remote project is ideal for those with excellent...  ...to detail. Candidates should be adept at evaluating scenarios and documenting findings. The... 
    Remote job
    Flexible hours

    Mindrift

    Dallas, TX
    1 day ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to join our Expert Network to help train AI models using real design expertise. This role involves evaluating AI-generated designs, auditing accessibility, and validating UX principles. The successful candidate will... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Virginia Beach, VA
    1 day ago
  • DataAnnotation seeks a Retail Banking Product Manager to enhance AI models used in finance. The ideal candidate will review AI...  ...degrees in finance and proficiency in financial analysis and data evaluation. This role offers hourly pay starting at $50-$60 with potential... 
    Remote job
    Hourly pay
    Work from home

    DataAnnotation

    New York, NY
    2 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    3 days ago
  • A leading AI evaluation firm in the United Kingdom is seeking an AI QA Trainer to enhance the reliability of large-scale language models. This mid-senior level contractor role involves designing and executing test plans while ensuring factual accuracy in model assessments... 
    Remote job
    Hourly pay
    For contractors

    Invisible Expert Marketplace

    New York, NY
    2 days ago
  • $80 per hour

    A leading AI consultancy in the United States is seeking Quality Assurance professionals to validate and improve autonomous AI agents. You will analyze complex systems, evaluate task structures, and ensure logical consistency through detailed reviews. Ideal candidates possess... 
    Remote job
    Hourly pay
    Flexible hours

    Mindrift

    Providence, RI
    4 days ago
  • Obsidian is seeking experienced Evaluators specializing in Investor materials, pitchbooks, and fundraising to review AI-generated work for quality and accuracy. This remote engagement requires expertise in assessing documents, spreadsheets, and slide decks. Ideal candidates... 
    Remote work
    Work at office

    Obsidian

    New York, NY
    4 days ago
  • Mercor, headquartered in San Francisco, is looking for a Public-sector procurement / RFI response Evaluator. In this remote position, you will evaluate AI-generated artifacts against quality standards and provide structured feedback. Applicants should have over 5 years... 
    Remote job
    Work at office
    Flexible hours

    Mercor

    San Francisco, CA
    11 hours ago
  • $40 per hour

    A technology-focused company is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbots based on complex chemistry questions. This remote position allows for flexible scheduling and project selection. Applicants must have a PhD in Chemistry and a strong... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Raleigh, NC
    2 days ago
  • Obsidian is seeking expert Evaluators in Privacy / regulatory compliance to review AI-generated work products for accuracy and quality. The role is remote and requires 5+ years of relevant experience along with proficiency in Microsoft Office and Google Workspace. As an... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    11 hours ago
  • $20 per hour

    A technology company specializing in AI is seeking a Receptionist to evaluate and enhance AI chatbot models. This remote position offers flexibility in choosing projects and scheduling, with compensation starting at $20 per hour plus bonuses for exceptional performance.... 
    Remote job
    Hourly pay

    DataAnnotation

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Radiology QA & AI Evaluation Lead. Be the first to apply!