Remote Radiology QA & AI Evaluation Lead
$175 per hourTrainpeer
- Remote job
Remote, part-time contract radiology expert to collaborate with a leading AI lab by writing challenging radiology questions, building rubrics, and providing correct solutions to evaluate LLM performance. Project runs ~2–3 months with 10–40 hrs/week available. US-based MD (top university) and practicing radiologist with 3+ years experience Strong attention to detail and excellent written/verbal communication Ability to author complex radiology Q&A and create scoring rubrics Availability for 10+ hrs/week (up to 40) for 2–3 months; comfortable working fully remote/asynchronous PK/PD Module expert: Translational / Clinical Pharmacology Decision-Maker $175 - $250/hr Seeking a senior translational/clinical pharmacology decision-maker to lead FIH dose rationale, SAD/MAD design, and Phase 2 dose selection, and to codify real-world dosing heuristics into AI-ready decision memos and rubrics. 10+ years in translational/clinical pharmacology (biopharma/biotech or specialized consulting) Personally led FIH starting dose selection plus SAD/MAD escalation for multiple assets Experience with Phase 2 dose selection and exposure–response-driven dose optimization Strong nonclinical-to-clinical translation skills (GLP tox, PK/PD, potency, MoA) Governance/IND experience defending dose/exposure rationale to leadership/regulators; able to write high-quality dose justification memos Able to formalize expert judgment into explicit decision rules/rubrics and articulate unwritten heuristics (including when to override models) Medical Expert (Lab) $130 - $200/hr U.S.-based MDs or Fellows with strong lab-panel expertise are needed to partner with a top AI lab to create and score diagnostic lab cases, helping evaluate and improve medical AI systems. Remote, async contract (20–40 hrs/week) for 3+ months with paid training required. U.S.-based practicing MD or current Fellow Strong experience with medical lab panels and lab-based clinical reasoning 2+ years of clinical experience Excellent English communication and strong analytical/detail orientation Able to work remote/asynchronous and complete paid 2–3 hour training Interest in evaluating and advancing AI in medicine $150 - $200/hr Lead PK/PD and exposure–response modeling to support dose selection by building quantitative plausibility checks and evaluation rubrics that flag non-credible fits and risky extrapolations. Contract, part-time, remote role focused on deliverables like rubrics, “golden” fits, and error taxonomies. 8–12 years in pharmacometrics/quantitative pharmacology (pharma/CRO/consulting) Expert hands-on PK/PD, exposure–response, and population PK modeling (QSP a plus) Strong model fitting/parameter estimation and sensitivity analysis; ability to identify implausible parameter spaces Proficient with NONMEM, Monolix, or equivalent tools Able to assess dose–exposure predictions, detect high-risk extrapolations, and interpret results for translational/clinical decisions Experience designing quantitative model evaluation rubrics/sanity checks, defining failure conditions, and producing “golden” fit examples and error taxonomies #J-18808-Ljbffr Trainpeer
$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER) Division... ...Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness...Remote workWork experience placementWork from home- Tanaq Management Services LLC is seeking a Public Health Evaluation Program Manager to lead the Translation, Health Education and Evaluation Branch (THEEB... ...drives evaluation planning, performance monitoring, and QA across DDT-funded contracts, with national scope and...Remote job
$40 per hour
DataAnnotation is seeking a Chemistry Instructor to help train AI models in the United States. This position involves providing complex chemistry questions to AI chatbots and evaluating their performance. Ideal candidates should hold a strong knowledge of chemistry and...Remote jobHourly payWork from home$40 per hour
DataAnnotation is seeking an expert Chemistry Instructor to assist in training AI models, specifically evaluating their logic and problem-solving capabilities. This position offers flexibility, allowing work from home and on your own schedule. A solid background in general...Remote jobHourly payWork from home$40 per hour
DataAnnotation is seeking a Chemistry Instructor located in the United States to train AI models by evaluating complex chemistry responses from chatbots. The role requires expertise in chemistry, with a flexible work schedule from home and hourly pay starting at $40. You...Remote jobHourly payWork from homeFlexible hours- Zones is hiring expert Evaluators in Public health communications to review AI-generated work products for accuracy and rigor. This remote, full-time role involves assessing documents, spreadsheets, and slide decks, and providing structured feedback to improve AI outputs...Remote jobFull time
$50 - $60 per hour
...company is seeking an M&A Integration Manager to train AI models. This role involves evaluating AI chatbots and improving their logic and performance.... ...financial analysis and modeling. This position offers flexible remote work and a competitive hourly pay range of $50-$60....Remote jobHourly payFull timePart timeFlexible hours- DataAnnotation is seeking a Corporate Attorney to assist in training AI models by providing legal expertise and evaluating chatbot responses. This independent contractor position offers flexible project selection, allowing you to work from home at your own schedule. The...Remote jobHourly payFor contractorsWork from homeFlexible hours
$80 per hour
...thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote workFlexible hours$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors...Remote workFreelance$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote workPart timeFlexible hours$80 per hour
Mercor is seeking a Coding Manager to lead our coding operations in San Francisco. The... ...inpatient coding. This role involves evaluating AI-generated coding assignments, conducting... ...offers competitive compensation of $80/hour and is remotely located. #J-18808-Ljbffr MercorRemote job- ...Role: Sr./Lead SDET (QA Automation) Location: 100% Remote Project Duration: Until December Total Experience Required: 10+ years... ...upgrade existing ones as needed. Contribute to AI-driven QA automation strategies. Work with Observability...Remote work
$55 per hour
A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention to... ...review tasks and define clear standards. This remote, flexible opportunity offers rates up to $5...Remote jobPart timeFlexible hours$40 per hour
A leading AI research firm is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbot outputs and improve their performance. This remote role offers flexibility in project selection and work schedules, along with hourly payment starting at $40+, plus potential...Remote workHourly pay$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This... .... Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and defining... ...With rates up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$80 per hour
A tech company specializing in AI is seeking QAs for autonomous AI agents to validate... ...opportunity allows contributors to work remotely while engaging in a complex AI project. Ideal... ...to detail, facilitating AI testing and evaluation without needing a coding background. The...Remote jobFlexible hours- Mercor is seeking a Program management / implementation planning Evaluator to assess AI-generated materials for quality assurance. The ideal... ...proficiency in Microsoft Office and Google Workspace. This remote position involves providing structured feedback on AI outputs...Remote jobContract workWork at office
- A technology consulting firm in Canada seeks an AI QA Trainer for LLM Evaluation. This remote role involves evaluating large-scale language models through testing and improvement processes. The ideal candidate will have experience in QA for ML systems, strong programming...Remote jobHourly pay
$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the... ...systems and scenarios. This flexible, remote project is ideal for those with excellent... ...to detail. Candidates should be adept at evaluating scenarios and documenting findings. The...Remote jobFlexible hours$50 per hour
Prolific is seeking Product Designers and UX Specialists to join our Expert Network to help train AI models using real design expertise. This role involves evaluating AI-generated designs, auditing accessibility, and validating UX principles. The successful candidate will...Remote jobWork from homeFlexible hours- DataAnnotation seeks a Retail Banking Product Manager to enhance AI models used in finance. The ideal candidate will review AI... ...degrees in finance and proficiency in financial analysis and data evaluation. This role offers hourly pay starting at $50-$60 with potential...Remote jobHourly payWork from home
- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they...Remote jobHourly pay
- A leading AI evaluation firm in the United Kingdom is seeking an AI QA Trainer to enhance the reliability of large-scale language models. This mid-senior level contractor role involves designing and executing test plans while ensuring factual accuracy in model assessments...Remote jobHourly payFor contractors
$80 per hour
A leading AI consultancy in the United States is seeking Quality Assurance professionals to validate and improve autonomous AI agents. You will analyze complex systems, evaluate task structures, and ensure logical consistency through detailed reviews. Ideal candidates possess...Remote jobHourly payFlexible hours- Obsidian is seeking experienced Evaluators specializing in Investor materials, pitchbooks, and fundraising to review AI-generated work for quality and accuracy. This remote engagement requires expertise in assessing documents, spreadsheets, and slide decks. Ideal candidates...Remote workWork at office
- Mercor, headquartered in San Francisco, is looking for a Public-sector procurement / RFI response Evaluator. In this remote position, you will evaluate AI-generated artifacts against quality standards and provide structured feedback. Applicants should have over 5 years...Remote jobWork at officeFlexible hours
$40 per hour
A technology-focused company is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbots based on complex chemistry questions. This remote position allows for flexible scheduling and project selection. Applicants must have a PhD in Chemistry and a strong...Remote jobHourly payFlexible hours- Obsidian is seeking expert Evaluators in Privacy / regulatory compliance to review AI-generated work products for accuracy and quality. The role is remote and requires 5+ years of relevant experience along with proficiency in Microsoft Office and Google Workspace. As an...Remote jobHourly payWork at office
$20 per hour
A technology company specializing in AI is seeking a Receptionist to evaluate and enhance AI chatbot models. This remote position offers flexibility in choosing projects and scheduling, with compensation starting at $20 per hour plus bonuses for exceptional performance....Remote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Radiology QA & AI Evaluation Lead. Be the first to apply!
- program coordinator remote Annapolis, MD
- remote customer service advisor Annapolis, MD
- it manager remote Annapolis, MD
- remote financial planning Annapolis, MD
- remote banking Annapolis, MD
- remote 3d animation Annapolis, MD
- tableau developer remote Annapolis, MD
- system engineer remote Annapolis, MD
- remote associate Annapolis, MD
- logistics manager remote Annapolis, MD

