Oncology AI Evaluator [Remote]
AuraOne Human Data
- Remote job
Oncology AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch oncology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Oncology AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current oncology clinical guidelines and standard of care for Oncology AI Evaluator assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in oncology or an adjacent specialty for Oncology AI Evaluator work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a oncology case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Oncology
- Medicine and healthcare
- AI evaluation
- Rubric writing
- Expert review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$40 per hour
A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent...SuggestedHourly payContract workRemote workFlexible hours- ...Blueprint Technologies, LLC. is seeking a detail-oriented Labeler / Annotator to evaluate AI responses in French. This remote role focuses on side-by-side evaluation across real-world scenarios, not translation, requiring strong judgment and attention to detail. You...SuggestedRemote work
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
$40 per hour
A technology company specializing in AI is seeking a Physics Graduate Assistant to enhance AI models. You will evaluate AI chatbot outputs and provide complex physics problems. Ideal candidates will have a strong understanding of classical mechanics, E&M, thermodynamics...SuggestedHourly payFull timePart timeRemote work$40 per hour
...We are looking for a Physics Graduate Assistant to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding...SuggestedHourly payFull timeContract workPart timeRemote work$40 per hour
...technology company is seeking a Physics Graduate Assistant to join their team in a remote position. The role involves training AI models by evaluating their outputs and improving their quality through complex physics problems. Candidates should have a strong grasp of...Hourly payContract workRemote work$20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hours$40 per hour
...We are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real...Hourly payFull timePart timeRemote work$20 per hour
A tech company specializing in AI is looking for a Digital Web Designer to evaluate AI-generated designs and help train models for better aesthetic understanding. This is a remote position open solely to applicants in the United States. The role involves assessing UI/UX...Remote work- ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong...FreelanceRemote work
- ...Seeking a PhD-level expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate responses, contributing to the training of advanced AI models in a flexible contract role....Full timeContract workRemote workFlexible hours
$20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...Hourly payRemote workFlexible hours$20 per hour
A tech company specializing in AI is seeking an Experience Designer to evaluate and enhance AI-generated UI/UX designs. This remote position allows for flexible scheduling and offers competitive pay rates starting at $20/hour for general projects and $40/hour for design...Remote workFlexible hours$40 per hour
A cybersecurity solutions provider seeks experienced professionals to evaluate AI-generated content related to security issues. You will be solving technical problems, contributing directly to AI models. Required qualifications include 2+ years in cybersecurity, coding...Hourly payRemote workFlexible hours$14.5 per hour
...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years... ...performance and provide insights on relevance and quality. Evaluate and rate the effectiveness of search engine results to ensure...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have native or professional fluency in French and strong English comprehension. Responsibilities include performing SBS comparisons, evaluating...Local areaRemote work
$40 per hour
A tech company specializing in AI is looking for experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role involves writing technical explanations and providing feedback to improve AI security models. Candidates...Hourly payRemote workFlexible hours- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
$40 per hour
A leading AI technology firm is seeking experienced cybersecurity professionals for a remote position in the United States. You will evaluate AI-generated security content while solving technical problems to strengthen AI models. Ideal candidates have 2+ years in cybersecurity...Hourly payRemote workFlexible hours$40 per hour
A technology company is seeking experienced cybersecurity professionals to join their remote team. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to enhance AI systems. Candidates should have...Hourly payRemote workFlexible hours$20 per hour
A technology company is seeking a Responsive Web Designer to review and improve AI-generated designs. This role offers flexibility in choosing projects and working hours. Candidates should possess a strong design background and fluency in English. Compensation starts at...Contract workRemote work$40 per hour
A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve cybersecurity problems. This role, which can be part-time or full-time, offers flexible hours and competitive pay starting from $40+ per hour. Ideal candidates...Hourly payFull timePart timeRemote workFlexible hours$40 per hour
...cybersecurity firm is seeking experienced cybersecurity professionals for a remote position in the United States. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to improve AI systems. Candidates...Hourly payRemote work$40 per hour
A cybersecurity solutions provider is seeking experienced cybersecurity professionals to help train AI models by evaluating cybersecurity content. Responsibilities include evaluating AI outputs, solving security problems, and providing can improve AI security reasoning....Hourly payRemote workFlexible hours$40 per hour
A cybersecurity technology company is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This is a remote position open to candidates in the US and several other English-speaking countries, offering flexibility...Hourly payRemote work$40 per hour
A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves critiquing UI/UX visuals, assessing aesthetic quality, and contributing to various design-focused projects. Candidates should have a strong background...Remote work- A leading tech company in Alabama is seeking a Marketing Designer to train and improve AI models by evaluating AI-generated designs. The role offers flexibility and competitive pay based on project levels. Ideal candidates will possess strong UI/UX design skills and a good...Remote work
$40 per hour
A technology company is seeking experienced cybersecurity professionals to help train AI models. The role involves evaluating AI-generated security content and solving technical cybersecurity problems. Candidates should have hands-on cybersecurity experience and strong...Hourly payFull timePart timeRemote work$40 per hour
A leading cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content. In this role, you will analyze threats, design solutions for AI training, and provide feedback. This position offers the flexibility of working remotely...Hourly payRemote work$40 per hour
A cybersecurity company is seeking experienced professionals to join their team in evaluating AI-generated security content and solving technical cybersecurity problems. This is a flexible role that can be done from anywhere in the US, Canada, UK, Ireland, Australia, and...Hourly payRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Oncology AI Evaluator [Remote]. Be the first to apply!

