Radiological AI Safety Evaluators & SMEs
Pasiflora AI LLC
Location: Remote (approved countries) · Type: Independent contractor Remote · Contract · Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are set by the client project, not by us, and we do not know them until a contract is in place. Work is paid hourly or per task depending on the engagement. We would rather tell you that than publish a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe, and Australia We are seeking qualified scientific and technical professionals to support an AI safety evaluation project focused on radiological, nuclear, and CBRN-related content. The work involves reviewing AI-generated prompts and responses, evaluating safety risks, identifying dual-use content, and assessing technical accuracy and responsible handling. Tier 1 - First-Pass Annotators Bachelor's or Master's degree in a relevant STEM or technical field. Strong backgrounds may include Physics, Nuclear Engineering, Nuclear Physics, Radiological Science, Radiation Physics, Health Physics, Chemistry, Chemical Engineering, Materials Science, or related engineering disciplines. Relevant professional experience in radiation, nuclear technology, hazardous materials, laboratory science, engineering, or safety may also qualify. Tier 2 - Senior SMEs and Auditors PhD or equivalent advanced industry or professional expertise in a relevant field. Relevant backgrounds include Nuclear Engineering, Nuclear Physics, Physics, Radiological Science, Radiation Physics, Health Physics, Chemistry, Chemical Engineering, CBRN-related science and engineering, or closely related fields. Strong candidates may have professional experience in nuclear or radiological operations, radiation safety, nuclear security or safeguards, CBRN preparedness, hazardous-materials safety, scientific research, national laboratories, defense, or regulatory environments. Who we're looking for We value real-world subject-matter expertise, analytical judgment, and strong attention to detail. Experience in AI evaluation, AI safety, scientific research, technical review, or quality assurance is a plus. CBRN experience is welcome, including expertise in Chemical, Biological, Radiological, or Nuclear domains. Remote and contract, within the eligible locations listed above. Requirements Tier 1: Bachelor's or Master's degree in a relevant STEM or technical field Tier 2: PhD or equivalent advanced industry or professional expertise A background in Physics, Nuclear Engineering, Nuclear Physics, Radiological Science, Radiation Physics, Health Physics, Chemistry, Chemical Engineering, Materials Science, or a related engineering discipline Professional experience in radiation, nuclear technology, hazardous materials, laboratory science, engineering, or safety may qualify in place of a specific degree Based in the US, Canada, the UK, Europe, or Australia Analytical judgment and strong attention to detail A plus: experience in AI evaluation, AI safety, scientific research, technical review, or quality assurance Responsibilities Tier 1: review AI prompts and model responses Tier 1: classify content as Benign, Dual-Use, or Malicious using project guidelines Tier 1: evaluate and rank responses for safety, and give a clear rationale for each Tier 1: identify the legitimate and the potentially harmful components of dual-use scenarios Tier 2: audit and QA Tier 1 annotations, and review complex or flagged cases Tier 2: validate classifications, rankings, rationales, and reference responses Tier 2: ensure evaluations meet appropriate scientific, technical, and safety standards #J-18808-Ljbffr Pasiflora AI LLC
- Sovrano AI is hiring for a remote, hourly contractor who will evaluate frontier AI models on chemical, biological, radiological, and nuclear questions. You will assess safety framing, flag unsafe guidance, and write reference safe-answers. The role spans four hazard domains...SuggestedRemote jobHourly payFor contractors
- AI Trainer Jobs is seeking qualified professionals for a remote AI safety evaluation project focused on explosives and energetic materials. Tier 1 annotators review prompts and... ..., providing clear rationales. Tier 2 senior SMEs audit Tier 1 work and validate complex cases,...SuggestedRemote jobContract work
- Mercor is hiring bilingual Ukrainian-English speakers to help make advanced AI models safer. You will write expert-level prompts in Ukrainian and apply structured guidelines to classify prompts and conversations. No prior AI/ML experience is required — training will be...SuggestedPart time
- The Work You will evaluate how AI models respond to sensitive questions about explosives and energetic materials. Scenarios may involve mining... ..., propellants, bomb disposal, investigations, and safety. You will use your professional judgment to assess whether responses...SuggestedHourly payFor contractorsRemote work
$48 - $52 per hour
...part-time, language-based role based in the Netherlands. You will write expert Dutch prompts and classify content to help improve safety for AI models. The position requires native NL Dutch and business English, a bachelor’s degree (or in progress), and keen attention to...SuggestedHourly payPart time- Mercor is hiring for a part-time Danish-English evaluative role to help make advanced AI models safer. You will craft expert-level prompts in Danish and apply guidelines to classify prompts and conversations, documenting your judgments with clear reasoning. No prior AI...Part timeImmediate start
$85 per hour
OpenTrain AI, Inc. is seeking a Process Safety Engineer AI Training Evaluator to review AI-generated content on environmental health and safety, process safety, and energy compliance. This remote, flexible project pays up to $85 per hour and requires strong written communication...Remote jobHourly payFlexible hours- AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak... ...applicable policy clause to enable rapid patching by the safety team. This contractor role requires strong written communication...Remote jobFor contractors
$30 - $60 per hour
Frontier AI Lab in the United States is seeking a part-time, contract-based AI Safety & Evaluation Specialist to test and review privacy-related behavior of AI agents. You will test privacy-focused scenarios, report potential disclosures of personal or sensitive data, identify...Remote jobHourly payContract workPart timeFor contractors- Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and...Remote jobWeekly payFor contractorsFlexible hours
- Mercor is seeking bilingual Spanish-English speakers to help improve AI safety by evaluating how models handle sensitive topics in Spanish. No prior AI/ML experience required; training will be provided. You will write expert prompts in Spanish, apply structured guidelines...Part timeImmediate start
- Gramian Consultancy is seeking an experienced Quality & Patient Safety Nurse to contribute to an AI training and evaluation project focused on clinical quality, patient safety, documentation review, adverse-event analysis, and healthcare process improvement. The role involves...Remote jobFor contractors
- OpenTrain AI, Inc. is seeking a Registered Nurse AI Evaluation Expert to review and create clinical content used to train AI systems. You will apply nursing judgment to ensure accuracy, safety, and clarity across patient education, triage guidance, and clinical documentation...Remote jobPart time
$85 per hour
Process Safety Engineer AI Training Evaluator Review AI-generated content on EHS, process safety, and energy compliance using your professional experience. This remote, flexible project pays up to $85 per hour. Remote Hourly $85/hr $85/hr Compensation Contract Engagement...Hourly payContract workRemote workFlexible hours$137.9k - $256.1k
Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing and refining prompts, skills... ...with specialized legal subject matter experts (SMEs), software engineers, and data scientists to...Full timeWork at officeLocal areaFlexible hours$18 - $45 per hour
...qualifications, and project requirements Help Shape the Future of AI in Finance Are you a finance professional specializing... ...Finance - Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland...Extra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation... ...: Remote Role Responsibilities Evaluate AI-generated responses for safety,...Contract workSummer workRemote work$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses against... ...the modeling team can use to retrain. Why this role matters AI data reviewers help turn pharmacovigilance safety evaluation outputs...Hourly payFor contractorsRemote work10 hours per week
- ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available...Full timePart timeImmediate start
- Prolific is seeking Materials Science Specialists to join its Expert Network for AI training and evaluation. You’ll complete a short test and, if selected, contribute to paid AI tasks requiring one hour of uninterrupted work. Researchers with a background in materials...Work from home
- Volga Partners seeks an experienced Senior Investment Research & Capital Markets SME to support AI model development, evaluation, and improvement in finance. This project-based contractor role requires evaluating AI-generated financial analyses, validating reasoning, and...For contractorsRemote work
- AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm policies. You will grade tone, escalation logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor...Remote jobFor contractors10 hours per weekFlexible hours
- Role Title: Food Delivery AI Response Evaluator Role Type : Contractor Location: Remote our partner is engaging Food Delivery AI Response Evaluators to contribute to a client’s innovative project focused on enhancing AI-driven customer interactions within the food delivery...Contract workFor contractorsRemote workWorldwideShift work
- Innodata is seeking a detail-oriented Voice Specialist for a 3-month, W2, full-time contract in the United States. You will evaluate two AI models through real-time conversations, comparing responses and providing structured feedback across defined criteria. Responsibilities...Full timeContract work
$25 - $35 per hour
Compare original and AI-generated images, spot visual defects, and write precise feedback that improves image models. This part-time... ...quality standards consistently and prioritize accurate evaluations. What it pays and takes Experience in visual work can help, but...Hourly payContract workPart timeFor contractorsRemote work- LILT seeks detail-oriented human reviewers to support AI training and evaluation projects. You will evaluate prompts and AI-generated outputs, review and correct text, and analyze multimedia content, applying local cultural context and brand alignment. This role demands...For contractorsLocal area
- AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and help identify edge cases for quality control. Responsibilities include comparing responses,...Remote jobFor contractors
- AuraOne, Inc. seeks a Revenue Recognition AI Reviewer to remotely assess evaluation prompts and responses against a published quality rubric. You will compare paired outputs, label edge cases, and produce structured feedback to retrain the model. As a contractor, you’ll...Remote jobFor contractors10 hours per week
- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality rubric. You will label edge cases, provide structured feedback, and inform retraining efforts through precise rationale. The role supports a contractor...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Radiological AI Safety Evaluators & SMEs. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY



