Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Nuclear Safety AI Auditor for Model Evaluation

$50 - $70 per hour

Brain Trust Inc

SuperAnnotate AI, Inc is assembling a panel of nuclear and radiological professionals for AI model auditing tasks. This short-term project seeks experts in reactor physics, health physics, safeguards, and related fields to classify and critique model responses on sensitive nuclear topics. Eligible candidates reside in the US, UK, Canada, Australia, New Zealand, or the EU. Compensation is $50–$70 per hour for about 20 hours per week, targeting specialists with 1–3 years of relevant activity and a #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Nuclear Safety AI Auditor for Model Evaluation in New York, NY vacancy
  • AI Trainer Jobs is seeking specialists to audit AI model responses to sensitive nuclear questions. You will classify requests as benign, dual-use or adversarial, and evaluate model outputs for safety and accuracy. Your task includes ranking three models and drafting the... 
    Nuclear

    SuperAnnotate AI, Inc.

    New York, NY
    4 days ago
  • $45 - $70 per hour

     ...Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated... 
    Suggested
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  •  ...Obsidian is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured... 
    Suggested

    Mercor Inc

    New York, NY
    1 day ago
  •  ...creative and technical talent with leading AI research labs. The company is...  ...Summers, and Jack Dorsey. They are hiring a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor Inc

    New York, NY
    5 days ago
  •  ...accelerate the pace of frontier model development. They are not...  ...Reflection is building model evals and safety from the ground up, and this...  ...real. That means defining the evaluation frameworks, building the...  ...landscape of model evaluation and AI safety, including evaluation... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI

    New York, NY
    5 days ago
  • AI Trainer Jobs seeks qualified professionals for an AI Safety Evaluation Project conducted remotely as independent contractors. Work includes reviewing AI prompts, assessing...  ...to PhD experts, with emphasis on radiological, nuclear, and CBRN domains. Ideal candidates hold STEM... 
    Nuclear
    Remote job
    For contractors

    Pasiflora AI LLC

    New York, NY
    3 days ago
  • $50 - $70 per hour

     ...project** SME Careers is assembling a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each...  ..., national labs), health physicists and radiation safety officers, radiochemists, and former military or... 
    Nuclear
    Remote job
    Temporary work

    Braintrust

    New York, NY
    1 day ago
  • $150 per hour

    Mercor is seeking a General Physician for a remote, short-term contract. You will evaluate AI model outputs for clinical validity, provide structured feedback, and flag safety issues while collaborating with AI researchers. The assignment spans 6 weeks at ~20+ hours per... 
    Remote job
    Hourly pay
    Temporary work

    mercor

    New York, NY
    5 days ago
  •  ...AuraOne, Inc. seeks a remote Gmail & Calendar AI Assistant Evaluator to review prompts and responses against our quality rubric. You will...  ...edge cases, and write structured feedback for retraining the modeling team. As an independent contractor, you will work... 
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    3 days ago
  • $60 - $80 per hour

     ...expertise to help develop advanced large language models. In this role, you will bring practical brand, growth, and campaign judgment to AI training data, partnering with research...  ...reasoning quality. Develop and improve evaluation guidelines and scoring rubrics for... 
    Hourly pay
    Weekday work

    SaidGig

    New York, NY
    3 days ago
  • $15 - $35 per hour

     ...requirements Help Shape the Future of AI in Healthcare What if the...  ...healthcare information, evaluates medical scenarios, and delivers...  ...Artificial Intelligence (AI) models. We're seeking individuals currently...  ..., and potential patient safety concerns in AI-generated responses... 
    Hourly pay
    For contractors
    Traineeship
    Freelance
    Internship
    Remote work
    Weekday work

    Volga Partners

    New York, NY
    5 days ago
  • Cincinnatus LLC is seeking behavioral health experts to help evaluate how AI models respond in everyday conversations about relationships,...  ...wellbeing and beliefs. This part-time role focuses on neutrality, safety and balanced guidance, with 20-40 hours per week and a W-2... 
    Part time

    Annotation Academy

    New York, NY
    2 days ago
  • $174k - $252k

     ...both human-powered and Large Language Model (LLM)-powered automated evaluation systems to assess model performance....  ...aspects like grounding, coherence, safety, and helpfulness.Utilize platforms...  ...projects.Experience integrating generative AI tools or Large Language Model (LLM)... 

    Google

    New York, NY
    4 days ago
  • $110 per hour

     ...background and interests. Role Overview Qualified physicians may contribute to AI research projects by bringing real-world clinical expertise to model development and evaluation. Key Responsibilities Train and evaluate AI models in medicine. Create tasks and... 
    Hourly pay
    Contract work
    Remote work

    SaidGig

    New York, NY
    4 days ago
  • $350k

     ...Research Engineer, Production Model Post-TrainingSan Francisco, CA...  ...capabilities, alignment, and safety. As a Research Engineer on our...  ...techniques like Constitutional AI, RLHF, and other alignment methodologies...  ...training, fine-tuning, or evaluating large language modelsCan... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    4 days ago
  •  ...health professionals with leading technology teams to evaluate AI interactions in non-crisis, everyday conversations....  ...and personal decisions to ensure balance and safety, contributing to rubric creation and model testing. The role emphasizes 20+ hours/week, with... 

    Mercor Inc

    New York, NY
    5 days ago
  •  ...remote Data Scientist contractor to support an AI lab. You will apply data science, statistics, and ML expertise to improve how models handle quantitative reasoning and experimentation. Responsibilities include evaluating model outputs, creating prompts and datasets, and... 
    For contractors
    Remote work

    SaidGig

    New York, NY
    15 hours ago
  •  ...Junior Data Scientist to join a remote contract role supporting an AI lab partnership. You will apply rigorous statistics, ML methods, experimentation design, and quantitative reasoning to evaluate model outputs and drive model quality. You will assess data science... 
    Contract work
    Remote work

    Carbon Data Solutions

    New York, NY
    5 days ago
  •  ...SaidGig is seeking contractors for remote, hourly ML engineering work. Responsibilities include training and evaluating AI models, creating real-world tasks and deliverables, and providing feedback to advance AI research. This is an open, rolling opportunity aligned with... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    New York, NY
    3 days ago
  •  ...Handshake seeks a CBRNE Red Teamer to evaluate AI models for safety and security risks across chemical, biological, radiological, nuclear, and explosive domains. You will craft adversarial scenarios, assess model defenses, and document how and why failures occur to guide... 
    Nuclear

    Handshake

    New York, NY
    5 days ago
  • Mercor is seeking a seasoned Business Domain Expert to pilot AI model evaluation across admin, marketing, HR and accounting workflows. This remote contractor role focuses on judging outputs with evidence-based rationales and delivering structured feedback within tight turnaround... 
    Remote job
    Contract work
    For contractors

    mercor

    New York, NY
    5 days ago
  •  ...remote, hourly paid R Engineer to review AI-generated responses and produce high-quality R- and data-analysis content. You will evaluate reasoning, assess accuracy, and explain solutions...  ..., ranking AI outputs, and validating model integrity across use cases, all while... 
    Hourly pay
    Contract work
    Remote work

    SuperAnnotate AI

    New York, NY
    5 days ago
  •  ...seeking CBRN experts to help secure Generative AI systems by crafting domain-specific prompts and evaluating AI responses for accuracy, safety, and ethical integrity. This is project-...  ...Experts in Biology, Chemistry, Virology, Nuclear Energy, or Radioactive Materials will... 
    Nuclear
    Freelance
    Remote work

    ALICE

    New York, NY
    1 day ago
  •  ...SuperAnnotate AI, Inc is seeking a CBRN Specialist (SME) on a short-term, remote contract...  ...chemical, biological, radiological, and nuclear safety topics. You will assess accuracy, safety...  ...delivering high-quality, policy-aligned evaluations across time zones. #J-18808-Ljbffr
    Nuclear
    Temporary work
    Remote work

    Brain Trust Inc

    New York, NY
    5 days ago
  •  ...Crossing Hurdles is seeking a detail-oriented evaluator to audit AI models and agents across predefined scenarios in a Canadian context. This role focuses on rigorous testing, precise execution, and thorough documentation of results. You will manage repetitive test cycles... 

    Crossing Hurdles

    New York, NY
    17 hours ago
  • $156k - $227k

    Lead frontier safety post deployment testing strategy...  ...experts, governance, and modeling teams to inform...  ...Experience working with AI or in an AI lab/startup...  ...implementing testing and evaluations of cutting edge AI systems...  ...biological, radiological, nuclear, cyber, harmful... 
    Nuclear

    Google

    New York, NY
    5 days ago
  • AI Trainer Jobs is seeking biologists to join an AI training project. You will review AI-generated responses, evaluate reasoning quality and provide expert feedback to ensure accuracy, clarity...  ...AI performance, and ensuring model integrity by fact-checking biology information... 

    SuperAnnotate AI, Inc.

    New York, NY
    4 days ago
  • A leading AI research firm in New York, NY, is looking for a specialist to oversee...  ...the red-teaming and adversarial evaluation pipeline for their models. The ideal candidate should possess a...  ...and have a deep understanding of LLM safety and adversarial techniques. A strong... 

    Reflection AI

    New York, NY
    5 days ago
  •  ...Prolific in the United Kingdom is seeking Senior Python Developers to join our Expert Network and help train and evaluate cutting-edge AI models. You will review AI-generated Python code for correctness, audit logic and run integration tests in appropriate environments... 
    Remote work

    Prolific

    New York, NY
    4 days ago
  • $18 per hour

     ...Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?About the opportunity:Outlier is looking for talented... 
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Nuclear Safety AI Auditor for Model Evaluation. Be the first to apply!