Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Chemical Safety Expert for AI Model Safety Audit

$100 per hour
Full-time

SuperAnnotate

Pay: up to $100/hour

## Description

SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer.

The requests are realistic: what synthetic and analytical chemists, toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones.

## Who we're looking for

Synthetic and analytical chemists; toxicologists and pharmacologists; industrial hygienists and chemical safety/process safety professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident responders; and chemical regulators (EPA, OSHA, HSE, OPCW-adjacent, or equivalent). Usually a relevant degree plus five or more years of professional experience. Experience with safety data sheets, exposure assessment, incident reports or regulatory review is a strong plus.

## Before you apply

Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and the European Union.

Responsibilities

  • Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
  • Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
  • Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.

Requirements

  • Bachelor’s degree or higher in Chemistry, Chemical Engineering, Toxicology, Environmental Health & Safety, Industrial Hygiene, Hazardous Materials Management, or a closely related field; advanced degree or professional safety certification is a strong plus.
  • 3+ years of professional experience in chemical safety, laboratory safety, hazardous materials handling, EHS, toxicology, industrial hygiene, chemical risk assessment, regulatory compliance, or related technical safety work.
  • Strong understanding of chemical hazards, including toxicity, corrosivity, flammability, reactivity, incompatibilities, exposure routes, storage risks, spill response principles, PPE, ventilation, and safe handling practices.
  • Familiarity with chemical safety documentation and frameworks such as Safety Data Sheets, GHS hazard communication, labeling, exposure limits, risk assessments, SOPs, and incident escalation procedures.
  • Ability to review AI-generated chemical safety content for technical accuracy, safety alignment, misuse risk, hallucinated claims, inappropriate specificity, and potentially dangerous procedural guidance.
  • Strong judgment in distinguishing between safe educational content and content that could enable unsafe chemical handling, synthesis, misuse, evasion, or harmful experimentation.
  • Excellent written English skills, with the ability to provide clear, structured feedback explaining why a response is safe, unsafe, incomplete, misleading, or technically incorrect.
  • High attention to detail when reviewing chemical terminology, units, concentrations, exposure assumptions, hazard classifications, safety controls, and emergency-response guidance.
  • Comfortable applying detailed project rubrics consistently across ambiguous or sensitive chemical safety scenarios.
  • Prior experience with AI safety, red-team review, model evaluation, content moderation, data annotation, technical QA, scientific review, or rubric-based evaluation is preferred.

Open to candidates in: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States

Interview language: English

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Chemical Safety Expert for AI Model Safety Audit in San Francisco, CA vacancy
  • $90 per hour

     ...a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives...  ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government... 
    Suggested
    Temporary work

    SuperAnnotate

    San Francisco, CA
    1 day ago
  • $50 - $70 per hour

     ...a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives...  ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government... 
    Suggested
    Contract work
    Temporary work
    Remote work

    Braintrust

    San Francisco, CA
    12 days ago
  •  ...materials professionals to audit how AI models respond to sensitive questions...  ...examiners; explosives safety officers and regulators (ATF...  ...incident reports, safety cases or expert opinions is a strong plus....  ...degree or higher in Chemistry, Chemical Engineering, Materials... 
    Chemical
    Permanent employment
    Full time

    SuperAnnotate

    San Francisco, CA
    1 day ago
  • $45 - $70 per hour

     ...and Social Science Help a leading AI lab ensure its models respond to people with care, balance and...  ...AI lab is seeking behavioral health experts to help evaluate and improve how its AI...  ...Nice to have: a background in AI safety, applied ethics, trust and safety or content... 
    Suggested
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    1 day ago
  • $65 - $75 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Chemicals Safety for Redteaming Type: Contract...  ..., dual-use, or adversarial. Evaluate model responses against defined policy standards... 
    Chemical
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $75 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...single-turn prompts in Chemistry and Chemical Safety , labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined policy standard to... 
    Chemical
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    San Francisco, CA
    7 days ago
  • $70 - $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: AI Safety Red Teamer Type: Contract Compensation...  ...prompts to stress-test frontier AI models . Identify jailbreaks, unsafe behaviors... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $300 per unit

     ...terminal-based engineering tasks for AI training and evaluation....  ...requires strong Engineering experts to develop realistic, terminal...  ...computational tasks that test modeling, simulation, optimization, data...  ...including mechanical, electrical, chemical, aerospace, civil, materials,... 
    Chemical
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    1 day ago
  • $16 - $22 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: AI Safety Experts — English & Odia Type: Contract...  ...Responsibilities Red team conversational AI models and agents. Conduct jailbreaks, prompt... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    28 days ago
  • $48 - $62 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract...  ...Responsibilities Red team conversational AI models and agents to identify jailbreaks,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $84 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Chemistry & Synthesis Expert Type: Contract Compensation...  .... Identify inaccuracies in chemical reasoning, proposed synthetic...  ...and reliability of advanced AI models . Qualifications Must-Have... 
    Chemical
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $48 - $62 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: AI Safety Experts — English & Finnish Type: Contract...  ...Responsibilities Red team conversational AI models and agents to identify jailbreaks,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Adolescent Mental Health Clinical Advisor (AI Safety Benchmark Project) Type: Contract...  ...of AI-generated conversations and provide expert judgment to calibrate automated evaluation... 
    Contract work
    Traineeship
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation...  ...Provide structured feedback to improve model alignment and safety performance.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $77 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible...  ...candidate in Chemistry , Biochemistry , Chemical Engineering , or a closely related field... 
    Chemical
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 hours ago
  • $50 per hour

     ...contract for PhDs in Chemistry, Chemical Engineering, or related fields...  ...-edge projects with top AI labs while earning up to $50+/...  ...Help fine-tune large language models (like ChatGPT) using your chemistry...  .... Assessment: Shortlisted experts complete an evaluation before... 
    Chemical
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    18 hours ago
  • $75 per hour

     ...technical talent with leading AI research labs....  ...Industrial Hygienist / Process Safety Engineer Type:...  ...prompts in chemistry and chemical safety . Label them as...  .... Evaluate AI model responses against a defined...  ...published research, or expert witness experience.... 
    Chemical
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    San Francisco, CA
    a month ago
  • $60 - $125 per hour

     ...teams behind the best-known AI models come to Mercor for engineering...  ...regime claimed, whether the safety factor is applied to the right...  ...Electrical engineering Chemical engineering; materials engineering...  .... Finishing the domain expert interview and joining every network... 
    Chemical
    Odd job
    Part time

    Mercor

    San Francisco, CA
    a month ago
  •  ...Data Center Sales Engineer to join their safety conscious team! The Sales Engineer has direct...  ...spans a number of industries, including chemical, energy and manufacturing, as well as...  ...be advised that Artificial Intelligence (AI) tools may be used to support certain stages... 
    Chemical
    Full time
    For contractors
    Local area
    Remote work

    Clean Harbors

    San Francisco, CA
    4 days ago
  •  ...problems and evaluate AI-generated solutions for...  ...environments that improve model capabilities in coding,...  .... Verify chemical reactions, mechanisms,...  ...standards. Provide expert advisory support to client...  ...academic, grant-review, safety, or ethics committees.... 
    Chemical
    Contract work
    Part time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  • $136.44k - $265.11k

    We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits...  ...structured data, and run AI agents and models directly in their workflows. Over 200,000...  ...Work closely with scientists, translating expert judgment into problems and evaluation criteria... 
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    3 days ago
  • $84 per hour

     ...Inorganic Chemistry and Materials Synthesis Experts to contribute to advanced AI research initiatives. In this role,...  .... Identify inaccuracies in chemical reasoning, proposed synthetic routes...  ...and reliability of advanced AI models. Required Qualifications PhD in... 
    Chemical
    Hourly pay
    Temporary work
    10 hours per week

    Mercor

    San Francisco, CA
    1 day ago
  • $50 - $60 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation: $50–$60/hour... 
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    21 days ago
  •  ...Obsidian is seeking an independent contractor for a remote role focused on benchmark dataset projects that evaluate AI models on visual document understanding in the Energy/Utilities domain. The role requires authoring complex tasks and providing objective rubrics to assess... 
    For contractors
    Remote work
    Flexible hours

    Obsidian

    San Francisco, CA
    18 hours ago
  • $255k - $300k

    Who We AreNotion is the collaborative AI workspace where teams and agents think together. We're building one place where your knowledge...  ...cutting edge of AI since before ChatGPT launched. The job of the Model Capabilities team is to keep us there. We own the model layer of... 
    Local area

    Notion Labs

    San Francisco, CA
    6 days ago
  • $246.8k - $333.9k

    In this role, you will lead the AWS account team for a frontier AI model lab and one of Amazon's largest strategic technology partnerships. The relationship spans billions in annual infrastructure spend, a multi-layered commercial partnership governed by executive-level... 
    Contract work
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    5 days ago
  • $80 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Develop and solve complex problems using chemical master equation , branching processes ,...  ...and other advanced methods. Review and audit completed work for accuracy and completeness... 
    Chemical
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $166k - $225k

     ...breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Databricks’ Model Serving product provides enterprises with a unified, scalable, and governed platform... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $84 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Atomic Layer Deposition (ALD) Experts Type: Contract...  ...processing. Rate and rank model outputs against defined scientific...  ...materials science, chemistry, chemical engineering, or physics. Clear... 
    Chemical
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  •  ...Exists At Mercor, we believe the safest AI is the one that’s already been...  ...red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities...  ...Mercor customers trust the safety of their AI because you’ve already probed... 
    Part time
    Remote work

    Mercor

    San Francisco, CA
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Chemical Safety Expert for AI Model Safety Audit. Be the first to apply!