Chemical Safety Expert for AI Model Safety Audit
$100 per hourSuperAnnotate
Pay: up to $100/hour
## Description
SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer.
The requests are realistic: what synthetic and analytical chemists, toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones.
## Who we're looking for
Synthetic and analytical chemists; toxicologists and pharmacologists; industrial hygienists and chemical safety/process safety professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident responders; and chemical regulators (EPA, OSHA, HSE, OPCW-adjacent, or equivalent). Usually a relevant degree plus five or more years of professional experience. Experience with safety data sheets, exposure assessment, incident reports or regulatory review is a strong plus.
## Before you apply
Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and the European Union.
Responsibilities
- Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
- Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
- Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.
Requirements
- Bachelor’s degree or higher in Chemistry, Chemical Engineering, Toxicology, Environmental Health & Safety, Industrial Hygiene, Hazardous Materials Management, or a closely related field; advanced degree or professional safety certification is a strong plus.
- 3+ years of professional experience in chemical safety, laboratory safety, hazardous materials handling, EHS, toxicology, industrial hygiene, chemical risk assessment, regulatory compliance, or related technical safety work.
- Strong understanding of chemical hazards, including toxicity, corrosivity, flammability, reactivity, incompatibilities, exposure routes, storage risks, spill response principles, PPE, ventilation, and safe handling practices.
- Familiarity with chemical safety documentation and frameworks such as Safety Data Sheets, GHS hazard communication, labeling, exposure limits, risk assessments, SOPs, and incident escalation procedures.
- Ability to review AI-generated chemical safety content for technical accuracy, safety alignment, misuse risk, hallucinated claims, inappropriate specificity, and potentially dangerous procedural guidance.
- Strong judgment in distinguishing between safe educational content and content that could enable unsafe chemical handling, synthesis, misuse, evasion, or harmful experimentation.
- Excellent written English skills, with the ability to provide clear, structured feedback explaining why a response is safe, unsafe, incomplete, misleading, or technically incorrect.
- High attention to detail when reviewing chemical terminology, units, concentrations, exposure assumptions, hazard classifications, safety controls, and emergency-response guidance.
- Comfortable applying detailed project rubrics consistently across ambiguous or sensitive chemical safety scenarios.
- Prior experience with AI safety, red-team review, model evaluation, content moderation, data annotation, technical QA, scientific review, or rubric-based evaluation is preferred.
Open to candidates in: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States
Interview language: English
$90 per hour
...a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives... ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government...SuggestedTemporary work$50 - $70 per hour
...a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives... ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government...SuggestedContract workTemporary workRemote work- ...materials professionals to audit how AI models respond to sensitive questions... ...examiners; explosives safety officers and regulators (ATF... ...incident reports, safety cases or expert opinions is a strong plus.... ...degree or higher in Chemistry, Chemical Engineering, Materials...ChemicalPermanent employmentFull time
$45 - $70 per hour
...and Social Science Help a leading AI lab ensure its models respond to people with care, balance and... ...AI lab is seeking behavioral health experts to help evaluate and improve how its AI... ...Nice to have: a background in AI safety, applied ethics, trust and safety or content...SuggestedContract workPart timeWeekday work$65 - $75 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Chemicals Safety for Redteaming Type: Contract... ..., dual-use, or adversarial. Evaluate model responses against defined policy standards...ChemicalContract workSummer workRemote work$75 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...single-turn prompts in Chemistry and Chemical Safety , labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined policy standard to...ChemicalRemote jobHourly payWeekly payContract workFor contractorsSummer work$70 - $84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: AI Safety Red Teamer Type: Contract Compensation... ...prompts to stress-test frontier AI models . Identify jailbreaks, unsafe behaviors...Contract workSummer workRemote work$300 per unit
...terminal-based engineering tasks for AI training and evaluation.... ...requires strong Engineering experts to develop realistic, terminal... ...computational tasks that test modeling, simulation, optimization, data... ...including mechanical, electrical, chemical, aerospace, civil, materials,...ChemicalContract workPart timeFor contractors$16 - $22 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Experts — English & Odia Type: Contract... ...Responsibilities Red team conversational AI models and agents. Conduct jailbreaks, prompt...Contract workSummer workRemote workFlexible hours$48 - $62 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract... ...Responsibilities Red team conversational AI models and agents to identify jailbreaks,...Contract workSummer workRemote work$84 per hour
...technical talent with leading AI research labs. Headquartered in... ...Chemistry & Synthesis Expert Type: Contract Compensation... .... Identify inaccuracies in chemical reasoning, proposed synthetic... ...and reliability of advanced AI models . Qualifications Must-Have...ChemicalContract workSummer workRemote work$48 - $62 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: AI Safety Experts — English & Finnish Type: Contract... ...Responsibilities Red team conversational AI models and agents to identify jailbreaks,...Contract workSummer workRemote work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Adolescent Mental Health Clinical Advisor (AI Safety Benchmark Project) Type: Contract... ...of AI-generated conversations and provide expert judgment to calibrate automated evaluation...Contract workTraineeshipSummer workRemote work$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation... ...Provide structured feedback to improve model alignment and safety performance....Contract workSummer workRemote work$77 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible... ...candidate in Chemistry , Biochemistry , Chemical Engineering , or a closely related field...ChemicalContract workSummer workRemote work$50 per hour
...contract for PhDs in Chemistry, Chemical Engineering, or related fields... ...-edge projects with top AI labs while earning up to $50+/... ...Help fine-tune large language models (like ChatGPT) using your chemistry... .... Assessment: Shortlisted experts complete an evaluation before...ChemicalContract workRemote workFlexible hours$75 per hour
...technical talent with leading AI research labs.... ...Industrial Hygienist / Process Safety Engineer Type:... ...prompts in chemistry and chemical safety . Label them as... .... Evaluate AI model responses against a defined... ...published research, or expert witness experience....ChemicalRemote jobContract workSummer workFlexible hours$60 - $125 per hour
...teams behind the best-known AI models come to Mercor for engineering... ...regime claimed, whether the safety factor is applied to the right... ...Electrical engineering Chemical engineering; materials engineering... .... Finishing the domain expert interview and joining every network...ChemicalOdd jobPart time- ...Data Center Sales Engineer to join their safety conscious team! The Sales Engineer has direct... ...spans a number of industries, including chemical, energy and manufacturing, as well as... ...be advised that Artificial Intelligence (AI) tools may be used to support certain stages...ChemicalFull timeFor contractorsLocal areaRemote work
- ...problems and evaluate AI-generated solutions for... ...environments that improve model capabilities in coding,... .... Verify chemical reactions, mechanisms,... ...standards. Provide expert advisory support to client... ...academic, grant-review, safety, or ethics committees....ChemicalContract workPart timeFor contractorsFreelanceRemote workFlexible hours
$136.44k - $265.11k
We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits... ...structured data, and run AI agents and models directly in their workflows. Over 200,000... ...Work closely with scientists, translating expert judgment into problems and evaluation criteria...Work at officeLocal areaMonday to FridayShift work$84 per hour
...Inorganic Chemistry and Materials Synthesis Experts to contribute to advanced AI research initiatives. In this role,... .... Identify inaccuracies in chemical reasoning, proposed synthetic routes... ...and reliability of advanced AI models. Required Qualifications PhD in...ChemicalHourly payTemporary work10 hours per week$50 - $60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation: $50–$60/hour...Contract workSummer workRemote workWeekday work- ...Obsidian is seeking an independent contractor for a remote role focused on benchmark dataset projects that evaluate AI models on visual document understanding in the Energy/Utilities domain. The role requires authoring complex tasks and providing objective rubrics to assess...For contractorsRemote workFlexible hours
$255k - $300k
Who We AreNotion is the collaborative AI workspace where teams and agents think together. We're building one place where your knowledge... ...cutting edge of AI since before ChatGPT launched. The job of the Model Capabilities team is to keep us there. We own the model layer of...Local area$246.8k - $333.9k
In this role, you will lead the AWS account team for a frontier AI model lab and one of Amazon's largest strategic technology partnerships. The relationship spans billions in annual infrastructure spend, a multi-layered commercial partnership governed by executive-level...Contract workLocal areaWorldwideFlexible hours$80 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Develop and solve complex problems using chemical master equation , branching processes ,... ...and other advanced methods. Review and audit completed work for accuracy and completeness...ChemicalContract workSummer workRemote work$166k - $225k
...breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Databricks’ Model Serving product provides enterprises with a unified, scalable, and governed platform...Local areaWorldwide$84 per hour
...technical talent with leading AI research labs. Headquartered in... ...Atomic Layer Deposition (ALD) Experts Type: Contract... ...processing. Rate and rank model outputs against defined scientific... ...materials science, chemistry, chemical engineering, or physics. Clear...ChemicalContract workSummer workRemote work- ...Exists At Mercor, we believe the safest AI is the one that’s already been... ...red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities... ...Mercor customers trust the safety of their AI because you’ve already probed...Part timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Chemical Safety Expert for AI Model Safety Audit. Be the first to apply!
- fulfillment expert San Francisco, CA
- technology expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- chemical manufacturing San Francisco, CA
- chemical sales San Francisco, CA
- chemical plant San Francisco, CA
- chemical San Francisco, CA
- chemical manager San Francisco, CA
- safety sales San Francisco, CA






