AI Safety Annotation Reviewer
Turing
Audit AI annotations for accuracy and policy compliance.
About Turing
Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countries and the world's best foundational LLM companies, by helping them improve performance through model evaluation, fine-tuning, feedback, factuality and handling diverse data.
Role Overview
A US based AI company that is at the forefront of AI research is looking for a Team Lead to oversee a team of business analysts. This opportunity is tailored for professionals who have experience in leading teams and has interest in supporting the development of solutions at the cutting-edge of technology.
Job Responsibilities
- Audit trainer-submitted evaluations for policy misapplication, incomplete reasoning, scoring drift, schema errors, and annotation inconsistencies.
- Apply a detailed AI safety policy framework consistently across high-stakes review tasks.
- Identify individual and systematic errors in human-generated annotations and written assessments.
- Validate annotation completeness, scoring accuracy, policy alignment, and adherence to required schemas.
- Provide direct, constructive feedback to trainers and recommend corrective actions when quality issues are identified.
- Document recurring error patterns and contribute to quality improvement, calibration, and reviewer training initiatives.
- Maintain accuracy and consistency while working under time-sensitive conditions and handling sensitive content.
Job Requirements
- Sharp attention to detail and strong analytical and logical reasoning skills.
- Demonstrated experience identifying systematic errors in human-generated annotations, evaluations, or written assessments.
- Ability to quickly understand and consistently apply detailed policy guidelines.
- Native-level English fluency and strong written communication skills.
- Comfort providing clear, direct, and constructive feedback.
- Strong understanding of US cultural context and communication norms.
- Ability to work independently, manage priorities, and maintain quality under time pressure.
- Availability to commit to 40 hours per week; immediate availability is preferred.
Preferred Qualifications
- Experience in AI annotation review, Trust & Safety quality assurance, test engineering, content moderation, or editorial fact-checking.
- Previous experience with schema validation, policy compliance reviews, annotation completeness checks, or quality auditing.
- Experience working with sensitive or high-stakes content.
Importante Note: This project includes sensitive content involving topics such as self-harm, violence, and abuse. Appropriate waivers, support resources, and wellbeing measures will apply.
Benefits
- Opportunity to work on cutting-edge AI projects.
- Competitive compensation.
- Flexible working hours and remote work environment.
Application Process
- Shortlisted candidates will be reached out.
Skills: Project Management
$10 per hour
...Pay: up to $10/hour Join a dynamic and fast-growing AI infrastructure company that collaborates with Fortune 100 clients to shape... ...be responsible for accurately identifying, classifying, and annotating entities within PDF documents. Your work will directly contribute...SuggestedTemporary work- An AI research accelerator is seeking a candidate skilled in internal or emergency medicine to enhance AI systems. This remote position demands collaboration on clinical scenarios and evaluation of AI responses, requiring strong communication and diagnostic skills. An...SuggestedContract workRemote workFlexible hours
$13 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Telugu Type:... ...for tables, formulas, and handwriting. Review a colleague's work thoroughly. Experienced...SuggestedContract workSummer workRemote work$13 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Odia Type:... ...for tables, formulas, and handwriting. Review a colleague's work: Conduct end-to-end reviews...SuggestedContract workSummer workRemote work$80 - $130 per hour
...proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on... ...medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus); Strong written English (C1+). This opportunity...SuggestedPermanent employmentContract workTemporary workPart timeFreelanceRemote work10 hours per week$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Contract workSummer workRemote work$120k - $165k
Credit Reviewer IIThe Independent Asset Review (IAR) within East West Bank operates as an independent Third Line of Defense (3rd) function, separate from lending, approval and administration process. IAR provides senior management and risk committee with independent and...Work at officeFlexible hours$65 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses in legal...Contract workSummer workRemote work10 hours per week$20 - $25 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: AI Data Generalist — Egocentric Video Review Type: Contract Compensation: $... ...learning and consistent application of detailed annotation guidelines. Strong written English...Contract workSummer workRemote workDay shift$25 - $30 per hour
...About the Role We are recruiting reviewers for a paid audio review project focused on alphanumeric speech. You will listen to English... ...Experience with transcription, audio QA, proofreading or data annotation is a plus. Phones and tablets cannot be used for reviewing....Part timeFlexible hours$20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...the exact span where they occur using our review tooling. Report on overall listener satisfaction... ...team communication. Experience with annotation, labeling, transcription, proofreading,...Remote jobContract workPart timeSummer work- ...and outcomes. By uniquely combining data, AI, and community, Citizen is building a... ...healthcare.ResponsibilitiesAbstract and review relevant longitudinal information from patient... ...disease model, ontology, and internal annotation tools to maximize productivity and data quality...
$45 - $65 per hour
...Pay: $45 - $65/hour Required Skills document review digital marketing seo written communication content editing About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations...Part timeFor contractorsRemote work$70 - $100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Qualifications Must-Have ~3+ years of experience producing and reviewing office documents. ~ Proficiency in Excel , Word , and...Contract workSummer workWork at officeImmediate startRemote work$15 - $29 per hour
Be among the first 25 applicants to apply for this position and get AI-powered advice on this job and more exclusive features. This salary range is provided by Compass Consulting. Your actual pay will be based on your skills and experience — talk with your recruiter to...Contract workFlexible hours- ...Clerk to adapt to shifting priorities and business needs, gain knowledge of company offerings to better serve clients, and follow safety procedures and company policies. Other duties include work collaboratively across teams and departments, maintain accurate records...Weekly payFlexible hoursShift work
- ...Clerk (Remote) to adapt to shifting priorities and business needs, respond promptly to inquiries and resolve basic issues, and follow safety procedures and company policies. Other duties include coordinate tasks to ensure deadlines are met, assist with processing returns...Remote jobWeekly payFlexible hoursShift work
- ...part of our success story as a American Airlines Data Entry Clerk to respond promptly to inquiries and resolve basic issues, follow safety procedures and company policies, and manage daily responsibilities with a focus on quality and efficiency. Other duties include...Weekly payFlexible hoursShift work
- ...Be part of our success story as a British Airways Data Entry Clerk (Remote) to follow safety procedures and company policies, assist with organizing, stocking, and general upkeep, and gain knowledge of company offerings to better serve clients. Other duties include maintain...Remote jobWeekly payFlexible hoursShift work
- Hmong Chinese Language Document Reviewer Employment Type: Full Time, Mid-Level Department: Legal As a CGS Hmong Chinese Document Reviewer... ...status as a protected veteran. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...Full timeWork at officeFlexible hours
$43.8k - $76.7k
...realities that transform the world for good. Your impact Role Summary The Document Control Specialist manages the creation, receipt, review, distribution, tracking, and archival of project documentation to ensure quality, compliance, and timely information flow across...Hourly payWork at officeRemote workShift work- CGS seeks a Hmong Chinese Document Reviewer to join its in-house legal team in San Francisco. You will support eDiscovery workflows, review and draft legal documents, and assist attorneys with litigation projects in a fast-paced environment. The role requires 3-5 years...
- We are seeking experienced Tax Reviewers to prepare and review individual tax returns during tax season. This is a fully remote contract opportunity requiring a minimum commitment of 30 hours per week (can work up to 60 hours per week during peak season). Candidates must...Contract workRemote work
$12 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Bengali Type... ...for tables, formulas, and handwriting. Review a colleague's work: every task is reviewed...Remote jobContract workSummer work$90 per hour
...is seeking senior mechanical engineering professionals to review evaluation tasks for AI systems operating in Fortune 500 enterprise product design... ...The workflows are calibrated to the design complexity, safety stakes, and production scale of Fortune 500 and large industrial...Hourly payTemporary work$80 - $120 per hour
...jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...any help or support, reach out to: ****@*****.***: Our team reviews applications daily. Please complete your AI interview and...Contract workSummer workWork at office$80 - $160 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy,...Contract workSummer workRemote work$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Remote jobContract workSummer workWork at office$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Vision Verticals Reviewer Type: Contract Compensation: $60–$80/hour Location...Remote jobContract workSummer work$25 per hour
...world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality... ...Ghana, Bangladesh, Turkey, Mexico Evaluation Process (approximately 75 mins) : ~ Assessment based review Skills: JavaScript...Contract workPart timeFor contractorsFreelanceRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Safety Annotation Reviewer. Be the first to apply!
- safety internship San Francisco, CA
- patient safety specialist San Francisco, CA
- safety associate San Francisco, CA
- safety attendant San Francisco, CA
- patient safety attendant San Francisco, CA
- site safety San Francisco, CA
- safety specialist San Francisco, CA
- warehouse safety San Francisco, CA
- entry level safety San Francisco, CA
- safety assistant San Francisco, CA






