AI Trainer
AuraOne
About the role
AI Trainer is a remote evaluation track for reviewing ai trainer evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
AI data reviewers help turn ai trainer evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Review frontier model outputs. Judge benchmark failures and calibrate other evaluators.
Responsibilities
- Evaluate ai trainer evaluation model outputs against a versioned rubric and assign severity tags for AI Trainer assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
What you should bring
- Prior evaluation, annotation, or human-rater experience on ai trainer evaluation or adjacent content for AI Trainer work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Role signals
Example tasks
- Compare two ai trainer evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Useful experience
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Compensation and schedule
Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.
Skills used in matching
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- AI Trainer evaluation
- AI model evaluation
Application boundary
Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.
Specialist intake
The intake preserves your chosen role, the visible terms, and source attribution for reviewer context.
- 01 Confirm profile and eligibility details.
- 02 Attach this role deliberately.
- 03 Receive a human review decision or follow-up.
Placement timing depends on program demand and reviewer confirmation.
$75 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...SuggestedContract workSummer workInternshipRemote workFlexible hours$170.6k
...Job Details: Job Description: The Role and Impact As an AI Software Engineering PhD Intern, you will contribute to the design, development, and optimization of cutting-edge AI software solutions across domains such as computer vision, machine learning, and deep learning...SuggestedInternshipLocal areaImmediate startWorldwideShift work$40 - $125 per hour
...Job Description About the role \n DataAnnotation is looking for experienced drug discovery scientists to evaluate how frontier AI models handle real discovery and preclinical work: SAR analysis, screening cascades, DMPK and PK/PD interpretation, biomarker strategy...SuggestedContract workWork at officeRemote work10 hours per weekFlexible hours- ...innovation engine of IBM. Exploring what's next in computing and shaping the technologies the world will rely on tomorrow. From advancing AI and hybrid cloud to pioneering practical quantum computing, we anticipate challenges and unlock new opportunities for clients,...SuggestedFull timeContract workPart timeFixed term contractInternshipShift work
- ...We are seeking a proactive and detail-oriented Eightfold AI Technical Support Engineer with hands-on experience supporting the Eightfold AI platform and its key modules, including Talent Acquisition, Talent Management, and Talent Design. Mandatory Skills Eightfold...SuggestedContract work
- DataAnnotation seeks an experienced Radiologist or credentialed imaging professional to help train AI models by reviewing de-identified studies and writing structured reports documenting every finding. You will provide clear impressions and recommend next steps, such as...
$20 - $55 per hour
About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of millions...Hourly payFor contractorsRemote work$125 per hour
We’re looking for an experienced Radiologist to help train AI models. You’ll measure how well frontier models interpret medical images, check their reasoning, and help raise the quality of each new version. This is a new and growing area: teaching AI to read diagnostic...Full timeRemote workFlexible hours$110k - $140k
About Centric Software:Centric Software is a global leader, providing an innovative and AI-enabled product-concept-to-commercialization platform for retailers, brands and manufacturers of all sizes. We equip retail, fashion, luxury, footwear, outdoor, home and consumer...Full timeRemote work- ...Must be okay with repetitive work. 1+ year experience working at companies like Apple, Google, Amazon, Tesla, Rivian, Microsoft, Scale AI, Waymo. Nice-to-have background and skills: Programming/coding knowledge (especially Python). #J-18808-Ljbffr OSI Engineering, Inc.
- ...Job DescriptionJob Description Indent : PSL307525-6Role : Senior Data Scientist / AI EngineerLocation : RemoteSalary: $120k to $125kIMP: - Skills - Agentic AI (A2A , MCP) , Azure Cloud , healthcare -payer space experience.Exp : 10 Job description:-We're looking for a...
- Contractor is expected to support a range of activities associated with dashboarding and analytics. The nature of the work tends to fall into two categories: Complementary detailed analytical and/or critical documentation development work supporting an inflight project...For contractors
- Job DescriptionJob Description Primary Skill : DataBricks, NumPy, Python Job Description : Job Requirements Role : Data Scientist Experience : 4 Years Job Description:" 4 years of primary, hands-on experience in Data Science and Predictive Modeling, with a strong foundation...Work experience placement
- Data ScientistLocation: RemoteDuration: Long Term10 years of experience and 5 years of work experience in data scientist discipline in FMCG/CPG/Retail industry.Hands-on expertise in building advanced analytics/machine learning models for price elasticity, promo optimization...Work experience placement
- Job DescriptionJob Description We are seeking a highly skilled Data Scientist for a hybrid contract role. This position requires a professional who can bridge the gap between complex data modeling and business strategy. The ideal candidate will be present in the office...Contract workWork at office3 days per week
- ...offering across LLM platforms. Apply causal inference methodologies to attribute revenue and conversion changes to product features in AI-driven checkout flows. Develop behavioral models to understand merchant and consumer interactions within conversational commerce...Full timeWork at officeLocal areaImmediate startRemote workFlexible hours
$131.7k - $219.5k
...for an experienced Data Scientist to join our AMI team. This hands‑on role combines Machine Learning, statistical modeling, Generative AI, Retrieval‑Augmented Generation (RAG), model evaluation, and applied AI experimentation for enterprise AI applications. AMI supports...$184.7k - $324.8k
...Role Number: 200631850 Team: Machine Learning and AI Location: Cupertino; Seattle Posted: 2025-11-12 Summary Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? Within...Work experience placementRelocation$156k - $204.23k
...will be sitting out of our Santa Clara, CA office and relocation support isnt available at this time. About this opportunity The AI Innovation & Incubation (AIII) team in Silicon Valley is a group of applied research professionals using AI and foundation models to...Temporary workWork at officeRelocation package$145k - $180k
...air mobility platform that delivers air taxis, unmanned aircraft systems (“UAS”), aviation-related physical artificial intelligence (“AI”) solutions, and other technologies to customers worldwide across the commercial aerospace and defense sectors. Our sights are set...Local areaWorldwideVisa sponsorshipNight shift$170k - $225k
About Us At Versa Networks, we're revolutionizing the way businesses connect, secure, and optimize their networks. Our mission is to secure anywhere, anytime access to anything. As a leader in Secure SD-WAN, SSE (Secure Service Edge), SASE (Secure Access Service Edge...Work at officeRemote workFlexible hours$152k - $264.5k
...NVIDIA is hiring a Senior Data Scientist for its Finance Data Science and AI team in Santa Clara, CA (onsite) . In this role, you will integrate Data Science and AI solutions into financial workflows, helping translate analytics into measurable outcomes for both...- ...Company Overview TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider. We are a force multiplier for defenders, helping organizations enhance their cybersecurity posture through advanced threat detection, rapid response...Work at office
- Data ScientistWe are seeking a seasoned Data Scientist to collaborate closely with cross-functional teams. Your role will be pivotal in shaping our product strategy using robust scientific methodologies. Leveraging your expertise in statistical analysis, machine learning...
$248k - $379.5k
...experience even at high resolutions and fps and at industry leading low latencies. Our team is building the Diagnostic, Prescriptive and AI-augmented Analytics solutions that encompass processing, visualization, anomaly detection, root cause and predictive modeling for the...Full timeRemote work- Principal Data ScientistIt's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business.If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your...
$80 - $160 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote workFlexible hours- NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using...
- ...Introduction Join the pioneering AI Foundations Research team at IBM Research and contribute to shaping the future foundations of artificial intelligence. Our group of scientists, engineers, and designers is dedicated to conducting end-to-end research that delivers real...Full timeContract workPart timeFixed term contractInternshipShift work
$55.56 per hour
...company that could do that for everyone-freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of...Full timeSummer workInternshipWork at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Trainer. Be the first to apply!






