Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Trainer

Temporary

AuraOne

About the role

AI Trainer is a remote evaluation track for reviewing ai trainer evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
AI data reviewers help turn ai trainer evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Review frontier model outputs. Judge benchmark failures and calibrate other evaluators.

Responsibilities

  • Evaluate ai trainer evaluation model outputs against a versioned rubric and assign severity tags for AI Trainer assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

What you should bring

  • Prior evaluation, annotation, or human-rater experience on ai trainer evaluation or adjacent content for AI Trainer work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

  • Compare two ai trainer evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Useful experience

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Compensation and schedule

Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • AI Trainer evaluation
  • AI model evaluation

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.

Specialist intake

The intake preserves your chosen role, the visible terms, and source attribution for reviewer context.

  • 01 Confirm profile and eligibility details.
  • 02 Attach this role deliberately.
  • 03 Receive a human review decision or follow-up.
    Placement timing depends on program demand and reviewer confirmation.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the AI Trainer in San Jose, CA vacancy
  • $75 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Suggested
    Contract work
    Summer work
    Internship
    Remote work
    Flexible hours

    Mercor

    San Jose, CA
    a month ago
  • $170.6k

     ...Job Details: Job Description: The Role and Impact As an AI Software Engineering PhD Intern, you will contribute to the design, development, and optimization of cutting-edge AI software solutions across domains such as computer vision, machine learning, and deep learning... 
    Suggested
    Internship
    Local area
    Immediate start
    Worldwide
    Shift work

    Intel

    Santa Clara, CA
    1 day ago
  • $40 - $125 per hour

     ...Job Description About the role \n DataAnnotation is looking for experienced drug discovery scientists to evaluate how frontier AI models handle real discovery and preclinical work: SAR analysis, screening cascades, DMPK and PK/PD interpretation, biomarker strategy... 
    Suggested
    Contract work
    Work at office
    Remote work
    10 hours per week
    Flexible hours

    DataAnnotation

    Mountain View, CA
    4 days ago
  •  ...innovation engine of IBM. Exploring what's next in computing and shaping the technologies the world will rely on tomorrow. From advancing AI and hybrid cloud to pioneering practical quantum computing, we anticipate challenges and unlock new opportunities for clients,... 
    Suggested
    Full time
    Contract work
    Part time
    Fixed term contract
    Internship
    Shift work

    IBM

    San Jose, CA
    3 days ago
  •  ...We are seeking a proactive and detail-oriented Eightfold AI Technical Support Engineer with hands-on experience supporting the Eightfold AI platform and its key modules, including Talent Acquisition, Talent Management, and Talent Design. Mandatory Skills Eightfold... 
    Suggested
    Contract work

    2T Consulting

    Santa Clara, CA
    a month ago
  • DataAnnotation seeks an experienced Radiologist or credentialed imaging professional to help train AI models by reviewing de-identified studies and writing structured reports documenting every finding. You will provide clear impressions and recommend next steps, such as... 

    DataAnnotation

    Mountain View, CA
    3 days ago
  • $20 - $55 per hour

    About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of millions... 
    Hourly pay
    For contractors
    Remote work

    Inworld, Inc.

    Mountain View, CA
    5 days ago
  • $125 per hour

    We’re looking for an experienced Radiologist to help train AI models. You’ll measure how well frontier models interpret medical images, check their reasoning, and help raise the quality of each new version. This is a new and growing area: teaching AI to read diagnostic... 
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Sunnyvale, CA
    4 days ago
  • $110k - $140k

    About Centric Software:Centric Software is a global leader, providing an innovative and AI-enabled product-concept-to-commercialization platform for retailers, brands and manufacturers of all sizes. We equip retail, fashion, luxury, footwear, outdoor, home and consumer... 
    Full time
    Remote work

    Centric Software

    Campbell, CA
    4 days ago
  •  ...Must be okay with repetitive work. 1+ year experience working at companies like Apple, Google, Amazon, Tesla, Rivian, Microsoft, Scale AI, Waymo. Nice-to-have background and skills: Programming/coding knowledge (especially Python). #J-18808-Ljbffr OSI Engineering, Inc.

    OSI Engineering, Inc.

    Cupertino, CA
    5 days ago
  •  ...Job DescriptionJob Description Indent : PSL307525-6Role : Senior Data Scientist / AI EngineerLocation : RemoteSalary: $120k to $125kIMP: - Skills - Agentic AI (A2A , MCP) , Azure Cloud , healthcare -payer space experience.Exp : 10 Job description:-We're looking for a... 

    PeopleNTech

    Santa Clara, CA
    2 days ago
  • Contractor is expected to support a range of activities associated with dashboarding and analytics. The nature of the work tends to fall into two categories: Complementary detailed analytical and/or critical documentation development work supporting an inflight project...
    For contractors

    TechDigital Group

    San Jose, CA
    4 days ago
  • Job DescriptionJob Description Primary Skill : DataBricks, NumPy, Python Job Description : Job Requirements Role : Data Scientist Experience : 4 Years Job Description:" 4 years of primary, hands-on experience in Data Science and Predictive Modeling, with a strong foundation...
    Work experience placement

    Diversity Nexus

    San Jose, CA
    1 day ago
  • Data ScientistLocation: RemoteDuration: Long Term10 years of experience and 5 years of work experience in data scientist discipline in FMCG/CPG/Retail industry.Hands-on expertise in building advanced analytics/machine learning models for price elasticity, promo optimization...
    Work experience placement

    Rootshell Inc

    Santa Clara, CA
    1 day ago
  • Job DescriptionJob Description We are seeking a highly skilled Data Scientist for a hybrid contract role. This position requires a professional who can bridge the gap between complex data modeling and business strategy. The ideal candidate will be present in the office...
    Contract work
    Work at office
    3 days per week

    Macpower Digital Assets Edge Private Limited

    San Jose, CA
    2 days ago
  •  ...offering across LLM platforms. Apply causal inference methodologies to attribute revenue and conversion changes to product features in AI-driven checkout flows. Develop behavioral models to understand merchant and consumer interactions within conversational commerce... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    PayPal

    San Jose, CA
    2 days ago
  • $131.7k - $219.5k

     ...for an experienced Data Scientist to join our AMI team. This hands‑on role combines Machine Learning, statistical modeling, Generative AI, Retrieval‑Augmented Generation (RAG), model evaluation, and applied AI experimentation for enterprise AI applications. AMI supports... 

    BMC Software

    Santa Clara, CA
    3 days ago
  • $184.7k - $324.8k

     ...Role Number: 200631850 Team: Machine Learning and AI Location: Cupertino; Seattle Posted: 2025-11-12 Summary Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? Within... 
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $156k - $204.23k

     ...will be sitting out of our Santa Clara, CA office and relocation support isnt available at this time. About this opportunity The AI Innovation & Incubation (AIII) team in Silicon Valley is a group of applied research professionals using AI and foundation models to... 
    Temporary work
    Work at office
    Relocation package

    Ericsson

    Santa Clara, CA
    3 days ago
  • $145k - $180k

     ...air mobility platform that delivers air taxis, unmanned aircraft systems (“UAS”), aviation-related physical artificial intelligence (“AI”) solutions, and other technologies to customers worldwide across the commercial aerospace and defense sectors. Our sights are set... 
    Local area
    Worldwide
    Visa sponsorship
    Night shift

    Archer Aviation

    San Jose, CA
    4 days ago
  • $170k - $225k

    About Us At Versa Networks, we're revolutionizing the way businesses connect, secure, and optimize their networks. Our mission is to secure anywhere, anytime access to anything. As a leader in Secure SD-WAN, SSE (Secure Service Edge), SASE (Secure Access Service Edge...
    Work at office
    Remote work
    Flexible hours

    Versa Networks

    Santa Clara, CA
    5 days ago
  • $152k - $264.5k

     ...NVIDIA is hiring a Senior Data Scientist for its Finance Data Science and AI team in Santa Clara, CA (onsite) . In this role, you will integrate Data Science and AI solutions into financial workflows, helping translate analytics into measurable outcomes for both... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...Company Overview TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider. We are a force multiplier for defenders, helping organizations enhance their cybersecurity posture through advanced threat detection, rapid response... 
    Work at office

    TenEx

    San Jose, CA
    5 days ago
  • Data ScientistWe are seeking a seasoned Data Scientist to collaborate closely with cross-functional teams. Your role will be pivotal in shaping our product strategy using robust scientific methodologies. Leveraging your expertise in statistical analysis, machine learning...

    Aven, Inc.

    Campbell, CA
    1 day ago
  • $248k - $379.5k

     ...experience even at high resolutions and fps and at industry leading low latencies. Our team is building the Diagnostic, Prescriptive and AI-augmented Analytics solutions that encompass processing, visualization, anomaly detection, root cause and predictive modeling for the... 
    Full time
    Remote work

    NVIDIA

    Santa Clara, CA
    2 days ago
  • Principal Data ScientistIt's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business.If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your...

    Opportunities

    San Jose, CA
    1 day ago
  • $80 - $160 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Jose, CA
    20 days ago
  • NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using...

    NutaNXT Technologies

    Santa Clara, CA
    4 days ago
  •  ...Introduction Join the pioneering AI Foundations Research team at IBM Research and contribute to shaping the future foundations of artificial intelligence. Our group of scientists, engineers, and designers is dedicated to conducting end-to-end research that delivers real... 
    Full time
    Contract work
    Part time
    Fixed term contract
    Internship
    Shift work

    IBM

    San Jose, CA
    4 days ago
  • $55.56 per hour

     ...company that could do that for everyone-freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of... 
    Full time
    Summer work
    Internship
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Trainer. Be the first to apply!