AI Session Evaluator & Training Specialist
Mercor
Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said with what was visible, and score it against a detailed rubric. Your written comments are the deliverable, and you will flag failures for correction. This is judgment work, not volume work, with careful attention to safety and accuracy in every review. #J-18808-Ljbffr Mercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Session Evaluator & Training Specialist in Seattle, WA vacancy
$134k - $179k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...As a Technical Education Specialist, you will keep CoreWeave's internal... ...demos, and similar sessions, and you will own the health... ...recurring programs, events, or training sessions on a published cadence...SuggestedPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Bellevue, WA1 day ago- Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools while contributing to the future of AI. You will evaluate model responses, review output quality, and provide...SuggestedRemote jobFull timeContract work
- Handshake is seeking an AI Policy Generalist in Seattle to translate complex customer policies into consistent, well-reasoned evaluations of AI model behavior. You will read user requests, model outputs, and history to determine the correct policy category and cite evidence...Suggested
- mpathic.ai in Seattle is seeking AI Safety Experts for a temporary project to evaluate and improve the safety, reliability, and real-world behavior of frontier AI systems... ...with structured rubrics, annotate data for training and benchmarking, and identify risks and improvement...SuggestedTemporary work
$55 - $120 per hour
...engineering content-policy evaluation role. Applicants must... ...we started Handshake AI and built the fastest-... ...data-intensive post-training techniques. We believe... ...Role As an AI Policy Specialist on the Violence &... ...Familiarity with calibration sessions, inter-rater agreement...SuggestedMonday to FridayShift work- YO AI Labs is seeking Turkish bilingual experts for a contract-based remote role focusing on language and AI training. You will evaluate Turkish audio samples, assess quality, and provide precise feedback to help improve AI systems. No prior AI experience is required, but...Remote jobContract work
- YO AI Labs is seeking a Child Development Psychologist (PhD) to support an AI training project as a contractor. You will evaluate and annotate data, analyze developmental scenarios, and provide expert guidance to improve AI systems' accuracy, cultural relevance, and psychological...Remote jobFor contractors
- InforCapital, partnership seeks a Licensed Real Estate Agent - AI Quality Evaluator for a part-time remote role based in Seattle, WA. The ideal candidate must have a bachelor's degree and at least 3 years of real estate experience. Responsibilities include fine-tuning...Remote jobPart timeFor contractors
$50 - $70 per hour
..., you will partner with other Spur Reply training team members and our client’s learning development... ...processes. These courses and virtual sessions will serve an audience of up to 1,400... ...management programs Familiarity with AI tools to accelerate content synthesis and...Contract work- ...We are looking for a Case Evaluator to run the first real conversation... ...decide whether a Legal Roadmap Session with one of our senior... ...review, not phone-script drills AI-first tooling (Gong, HubSpot,... ...stipend to support certifications, training, and continued education. ~...
$100 per hour
...What This Role Actually Is You will assess how AI coding agents behave in real-world scenarios — focusing on: Whether the response... ...taste — not syntax correctness. What You’ll Be Doing Evaluate AI-generated coding interactions end-to-end Judge whether outputs...Contract workImmediate startG2i
Seattle, WA22 days ago$100 per hour
...looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI... ...engineer. What This Role Actually Is You will assess how AI coding agents behave in real-world scenarios — focusing on:...Contract workImmediate startG2i
Seattle, WA22 days ago$82.6k - $162.8k
...highly skilled and passionate individual to join our team as an AI Design Facilitator and Forward-Deployed Engineer II - Consultant... ...Teaching Technical AI Skills: Develop and deliver comprehensive training programs on generative AI technologies, including tools such as...Local area$29 per hour
...Northwest Ambulance is looking for an Training Specialist to help shape the next generation of our... ...Help run quarterly OTEP skill sessions and public CPR & First Aid classes... ...current EMS certification) ~ WA State EMS Evaluator (upon meeting state criteria) ~ HSI...Hourly payNorthwest Ambulance
Mountlake Terrace, WA4 days ago- ...We are seeking a seasoned Training Specialist to design, develop, and deliver IT training programs... ...training methods including classroom sessions, computer-based training (CBT),... ...presentations, manuals, videos, and CBTs. Evaluate training effectiveness and adjust programs...
Compunnel
Seattle, WA3 days ago - YO AI Labs seeks a Personal Financial Advisor (Private Wealth) contractor (US only) to help train next-gen AI systems using real-world wealth management expertise. You'll provide actionable guidance across budgeting, investments, retirement planning, and debt management...Remote jobFor contractors
$125 per hour
...providing outpatient psychotherapy and evaluations for ADHD and Autism. This role is ideal... ...part of providing assessments, you will be trained to utilize standardized questionnaires... ...Provide individual and couples therapy sessions to clients, with a focus on neurodivergent...Hourly payFull timePart timeRemote workFlexible hours$32.91 - $40.44 per hour
...holiday pay and paid time off. Job Description The Training Specialist will foster and support an inclusive and high-performance training... ...training environment Facilitate interactive training sessions in the classroom and on the ramp for on-the-job training (...TraineeshipLocal areaFlexible hoursShift workWeekend workMcGee Air Services
Seattle, WA2 days ago- ...share our dedication to excellence. Job Overview: As a Training Specialist at Oryx Dental Software, you will play a crucial role in helping... ...: Client Training: Conduct live and virtual training sessions for new and existing clients, that adjust to their learning...Full timeWork at officeLocal areaRemote workFlexible hours
Oryx Software Inc
Seattle, WA2 days ago $90k - $110k
Nakupuna Companies is seeking an Entry-Level Training Specialist in support of the Department of State... ...(GA/FAM). Schedule training sessions and coordinate logistics Maintain training... ...-training assessments Conduct skills evaluations and competency testing Provide...Contract workWork at office- Nakupuna Companies is seeking an Entry-Level Training Specialist to support the Department of State (DoS) Bureau of Global Acquisitions (GA) in Washington, DC. The role entails scheduling sessions, tracking attendance, maintaining training records, and developing assessments...Work at office
$80k - $100k
Technology Training & Adoption Specialist OCT Consulting is a business management and technology consulting firm that supports Federal Government... ...documentation to support knowledge management. Conduct user training sessions. Assist with communication efforts to facilitate smooth...Contract workTemporary workRemote work- The TRIRIGATraining and Change Management Specialist oversees training strategy, content development, and delivery activities. The Training and Change... ...led (virtual or in‑person), recorded, and hybrid training sessions using IRS-approved platforms (e.g., Microsoft Teams, Adobe...
- Robots & Pencils is an applied AI engineering firm building the next frontier of business... ...product success metrics and use data to evaluate outcomes, inform priorities, and drive... ...executive level Lead complex stakeholder working sessions, workshops, and decision-making forums...Local area
$214.08k - $332.2k
...team, you will play a critical role in shaping the future of Zoom AI through innovative engineering solutions. You'll take the lead... ...and AIEA runtime services in alignment with organizational goals.Evaluate emerging AI technologies and frameworks to enhance the team’s...Full timeWork at officeRemote work- YO AI Labs is seeking a Hebrew bilingual expert to contribute to an AI training project focused on Hebrew language understanding and generation. You will evaluate Hebrew audio, judge nativeness and linguistic quality, and provide detailed feedback. No prior AI experience...Remote jobFor contractorsFlexible hours
- Acentra Health is seeking a PASRR Clinical Evaluator - PRN to join our growing team. This role conducts PASRR evaluations, makes level of care recommendations, and ensures that the quality of care provided meets industry standards and complies with government regulations...ReliefFlexible hours
- Acentra Health is seeking a PASRR Clinical Evaluator to perform PASRR Level II assessments, make level-of-care recommendations, and ensure the quality of care meets regulatory standards across Yakima, Washington. This full-time position is a hybrid role combining telehealth...Full time
- CXG in the United States connects premium brands with a global network of evaluators. As a luxury brand evaluator, you will discreetly assess in-store and online experiences and provide actionable feedback to help brands refine service quality. Assignments are flexible...Flexible hours
$80k - $102k
...and Tacoma areas. Key Responsibilities: Conduct diagnostic evaluations, provide diagnoses, and deliver psychotherapy and treatment planning... ...(e.g., LCSW). Additional certifications or specialized training in specific therapeutic modalities or populations served are desirable...Full timeLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Session Evaluator & Training Specialist. Be the first to apply!
Related searches
- quality evaluator Seattle, WA
- evaluator Seattle, WA
- ai evaluator Seattle, WA
- education evaluator Seattle, WA
- social media evaluator Seattle, WA
- ai scientist Seattle, WA
- ai data scientist Seattle, WA
- learning and development facilitator Seattle, WA
- learning facilitator Seattle, WA
- community learning facilitator Seattle, WA