Remote AI Evaluation Auditor for Gmail & Calendar
AuraOne, Inc.
AuraOne, Inc. seeks a remote Gmail & Calendar AI Assistant Evaluator to review prompts and responses against our quality rubric. You will compare outputs, tag edge cases, and write structured feedback for retraining the modeling team. As an independent contractor, you will work asynchronously, at least 10 hours per week, calibrating against gold-standard examples and documenting recurring failure modes to inform future training runs. #J-18808-Ljbffr
- Executive Staff Recruiters / ESR Healthcare is seeking a meticulous Gmail & Google Calendar AI Assistant Evaluator for a remote contract role based in the United States. You will perform real-world digital tasks, give AI clear instructions, and review results to ensure...Remote jobContract work
- Frontier AI Lab is seeking a Gmail & Google Calendar AI Assistant Evaluator to work remotely as a contractor in the United States. You will perform everyday digital tasks, give clear AI instructions, and review results for accuracy. The role focuses on evaluating AI assistants...Remote jobFor contractors
- # Gmail & Google Calendar AI Assistant EvaluatorFrontier AI Lab · Remote · Full-time## Ready to see if you fit?Upload a resume once, then run an honest fit check on... ...engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing...Remote workFull timeFor contractors
- ...Gmail & Google Calendar AI Assistant Evaluator is a remote evaluation track for reviewing gmail google calendar ai assistant evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured...Remote jobHourly payFor contractors10 hours per week
- ...Prolific is seeking Product Designers and UX Specialists to join their Expert Network for AI training and evaluation. This role involves critical evaluation of AI-generated wireframes and design requirements, ensuring usability and adherence to accessibility standards...Remote workFlexible hours
- ...IT Risk & Controls Auditor – Digital Asset Anywhere... ...Other Workplace Type: Remote Standard Hours: Open... ...processes. Evaluate business process and IT... ...artificial intelligence (AI) tools as part of its initial... ....com address, never Gmail, Yahoo, etc. Eliassen...Remote workHourly payLocal area
- ...Other Workplace Type: Remote Standard Hours: Open... ...established methodologies. Evaluate IT controls over change... ...owners, external auditors, and project stakeholders... ...artificial intelligence (AI) tools as part of its... ...Eliassen.com address, never Gmail, Yahoo, etc. ·...Remote workHourly payLocal area
- ...Mercor is seeking a Contract Compliance Officer to evaluate AI-driven regulatory assessments for quality and accuracy. This 4-6 week, remote engagement requires 20+ hours per week and strong written English skills. You will review eligibility determinations, licenses,...Remote workContract workImmediate start
$97k - $120k
...board!Job purposeThe Senior IT Auditor is responsible for executing... ...audit conclusions. This role evaluates the efficiency and effectiveness... ...adoption, system implementations, AI, automation, and other... ...requires 3 days of onsite work, with remote work capability for 2 days,...Remote workFull time$20 - $25 per hour
...Florida, or California (Hybrid Remote)Compensation: Starting at $20/... ...startups, SaaS companies, AI companies, fintech businesses,... ...motivated, detail-oriented IT Auditors to join our growing cybersecurity... ...clients across multiple industries.Evaluate IT general controls (ITGCs),...Remote workWork from home$50 per hour
...Prolific is seeking Product Designers and UX Specialists in Austin, Texas to join their Expert Network for AI model training. This role includes evaluating AI-generated designs, ensuring adherence to usability and accessibility standards, and providing strategic feedback...Remote workHourly payWork from homeFlexible hours- ...AuraOne is seeking a remote evaluation specialist to review voice actor/coaches prompts and responses against our quality rubric. This contractor role involves comparing paired outputs, labeling edge cases, and producing structured feedback for model retraining. You...Remote workFor contractors
- ...work. Today, ServiceNow is the AI control tower for business... ...looking for an experienced Senior Auditor to support planning and lead... ...and application controls. This remote position will be reporting to... ...timely. Conduct walkthroughs, evaluate process design, and perform...Remote workFull timeWork experience placementWork at officeImmediate startFlexible hours
$50 per hour
...Prolific in Los Angeles is looking for Product Designers and UX Specialists to join their Expert Network for training AI models. Candidates will evaluate AI-generated designs, ensuring usability and adherence to accessibility standards, while providing strategic feedback...Remote workHourly payWork from homeFlexible hours- ...IT Audit Manager for a hybrid remote opportunity with a longstanding... ..., data governance, AI governance, cloud environments... ...from planning through reporting.Evaluate the design and effectiveness of... ...Certified Information Systems Auditor (CISA) certification.Strong experience...Remote work
- ...A leading AI research accelerator is seeking a medical professional with expertise in... ...involves designing clinical scenarios to evaluate AI responses, ensuring high-quality medical... ...skills. The position is fully remote, requiring a commitment of 20-40 hours per...Remote work
- ...including the department's use of AI and agentic AI tools to... ...management team (ICC) and the external auditor, and works closely with IT and... ...and support ICC's deficiency evaluation.System Implementation and... ...control, DCS/PLCs, historians, remote access), including IT/OT...Remote workWork from home
$150 per hour
...100k+ experts train the world’s leading AI models. You’ll run agentic coding sessions... ...they fail in interesting ways. Flexible, remote, and always project-available. Compensation... ...-on role focused on real-world coding and model evaluation. #J-18808-Ljbffr DataAnnotationRemote jobHourly payFlexible hours- AuraOne is seeking a remote contractor to evaluate AI-generated CAD design outputs for Mechanical Design Engineer - CAD & Manufacturing roles. Reviewers assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrected approaches...Remote jobFor contractors
- A leading AI research accelerator is seeking a medical expert in internal or emergency... ...involves designing clinical scenarios, evaluating AI responses, and collaborating with researchers... ...communication skills. This is a fully remote contractor position requiring 20-40 hours...Remote workFor contractors
$20 - $22 per hour
...Hybrid (2 days in-office, 3 days remote) Compensation: $20–$22 per... ...startups, SaaS companies, AI companies, fintech businesses,... ...motivated, detail-oriented Junior IT Auditor to join our growing... ...cybersecurity professionals to evaluate organizations' security controls...Remote workHourly payInternshipWork at office2 days per week3 days per week$178k - $266k
...Posting Type Hybrid/Remote Job Overview The Staff IT Auditor leads second-line assurance for Relativity's control... ..., including NIST CSF 2.0, NIST AI RMF, NIST 800-53, ISO/IEC 27001/270... ...testing program, including deficiency evaluation and reporting. ~ Expert knowledge...Remote workWork at officeShift work$125 per hour
AI Trainer Jobs seeks an AEC Specialist for a remote review track evaluating AI outputs across AEC specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operations risks and document the next steps so the modeling...Remote jobHourly payFor contractors- AuraOne, Inc. is seeking a College Vocational Instructor to remotely assess AI outputs within education review workflows. You will evaluate tone, adherence to policy, and stakeholder fit using a structured rubric. As a contractor with flexible availability, you will flag...Remote jobFor contractorsFlexible hours
$70 per hour
AuraOne is seeking specialists for a remote review track focused on evaluating AI outputs across material science phd coding experts operations workflows. Reviewers assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document...Remote jobHourly pay10 hours per week- ...DataAnnotation is seeking a Physicist to evaluate AI reasoning across mechanics, E&M, quantum, and thermodynamics, and to write solutions with the care of a good problem-set grader. You’ll craft problems exposing weak reasoning, review AI solutions for dimensional errors...Remote work
$40 - $125 per hour
...DataAnnotation is seeking a Finance Expert to evaluate AI-built financial analyses on real corporate scenarios and to write judgments that... ...back through the model’s math to expose inconsistencies. Remote, flexible, project-based work with earnings up to $40–$125+/hr...Remote workFlexible hours- DataAnnotation is seeking a Finance Expert to evaluate AI-built financial analyses, verify valuation assumptions, and document defensible... ...CFO-ready analyses. This flexible, project-based role offers remote work and competitive hourly compensation depending on task complexity...Remote workHourly payFlexible hours
$30 - $80 per hour
...AI Trainer Jobs seeks a remote Executive Assistant / Admin reviewer to evaluate AI outputs across executive assistant operations. Reviewers grade workflow correctness, policy adherence, stakeholder fit, and document the right next step so the modeling team can train on...Remote workHourly payFor contractorsFlexible hours- ...DataAnnotation is seeking a Finance Expert to evaluate AI-built financial analyses on real corporate scenarios, trace the numbers, and... ...clearly explain drivers so CFOs can trust the conclusions you reach. This role is flexible, remote, and project-based. #J-18808-LjbffrRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Auditor for Gmail & Calendar. Be the first to apply!



