Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Insights - Executive Report Evaluation Expert [Remote]

AuraOne Human Data

Remote
  • Remote job

Head of Insights - Executive Report Evaluation Expert is a remote review track for evaluating AI outputs across head of insights executive report evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

Why this role matters

Head of Insights Executive Report Evaluation specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.

Responsibilities

  • Review AI outputs against current head of insights executive report evaluation specialist operations workflows, playbooks, and firm policy for Head of Insights - Executive Report Evaluation Expert assignments.
  • Grade tone, escalation logic, and stakeholder fit on a structured rubric.
  • Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
  • Capture the right next step so the modeling team can train on it.
  • Adjudicate disputed treatments against published playbooks or firm guidance.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Direct working experience in head of insights executive report evaluation specialist operations on real teams for Head of Insights - Executive Report Evaluation Expert work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the policy or workflow being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's response to a real head of insights executive report evaluation specialist operations ticket and rate workflow, tone, and escalation.
  • Flag a missed escalation with the right severity tag and corrected next step.
  • Adjudicate a disputed playbook call between two reviewers using firm guidance.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior experience training, calibrating, or QA-ing operations teams.
  • Familiarity with AI-assisted workflow tooling and its failure modes.
  • Bilingual experience for cross-region operations.

Skills

  • Operational review
  • Policy adherence
  • Workflow judgment
  • Stakeholder communication
  • Head of Insights Executive Report Evaluation specialist operations

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$200 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Head of Insights - Executive Report Evaluation Expert [Remote] in Remote vacancy
  • $70 per hour

     ...Generalist Head of Consumer Insights Expert Ethos • Remote Education...  ...structuring readouts for executives ▍ Deep expertise in...  ...decision-ready decks to create, evaluate, and refine AI-generated...  ...presentations, tracker reports, qualitative findings storytelling... 
    Suggested
    Hourly pay
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Ethos

    United Kingdom
    21 days ago
  • $70 per hour

     ...Business Head of Executive Messaging Expert Ethos • Remote Education Not stated Type Hourly Pay Rate $70/hr Listed...  ...keynotes and building the decks behind them to create, evaluate, and refine AI-generated presentations and slide decks across... 
    Suggested
    Hourly pay
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Ethos

    United Kingdom
    21 days ago
  • $74.3k - $106.1k

     ...and capabilities. Summary As a Data Analytics and Reporting Subject Matter Expert (SME) at Gainwell, you can contribute your skills as we harness...  ...key business metrics and gather requirements for which insights should be made available at scale. Architect data... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Gainwell Technologies LLC

    Ohio
    1 day ago
  • $70 - $100 per hour

     ...Larry Summers , and Jack Dorsey . Position: Domain Expert - Financial Reporting (Workiva) Type: Contract Compensation: $70–$100...  ...areas above Prior data annotation, labeling, or AI evaluation experience is a plus Application Process (Takes 20–30... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    17 days ago
  •  ...Alignerr is seeking French language experts to evaluate and improve AI systems trained on French content. Your linguistic insight and teaching background will shape how AI understands, generates, and teaches French—impacting one of the world's most influential languages... 
    Suggested
    Hourly pay
    Contract work
    Remote work

    Alignerr Corp.

    Seattle, WA
    1 hour ago
  • Alignerr Corp. is seeking French language experts to help evaluate and improve AI systems trained on French-language content. Your linguistic insight will shape how AI understands, generates, and teaches French, affecting learners worldwide. You'll work remotely on a freelance... 
    Remote job
    Hourly pay
    Freelance
    Worldwide

    Alignerr Corp.

    Los Angeles, CA
    5 days ago
  • $70 per hour

     ...experienced market research and insights professionals who can help...  ...-ready decks to create, evaluate, and refine AI-generated presentations...  ...presentations, tracker reports, qualitative findings...  ...and structuring readouts for executives Expert-level PowerPoint and slide craftsmanship... 
    Immediate start
    Remote work
    Flexible hours

    Ethos

    New York, NY
    4 days ago
  • $140 per hour

     ...Jack Dorsey . Position: Healthcare Survey Research & Pharma Insights Expert Type: Contract Compensation: $140/hour Location: Remote Role...  ...objectives into clear, methodologically sound questionnaires. Evaluate screeners, eligibility criteria, question wording, response... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    3 days ago
  • $40 - $80 per hour

     ...modern artificial intelligence. Experts review model-generated...  ...useful and reliable results. Evaluate AI-generated text for accuracy...  ...Role As a Military Operations Reporting AI Training Expert, you will...  ...processes, recurring reports, and executive updates will inform detailed... 
    Hourly pay
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $8 - $65 per hour

     ...for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological...  ...the benefits of a unique platform connecting researchers with professional insights. #J-18808-Ljbffr Prolific
    Remote job
    Flexible hours

    Prolific

    Phoenix, AZ
    2 days ago
  • Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    2 days ago
  • Prolific is seeking Legal Subject Matter Experts to join our Expert Network to train and evaluate AI models using professional legal insight. If successful, you'll join Prolific's Legal Projects as a participant, where you'll be paid to train and evaluate powerful AI models... 
    Remote job
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $114.7k - $236.7k

     ...Location: Sacramento Job Summary The Executive Director of Accreditation and Evaluation provides strategic leadership,...  ...improvement (CQI) enterprise. Reporting to the Associate Dean for Academic...  ...regulatory or accreditation deadlines. Expert knowledge of higher education... 
    Temporary work
    Work at office
    Local area
    Remote work
    Shift work

    University of California - Davis

    Sacramento, CA
    5 days ago
  •  ...strategy, optimize lifecycle execution, and drive customer...  ...betting company, is seeking a Head of CRM to lead scalable lifecycle...  ...service reliability, and report key insights to stakeholders. Translate...  ...updates, and best practices. Evaluate CRM technologies, automation... 
    Full time
    Work at office
    Remote work

    Soft2Bet

    Fort Lee, NJ
    4 days ago
  • $130k - $150k

     ...shared firsthand testing insights Esquire highlighted...  ...commercially minded Head of Tiktok Shop to lead...  .... Develop and execute promotional strategies...  ...strategy for Tiktok shop. Evaluate live shopping...  ...channel KPIs, performance reporting, and a consistent operating... 
    Full time
    Remote work
    Work from home

    iRESTORE

    Remote
    18 days ago
  •  ...Description Job Description Federal Reporting & Staff Writing Expert Job Type: Contractor Location:...  .... You will create, review, and evaluate federal and military-style reports while...  ..., SITREPs, after-action reports, executive summaries, and briefings . Develop... 
    Remote job
    For contractors

    YO AI Labs

    Houston, TX
    17 days ago
  • $140 per hour

     ...Healthcare Survey Research & Pharma Insights Expert is a remote clinical-review track for evaluating AI outputs that touch pharma. Reviewers grade differential reasoning...  ...Audit a 25-case batch for rubric consistency and report drift to the program lead. Nice to have... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    23 days ago
  •  ...Job Description Research & Insights Expert – PowerPoint Review & Reconstruction...  ..., and enhancing executive-level business presentations...  ...materials such as research reports, survey results, segmentation...  ...Experience with AI training, evaluation, or rubric development. Strong... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    17 days ago
  •  ...Head of Channel Remote – US-Based...  ...security market. Reporting to the CRO, the Head...  ..., accelerate deal execution, and scale a...  ...professionals and security experts built a patent-...  ...Sandbox, CB Insights AI 100, and more....  ...cloud solutions are evaluated, purchased, implemented... 
    Full time
    Remote work
    Home office
    Flexible hours

    HiddenLayer

    Remote
    9 days ago
  •  ...About the role Research & Insights Expert is a remote review track for evaluating AI outputs across research insights research review reasoning, calculations...  ...Audit a 25-row batch for rubric consistency and report drift to the program lead. Useful experience... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    28 days ago
  •  ...Research & Insights Expert is a remote review track for evaluating AI outputs across research insights research review reasoning, calculations, and research...  ...Audit a 25-row batch for rubric consistency and report drift to the program lead. Nice to have PhD,... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $140 per hour

     ...the role Healthcare Survey Research & Pharma Insights Expert is a remote clinical-review track for evaluating AI outputs that touch pharma. Reviewers grade differential...  ...Audit a 25-case batch for rubric consistency and report drift to the program lead. Useful experience... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    28 days ago
  •  ...Description EDW Senior Medicaid SME (Federal Reporting, Policy & Data Strategy) Remote (Must...  ...experienced Medicaid Subject Matter Expert to support a large State Medicaid Enterprise...  ...individual will regularly interact with executive leadership, State stakeholders, finance... 
    Permanent employment
    Contract work
    Remote work

    MSR Technology Group

    Springfield, IL
    18 days ago
  • $175.2k - $287k

     ...a Vice President, Head of Complex Excess...  ...and Excess teams. Reporting directly to the Head...  ..., leverage claims insights to influence...  ...outcomes. Set and execute a forward‑looking...  ...senior subject‑matter expert. Review and enhance...  ...of best practices. Evaluate organizational... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Flexible hours

    Zurich NA

    Dallas, TX
    5 days ago
  • $170k - $180k

     ...– Apply Now Partnership Executive About Benefitfocus: Benefitfocus...  ...intelligence, and customer insights to influence product strategy...  ...and Engineering teams to evaluate business opportunities and...  .... Develop executive-level reporting, dashboards, and business reviews... 
    Contract work
    Part time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours

    Voya Financial

    Minnesota
    3 days ago
  •  ...Head of AI City: London Division: Corporate -...  ...through differentiated insights, disciplined investments...  ...Come First - Always | Execution Supersedes Intention |...  .... You will report directly to the Chief...  ...innovation, continuously evaluating emerging artificial intelligence... 
    Temporary work
    Remote work
    Flexible hours

    Janus Henderson Investors

    United States
    1 day ago
  • $225k - $275k

     ...lanterncare.com. Head of Consultant Relations...  ...be responsible for executing Lantern's consultant relations...  ...gathering insight and feedback to help Lantern...  ...have a regular cadence to report out on results against...  ...cancer support) and how to evaluate solutions in this space... 
    Full time
    Temporary work
    Local area
    Remote work

    Lantern

    Remote
    21 days ago
  •  ...professionals who truly fit their needs. About the Role We are seeking Family Medicine Physicians to support the training and evaluation of next-generation AI systems using their primary care expertise. You will review medical records, assess AI-generated clinical... 
    Contract work
    Remote work

    Gramian Consulting Group

    Remote
    19 days ago
  •  ...Subject Matter Expert Role Description Engagement Type: Part-...  ...focused exclusively on quality evaluation and standards definition...  ...experts who provide high-value insights through audits, quality frameworks...  .... Provide structured reports with clear recommendations to... 
    Hourly pay
    Part time
    Work at office

    Scale AI

    Remote
    8 days ago
  •  ...Company Description An Enterprise client is seeking Welsh-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs,... 
    Contract work

    Lifted, an Upwork Company™

    Remote
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Insights - Executive Report Evaluation Expert [Remote]. Be the first to apply!