US Macroeconomist — AI Model Evaluation [Remote]
AuraOne Human Data
Remote
- Remote job
US Macroeconomist — AI Model Evaluation is a remote review track for evaluating AI outputs across us macroeconomist specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
US Macroeconomist specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current us macroeconomist specialist operations workflows, playbooks, and firm policy for US Macroeconomist — AI Model Evaluation assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in us macroeconomist specialist operations on real teams for US Macroeconomist — AI Model Evaluation work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real us macroeconomist specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- US Macroeconomist specialist operations
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the US Macroeconomist — AI Model Evaluation [Remote] in Remote vacancy
- Radiologist | $350/hr | Remote in US (contract, flexible part-time hours) Mercor is hiring board-certified radiologists (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical...SuggestedRemote jobHourly payContract workPart timeImmediate startFlexible hours
$15 - $35 per hour
...requirements Help Shape the Future of AI in Healthcare What if the... ...healthcare information, evaluates medical scenarios, and delivers... ...Artificial Intelligence (AI) models. We're seeking individuals currently... ...-based principles. Join us in helping shape the next generation...SuggestedHourly payFor contractorsTraineeshipFreelanceInternshipRemote workWeekday work$20 - $45 per hour
...experience, and project requirements Help Shape the Future of AI in Healthcare What if your pharmaceutical expertise... ...with opportunities to contribute to the development and evaluation of advanced AI models. We're seeking pharmaceutical regulatory, quality,...SuggestedHourly payExtra incomeContract workFor contractorsFreelanceRemote workVolga Partners
Remote5 days ago- Mercor is hiring board-certified radiologists to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient... ...: MD/DO, ABR Diagnostic Radiology certification, active US license, and 1+ year of independent practice. 3+ years post-...SuggestedRemote jobHourly payPart timeImmediate startFlexible hours
$110 per hour
...Apply to join a physician talent network supporting AI labs and companies with medical expertise. This is an open application... ...projects by bringing real-world clinical expertise to model development and evaluation. Key Responsibilities Train and evaluate AI models...SuggestedHourly payContract workRemote workConfidential
Kingsland, TX1 day ago- Mercor is seeking board-certified psychiatrists (MDs and DOs) to evaluate health AI models remotely in the United States. You will assess AI-generated... ...de-identified patient charts. We are looking for active US licenses, ABPN Psychiatry certification, and the ability to...Remote jobPart timeImmediate startFlexible hours
- Mercor is seeking experienced MDs or DOs to evaluate health AI models remotely in the United States. You will review outputs across diagnoses, clinical... ...medical accuracy and safety. The role requires an active US license, completion of residency, and 3+ years post-...Remote jobPart timeFor contractors
- SaidGig is seeking biotechnology experts for an ongoing remote, hourly contractor pool. The role centers on evaluating AI models used in bioprocess, therapeutic development, and assay developability. You will create development problems, assess AI outputs, document reasoning...Hourly payFor contractorsRemote work
$15 per hour
Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity: We are seeking detail-oriented English speakers to review AI-...Remote jobHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- Mercor connects elite creative and technical talent with leading AI research labs. The company is headquartered in San Francisco,... ...for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and policy compliance...Remote jobContract workSummer work
- Prolific is seeking Materials Science Specialists to join its Expert Network for AI training and evaluation. You will be tested briefly and, if selected, paid to work on tasks that require focused attention and technical accuracy from home. Applicants should hold a BSc...Remote jobWorldwide
- ...Constitutional AI Reward Model Evaluator is a remote evaluation track for reviewing constitutional ai reward model evaluation prompts and responses... ...calibration Constitutional Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment...Remote jobHourly payFor contractors10 hours per week
$45 - $70 per hour
...Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers... ...and Model Evaluation evaluation Work model Remote — US-eligible. Remote · Independent specialist contractor....Remote jobFor contractors10 hours per week$45 - $70 per hour
Gridnaut Recruiting is hiring a remote Behavioral Health Expert, AI Safety and Model Evaluation contractor (pay $45-$70/hr). Contribute to frontier AI... ...health setting; licensure valued but not required.; Part-time W-2 role, 20+ hours/week (up to 40); remote, US-based..Contract workPart timeFor contractorsRemote work- Draft labs is seeking remote AI Model Evaluators and AI Trainers in the United States. This role involves reviewing AI outputs, ranking responses, and providing detailed feedback to improve model performance. No prior professional experience is required, and the position...Remote jobPart timeFor contractorsFlexible hours
$295k
...leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are... ...over what we build. Each one of us is responsible for contributing to... ...and Seoul. Join us!Role Overview:Evaluation is critical to making progress in...Full timeWork at officeLocal areaRemote workHome officeCohere
New York, NY5 days ago- ...function secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed,... ..., build, and run model validation and evaluation harnesses to test AI models and... ...Costa Cruises in Southern Europe.Join us and embark on a career that offers not...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
Carnival Cruise Line
Miami, FL3 days ago $130 per hour
...Category: Coding, SWE & Agent Evaluation · Pay: $130 / hr · Location: Remote — US-eligible · Contractor ML Engineer (MSc/PhD) — AI Model Evaluation is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs...Hourly payContract workFor contractorsRemote work10 hours per weekAuraOne
San Jose, CA9 days ago$60 - $90 per hour
...About the role Machine Learning Engineer — Model Evaluation & Experimentation is a remote review track for evaluating AI outputs across machine learning engineer model... ...contractor Compensation $60–$90 / hr Eligible from US What you should bring Direct working...Contract workFor contractorsWork experience placementRemote work10 hours per weekAuraOne
San Jose, CA25 days ago$20 per hour
Job Description We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects. We are building an in-house contributor team for work across AI model evaluations, computer-use tasks, response ranking, red teaming, tool-use evaluation...Part timeFor contractorsWork experience placementRemote workFlexible hours- Mercor is seeking board-certified critical care physicians (MDs/DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-identified patient charts and judge AI answers to clinical questions in critical care. Responsibilities include evaluating...Remote jobHourly payPart timeImmediate start
- General Motors, through Embodied AI, seeks a Senior Engineer to measure and visualize AV model performance. You will design and implement evaluation workflows, collaborate across Data, Infra and validation teams, and connect offline evaluation with real-world behavior....Remote job
$219k - $351k
...memory-bandwidth business. As models scale past what any single GPU... ...memory as the core product of AI inference, not an afterthought... ...roles at this level across all US locations and functions. Pay... ...to ensure every candidate is evaluated fairly and holistically.Recruiting...Work at officeRemote workFlexible hoursSamsung Semiconductor
San Jose, CA3 days ago- Mercor Operations is seeking a board-certified radiologist (MD or DO) to evaluate health AI models. You will read de-identified patient charts and judge AI-provided radiology answers for clinical accuracy. This is a fully remote, part-time, hourly role open to qualified...Remote jobHourly payPart timeFor contractors
- ...is seeking a QA Engineer for a remote contractor role focused on AI training data quality. You will design and execute tests to validate AI outputs, annotate datasets to improve model training, and evaluate predictions for errors and patterns. Collaboration with cross-...Remote jobFor contractors
$145k - $200k
...engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of... ...requirements. Our customers rely on us for frontier AI capabilities running... ...capabilities and the ability to quickly evaluate and integrate new models and...Full timeWork experience placementWork at officeRemote workWork from homeRelocation packagePalantir Technologies
Palo Alto, CA1 day ago- As the Manager of Model Validation & Verification (VnV) for Behavior... ...science team responsible for evaluating, benchmarking, and validating... ...robotics, autonomous systems, or AI/ML. Domain Knowledge: Strong... ...-oriented team. Follow us on LinkedIn Accommodations If...Temporary workRelocation package
$86.8k - $198k
Model and Simulation Software EngineerThe Opportunity: You will play... ...) capabilities by integrating AI‑enabled models that support... ...next‑generation M&S systems by evaluating new frameworks, enhancing simulation... ...simulation environments.Join us. The world can't wait.You Have...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Suffolk, VA2 days ago$77.6k - $176k
AI Model EngineerThe Opportunity: As an AI Model Engineer, you’ll advance organizational strategy to deliver leading... ....Support ongoing modernization initiatives by evaluating emerging technologies and tools.Join us. The world can’t wait. You Have: 5+ years of experience...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Springfield, VA1 day ago$125k - $150k
Job DescriptionEverforth ECS is seeking an AI Model Engineer to work in a hybrid remote/... ...candidate is innovative with a track record of evaluating, experimenting with, and transitioning... ...maintain a Public Trust Clearance from the US federal gvmt. This requires US...Contract workWork at officeRemote workECS Federal
Fairfax, VA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to US Macroeconomist — AI Model Evaluation [Remote]. Be the first to apply!
Related searches