Agentic AI Expert [Remote]
AuraOne Human Data
Remote
- Remote job
Agentic AI Expert is a remote review track for evaluating AI outputs across agentic ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
Agentic AI specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current agentic ai specialist operations workflows, playbooks, and firm policy for Agentic AI Expert assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in agentic ai specialist operations on real teams for Agentic AI Expert work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real agentic ai specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Agentic AI specialist operations
- AI model evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Agentic AI Expert [Remote] in Remote vacancy
$70 - $126 per hour
...Role Overview Help advance next-generation AI systems by applying real-world technical expertise to agentic AI workflows. This remote contract role focuses on producing high-quality input, evaluations, and feedback that improve how AI systems learn, reason, and perform...SuggestedHourly payContract workRemote workSaidGig
United Statesmore than 2 months ago- ...developers choose us: launch posts, cookbook recipes, video walkthroughs, and "build-with-us" threads. Be the technical face at Web3 × AI events; Engineering & Grounding Improve LLM grounding on crypto-specific context (tokens, contracts, narratives) to cut...SuggestedFull timeContract workLocal areaWeekend work
CoinMarketCap
Remote11 days ago $70 - $126 per hour
...Role Overview Apply your technical domain expertise to shape how agentic AI performs in real engineering workflows. In this contractor role you will work with autonomous AI coding agents to plan, implement, debug, and document complex software and technical processes...SuggestedHourly payFor contractorsLocal areaRemote workVisa sponsorshipSaidGig
United States2 days ago- ...Remote Mathematics Expert (AI/LLM) - 34877 Remote Mathematics Expert (AI/LLM) - 34877 1 week ago Be among the first 25 applicants... ...advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier...SuggestedHourly payContract workPart timeFor contractorsFreelanceInternshipRemote workWork from homeWorldwideAfternoon shift
Turing
United States5 days ago $185k - $215k
...remote work.* Help Shape the Future of AI for National Security At IntelliGenesis... ...most challenging mission environments. From agentic AI and large language models to cyber... ...experienced Artificial Intelligence Subject Matter Expert (AI SME) to serve as a bridge between...SuggestedFull timeContract workWork experience placementWork at officeLocal areaRemote workIntelliGenesis
Annapolis Junction, MD23 days ago- ...Job Description Job Description Enterprise AI Workflow Expert Job Type: Contractor Location: Remote Job Overview We are seeking... ...Design, build, and optimize AI-powered and agentic workflows for business processes. Evaluate AI agent performance...For contractorsRemote work
YO AI Labs
Los Angeles, CA7 days ago $80 - $100 per hour
...geospatial expertise to improve next-generation AI systems through practical technical input,... .... Key Responsibilities Provide expert analysis, feedback, and practical examples... ...technical challenges and explain how AI agentic workflows supported solutions. Collaborate...Hourly payContract workRemote workSaidGig
United Statesmore than 2 months ago- ...Job Description Salesforce AI Workflow Specialist – Claude Expert \n CloudMasters Miami, Florida, United States (Remote) \n Save \n \n... ...automations using Claude's API, MCP integrations, and agentic capabiliti \n esTrain and support team members on effective...Remote work
CloudMasters
Miami, FL7 days ago $80 - $110 per hour
...research-level physics challenges, built to test whether frontier AI models can carry out genuine physics research reasoning rather... ...with LaTeX, Python, SymPy and Jupyter. Some familiarity with an agentic coding extension in VS Code is useful. Gaps here are acceptable...Hourly payImmediate startRemote work10 hours per week$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas Analytics, Data & Research, Management... ...build, and scale next-generation generative AI systems and agentic solutions for Bain’s clients. As a leader in the practice,...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per weekBain & Company
Atlanta, GA2 days ago- ...Prolific is seeking Mental Health Professionals to train and evaluate AI models. You’ll start with a quick test to assess suitability and, if successful, join as a Domain Expert participant, paid to work on AI tasks from home. You'll review AI-generated psychology prompts...Remote workWork from home
Prolific
United States2 days ago - ...Prolific is recruiting Mental Health Professionals to train and evaluate AI models as Domain Experts. You will be invited after a quick test and paid to complete AI tasks requiring focused hours. Expect earnings per task ranging with flexible hours and remote work....Remote workFlexible hours
Prolific Academic Ltd
United States1 day ago - ...Turing is one of the world’s fastest-growing AI companies, accelerating the advancement... ...capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality,... ..., ANOVA, and research reporting. The expert will create research datasets, execute reference...Hourly payTemporary workImmediate startRemote work
Turing
Remote28 days ago - ...but sharp team in Zurich, we’re looking for analytical and driven Geopolitical and Event Forecasting Professionals to help us evaluate AI-generated predictions about real-world events. Estimated project scope of approximately 15 hours/week. Tasks Evaluate AI-...FreelanceRemote work
Lightly
United States3 days ago $150 - $180 per hour
...Prolific is looking for experienced Mental Health Professionals to train and evaluate AI models. As a participant in our Expert Network, you will review AI-generated content, analyze psychological scenarios, and contribute to the improvement of AI capabilities. With competitive...Remote workWork from homeFlexible hoursProlific
Albuquerque, NM5 days ago$150 - $180 per hour
...Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological... ...to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly from...Remote workWork from homeProlific
Virginia Beach, VA2 days ago$150 - $180 per unit
...Prolific in Atlanta, Georgia is seeking Mental Health Professionals to join their Expert Network for AI training and evaluation. Participants will help train AI models by completing various tasks that leverage their expertise in psychology and human behaviour, offering...Remote workFlexible hoursProlific
Atlanta, GA5 days ago- ...Prolific, based in Columbus, Ohio, is seeking Mental Health Professionals to train and evaluate AI models. This role involves reviewing AI-generated responses, completing psychology tasks, and contributing to AI model improvements. Candidates must have verified status...Remote workWork from homeFlexible hours
Prolific
Columbus, OH3 days ago $8 - $65 per hour
...Oregon is looking for Mental Health Professionals to help train AI models. You will review AI-generated responses, complete psychology... ...Professional is required, and you will need to complete a skills screener to join Prolific's Domain Expert pool. #J-18808-Ljbffr...Hourly payRemote workFlexible hoursProlific
Portland, OR3 days ago$8 - $65 per hour
...Prolific is looking for Mental Health Professionals in Houston, Texas, to train and evaluate cutting-edge AI models. The role offers flexible hours and competitive pay rates ranging from $8 to $65 per hour for AI tasks. Candidates must have a verified status as a Mental...Hourly payRemote workFlexible hoursProlific
Houston, TX2 days ago$65 - $70 per hour
...Biology Expert (PhD) — AI Safety is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team...For contractorsRemote work10 hours per weekAI Trainer Jobs
New York, NY5 days ago$20 - $40 per hour
This role is for one of our clients $20 - $40/hourpay Role Title: Physics Subject Matter Expert (AI Training) Role Type: Contractor Location: Remote We are seeking a Physics Subject Matter Expert to contribute to the development of next-generation AI systems by applying...For contractorsRemote workWeekday AI
United States3 days ago$8 - $65 per hour
...Prolific seeks Mental Health Professionals in Jacksonville to participate in training AI models. The role requires verified status as a Mental Health Professional and offers competitive pay rates ranging from $8–$65/hr for tasks, which can be completed remotely. Candidates...Remote workWork from homeFlexible hoursProlific
Jacksonville, FL2 days ago$150 - $180 per hour
...Mental Health Professionals - AI Training Prolific is not just another player in the AI space – we are building the biggest pool... ...tasks. If successful, you’ll be invited to join Prolific as a Domain Expert participant, where you’ll get paid to train and evaluate powerful...Self employmentRemote workWork from homeFlexible hoursProlific
Louisville, KY5 days ago$8 - $65 per hour
...Prolific is looking for Mental Health Professionals in Washington, DC to help train advanced AI models. Participants will review AI-generated content, analyze psychological scenarios, and provide feedback to enhance AI responses. Ideal candidates should have verified...Hourly payRemote workWork from homeFlexible hoursProlific
Washington DC2 days ago- ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants...Hourly payRemote workWork from homeFlexible hours
Prolific
Nashville, TN2 days ago - ...Korean Language Expert (AI Training) About the Role We're looking for Korean language experts to help evaluate and improve AI systems built for Korean language learning. Your linguistic insight and teaching experience will directly shape how AI understands, assesses...Hourly payOngoing contractContract workFreelanceRemote workWorldwide
Alignerr
Los Angeles, CA1 day ago - ...Prolific is seeking Mental Health Professionals to train AI models. Successful candidates will analyze AI-generated content and provide feedback, ensuring high-quality results. The role offers competitive pay, flexible hours, and a chance to work remotely. Candidates...Remote workFlexible hours
Prolific
Long Beach, CA2 days ago $8 - $65 per unit
...Prolific is seeking Mental Health Professionals to train AI models. Join our Expert Network for flexible hours and competitive pay ranging from $8 to $65 per task. Responsibilities include reviewing AI responses, analyzing content, and providing feedback to improve AI...Remote workWork from homeFlexible hoursProlific
Austin, TX5 days ago$20 - $40 per hour
...Physics Subject Matter Expert (AI Training) This role is for one of our clients $20 - $40/hourpay. Role Type: Contractor. Location: Remote. We are seeking a Physics Subject Matter Expert to contribute to the development of next-generation AI systems by applying...For contractorsRemote workWeekday
United States2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic AI Expert [Remote]. Be the first to apply!
