Remote AI Agent Power User & Workflow Evaluator

YO AI Labs

Remote job

YO AI Labs in the United States is seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows. You'll test complex scenarios, document workflows, and provide actionable feedback to AI research and product teams, using AI tools such as ChatGPT and Claude; no formal AI background is required. #J-18808-Ljbffr YO AI Labs

Apply

Vacancy posted 11 hours ago

Similar jobs that could be interesting for youBased on the Remote AI Agent Power User & Workflow Evaluator in Seattle, WA vacancy

AI Agent Power User
AI Agent Power User AI Agent Power User Role Type: Contractor Location: Remote (US, CA, UK, IE, AU, NZ) Scope of Work: Run complex, multi... ...genuine professional workflows. Document each step, highlighting... ...from realistic business needs. Evaluate and score AI-generated...
Remote work
Contract work
For contractors
ESR Healthcare
New York, NY
23 hours ago
AI Agent Power User - Remote
AI Agent Power User Role Type: Contractor Location: Remote - US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced... ...AI training project focused on evaluating and improving AI assistants in real-world business workflows. You'll use your professional...
Remote job
Contract work
For contractors
YO AI Labs
Seattle, WA
12 hours ago
AI Agent Power User
...AI Agent Power User is a remote review track for evaluating AI outputs across ai agent power user specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the...
Remote job
Hourly pay
For contractors
Work experience placement
10 hours per week
AuraOne Human Data
Remote
21 days ago
AI Agent QA Reviewer & Workflow Auditor (Remote)
AuraOne, Inc. is seeking a remote AI Agent Power User reviewer who can assess outputs against workflows, playbooks, and policy. You will evaluate tone, escalation logic, and stakeholder fit to support safe, scalable AI operations. As an independent contractor, you’ll work...
Remote job
For contractors
10 hours per week
AuraOne, Inc.
New York, NY
23 hours ago
Remote AI Agent Designer: Shape Global Workflows
Global Payments is seeking an AI Agent Designer to join the AI Strategy team. You will design AI-powered workflows and autonomous agent experiences, partnering with senior leaders to translate business challenges into actionable agentic solutions. You will create agent...
Remote job
Global Payments
Columbus, OH
1 day ago
AI Agent Evaluator, Remote- Contract
Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Required Skills: ChatGPT Muse AI agents Attention to Detail Following... ...well they actually do it, from the point of view of a real user. That's you. You'll test two AI agents side by side, using your...
Remote job
Contract work
For contractors
Work at office
Weekend work
Xperteez Technology Pvt Ltd
New York, NY
2 days ago
AI Product Manager, Agents & Orchestration
$185k - $260k
...AI Product Manager, Agents & Orchestration This is a fully remote opportunity and can be worked from... ...the platform that powers the next... ...hand off, and get evaluated. Then you'll turn... ...agents to production users. You've owned a product... ...who did. Workflow or orchestration...
Remote work
Full time
1mind
Remote
8 days ago
Senior AI Product Manager (Agent Platform)
$125.3k - $154.1k
...looking for a Senior AI Product Manager (Agent Platform) based... ...the end-to-end user journey, from... ...standard development workflows. Identify and... ..., and AI evaluation frameworks.... ...well-being. Remote work: A full-time... ...We use an AI-powered matching process...
Remote work
Full time
Flexible hours
Jobgether
Remote
1 day ago
SMB AI Power User — Competitive Evaluations
$83.2k - $104k
...MERIDIAL SMB AI Power User — Competitive Evaluations Company Meridial Location Remote Engagement Type Independent Contractor... ...head prompts and multi-turn workflows across the client's... ...beyond chat - automations, agents, API or no-code integrations...
Remote work
Hourly pay
Contract work
For contractors
Meridial
Remote
12 days ago
Software Engineer, AI Agents
$230k - $275k
...Software Engineer, AI Agents Compensation: $230,000... ...equity Location: Remote, USA Join an early... ...agents directly into real workflows. The Role You... ...that reached real users or business workflows.... ...the underlying platform powering them. Gain unusually...
Remote work
Full time
People In AI
United States
1 day ago
Remote Technical Sales Evaluator for AI Content & Workflows
...is seeking a seasoned sales professional to help evaluate and improve AI-generated sales content and workflows for technical products. You will review conversations... ...manufacturing, and scientific markets. This is a remote, hourly engagement with flexible hours. #J-18808-...
Remote job
Hourly pay
Flexible hours
SaidGig
New York, NY
23 hours ago
Remote AI Workflow Evaluator — Management Consulting
AuraOne, Inc. is seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. The...
Remote job
For contractors
AuraOne, Inc.
New York, NY
11 hours ago
Senior Software Engineer II - Agent Observability
$183.34k - $206k
...accountability from Day 1. #LI-Remote Little more about... ...observability for AI in Honeycomb. We help customers... ...see what their agents are doing, what those agents... ...and unlocks meaningful user workflows. Teach best... ...building LLM or agent-powered features in production....
Remote work
Full time
Work at office
Local area
Work from home
Home office
Visa sponsorship
Shift work
Honeycomb.io
Remote
13 days ago
Senior Software Engineer I - Agent Observability
$160k - $180k
...accountability from Day 1. #LI-Remote Little more about... ...observability for AI in Honeycomb. We help customers... ...see what their agents are doing, what those agents... ...and unlocks meaningful user workflows. Share what you... ...building LLM or agent-powered features in production....
Remote work
Full time
Work at office
Local area
Work from home
Home office
Visa sponsorship
Shift work
Honeycomb.io
Remote
13 days ago
Software Engineer, AI Agents
$200k - $320k
...engineering team building AI-powered tools for data and marketing workflows. You will explore... ...systems that help users get insights and... ...LLM pipelines. Evaluate where different models... .... Develop data agents that answer... ...available. Location Remote, United States....
Remote work
Full time
Visa sponsorship
True Talent Solutions Partners
Remote
4 days ago
Senior Software Engineer - Agent Team
$140k - $190k
...Software Engineer – Agent Team based in the... ...performance. This remote opportunity offers... ...behavior, evaluate the impact of changes... ...improve development workflows, testing strategies... ...comfortable owning the user interface... ...works: We use an AI-powered matching process...
Remote work
Full time
Temporary work
Work from home
Worldwide
Home office
Visa sponsorship
Flexible hours
Jobgether
Remote
6 days ago
AI Generalist Digital Workflow Evaluator
$30 - $49 per hour
AI Generalist Digital Workflow Evaluator Review AI-generated outputs and workflow screenshots, apply project guidelines, and write clear feedback. This remote US contract pays $30 to $49 per hour for a flexible 1 to 3 month project. Remote Hourly · $30-$49/hr $30-$49...
Remote work
Hourly pay
Contract work
Part time
For contractors
Flexible hours
OpenTrain AI, Inc.
New York, NY
3 days ago
Software Engineer - Agent Team
...Software Engineer - Agent Team based in... ...software that powers cloud-native endpoint... ...in a fully remote environment. With... ...ownership of the user interface... ...enhancements, and workflow automation.... ...opportunities. Evaluate technical alternatives... ...We use an AI-powered matching...
Remote work
Full time
Local area
Worldwide
Visa sponsorship
Work visa
Jobgether
Remote
6 days ago
Voice AI Agent Engineer
...Burlington, VT (hybrid) or remote ABOUT OHMD OhMD... ...digital forms, automated workflows, and OhMD AI, our voice and text agent. OhMD AI answers on the... ...deployed at least one LLM-powered conversational agent (... ...chat, or SMS) that real users interacted with, and you...
Remote work
Agency work
Freelance
Live in
OhMD
United States
23 hours ago
AI Agent Lead
...Description Job Title: AI Skills and Agents Lead (Low/No code... ...week or fully remote within the US.... ...n Project : AI Workflow Automation... ...test, and scale AI-powered skills, agents, and... ...representative users, incorporate feedback... ..., retrieval, evaluation, structured outputs...
Remote work
Full time
Work at office
Immediate start
2 days per week
3 days per week
YunoJuno
Seattle, WA
12 days ago
Remote Pharmacy Tech Expert — AI Workflow Evaluator
$45 - $65 per hour
...Group is seeking an experienced pharmacy technician to evaluate and improve AI medication workflows in healthcare settings. You will create realistic... ...safety, applying real-world workflow knowledge. This fully remote, asynchronous contract offers hourly compensation ($45...
Remote job
Hourly pay
Contract work
10 hours per week
Flexible hours
Appsierra Group
New York, NY
23 hours ago
Enterprise AI Agent Users
$30 per hour
...About the role Enterprise AI Agent Users is a remote review track for evaluating AI outputs across enterprise ai agent users specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document...
Remote work
Contract work
For contractors
Work experience placement
10 hours per week
AuraOne
San Jose, CA
25 days ago
Senior Software Engineer, Agent Runtime & Customer Workflows
$148k - $222k
...Software Engineer, Agent Runtime & Customer Workflows Customer AgentAbout... ...build state-of-the-art AI systems that help... ...backend systems and AI-powered product experiences... ...better than LLMs.Develop evaluation strategies using... ...production for real users.You are proficient...
Klaviyo
Boston, MA
23 hours ago
Software Engineer, Conversational Products & Agent Workflows
$116k - $174k
...Conversational Products & Agent WorkflowsCustomer... ...state-of-the-art AI systems that help... ...Products & Agent Workflows to join the... ...backend systems and AI-powered product... ...to contribute to user-facing experiences... ...approaches.Build and use evaluation approaches including...
Klaviyo
Boston, MA
23 hours ago
Senior AI Agent Engineer | Moveworks
$143.2k - $243.4k
...Today, ServiceNow is the AI control tower for... ...AI, any data, and any workflow— helping 85% of the Fortune... ...exceptional experiences for end users. Entrepreneurial... ...may include using AI-powered tools, automating... ...Work personas (flexible, remote, or required in office)...
Remote work
Full time
Work at office
Immediate start
Flexible hours
Day shift
ServiceNow
Remote
2 days ago
AI Operations Lead Remote Agent Workflows
Invoca is seeking an AI Operations Lead to own internal agentic workflows and build agents using Claude and Gumloop. This hands-on role interacts with executives and... ...security, data governance, and practical adoption. Remote-first with US locations including Seattle area....
Remote job
Invoca
Seattle, WA
4 days ago
Senior ServiceNow Developer (Virtual Agent / Now Assist)
...Developer (Virtual Agent / Now Assist)... ...conversational self-service, workflow automation, and future NLU/AI readiness in a... ...needs. Evaluate existing... ...applications and remote collaboration tools... ...to train end users on frequently asked... ...has the power to inspire and transform...
Remote work
Contract work
For contractors
Work at office
Work from home
Home office
Chenega MIOS
Saint Louis, MO
2 days ago
Senior Software Engineer, Agent Eval Platform
$161.3k - $274.2k
...areMoveworks: the Agentic AI Assistant... ...tasks. Powered by the world's... ...streamline complex workflows, and continuously... ...' AI agents don't just generate... ...layer of our agent evaluation platform: the rubrics... ...and user simulator, drive... ...personas (flexible, remote, or required in...
Remote work
Contract work
Work at office
Flexible hours
Moveworks
Mountain View, CA
3 days ago
AI Agent Evaluator - Remote
...Job Description Job Description Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail... ..., and provide feedback to improve their reliability and user experience. Key Responsibilities Test AI agents on everyday...
Remote job
For contractors
Work at office
YO AI Labs
New York, NY
14 days ago
Remote AI Agent Engineer
...volume and registered users. We are trusted by... .... We leverage the power of digital assets... ...We are building AI Agent systems for core... ...function calling, and workflow orchestration.... ...quality monitoring and evaluation systems for... ...company benefits Remote-first, work-from-...
Remote work
Full time
Work from home
Binance
Remote
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Power User & Workflow Evaluator. Be the first to apply!