Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Everyday AI Agent Tester

$25 - $45 per hour
Part-time

micro1

pay

Required Skills
ChatGPT
Muse
AI agents
Attention to Detail
Following Instructions
Screen Recording
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.

Role Title: Everyday AI Agent Tester

Role Type: Contractor

Location: U.S based

Opportunity Snapshot

Pay: $25-45/hour

Time per task: ~1.5 hours per run (evidence and scoring included)

Project kickoff: Monday, October 12

Onboarding: Today (Fri), Saturday, or Sunday, so you’re ready to start Monday

You’ll need: An active personal popular AI account (Free, Go, or Plus; not Pro), an active personal and a smartphone that can screen record

Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results

About the role

AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you.

You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.

What you’ll do
Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
Approve or stop the agent at key steps
Screen record every attempt
Score each run on
completion, quality, control issues, satisfaction, and time
Share clear written feedback on the agent experience
Who we’re looking for
US-based
, with a Bachelor’s degree
Someone who already uses
AI in daily life
2-3 years
of experience, preferably in engineering, business management, or office/operations
Detail-oriented, great at following instructions and documenting each step
Clear written communication
Generalists welcome, domain experts preferred
No coding or AI background needed

Why you’ll like it
Get paid to use the AI tools you already use
Work entirely from your phone, on your schedule
Have a direct say in how next-generation AI agents get built and improved

How the selection process works
Complete the screening questions
Interview
: 15-30 minutes max
Profile review:
if everything looks good, we present you to the client
Onboarding:
our Talent Ops team will contact you to get you started

Email

By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.

Continue
or
Continue with Google
Continue with LinkedIn

Have any questions? See FAQs

Refer and Earn
$100

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Everyday AI Agent Tester in San Francisco, CA vacancy
  • $133k - $391.5k

     ...cloud innovation to customers worldwide.    Living our values everyday results in our team-first culture and enables us to innovate,...  ...their authentic selves.  The Senior Manager, Engineering - AI Agents will lead the development and delivery of Five9's AI Agent... 
    Suggested
    Temporary work
    Work at office
    Worldwide
    3 days per week

    Five9

    San Francisco, CA
    17 days ago
  •  ...overseeing Piper's intelligence and behavior across chat, voice, video, and email channels. You will define success metrics, partner with AI/engineering teams, and drive end-to-end improvements in Piper’s conversation quality for a fast-moving B2B SaaS product. The role... 
    Suggested
    Remote job

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...Agents are the heart of the platform and the hardest thing to get right. The line between "helpful" and "made something up," between "took...  ...line and the roadmap around it. You’ll own the roadmap for AI agents — how customers define an agent’s instructions, tools, knowledge... 
    Suggested

    AtomMatrix

    San Francisco, CA
    3 days ago
  •  ...BackOps in San Francisco is seeking a senior Product Manager for the Agent Platform to own the platform foundation enabling Relay integrations, security, and scalable workflows across enterprise environments. You’ll lead architecture discussions, work with engineers, founders... 
    Suggested

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $200k - $275k

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...on this mission. If you are too, let's talk. About Okta for AI Agents Okta secures access for 20,000 organizations and billions of... 
    Suggested
    Local area
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Okta, Inc.

    San Francisco, CA
    18 hours ago
  • $189k - $260k

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...are too, let's talk. As a Senior Product Manager, Okta for AI Agents, you will drive the product strategy and execution for how Okta... 
    Local area
    Worldwide
    Flexible hours

    Jobleads-US

    San Francisco, CA
    4 days ago
  •  ...Valerie Health in San Francisco is seeking a Director of Agent Operations to build and lead the team that deploys AI agents for complex healthcare workflows. You’ll own delivery from discovery through launch, collaborating with Engineering, Product, and customer teams... 

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $150k - $235k

    A fast-growing AI startup is seeking a Technical Product Manager to lead their AI agent builder platform. The ideal candidate will have over 5 years of experience in B2B SaaS product management and a strong technical background. This role involves collaborating with engineering... 
    Remote work

    The Resume Database

    San Francisco, CA
    20 hours ago
  •  ...Salesforce is seeking a Director of Agentforce Voice Models to own the full voice intelligence stack—ASR, TTS, S2S—for enterprise-scale agents. You will lead from product alignment through architecture, setting benchmarks for accuracy, latency, and quality while... 

    Jobleads-US

    San Francisco, CA
    1 day ago
  • Vercel in San Francisco, CA is seeking a Product Manager to own the compute platform—Fluid compute, Vercel Functions, Sandbox, and more—and set the direction for how developers configure, scale, and run code on Vercel. You will lead a cross-functional effort shaping...
    Work at office
    Remote work

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...Francisco, California | Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the environments, evaluation...  ...infrastructure used to train and assess long-horizon enterprise AI agents. The Opportunity You will work on the engineering and... 

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    13 days ago
  •  ...FutureSight is seeking a Co-Founder & CEO to lead HawkAI, an enterprise AI venture for US logistics brokerages, carriers, and warehouse...  ...software serving these industries, with familiarity in AI agents/LLMs How to Apply Please submit your resume, LinkedIn profile... 

    FutureSight Ventures

    San Francisco, CA
    23 days ago
  • $270k - $350k

     ...Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their...  ...a Member of Technical Staff to help define how frontier coding agents are benchmarked and improved. This is a broad, high-ownership... 
    Full time
    Work at office
    Flexible hours

    Handshake

    San Francisco, CA
    5 days ago
  • $180k - $320k

     ...About the Role We’re looking to add a product-minded AI engineer to the team. The ideal candidate will have strong customer and product...  ...of AI architecture and frameworks Building production data agents that can make use of a company’s data to seamlessly answer analytics... 
    Remote work

    algojobs

    San Francisco, CA
    3 days ago
  • $180k - $320k

     ...About Hightouch Hightouch is the modern AI platform for marketing and growth teams. Our AI agents reimagine marketing workflows, allowing marketers to create content, plan campaigns, and execute strategies with transformational velocity and performance. Hightouch is a... 
    Full time
    Remote work
    Shift work

    High Touch LLC

    San Francisco, CA
    4 days ago
  • Fuku in San Francisco is seeking its first Product Engineer for a new product line that combines data APIs with a user-friendly, self-serve UX. This high-autonomy role is built for a builder who wants to ship 0→1. You will own end-to-end development from discovery to...
    Visa sponsorship

    Jobleads-US

    San Francisco, CA
    4 days ago
  •  ...Postman is seeking a Member of Technical Staff and AI Agent Development Lead to guide the design, development, and deployment of next-generation AI agents that interact with users and complex environments. You will drive architecture and implementation of scalable,... 

    Jobleads-US

    San Francisco, CA
    5 days ago
  • $300k

     ...Job Description Job Description Director of Engineering – AI Agents Location: San Francisco, CA (on - site) Employment Type: Full-time Work Arrangement: On-site, five days per week Base Salary: $300,000–$450,000 annually + equity About the Company... 
    Full time

    DeltaV Recruitment

    San Francisco, CA
    16 days ago
  •  ...surfaces and MCP platform, driving design and engineering teams to deliver innovations at speed. You will shape the roadmap for AI agents that help customers derive rapid insights, with a focus on expanding access via coding agents, CLI, IDE, and our UI. This role... 

    Jobleads-US

    San Francisco, CA
    1 day ago
  • $152k - $240k

     ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual...  ...craft, and builders become leaders.What you’ll doWe're building AI agents to automate and augment internal functions at Brex, and we're looking... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    3 days ago
  • $237k - $356k

     ...Amplitude is the leading AI analytics platform, helping over 5,200 customers—including Atlassian, Burger King, NBCUniversal, and Square...  ...—build better products and digital experiences. With powerful AI Agents embedded across our platform, teams can analyze, test, and... 
    Home office
    Flexible hours

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...Primarily On-site We are seeking a highly technical Enterprise Agent Systems Engineer to build and deploy advanced agent systems for...  ...This role combines strong software engineering with applied AI research judgment. You will work directly with technically sophisticated... 

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    13 days ago
  •  ...Agent Solutions Engineer We're a Series C startup, and have raised $100 million from Emergence Capital, Y Combinator, Dell Technologies Capital and the founders of PayPal and Twilio. Bland.ai builds AI voice agents that handle real phone calls for some of the largest... 

    Bland AI

    San Francisco, CA
    1 day ago
  • $211k - $251k

     ...Spanish and English. Preferred: experience building or deploying AI/LLM systems in production. Preferred: experience as a founder...  ...engineer. Preferred: familiarity with eval frameworks, agent tooling, RAG pipelines, and prompt engineering. Preferred: prior... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    8 days ago
  • $211k - $251k

     ...-technical audiences. Bonus: experience building or deploying AI/LLM systems in production. Bonus: founder or founding engineer...  ...craftsmanship, ownership, and speed. Bonus: familiarity with AI agent tools such as eval frameworks, agent tooling, RAG pipelines, and... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    15 days ago
  • $135k - $180k

     ...About Pallet Pallet is building AI Agents to transform the physical economy a $12 trillion global industry. Weve raised $50M from top investors including General Catalyst Bessemer Venture Partners and Bain Capital under two years weve achieved 700% revenue growth and... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Pallet

    San Francisco, CA
    2 days ago
  •  ...Job Description Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home   We are looking for a Senior Technical Product Manager. This is a deeply technical, hands-on role. The Senior Technical... 
    Full time
    Remote work
    Work from home

    Parallel Partners

    San Francisco, CA
    3 days ago
  • $211k - $251k

     ...customer loyalty. Its even better if youve built or deployed AI/LLM systems in production. Its even better if youve been a founder...  ...even better if youre familiar with tools that support modern AI agents, including evaluation frameworks, agent tooling, RAG pipelines,... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    8 days ago
  •  ...customers and operators to understand supply-chain workflows and ship agents that automate meaningful work. Build production agent systems...  ...building in fast, ambiguous environments, ideally at a vertical AI, AI-agent, forward-deployed, or data-product company. ~... 
    Full time

    Traba

    San Francisco, CA
    2 days ago
  • $211k - $251k

     ...Additional experience is a plus if we have built or deployed AI/LLM systems in production. Additional experience is a plus if...  ...experience. Additional familiarity is a plus with tools used for AI agents, such as eval frameworks, agent tooling, RAG pipelines, and... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Everyday AI Agent Tester. Be the first to apply!