Open app
Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineering Evaluator - Expert - AI Trainer

$100 - $150 per hour

Mercor

San Francisco, CA

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts for usability in a software engineering context.
  • Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Apply deep subject-matter expertise to grade outputs and enhance quality.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor

Apply
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
  • Frontend Code Evaluator - Expert - AI Trainer

    $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type...  ...from those that merely look correct. Evaluate responsive behavior and semantic quality,... 
    Suggested
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • Software Engineering Expert

    $70 - $150 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...DAngelo Larry Summers and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $70$150/... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • Expert Senior Manager, AI Engineering

    $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas...  ...research, model experimentation, and evaluation design to production system...  ...For (Qualifications):8-12+ years in software engineering, ML engineering, or applied... 
    Suggested
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    3 days ago
  • Expert Interviewer - AI Trainer

    $50 - $60 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Jack Dorsey . Position: Expert Interviewer Type: Contract...  ...depth, communication, and AI-evaluation fit using a provided rubric....  ...Comfort assessing senior engineers. Strong communication and... 
    Suggested
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    21 days ago
  • Expert MDM Software Engineer (Developer)
     ...6111 We’re hiring a number of remote  software developers who write MDM/endpoint code...  ...is not an MDM Administrator / Endpoint Engineer / IT Ops role. If your day-to-day is mainly...  ...(Go) High-throughput services that evaluate encryption, patch status, device posture... 
    Suggested
    Permanent employment
    Full time
    Local area
    Remote work
    San Francisco, CA
    a month ago
  • Software Engineer - AI Expert

    $103k - $143k

     ...detail and sound professional judgment ~ Ability to critically evaluate financial analysis and assumptions ~ Ability to clearly...  ...portfolio management, economics, or quantitative finance ~ Prior AI experience is not required Responsibilities: Review financial... 
    Full time
    Temporary work
    Remote work
    Flexible hours

    Alpheva AI

    San Francisco, CA
    8 days ago
  • DevOps Engineer - AI Model Evaluator - AI Trainer

    $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • Generalist Expert - Content Evaluator

    $50 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation...  ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    25 days ago
  • AI Native Software Engineer - Products
     ...portfolio of agentic software products in the industries...  ..., design, and engineering together with the autonomy...  ...You are an exceptional AI-native software engineer...  ..., establish tests and evaluations, and review generated...  ...customers, and domain experts. The ability to... 
    Permanent employment
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    5 days ago
  • Agentic AI Team - Software Engineer (Mid-level)

    $160k - $200k

     ...General Catalyst, GV, and Accel and enjoy multi-year runway.About The Role:We're looking for an entrepreneurial Software Engineer with interest in agentic AI and at least 2-3 years of general engineering experience who wants to make an impact as one of the founding engineers... 
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday

    Sprinter Health

    San Francisco, CA
    3 days ago
  • Clinical Expert AI System Evaluator

    $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...consistent model response grading. Evaluate clinical dialogues for accuracy safety... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • Inorganic Chemistry PhD Synthesis Expert AI Trainer

    $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Inorganic Chemistry & Synthesis Expert Type: Contract Compensation...  .../week Role Responsibilities Evaluate technically complex problems involving... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • Software Engineering Expert

    $70 - $150 per hour

     ...Part time, ~40 h/week Field: Software Engineering The research teams behind the best-known AI models come to Mercor for...  ...engineers who want AI training and evaluation work, not a specific job...  ...months. Finishing the domain expert interview and joining every network... 
    Odd job
    Part time

    Mercor

    San Francisco, CA
    a month ago
  • Software Engineer II, Data Engineering
     ...of DoorDash success. The Data Engineering team builds database...  ...roleYou have proficiency in using AI coding tools (e.g., Claude Code...  ..., Codex, Cursor) in the full software development lifecycle, including...  ...as an AEDT. As part of the evaluation process we provide Covey with... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  • Senior Software Engineer, Data Engineering

    $167.7k - $245.2k

     ...platform.We’re looking for a Data Engineer to help build and operate the...  ...lifecycle by integrating AI-assisted engineering tools, ensuring...  ..., organized approach to software quality, testing, and operational...  ...network of doers and experts, and you’ll see that the opportunities... 
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    CISCO Systems

    San Francisco, CA
    4 days ago
  • Senior Software Engineer, Data Engineering
    About the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and financial reporting. By implementing pipelines, data structures, and... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • Software Engineer, Data
    About the RoleFactory is bringing autonomy to software engineering, and we’re hiring a Data Engineer to own the systems that power how we understand and operate the business. You’ll architect and evolve the full data stack, designing the pipelines, models, and integrations... 
    Work at office

    The San Francisco AI Factory

    San Francisco, CA
    2 days ago
  • Software Engineer, Data Governance
     ...SuperhumanGrammarly is now part of Superhuman, the AI productivity platform on a mission to...  ...ever putting trust at risk? As a Senior Engineer on our Data Platform team, you’ll help us...  ...high-impact role at the intersection of Software Engineering and Data, where the systems... 
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    3 days ago
  • Senior Software Engineer, Data Engineering

    $164k - $227k

    About the RoleThe Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of...  ...standardized data models that enable self-serve data insights using AI.Own the ETL workflows and make sure the pipeline meets data... 
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    4 days ago
  • AI Software Engineer
     ...Zof AI is seeking an AI Software Engineer to build our AI products end to end, from the product surface down to the model-facing layer. This role works across the stack: shipping product features, and building the retrieval pipelines, agent orchestration, and context engineering... 
    Full time

    Zof AI, Inc.

    San Francisco, CA
    4 days ago
  • Senior AI Software Engineer
     ...Zof AI is seeking a Senior AI Software Engineer to help build advanced AI products and infrastructure. This role is for a highly capable engineer who can operate across the stack, work through ambiguity, make strong technical decisions, and build production-quality systems... 
    Full time

    Zof AI

    San Francisco, CA
    2 days ago
  • Senior Software Engineer, Backend (Product Engineering)

    $192k - $240k

     ...intuitive spend management, bill pay, and travel software, Brex enables founders and finance teams...  ..., and control spend effortlessly. Brex’s AI-native automation and world-class service...  ...and support you need to grow your career.Engineering at BrexEngineering at Brex is about... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    3 days ago
  • Software & Firmware Engineering Experts

    $100 - $120 per hour

     ...Commitment: Part time, ~40 h/week Field: Software Engineering Mercor is seeking experienced...  ...to support an advanced engineering and AI research initiative with a leading technology...  ...practical engineering judgment to evaluating embedded systems, firmware, digital... 
    Part time
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    19 days ago
  • STEM Expert Task Designer AI Trainer

    $2,000 per unit

     ...and technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: STEM Expert Task Pilot Type: Contract...  ...the fastest possible attention engine to push AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • Sr. Software Engineer, Data Analytics Engineering

    $183.04k - $320.32k

     ...you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful partner...  ...process here.We’re looking for a Sr. Software Engineer , Data Analytics and Engineering to...  ...workflows.Strong track record of critically evaluating and verifying AI-assisted work through... 
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    5 days ago
  • Quantitative Software Engineer - Research Data and Models (PL)
     ...data, and research capabilities that help drive investment insights and product innovation across the firm. As a Quantitative Software Engineer - Research Data & Models, you will lead a team responsible for building and modernizing research platforms, scalable data solutions... 
    Full time
    Work at office

    The Charles Schwab Corporation

    San Francisco, CA
    4 days ago
  • Investment Banking Expert - Evaluator

    $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • AI Developer Coding Sessions AI Trainer

    $500 per unit

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...Adam DAngelo Larry Summers and Jack Dorsey . Position: Software Developers: Share Your AI Coding Sessions Type: Contract... 
    Full time
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    6 days ago
  • Senior Software Engineer, Data

    $180k - $225k

     ...ecosystem powering the next generation of AI products. We build the infrastructure,...  ...About this role: As a Senior Data Engineer at fal, you will build the data infrastructure...  ...This role sits at the intersection of software engineering and data engineering. You\'ll... 
    Currently hiring
    Remote work
    Relocation package

    The Consensus

    San Francisco, CA
    3 days ago
  • B2B Sales Expert - Evaluator

    $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $...  ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert - AI Trainer. Be the first to apply!

Related searches