Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineering Evaluator - Expert - AI Trainer

$100 - $150 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts for usability in a software engineering context.
  • Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Apply deep subject-matter expertise to grade outputs and enhance quality.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type...  ...from those that merely look correct. Evaluate responsive behavior and semantic quality,... 
    Suggested
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Material Science PhD Coding Experts Type: Contract Compensation...  ...materials science, materials engineering, applied physics, chemistry,...  .... Prior scientific software or research engineering experience... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  •  ...from @ Rippling.com addresses. About the role At Rippling, Engineering is at the heart of our business and culture. We believe in our...  ...Rippling leaders, and more! What you will do Utilize your software engineering experience to tackle important projects, solving... 
    Suggested
    Full time
    Summer work
    Internship
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  •  ...AfterQuery is seeking College Software Engineer Experts to create and refine software development challenges for training AI models. In this remote, flexible role, you will design and evaluate coding scenarios that test the AI's ability to interpret and apply complex... 
    Contract work
    Remote work
    Flexible hours

    AfterQuery

    San Francisco, CA
    a month ago
  •  ...This is a remote, project-based role for software engineers with 1–3 years of professional experience. You will complete tasks spanning software development, debugging, code review, and technical implementation across a variety of stacks and applications. Work is over... 
    Contract work
    Remote work
    10 hours per week

    AfterQuery

    San Francisco, CA
    a month ago
  • $70 - $150 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $70–$150/hour... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Jack Dorsey . Position: Software Engineer (Foundational) Type: Contract...  ...engineering problems . Evaluate tasks and solutions,...  ...Collaborate with other subject matter experts to ensure consistency and... 
    Full time
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    7 days ago
  • $50 - $100 per hour

     ...About the Role: \n We are looking for existing software engineers and developers to help advance AI development. As a member of DataAnnotation's Software...  ...high-quality code and technical explanations. \n Evaluate model trajectories for accuracy, performance, readability... 
    Hourly pay
    Full time
    For contractors

    DataAnnotation

    San Francisco, CA
    2 days ago
  • $60 per hour

     ...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully autonomous...  ...simulation data pipelines that evaluate the driving capability of the Waymo Driver...  ...distributed systems Comfortable with AI-assisted development features and... 
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    San Francisco, CA
    1 day ago
  • $18 - $37 per hour

     ...including mobile elevating work platforms, telehandlers, utility vehicles and accessories-can be found all over the world. The Software Engineer Intern will provide support for the Software Engineering team. Activities will include designing reliable, functional, and... 
    Permanent employment
    Internship
    Work at office
    Flexible hours
    Shift work

    Oshkosh Corporation

    San Francisco, CA
    3 days ago
  • $86.53k - $123.55k

     ...like yours to collaborate with full-time engineers and cross functional teammates, learn development...  ...methodologies, and gain practical software engineering experience. Software...  ...have redefined the data platform for the AI era, enabling builders to create, transform... 
    Full time
    Summer work
    Internship
    Work at office
    Local area
    Worldwide
    Relocation package
    Flexible hours
    3 days per week

    MongoDB

    San Francisco, CA
    3 days ago
  • $61.9 per hour

     ...can work on a wide range of high-impact engineering challenges across our connected operations...  ...products. For those focused on embedded software, projects may include building and maintaining...  ...hardware, spanning areas like edge AI, multimedia frameworks, power management,... 
    Hourly pay
    Full time
    Summer work
    Internship
    Work at office
    Remote work
    Relocation package
    Flexible hours
    3 days per week

    Samsara

    San Francisco, CA
    4 days ago
  • $70 per hour

     ...and tens of billions in simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully autonomous driving...  ...Data fluency We prefer: Experience with training and evaluating Machine Learning models Experience prototyping agentic systems... 
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    San Francisco, CA
    3 days ago
  • $218.4k - $365.2k

     ...you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success...  ...runtimes, state and memory, human oversight, evaluation, and production operations. Set technical... 
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • Remote is seeking a Neuroscience Specialist - AI Trainer to help shape the future of AI by guiding neural models with rigorous neuroscience...  ..., document failures, and propose improvements to prompts and evaluation metrics. This contract role requires a master’s or PhD in... 
    Remote job
    Contract work

    Remote

    San Francisco, CA
    2 days ago
  •  ...digital core and unleashing the power of AI to create value at speed for organizations...  ...and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in...  ...bridge the gap between semantic modeling, software engineering, and modern Big Data... 
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    2 days ago
  • $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas...  ...research, model experimentation, and evaluation design to production system...  ...For (Qualifications):8-12+ years in software engineering, ML engineering, or applied... 
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    13 hours ago
  •  ...re looking for a talented, startup-minded engineer to help us accelerate development of a...  ...experiences, robust backend systems, and AI-powered workflows that help life sciences...  ...real customer problems into high-quality software Make pragmatic technical and architectural... 
    Full time
    Work at office

    artosai

    San Francisco, CA
    3 days ago
  •  ...Full Stack Software EngineerSwantide is changing the way companies manage their CRM. Our platform...  ...looking for a driven full stack software engineer to join our early engineering team.You...  ...not necessary:Experience working with AI/MLExperience with or knowledge of SalesforceOur... 
    Full time

    Swantide

    San Francisco, CA
    5 days ago
  • $167.7k - $245.2k

     ...Software EngineerThis is a hybrid role located in San Jose or San Francisco...  ...amounts of machine data. As AI becomes an increasingly...  ...ImpactWe're looking for a Software Engineer who enjoys solving difficult...  ...worldwide network of doers and experts, and you'll see that the... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    3 days per week

    Outshift by Cisco

    San Francisco, CA
    2 days ago
  •  ...addresses. About the Role At Rippling, Engineering is at the heart of our business and...  ...engineering, model training, and evaluation. You will work with data engineers to collect...  ...skills, both in machine learning and software engineering. Additional... 
    Full time
    Internship
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  •  ...Full Stack Software Engineer - US RemoteAt Zarego, we are on the lookout for a Full Stack Software Engineer (Mid to Senior level) to join our...  ...React and Next.js to build high-performance frontend interfaces.AI Implementation: Practical experience deploying AI-powered... 
    Remote work

    Zarego

    San Francisco, CA
    5 days ago
  • $160k - $210k

     ...Job DescriptionJob Description About the Role A growing technology startup is hiring a Senior Full Stack Software Engineer to help build and scale its core product. This engineer will work across the frontend and backend, contributing directly to customer-facing features... 
    Remote work
    Flexible hours

    twenty80.io

    San Francisco, CA
    2 days ago
  • $500 per month

     ...Full Stack Software EngineerWe are hiring talented Full Stack Software Engineers for our Control Plane team. The team focuses on great user experience, seamless, automated, and scalable cloud infrastructure deployment, and lifecycle management. We build and maintain the... 
    Local area
    Remote work
    Home office
    Flexible hours

    IVP

    San Francisco, CA
    5 days ago
  •  ...maximizing clean energy capture. We've recently raised a $50 million Series A, led by Felicis. About The Role We are hiring Software Engineers to join our team. This is an opportunity to join us in-person as an early employee and make a large impact at a high growth... 
    Work at office
    Flexible hours

    CHALK INC

    San Francisco, CA
    3 days ago
  •  ...team members have what they need to do their best work — both in and out of the office. We are seeking a highly motivated Software Engineer (SWE) with experience in building robust and scalable web systems. The ideal candidate has a strong background in modern JavaScript... 
    Work at office
    Local area
    Remote work

    Oura

    San Francisco, CA
    2 days ago
  • $204.4k - $285.6k

     ...Senior Full Stack Software EngineerSan Francisco (Brisbane), CAVivodyne...  ...novel biology, robotics, and AI. We identify and validate new...  ...exceptional Senior Full-Stack Software Engineer to work hand in hand with our...  ...talent-dense team of experts from multiple scientific disciplines... 
    Local area
    Shift work

    Vivodyne

    Brisbane, CA
    5 days ago
  •  ...accessing, routing, and managing more than 130 AI models across major providers. The...  ...firms, this is an early-stage startup where engineers own meaningful product decisions and...  ...Role We are looking for a Full-Stack Software Engineer to join a growing engineering team... 

    Surgecrypto

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert - AI Trainer. Be the first to apply!