Software Engineering Evaluator - Expert - AI Trainer
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
$130 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Software Engineer, TypeScript — Codebase Q&A Type:... ...work in the task README and submit for expert review, addressing reviewer feedback on...SuggestedContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,...SuggestedContract workSummer workLocal areaRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work$70 per hour
...technical talent with leading AI research labs. Headquartered... ...Material Science PhD Coding Experts Type: Contract Compensation... ...materials science, materials engineering, applied physics, chemistry,... .... Prior scientific software or research engineering experience...SuggestedContract workSummer workImmediate startRemote work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...AI coding agents to complete and evaluate complex infrastructure engineering tasks....Contract workSummer workRemote work- ...Description Job Description Job Title: AI Software Engineering Domain Remote Job Type: Contractor (... ...AI Software Engineering Domain Experts to contribute their technical expertise... ...generation AI systems. In this role, you will evaluate, review, and refine AI-generated...Remote jobPart timeFor contractors
- ...Description Job Description About unitQ At unitQ , we leverage AI and advanced analytics to enable businesses to proactively... .... About the Opportunity We’re looking for an AI Software Engineer to lead features that use AI and conventional methods to intelligently...Flexible hours
unitQ
San Francisco, CAa month ago - About the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and financial reporting. By implementing pipelines, data structures, and...Hourly payWork at officeLocal areaRemote workFlexible hours
Doordash
San Francisco, CA8 hours ago - ...data, and research capabilities that help drive investment insights and product innovation across the firm. As a Quantitative Software Engineer - Research Data & Models, you will lead a team responsible for building and modernizing research platforms, scalable data solutions...Full timeWork at office
The Charles Schwab Corporation
San Francisco, CA17 hours ago $180k - $250k
...(remote) What is Verse? The race to AI has become the race to power. Every breakthrough... ...platform for the AI economy. Our software helps the world's largest energy consumers... ...of data at Verse. This role supports Core Engineering needs within the organization and builds...Remote workFlexible hoursVerse
San Francisco, CA28 days ago$193.93k - $291.15k
...and profound opportunity for AI to drive positive change in the... ...where ML and systems engineering converge. This is not a "run... ...raise the bar on the data and evaluation loop that drives autonomy. Your... ...area. ~4+ years of industry software engineering experience with Python...Immediate startFlexible hoursNuro
San Francisco, CA28 days ago$140k - $170k
...manual financial operations into flawless automated systems. As a Software Engineer on the Financial Core team, you'll play a crucial role in... ...finance, and product teams are your collaborators ~ Uses AI tools (Claude, Copilot, Cursor, etc.) actively as a core part...Full timeWork at officeLocal area$160k - $210k
...Job Description Job Description About the Role A growing technology startup is hiring a Senior Full Stack Software Engineer to help build and scale its core product. This engineer will work across the frontend and backend, contributing directly to customer-facing...Remote workFlexible hourstwenty80.io
San Francisco, CAa month ago- ...Role You'll be a full-stack engineer building the product surfaces,... ...internal tools that power an AI-focused reinforcement learning... ...and external partners create, evaluate, and iterate on RL training data... ...For ~3+ years of full-stack software engineering experience building...Remote workVisa sponsorshipRelocation package
Clera
San Francisco, CA4 days ago - ...mission is to unlock financial freedom for everyone by making money movement and access to financial data simple and secure. As a Software Engineer, you will design and build the systems that power how millions of people connect to their finances. You will work across the...Full timeWork experience placementLocal area
Plaid
San Francisco, CA3 days ago $180k - $280k
...Job Description Job Description Senior Full-Stack Software Engineer San Francisco, CA · On-site · Full-time Compensation: $180K–$280... ...equity About the company Our client is a seed-stage enterprise-AI company building a platform that captures the operational...Full timeH1bVisa sponsorshipDavid Joseph & Company
San Francisco, CA12 days ago$120k - $220k
...credit card swipes, verifying identities, and maximizing clean energy capture. About the role We are hiring experienced Frontend Software Engineers to join our team. In this role, you will be responsible for defining strong front-end architecture patterns, leading...Contract workFor contractorsFor subcontractorWork at officeRemote workMonday to FridayFlexible hoursCHALK INC
San Francisco, CA1 day ago- ...Outset invented a better way to do research: AI-powered user interviews. Global brands like Hubspot, Microsoft, Uber and... ...improve our product's UI/UX. Qualifications ~3+ years of software engineering experience building production-grade frontend systems. ~ Strong...
Adverb
San Francisco, CA22 hours ago $186.4k - $266.3k
About the Role:We are hiring a Senior Software Engineer to build Tubi's native app runtime for connected TVs on Cobalt, the lightweight, open-source browser engine behind YouTube on living room devices. You will own the layer between Tubi's React app and the device: the...Full timeTemporary workWork at officeLocal areaFlexible hoursTubi TV
San Francisco, CA17 hours ago$117.2k - $176.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...thousands of Salesforce engineers use every day to plan, build,... ...experience.3-5 years of professional software engineering experience... ...help our recruiters assess and evaluate candidates’ resumes and qualifications...Full timeImmediate startSalesforce
San Francisco, CA1 day ago$155k - $400k
...application monitoring standard and our team is building its AI-native future.About the roleSentry's issue platform processes... ...and what a developer needs to know to investigate.As a Senior Software Engineer on the Issue Detection team, you'll design, build, and operate...Work experience placementImmediate startSentry
San Francisco, CA1 day ago$173.37k - $234.56k
We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits... ...processes at scale. Our workflow engine is the foundational layer — a system that... ...entire team is coordinating across steps.As a Software Engineer on this team, you'll work full-stack...Work at officeLocal areaFlexible hours3 days per weekBenchling
San Francisco, CA1 day ago$197.3k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...designing and implementing software that manages Kubernetes clusters... ...You will play a key role in evaluating and integrating open source... ...solutions, and mentor other engineers as they build against your designs...Full timeSalesforce
San Francisco, CA4 days ago$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...own it" culture, where engineers are responsible for the... ...contributor and domain expert on the Page Builder... ...years of professional software development experience,... ...recruiters assess and evaluate candidates’ resumes and...Full timeSalesforce
San Francisco, CA17 hours ago$107.6k - $198.4k
...strategies, advanced analytics, Generative AI, transformative technologies, and... ...scientists, operators, creatives, designers, engineers, and architects. Our team balances business... ...role ends on 10/30/26Work you'll doAs a Software Engineer III on the Customer team, you will...Local areaDeloitte
San Francisco, CA17 hours ago$72.8k - $130k
...system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve some... ...and ongoing support for the existing application. The Software Engineer will design, build, test, deploy, and operate scalable APIs, microservices...Minimum wageFull timeWork experience placementWork at officeLocal areaRemote workUnitedHealth Group
San Francisco, CA4 days ago$126k - $248k
...clusters in just minutes.We're seeking a Senior Engineer to join the Atlas Identity and Access... ...Profile5+ years experience of software engineering, primarily focused on backend... ...have redefined the data platform for the AI era, enabling builders to create, transform...Local areaRemote workWorldwideFlexible hoursMongoDB
San Francisco, CA17 hours ago- ...Job DescriptionOur leading-edge Agile team in the engineering group is looking for a motivated and energetic Senior Software Engineer who is eager to learn and make big... ...modern containerized environments.Develop agentic AI and Generative AI applications that integrate LLMs...Contract workWork at officeWork visaFlexible hours
Square trade
San Francisco, CA17 hours ago $193.4k - $290k
...operate. By combining frontier agentic AI, an enterprise-grade platform, and deep... ...started. Role Overview As a Backend Software Engineer on the Product Engineering team at... ...the world's most sensitive matters ~ Evaluating LLMs across a 10k+ leaf taxonomy of tasks...Relocation packageHarvey
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert - AI Trainer. Be the first to apply!
Related searches
- software engineer internship remote San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software developer positions San Francisco, CA
- agile software developer San Francisco, CA
- software engineer intern San Francisco, CA
- part time software developer San Francisco, CA
- rust software engineer San Francisco, CA
- software engineer no experience San Francisco, CA
- software engineer internship San Francisco, CA
- entry level software engineer remote San Francisco, CA