Software Engineering Evaluator - Expert - AI Trainer
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...AI coding agents to complete and evaluate complex infrastructure engineering tasks....SuggestedContract workSummer workRemote work$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,...SuggestedContract workSummer workLocal areaRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work$70 per hour
...technical talent with leading AI research labs. Headquartered... ...Material Science PhD Coding Experts Type: Contract Compensation... ...materials science, materials engineering, applied physics, chemistry,... .... Prior scientific software or research engineering experience...SuggestedContract workSummer workImmediate startRemote work- ...from @ Rippling.com addresses. About the role At Rippling, Engineering is at the heart of our business and culture. We believe in our... ...Rippling leaders, and more! What you will do Utilize your software engineering experience to tackle important projects, solving...SuggestedFull timeSummer workInternshipWork at office3 days per week
- ...AfterQuery is seeking College Software Engineer Experts to create and refine software development challenges for training AI models. In this remote, flexible role, you will design and evaluate coding scenarios that test the AI's ability to interpret and apply complex...Contract workRemote workFlexible hours
- ...This is a remote, project-based role for software engineers with 1–3 years of professional experience. You will complete tasks spanning software development, debugging, code review, and technical implementation across a variety of stacks and applications. Work is over...Contract workRemote work10 hours per week
$70 - $150 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $70–$150/hour...Contract workSummer workRemote work$120 per hour
...technical talent with leading AI research labs. Headquartered... ...Jack Dorsey . Position: Software Engineer (Foundational) Type: Contract... ...engineering problems . Evaluate tasks and solutions,... ...Collaborate with other subject matter experts to ensure consistency and...Full timeContract workSummer workRemote workWeekday work$50 - $100 per hour
...About the Role: \n We are looking for existing software engineers and developers to help advance AI development. As a member of DataAnnotation's Software... ...high-quality code and technical explanations. \n Evaluate model trajectories for accuracy, performance, readability...Hourly payFull timeFor contractors$60 per hour
...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully autonomous... ...simulation data pipelines that evaluate the driving capability of the Waymo Driver... ...distributed systems Comfortable with AI-assisted development features and...Hourly payFull timeInternshipSummer internship$18 - $37 per hour
...including mobile elevating work platforms, telehandlers, utility vehicles and accessories-can be found all over the world. The Software Engineer Intern will provide support for the Software Engineering team. Activities will include designing reliable, functional, and...Permanent employmentInternshipWork at officeFlexible hoursShift work$86.53k - $123.55k
...like yours to collaborate with full-time engineers and cross functional teammates, learn development... ...methodologies, and gain practical software engineering experience. Software... ...have redefined the data platform for the AI era, enabling builders to create, transform...Full timeSummer workInternshipWork at officeLocal areaWorldwideRelocation packageFlexible hours3 days per week$61.9 per hour
...can work on a wide range of high-impact engineering challenges across our connected operations... ...products. For those focused on embedded software, projects may include building and maintaining... ...hardware, spanning areas like edge AI, multimedia frameworks, power management,...Hourly payFull timeSummer workInternshipWork at officeRemote workRelocation packageFlexible hours3 days per week$70 per hour
...and tens of billions in simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully autonomous driving... ...Data fluency We prefer: Experience with training and evaluating Machine Learning models Experience prototyping agentic systems...Hourly payFull timeInternshipSummer internshipRelocation package$218.4k - $365.2k
...you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success... ...runtimes, state and memory, human oversight, evaluation, and production operations. Set technical...Full time- Remote is seeking a Neuroscience Specialist - AI Trainer to help shape the future of AI by guiding neural models with rigorous neuroscience... ..., document failures, and propose improvements to prompts and evaluation metrics. This contract role requires a master’s or PhD in...Remote jobContract work
- ...digital core and unleashing the power of AI to create value at speed for organizations... ...and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in... ...bridge the gap between semantic modeling, software engineering, and modern Big Data...Live inWork at officeLocal area
$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas... ...research, model experimentation, and evaluation design to production system... ...For (Qualifications):8-12+ years in software engineering, ML engineering, or applied...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week- ...re looking for a talented, startup-minded engineer to help us accelerate development of a... ...experiences, robust backend systems, and AI-powered workflows that help life sciences... ...real customer problems into high-quality software Make pragmatic technical and architectural...Full timeWork at office
- ...Full Stack Software EngineerSwantide is changing the way companies manage their CRM. Our platform... ...looking for a driven full stack software engineer to join our early engineering team.You... ...not necessary:Experience working with AI/MLExperience with or knowledge of SalesforceOur...Full time
$167.7k - $245.2k
...Software EngineerThis is a hybrid role located in San Jose or San Francisco... ...amounts of machine data. As AI becomes an increasingly... ...ImpactWe're looking for a Software Engineer who enjoys solving difficult... ...worldwide network of doers and experts, and you'll see that the...Full timeTemporary workWork at officeLocal areaFlexible hours3 days per week- ...addresses. About the Role At Rippling, Engineering is at the heart of our business and... ...engineering, model training, and evaluation. You will work with data engineers to collect... ...skills, both in machine learning and software engineering. Additional...Full timeInternshipWork at office3 days per week
- ...Full Stack Software Engineer - US RemoteAt Zarego, we are on the lookout for a Full Stack Software Engineer (Mid to Senior level) to join our... ...React and Next.js to build high-performance frontend interfaces.AI Implementation: Practical experience deploying AI-powered...Remote work
$160k - $210k
...Job DescriptionJob Description About the Role A growing technology startup is hiring a Senior Full Stack Software Engineer to help build and scale its core product. This engineer will work across the frontend and backend, contributing directly to customer-facing features...Remote workFlexible hours$500 per month
...Full Stack Software EngineerWe are hiring talented Full Stack Software Engineers for our Control Plane team. The team focuses on great user experience, seamless, automated, and scalable cloud infrastructure deployment, and lifecycle management. We build and maintain the...Local areaRemote workHome officeFlexible hours- ...maximizing clean energy capture. We've recently raised a $50 million Series A, led by Felicis. About The Role We are hiring Software Engineers to join our team. This is an opportunity to join us in-person as an early employee and make a large impact at a high growth...Work at officeFlexible hours
- ...team members have what they need to do their best work — both in and out of the office. We are seeking a highly motivated Software Engineer (SWE) with experience in building robust and scalable web systems. The ideal candidate has a strong background in modern JavaScript...Work at officeLocal areaRemote work
$204.4k - $285.6k
...Senior Full Stack Software EngineerSan Francisco (Brisbane), CAVivodyne... ...novel biology, robotics, and AI. We identify and validate new... ...exceptional Senior Full-Stack Software Engineer to work hand in hand with our... ...talent-dense team of experts from multiple scientific disciplines...Local areaShift work- ...accessing, routing, and managing more than 130 AI models across major providers. The... ...firms, this is an early-stage startup where engineers own meaningful product decisions and... ...Role We are looking for a Full-Stack Software Engineer to join a growing engineering team...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert - AI Trainer. Be the first to apply!
- software engineer internship remote San Francisco, CA
- software engineer remote San Francisco, CA
- graduate software developer no experience San Francisco, CA
- work from home software developer San Francisco, CA
- summer intern software engineer San Francisco, CA
- information technology software engineer San Francisco, CA
- senior software engineer remote San Francisco, CA
- rust software engineer San Francisco, CA
- part time software developer San Francisco, CA
- software developer night shift San Francisco, CA






