Software Engineering Evaluator - Expert
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in San Francisco, CA vacancy
- ...Description Job Description Job Title: AI Software Engineering Domain Remote Job Type: Contractor (... ...AI Software Engineering Domain Experts to contribute their technical... ...generation AI systems. In this role, you will evaluate, review, and refine AI-generated...SuggestedRemote jobPart timeFor contractors
$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... ...and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional...SuggestedContract workSummer workRemote workMercor
San Francisco, CA13 days ago$140k - $170k
...technology? At Ripple Labs Inc., we are on a mission to transform manual financial operations into flawless automated systems. As a Software Engineer on the Financial Core team, you'll play a crucial role in building the essential infrastructure that powers Ripple's global...SuggestedFull timeWork at officeLocal area- ...bachelor’s or master’s degree to begin their engineering careers with DoorDash. You’ll help build... ..., maintain, and ship production-ready software with support from your mentor and team... ..., alongside an understanding of how to evaluate their outputs and use them responsibly...SuggestedHourly payFull timeSummer workInternshipWork at officeLocal areaRemote workFlexible hours
- ...world’s most reliable on-demand logistics engine for delivery! We’re looking for... ...retaining top talent. During our 12-week Software Engineer internship, interns are completely... ...learning, with an understanding of how to evaluate outputs and use these tools responsibly...SuggestedHourly payFull timeWork experience placementSummer workInternshipSummer internshipWork at officeLocal areaRemote workFlexible hours
- ...About The Role We're hiring a Software Engineer to help build and scale the systems that power Collective's accounting product, the connection between our members' bank activity, bookkeeping, and tax outcomes. You'll work across the stack on the platform that automates...Work at officeRemote workFlexible hours
Collective
San Francisco, CA3 days ago - ...Full Stack Software Engineer Full-Time, Bay Area, Hybrid Location: Bay Area / Hybrid... ...traditionally done by highly specialized domain experts. We want generalists who can take a... ...workflows, with appropriate evaluation, fallbacks, and human control. Design...Full timeRemote workHome office
Getpeer
San Francisco, CA3 days ago - ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated minerals... ...a highly motivated Full Stack Software Engineer to work on building the critical minerals... ...project faster and more efficiently. Evaluate existing software in the ecosystem to assist...
Mariana Minerals
San Francisco, CA3 days ago - ...About the job Full Stack Software Engineer Job brief We are seeking a Software Engineer to execute the full lifecycle of the product development, by programming well-designed, efficient, and testable code that meets specifications. Responsibilities Develop new capabilities...
RxCloud
San Francisco, CA3 days ago - ## Senior Fullstack Software EngineerApplylocations: San Francisco: New York: Seattle: Little Rocktime type: Full timeposted on: Posted... ...privacy requirements.**LiveRamp is looking for a Senior Software Engineer to help shape the next generation of Data Marketplace...Work from homeFlexible hoursNight shift
LiveRamp
San Francisco, CA3 days ago - ...autonomous vehicles. About the role We’re hiring a Software Engineer, Backend to help build and scale our autonomous agent. This... ...integrations with production systems Support development of agent evaluation and observability tooling Work with senior engineers to...
Cleric
San Francisco, CA17 hours ago - ...benchmarking company. We support labs, engineers and enterprises to understand AI... ...'re looking for a Senior Full Stack Software Engineer to join our team and lead full... ...direction of AI. Become a world expert in AI: You will evaluate every major model, across every...
Artificial Analysis, Inc.
San Francisco, CA16 hours ago - ...complex scientific manufacturing processes at scale. Our workflow engine is the foundational layer — a system that lets scientists and... ...or an entire team is coordinating across steps. As a Software Engineer on this team, you'll work full-stack across Workflows,...Work at officeLocal areaFlexible hours3 days per week
- ...6111 We’re hiring a number of remote software developers who write MDM/endpoint code... ...is not an MDM Administrator / Endpoint Engineer / IT Ops role. If your day-to-day is mainly... ...(Go) High-throughput services that evaluate encryption, patch status, device posture...Remote jobPermanent employmentLocal area
- ...Job Description Job Description GPU Programmer / Software Engineer Job Type: Contractor Location: Remote Job Overview We are seeking experienced GPU Programmers / Software Engineers to design and optimize GPU-based tasks for AI and LLM applications. You...Remote jobFor contractors
- ...business owners, not just assist them. The engineers who join now will be the ones who... ...Looking For ~2+ years of professional software engineering experience, with demonstrated... ...learning systems (AI Tools), to assist in evaluating applicants’ qualifications and fitness...Work at officeLocal areaFlexible hoursNight shift3 days per week
Engg
San Francisco, CA16 hours ago $159k - $239k
...Auth0 customers. At Okta, we’re building the next generation of authentication for the GenAI era. We’re looking for a Senior Software Engineer to join the AI Agentic Experience team at Auth0. This role is pivotal in extending and complementing ourAuth for...Local areaWorldwideFlexible hoursOkta, Inc.
San Francisco, CA1 day ago- ...never stops moving. And that takes exceptional people. Trusted Engineering That Matters Engineering at VGS VGS is building the... ...and our reliability practices. About the Role As a Sr. Software Engineer, Payments Quality, you will serve as a key technical...Shift work
Socket
San Francisco, CA3 days ago $196k - $220k
...making it easier and more fun for people to hang out before, during, and after playing games. We\'re looking for a Senior Software Engineer to join the Growth team at Discord. Our team owns how new users discover, understand, and get started with Discord — from the...Full timeDiscord
San Francisco, CA2 days ago- ...fragmented and legacy systems About The Role As a founding engineer, you will get a front seat into building a world‑class startup.... ...About You ~ Experience: ~1 - 10+ years of experience in software engineering, with a strong background in computer science. ~...Work at office
Valerie Health
San Francisco, CA3 days ago $180k - $250k
...Software Engineer | AI Agents | San Francisco $180k–$250k base + equity I’m working with a client, an early-stage AI company building the platform that runs autonomous AI agents inside some of the world’s largest enterprises. They’re looking for a Software Engineer...Work at officeTruNorth
San Francisco, CA1 day ago$180k - $230k
...Type Full time Location Type On-site Department Engineering About the Company Valon is building the AI-native... ...it was how we deeply understood the complexity needed to build software that actually works in regulated industries. The results speak...Full timeWork at officeLocal areaRemote workFlexible hoursValon Technologies
San Francisco, CA1 day ago$170k - $220k
...Jiffy.com is seeking a Software Development Engineer II with deep hands‑on experience orchestrating AI coding agents to ship production software... ...tooling: author skills, rules, prompts, MCP integrations, and evaluation harnesses that make the whole engineering org faster....Local areaHome officeShift workJiffyShirts.com
San Francisco, CA17 hours ago$120k - $160k
...build the next interface to improve individual lives as well as the well-being of society as a whole. About the Role As a Software Engineer , you will build the infrastructure that allows us to do high quality and fast research. You\'ll be owning and developing...Work from homeVisa sponsorshipAlljoined
San Francisco, CA16 hours ago$140k - $230k
...never stops moving. And that takes exceptional people. Trusted Engineering That Matters Engineering at VGS VGS is building the... ...and our reliability practices. About the Role As a Senior Software Engineer, you will be a key contributor and technical...Currently hiringWork at officeLocal areaImmediate startRemote workFlexible hoursShift workVGS
San Francisco, CA1 day ago$150k - $200k
...microelectronics and EDA industries. About the role As a founding software engineer at Bronco AI, you will be building world-class intelligent... ...you’re most needed. learn incredibly quickly. You’re an expert in multiple technical domains and you want to become an...Night shiftBronco
San Francisco, CA16 hours ago$200k - $230k
...Graphite builds consumer-quality tools for modern software engineering teams, so they can ship faster and create amazing products. Our product Graphite is modern code review for fast-moving teams - we help engineers write and review smaller pull requests, stay unblocked...RelocationRelocation packageGraphite Solutions, Inc.
San Francisco, CA3 days ago- ...unlock financial freedom for everyone by making money movement and access to financial data simple and secure. As a Fullstack Software Engineer, you will design and build the systems and experiences that power how millions of people connect to their finances. You will...Work experience placementLocal area
Plaid
San Francisco, CA3 days ago - ...shipping great products, including hands-on engineering, talking with customers, and mastering... ....js, etc. There’s no need to be a prior expert in our stack — it’s more important that... ...data science to build and iterate on software that helps our customers understand their...Work at officeRemote work
WaterSHED
San Francisco, CA3 days ago $124k - $162k
...getting from pilot to profit. That is the problem our engineers work on. As a New Grad Software Engineer, you will own meaningful, customer-facing work... ...that power frontier model development Develop evaluation infrastructure that measures model reliability for enterprise...InternshipScale AI
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!
Related searches
- software engineer internship remote San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software developer positions San Francisco, CA
- intermediate software engineer San Francisco, CA
- agile software developer San Francisco, CA
- software engineer intern San Francisco, CA
- part time software developer San Francisco, CA
- rust software engineer San Francisco, CA
- software engineer no experience San Francisco, CA
- software engineer internship San Francisco, CA