Software Engineering Evaluator - Expert
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in San Francisco, CA vacancy
- Obsidian is seeking expert Evaluators in Software Engineering to review AI-generated slides, spreadsheets, and documents for real-world quality. You will apply deep subject-matter expertise to grade outputs and provide actionable feedback in a clear, structured format....SuggestedHourly payWork at officeRemote work
- ...AfterQuery is seeking College Software Engineer Experts to create and refine software development challenges for training AI models. In this remote, flexible role, you will design and evaluate coding scenarios that test the AI's ability to interpret and apply complex...SuggestedTemporary workRemote workFlexible hours
AfterQuery
San Francisco, CA7 days ago $70 - $150 per hour
...include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $70$150/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workRemote workMercor
San Francisco, CA9 days ago- ...This is a remote, project-based role for software engineers with 1–3 years of professional experience. You will complete tasks spanning software development, debugging, code review, and technical implementation across a variety of stacks and applications. Work is over...SuggestedTemporary workRemote work10 hours per week
AfterQuery
San Francisco, CA7 days ago $100 - $120 per hour
...$120/hour Commitment: Part time, ~40 h/week Field: Software Engineering Mercor is seeking experienced Software and Firmware Engineers... ...products and can bring practical engineering judgment to evaluating embedded systems, firmware, digital hardware, flight...SuggestedPart timeRemote workFlexible hoursMercor
San Francisco, CA7 days ago$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas... ...research, model experimentation, and evaluation design to production system... ...For (Qualifications):8-12+ years in software engineering, ML engineering, or applied...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per weekBain & Company
San Francisco, CA15 hours ago- ...6111 We’re hiring a number of remote software developers who write MDM/endpoint code... ...is not an MDM Administrator / Endpoint Engineer / IT Ops role. If your day-to-day is mainly... ...(Go) High-throughput services that evaluate encryption, patch status, device posture...Permanent employmentFull timeLocal areaRemote workSan Francisco, CAa month ago
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA13 days ago$70 - $150 per hour
...Commitment: Part time, ~40 h/week Field: Software Engineering The research teams behind the best-... ...engineers who want AI training and evaluation work, not a specific job opening. It... ...months. Finishing the domain expert interview and joining every network you...Odd jobPart timeMercor
San Francisco, CAa month ago$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...Contract workSummer workRemote workMercor
San Francisco, CA11 days ago- Join a high-scale consumer platform team as a Senior Backend Engineer, building the services behind digital experiences used by millions... ...a large enterprise technology organization to place a Senior Software Engineer on a platform team that powers its core customer-facing...Full timeContract workWeekday work
$218.4k - $365.2k
...looking for a trailblazing engineering leader who is passionate about... ..., monitoring, evangelism, evaluation, and cost management, while... ...forging new trails. You are an expert at dealing with extreme... ...roadmap for how AI accelerates software development at scale.What You...Full timeSalesforce
San Francisco, CA2 days ago$218.4k - $365.2k
...Developer Experience using AI - to change how software is designed, built, tested, secured,... ...(MCP), LLM Model Gateway, and Context Engineering capabilities.This is a hands-on... ...runtimes, state and memory, human oversight, evaluation, and production operations.Set...Full timeSalesforce
San Francisco, CA15 hours ago$192k - $240k
...banking with intuitive spend management, bill pay, and travel software, Brex enables founders and finance teams to accelerate operations... ...tools, resources, and support you need to grow your career.Engineering at BrexEngineering at Brex is about building systems that scale...Work at officeRemote workWork from homeBrex
San Francisco, CA5 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... ...and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional...Contract workSummer workRemote workMercor
San Francisco, CA22 days ago$50 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases such as...Contract workSummer workRemote work- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured...
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs. Evaluator Type: Contract. Compensation: $80-$120/hour. Location: Remote. Role Responsibilities Evaluate AI-generated artifacts against...Contract workSummer workWork at officeRemote work$130k - $196.5k
...San Francisco, California, with offices worldwide. Learn more at LiveRamp.com.Job DescriptionLiveRamp is looking for a Senior Software Engineer to help shape the next generation of Data Marketplace capabilities. In this role, you will lead the design and delivery of scalable...WorldwideLiveRamp
San Francisco, CA5 hours ago- ...s the most important bet at the company.As a Senior Full Stack Engineer for Rippling AI, you'll own meaningful technical initiatives end... ...approaches unlock better outcomesWhat you will need5+ years of software engineering experience with a proven track record of owning and...Work at office3 days per week
Rippling
San Francisco, CA4 days ago $165k - $247k
...product, data, and decision-making, and we’re looking for a Product Engineer to help take it to the next level.Why this role mattersThis isn... ...-facing valueWhat we’re looking for5+ years of experience in software engineering Education: B.S. in Computer Science or an...Home officeAmplitude
San Francisco, CA5 hours ago$150k - $200k
...ways to address them.You’ll play a critical role in shaping our engineering and broader company culture and help make this the best place... ..., or similar degree.You have 3+ years of experience in a Software Engineering position. You have experience with HTML, CSS, React...Candid Health
San Francisco, CA2 days ago$158.4k - $237.6k
About the RoleAs a Senior Software Engineer at Hinge Health, you will play a pivotal role in designing, building, and maintaining large-scale software solutions that directly impact our members’ health outcomes. You will collaborate with cross-functional partners, including...Full timeTemporary workInternshipWork at officeLocal areaRemote workWorldwide3 days per weekHinge Health
San Francisco, CA3 days ago- ...workflows with more speed, confidence, and accuracy.As a Senior Software Engineer on this team, you will help define how AI becomes a core part... ...upfront.Ability to partner with product managers, domain experts, operations teams, and engineers to turn messy real-world workflows...Work at office3 days per week
Rippling
San Francisco, CA2 days ago $160k - $215k
...Francisco or DenverEngineering /Full-Time /HybridAs a Backend Engineer on our application team at Windfall, you will be building the system... ...DockerRequirements:5+ years of experienceProfessional backend software engineering experienceExpert object-oriented programming...Full timeWindfall
San Francisco, CA3 days ago$140k - $260k
Substack is building a new economic engine for culture, giving the brightest, most interesting, and most creative people on the internet... ...here is beneficial but not required.Requirements3+ years of software engineering experience, including building and shipping web applications...Full timeSubstack
San Francisco, CA2 days ago$122k - $240.5k
Position Summary Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a ServiceAgentic AI is moving from... ...such as orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop controlsAt least 1 year...Work at officeLocal areaVisa sponsorshipFlexible hoursShift workDeloitte
San Francisco, CA5 days ago$140k - $260k
Substack is building a new economic engine for culture, giving the brightest, most interesting, and most creative people on the internet... ...be excited to help you learn.RequirementsAt least 3+ years of software engineering experience.Independent and autonomous. We’re too...Full timeSubstack
San Francisco, CA2 days ago- ...mission is to unlock financial freedom for everyone by making money movement and access to financial data simple and secure. As a Software Engineer, you will design and build the systems that power how millions of people connect to their finances. You will work across the...Full timeWork experience placementInternshipLocal area
Plaid Financial
San Francisco, CA5 days ago $105k - $187.55k
Job Requisition ID #26WD101503Position OverviewAs a Senior Software Engineer supporting Autodesk’s Data Experience organization, you will design, develop, and maintain secure, reliable backend services and APIs that connect Autodesk applications, internal platforms, and...Full timeAutodesk
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!
Related searches
- software engineer amazon San Francisco, CA
- information technology software engineer San Francisco, CA
- federal - software developer San Francisco, CA
- graduate software developer San Francisco, CA
- rust software engineer San Francisco, CA
- software development engineer (robotics engineer) San Francisco, CA
- IT software developer San Francisco, CA
- software engineer remote San Francisco, CA
- junior software developer internship San Francisco, CA
- remote entry level software developer San Francisco, CA