Sales Engineering Expert - Evaluator
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Sales Engineering Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world pre-sales and solutions-engineering deliverables.
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment to ensure reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
Qualifications
Must-Have
- 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre-Sales Consultant, or Technical Sales Consultant.
- Deep fluency in the pre-sales craft, including technical discovery and translating customer requirements into product solutions.
- Hands-on experience with technically complex B2B software such as SaaS , cloud infrastructure , cybersecurity , data platforms , developer tools , or enterprise applications .
- Exceptionally strong written communication skills for explaining technical work to both technical and business stakeholders.
- Detail-oriented and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote work$175 per hour
...Compensation: $175/hour Location: Remote Commitment: Flexible part-time hours Role Responsibilities Evaluate AI answers to ophthalmology questions for clinical accuracy and safety. Check each answer against the patient chart and...SuggestedFull timeContract workPart timeSummer workImmediate startRemote workFlexible hours$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedContract workSummer workWork at officeRemote work$90 per hour
..., Larry Summers , and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type: Contract Compensation... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...SuggestedContract workSummer workLocal areaRemote work- ...Anesthesiologist Type: Contract Compensation: $350/hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and safety. Check each answer against the patient chart and...Full timeContract workSummer workImmediate startRemote workFlexible hours
$40 - $65 per hour
Crossing Hurdles is seeking a British English Voice Expert to evaluate short British English audio recordings and assess naturalness, pronunciation, and accents. The role is remote and paid per hour. You will provide structured feedback to support AI training and evaluation...Remote jobHourly payContract work$30 - $50 per hour
Review and improve AI answers written in Polish so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the chart what good looks like. What you will do Rate Polish AI responses for accuracy, fluency, tone and instruction...Remote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models....Remote jobContract workFreelance10 hours per weekFlexible hours
$18 - $45 per hour
...Intelligence (AI) technology? Volga Partners is seeking experienced Finance - Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland China and Spain. We are looking for professionals with hands...Extra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours- Vettedlance seeks a bilingual reviewer to rate Spanish AI responses for accuracy, fluency and instruction-following. You will rewrite or correct weak answers, fact-check claims, and flag unsafe or invented content while maintaining clear tone. The role is remote, part-time...Remote jobHourly payWeekly payContract workPart time10 hours per week
- Vettedlance is seeking a meticulous Polish language reviewer to enhance AI answers. You will rate Polish responses for accuracy, fluency, and tone, rewrite weak answers, and ensure factual correctness. You will also fact-check claims, flag unsafe content, and craft prompts...Remote jobHourly payPart timeFlexible hours
- micro1 is seeking VA-accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits topics. You’ll use your claims experience to check that questions sound like real veterans and families and that answers are correct and useful. Accuracy...Remote jobFor contractors
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity, usefulness, and technical accuracy, with a focus on JSON structure and formatting. The role combines language fluency, customer service judgment,...For contractorsRemote workFlexible hours
- YO AI Labs is seeking an experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in photography, cinematography, camera operation, and video production....Remote jobWorldwide
$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote work$70 - $110 per hour
...Summers , and Jack Dorsey . Position: Sales Representatives, Wholesale and... ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product... ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously...Hourly payContract workSummer workImmediate startRemote work$50 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: German Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across various use...Contract workSummer workRemote work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems...Contract workSummer workImmediate startRemote work$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Contract workSummer workImmediate startRemote work$50 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:...Contract workSummer work10 hours per week$39 per hour
...Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation... ...of experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Contract workSummer workImmediate startRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against...Contract workSummer workImmediate startRemote work$100 - $120 per unit
...Jack Dorsey . Position: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100–$120 per task... ...stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis. Run the same question on two AI products side...Contract workWork experience placementSummer workRemote work$30 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text across various use...Contract workSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$70 - $110 per hour
...Summers , and Jack Dorsey . Position: Sales Managers Type: Contract... ...+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...Hourly payContract workSummer workImmediate startRemote work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Contract workSummer workImmediate startRemote workFlexible hours$50 per hour
...Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases...Contract workSummer workRemote work$30 per hour
Vetto is building a global AI wellness platform and is recruiting professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing...Hourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!
- sales engineer remote New York, NY
- software sales engineer New York, NY
- internal sales engineer New York, NY
- senior sales engineer New York, NY
- sales engineer New York, NY
- sales engineer technical sales New York, NY
- pre-sales engineer New York, NY
- director sales engineering New York, NY
- sql expert New York, NY
- technology expert New York, NY


