Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sales Engineering Expert - Evaluator

$100 - $150 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Sales Engineering Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world pre-sales and solutions-engineering deliverables.
  • Score AI-generated and human work samples against criteria with detailed written justifications.
  • Apply consistent, evidence-based judgment to ensure reproducible and defensible scores.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Qualifications

Must-Have

  • 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre-Sales Consultant, or Technical Sales Consultant.
  • Deep fluency in the pre-sales craft, including technical discovery and translating customer requirements into product solutions.
  • Hands-on experience with technically complex B2B software such as SaaS , cloud infrastructure , cybersecurity , data platforms , developer tools , or enterprise applications .
  • Exceptionally strong written communication skills for explaining technical work to both technical and business stakeholders.
  • Detail-oriented and comfortable having your judgment reviewed and calibrated against peers.

Preferred

  • Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Sales Engineering Expert - Evaluator in New York, NY vacancy
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $175 per hour

     ...Compensation: $175/hour Location: Remote Commitment: Flexible part-time hours Role Responsibilities Evaluate AI answers to ophthalmology questions for clinical accuracy and safety. Check each answer against the patient chart and... 
    Suggested
    Full time
    Contract work
    Part time
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    18 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $90 per hour

     ..., Larry Summers , and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type: Contract Compensation...  ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use... 
    Suggested
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    New York, NY
    2 days ago
  •  ...Anesthesiologist Type: Contract Compensation: $350/hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and safety. Check each answer against the patient chart and... 
    Full time
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    18 days ago
  • $40 - $65 per hour

    Crossing Hurdles is seeking a British English Voice Expert to evaluate short British English audio recordings and assess naturalness, pronunciation, and accents. The role is remote and paid per hour. You will provide structured feedback to support AI training and evaluation... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    1 day ago
  • $30 - $50 per hour

    Review and improve AI answers written in Polish so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the chart what good looks like. What you will do Rate Polish AI responses for accuracy, fluency, tone and instruction...
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    5 days ago
  • Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models.... 
    Remote job
    Contract work
    Freelance
    10 hours per week
    Flexible hours

    Welo Global

    New York, NY
    3 days ago
  • $18 - $45 per hour

     ...Intelligence (AI) technology? Volga Partners is seeking experienced Finance - Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland China and Spain. We are looking for professionals with hands... 
    Extra income
    Temporary work
    For contractors
    Freelance
    Remote work
    Flexible hours

    Volga Partners

    New York, NY
    1 day ago
  • Vettedlance seeks a bilingual reviewer to rate Spanish AI responses for accuracy, fluency and instruction-following. You will rewrite or correct weak answers, fact-check claims, and flag unsafe or invented content while maintaining clear tone. The role is remote, part-time...
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    10 hours per week

    Vettedlance

    New York, NY
    5 days ago
  • Vettedlance is seeking a meticulous Polish language reviewer to enhance AI answers. You will rate Polish responses for accuracy, fluency, and tone, rewrite weak answers, and ensure factual correctness. You will also fact-check claims, flag unsafe content, and craft prompts...
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    4 days ago
  • micro1 is seeking VA-accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits topics. You’ll use your claims experience to check that questions sound like real veterans and families and that answers are correct and useful. Accuracy... 
    Remote job
    For contractors

    Micro1

    New York, NY
    3 days ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity, usefulness, and technical accuracy, with a focus on JSON structure and formatting. The role combines language fluency, customer service judgment,... 
    For contractors
    Remote work
    Flexible hours

    Meridial

    New York, NY
    1 day ago
  • YO AI Labs is seeking an experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in photography, cinematography, camera operation, and video production.... 
    Remote job
    Worldwide

    YO AI Labs

    New York, NY
    1 day ago
  • $80 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour...  ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $70 - $110 per hour

     ...Summers , and Jack Dorsey . Position: Sales Representatives, Wholesale and...  ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product...  ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    22 days ago
  • $50 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: German Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across various use... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    23 days ago
  • $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:...  ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    22 days ago
  • $14 per hour

     ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...  ...experience as a music producer, audio engineer, or sound mixer. ~ College degree in... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    11 days ago
  • $50 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:... 
    Contract work
    Summer work
    10 hours per week

    Mercor

    New York, NY
    12 days ago
  • $39 per hour

     ...Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract...  ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation...  ...of experience as a music producer, audio engineer, or sound mixer. ~ College degree in... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    11 days ago
  • $15 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    18 days ago
  • $100 - $120 per unit

     ...Jack Dorsey . Position: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100–$120 per task...  ...stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis. Run the same question on two AI products side... 
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    New York, NY
    14 days ago
  • $30 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text across various use... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    23 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $70 - $110 per hour

     ...Summers , and Jack Dorsey . Position: Sales Managers Type: Contract...  ...+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans...  ...customer complaint resolution. Provide expert feedback on sales-performance analysis to... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    25 days ago
  • $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:...  ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    5 days ago
  • $50 per hour

     ...Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $30 per hour

    Vetto is building a global AI wellness platform and is recruiting professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing...
    Hourly pay

    Vetto

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!