Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sales Engineering Expert - Evaluator

Mercor

  1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
  2. Key Responsibilities Design precise, task‑specific grading criteria for real‑world pre‑sales and solutions‑engineering deliverables (technical discovery plans, tailored product demonstrations, proof‑of‑concept and technical evaluation plans, security questionnaires and RFP responses, integration/API/architecture explanations, and product‑fit and technical‑risk assessments)
Score AI‑generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence‑based judgment so scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre‑Sales Consultant, or Technical Sales Consultant Deep fluency in the pre‑sales craft: leading technical discovery, translating customer requirements into product solutions, delivering tailored demos, handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk Hands‑on experience with technically complex B2B software — SaaS, cloud infrastructure, cybersecurity, data platforms, developer tools, or enterprise applications Exceptionally strong written communication, with the ability to explain exactly why a piece of technical work would or would not land with both technical and business stakeholders Detail‑oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human‑data projects is a strong plus #J-18808-Ljbffr Mercor

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Sales Engineering Expert - Evaluator in San Francisco, CA vacancy
  • $100 - $150 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $100–$150/hour...  ...handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on experience... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining... 
    Suggested

    Obsidian

    San Francisco, CA
    1 day ago
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

     ..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $80 - $120 per hour

     ...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location...  ...AI model performance . Collaborate with subject matter experts to ensure consistency and domain relevance. Work independently... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $15 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    3 days ago
  • $50 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 10–20 hours/week Role... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $120 - $175 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $220k - $290k

     ...Harness powered over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3T protected API calls...  ...talent to help us move even faster.Position SummaryThe Sales Engineer lives and works in the intersection between sales and engineering... 
    Local area
    Immediate start
    Remote work
    Flexible hours
    Shift work

    Harness

    San Francisco, CA
    1 day ago
  • $120k - $145k

     ...teamwork and collaboration to succeed for the sales organization. Even though each person is...  ...will be welcomed warmly into the sales engineering group.The Impact: Our Pre-Sales...  ...and insightful information. Our team of experts delivers unrivaled insights and leading... 
    Full time
    Second job
    Live in
    Worldwide
    Flexible hours

    S&P Global

    San Francisco, CA
    21 hours ago
  • The Team + The RolePendo’s Customer Engineering team is the technical backbone of the pre- and post-sales customer motion. The team brings together work that has historically...  ...and deliver tailored demos, and lead technical evaluations through requirements gathering, success... 
    Remote work
    Flexible hours

    Pendo

    San Francisco, CA
    2 days ago
  • $167k - $270k

     ...At Fortinet, our mission is to safeguard people, devices, and data everywhere. We are currently seeking a dynamic Enterprise, Sales Engineer to be a part of enabling the success of our rapidly growing business. As an Enterprise Sales Engineer, you will:Pre-sales: Assist... 
    Work at office
    Worldwide
    Home office

    Fortinet

    San Francisco, CA
    2 days ago
  • $165k - $264k

     ...efficiency at scale. As a results-driven Senior Sales Engineer here, you’ll enjoy a fast-paced,...  ...and competing prioritiesDiscovery expert that deeply understands customers’ core...  ...personal information from applicants to evaluate candidates for employment. You may request... 
    Work experience placement
    Remote work

    Axon

    San Francisco, CA
    2 days ago
  • Pre-Sales Engineer, CybersecurityThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We...  ...career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Hewlett Packard Enterprise

    San Francisco, CA
    2 days ago
  • $220k - $290k

     ...over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3...  ...even faster.Position SummaryThe AppSec Sales Engineer is the technical liaison who bridges sales and engineering, expertly articulating the technology and product positioning... 
    Local area
    Immediate start
    Flexible hours
    Shift work

    Harness

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour Location...  ...written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • Synthires is offering a part-time role for PhD-level Chemistry experts to contribute to AI safety and evaluation projects. The work involves applying scientific expertise to understand and improve how AI systems handle specialized chemistry topics, with training provided... 
    Remote job
    Part time

    Synthires

    San Francisco, CA
    11 hours ago
  • $50 per hour

     ...contract for PhDs in Chemistry, Chemical Engineering, or related fields. Work on cutting-edge...  ...-step solutions with rigorous logic. Evaluate AI outputs for accuracy and quality of...  ...expertise). Assessment: Shortlisted experts complete an evaluation before selection.... 
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • A leading luxury brand evaluator is seeking a Luxury Automotive Experience Evaluator in San Francisco. This freelance position offers flexible working hours and invites automotive enthusiasts to assess premium showrooms based on their refined experiences. You will engage... 
    Freelance
    Flexible hours

    CXG

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, is seeking a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts and provide structured feedback. Candidates should have over 5 years of relevant experience and fluency in English. This remote position offers a competitive... 
    Remote job
    Hourly pay
    Work at office

    Mercor Inc

    San Francisco, CA
    4 days ago
  • Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly position requires a minimum of 5 years in finance and fluency in English. Your role will involve evaluating outputs... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    1 day ago
  • $175k - $275k

    VC Stack is seeking an Associate or Principal in San Francisco who possesses a strong engineering background and excellent communication skills. In this role, you'll evaluate the technical capabilities of startups while actively engaging with founders in the consumer software... 

    VC Stack

    San Francisco, CA
    3 days ago
  •  ...experiences that deliver more value. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess...  ...profile. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your... 
    Contract work
    Worldwide
    Flexible hours

    CXG group

    San Francisco, CA
    3 days ago
  • $120 per hour

    About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    1 day ago
  • Synthires is seeking a PhD-level expert to contribute to advanced AI research and evaluation projects in San Francisco. The role centers on applying deep domain knowledge to design problems, evaluate AI responses, and craft high-quality reference solutions that push the... 
    Part time

    Synthires

    San Francisco, CA
    2 days ago
  • Infinitus Systems is seeking highly motivated and detail-oriented Clinical Evaluators to join our team on a part-time contract basis. You will play a critical role in shaping the future of healthcare by evaluating the quality and accuracy of healthcare conversations conducted... 
    Remote job
    Hourly pay
    Contract work
    Part time
    Flexible hours

    Infinitus Systems, Inc.

    San Francisco, CA
    4 days ago
  • CXG is a global Customer Experience consulting firm specializing in serving premium and luxury brands. We seek a luxury brand evaluator to discreetly assess experiences—from boutique visits to online interactions—and provide feedback that shapes services for luxury brands... 
    Worldwide
    Flexible hours

    CXG

    San Francisco, CA
    11 hours ago
  • $160k - $270k

     ...Workspace. What you'll doGTM technical expert: Own the end-to-end technical pre-sales process by scoping customer use...  ...our Sales, Product and Agent Engineering teams to both drive our GTM function...  ...job description. We strive to evaluate all applicants consistently without... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    2 days ago
  • $238k - $317k

    Datadog is looking for a visionary Senior Leader of Sales Engineering (SE) to lead and scale a high-performing team of SE Directors in North America across Enterprise, Majors, and Public Sector accounts.This is a strategic leadership role with regional and global impact... 
    Work at office
    Local area

    Datadog

    San Francisco, CA
    21 hours ago
  • $160k - $270k

     ...everyone.What you'll doGTM technical expert: Own the end-to-end technical pre-sales process by scoping customer use...  ...our Sales, Product and Agent Engineering teams to both drive our GTM function...  ...job description. We strive to evaluate all applicants consistently without... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!