Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sales Engineering Expert - Evaluator

Mercor

  1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
  2. Key Responsibilities Design precise, task‑specific grading criteria for real‑world pre‑sales and solutions‑engineering deliverables (technical discovery plans, tailored product demonstrations, proof‑of‑concept and technical evaluation plans, security questionnaires and RFP responses, integration/API/architecture explanations, and product‑fit and technical‑risk assessments)
Score AI‑generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence‑based judgment so scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre‑Sales Consultant, or Technical Sales Consultant Deep fluency in the pre‑sales craft: leading technical discovery, translating customer requirements into product solutions, delivering tailored demos, handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk Hands‑on experience with technically complex B2B software — SaaS, cloud infrastructure, cybersecurity, data platforms, developer tools, or enterprise applications Exceptionally strong written communication, with the ability to explain exactly why a piece of technical work would or would not land with both technical and business stakeholders Detail‑oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human‑data projects is a strong plus #J-18808-Ljbffr Mercor

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sales Engineering Expert - Evaluator in San Francisco, CA vacancy
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    4 days ago
  • Obsidian evaluates Neuron Kernel Interface (NKI) development tasks used for frontier AI model training and evaluation. The role focuses on assessing CUDA→NKI migration fidelity, Trainium-specific performance optimization quality, and cross-platform numerical-correctness... 
    Suggested

    Obsidian

    San Francisco, CA
    2 days ago
  • YO AI Labs is seeking a Development & Infrastructure Expert to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and deployment workflows and provide... 
    Suggested
    Remote job

    YO AI Labs

    San Francisco, CA
    2 days ago
  • Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured... 
    Suggested

    Obsidian

    San Francisco, CA
    1 day ago
  • Harness is seeking a Sales Engineer in the San Francisco Bay Area region to bridge sales and engineering, delivering compelling platform demonstrations and technical guidance. The role requires strong presentation skills, direct customer interaction, and the ability to... 
    Suggested
    Remote job

    Mosaic.tech

    San Francisco, CA
    2 days ago
  •  ...Description Developer & Infrastructure Expert Role Type: Contractor Location: Remote...  ...Developer & Infrastructure Experts to evaluate AI-powered workflows across software...  ...infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands,... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    12 days ago
  • $199.9k - $320k

     ...and to the world. Progress starts with you.Job DescriptionThe Sales Engineer (SE) is a technical sales specialist responsible for enabling...  ...experience walkthroughs.Serve as the technical subject‑matter expert during sales cycles for high‑complexity products and solutions... 
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    San Francisco, CA
    5 days ago
  •  ...Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience... 

    Welo Data

    San Francisco, CA
    5 days ago
  • $194k - $291k

     ...employees of all backgrounds to thrive.About the RoleAs a Senior Sales Engineer, Enterprise at Amplitude, you'll be the technical quarterback...  ....What You'll DoDeal Execution (70% of time)Lead technical evaluation phases for deals ranging from 100K to 1M+ ARRConduct deep... 
    Work at office
    Home office

    Amplitude

    San Francisco, CA
    2 days ago
  • $220k - $290k

     ...over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3...  ...even faster.Position SummaryThe AppSec Sales Engineer is the technical liaison who bridges sales and engineering, expertly articulating the technology and product positioning... 
    Local area
    Immediate start
    Flexible hours
    Shift work

    Harness

    San Francisco, CA
    1 day ago
  • $188k - $282k

    Job DescriptionSenior Sales Engineer (SE) Job DescriptionAt Zendesk, we are redefining the boundaries of Customer Experience (CX) and Employee...  ...(AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company... 
    Full time
    Work at office
    Local area
    Remote work

    Forethought

    San Francisco, CA
    1 day ago
  • $167k - $270k

     ...At Fortinet, our mission is to safeguard people, devices, and data everywhere. We are currently seeking a dynamic Enterprise, Sales Engineer to be a part of enabling the success of our rapidly growing business. As an Enterprise Sales Engineer, you will:Pre-sales: Assist... 
    Work at office
    Worldwide
    Home office

    Fortinet

    San Francisco, CA
    5 hours ago
  • $220k - $290k

     ...Harness powered over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3T protected API calls...  ...talent to help us move even faster.Position SummaryThe Sales Engineer lives and works in the intersection between sales and engineering... 
    Local area
    Immediate start
    Remote work
    Flexible hours
    Shift work

    Harness

    San Francisco, CA
    4 days ago
  • $200.3k - $290.45k

     ...trusted advisor and engage senior stakeholders through complex sales cycles and solution-oriented discussionsExcellent communication,...  ...globally. The Industry Practice Group consists of senior domain experts with backgrounds in industry, consulting, regulatory, and practitioner... 
    Full time

    Moodys

    San Francisco, CA
    8 days ago
  • $137k - $161k

     ...Breakthrough Company.Solutions EngineerCheckr’s Solutions Engineering team are strategic partners to our Sales and Implementation teams. They are responsible for...  ...to real-world challenges, and serve as a trusted expert on safe and fair hiring. If you love solving hard... 
    Contract work
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    3 days ago
  • Pre-Sales Engineer, CybersecurityThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We...  ...career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Hewlett Packard Enterprise

    San Francisco, CA
    1 day ago
  • $165k - $264k

     ...efficiency at scale. As a results-driven Senior Sales Engineer here, you’ll enjoy a fast-paced,...  ...and competing prioritiesDiscovery expert that deeply understands customers’ core...  ...personal information from applicants to evaluate candidates for employment. You may request... 
    Work experience placement
    Remote work

    Axon

    San Francisco, CA
    5 hours ago
  • $199.9k - $320k

     ...and to the world. Progress starts with you.Job Description The Sales Engineer is a critical member of the Visa Acceptance Solutions (...  ...merchant needs. Responsibilities: Sales Process Support Maintain expert knowledge of Visa Acceptance Solutions (VAS), CyberSource, and... 
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    San Francisco, CA
    5 days ago
  • $175k - $275k

    VC Stack is seeking an Associate or Principal in San Francisco who possesses a strong engineering background and excellent communication skills. In this role, you'll evaluate the technical capabilities of startups while actively engaging with founders in the consumer software... 

    VC Stack

    San Francisco, CA
    1 day ago
  • Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly position requires a minimum of 5 years in finance and fluency in English. Your role will involve evaluating outputs... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    4 days ago
  • $120 per hour

    About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    4 days ago
  • YO AI Labs is seeking Polish bilingual experts to contribute to an AI training project. You will evaluate Polish audio content, assess nativeness, fluency, pronunciation, and linguistic authenticity, and provide clear feedback in English. No prior AI experience required... 
    Remote job

    YO AI Labs

    San Francisco, CA
    4 days ago
  • A leading luxury brand evaluator is seeking a Luxury Automotive Experience Evaluator in San Francisco. This freelance position offers flexible working hours and invites automotive enthusiasts to assess premium showrooms based on their refined experiences. You will engage... 
    Freelance
    Flexible hours

    CXG

    San Francisco, CA
    2 days ago
  • Mercor is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. This remote hourly engagement requires deep subject-matter expertise to grade outputs and provide actionable feedback. Candidates... 
    Remote job
    Hourly pay
    Work at office

    Mercor Inc

    San Francisco, CA
    1 day ago
  • Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured... 
    Hourly pay
    Work at office
    Remote work

    Obsidian

    San Francisco, CA
    4 days ago
  • Turing is seeking a Software Engineering evaluator to create datasets for training and benchmarking language models, focusing on Rust with additional languages. The role involves evaluating AI-generated code and working with researchers to improve enterprise AI coding solutions... 
    For contractors
    10 hours per week
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  • Become a Luxury Brand Evaluator in San Francisco - Apply Now Turn your passion for luxury into a career opportunity. Explore the world of...  ...profile Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    San Francisco, CA
    2 days ago
  • Obsidian is seeking expert Evaluators in Operations / inventory / capacity planning to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. The role is remote and paid hourly, inviting professionals who can apply deep subject-matter... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in Personal finance / consumer planning to review AI-generated outputs for accuracy and quality. This is a remote, hourly engagement. Candidates should have 5+ years in Personal finance / consumer planning, native or professional English... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    2 days ago
  • Cincinnatus LLC is seeking a senior character animator to help define evaluation standards for a performance transfer model and to guide the scoring framework at a leading AI lab. This part-time W-2 role requires on-site collaboration in Playa Vista (Los Angeles) or New... 
    Part time

    Obsidian

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!