Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sales Engineering Expert - Evaluator

Mercor

1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. 2. Key Responsibilities Design precise, task-specific grading criteria for real-world pre-sales and solutions-engineering deliverables (technical discovery plans, tailored product demonstrations, proof-of-concept and technical evaluation plans, security questionnaires and RFP responses, integration/API/architecture explanations, and product-fit and technical-risk assessments) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre-Sales Consultant, or Technical Sales Consultant Deep fluency in the pre-sales craft: leading technical discovery, translating customer requirements into product solutions, delivering tailored demos, handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk Hands-on experience with technically complex B2B software — SaaS, cloud infrastructure, cybersecurity, data platforms, developer tools, or enterprise applications Exceptionally strong written communication, with the ability to explain exactly why a piece of technical work would or would not land with both technical and business stakeholders Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human-data projects is a strong plus 4. Application Process Qualified applicants may be asked to complete a brief assessment or submit additional information #J-18808-Ljbffr Mercor

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Sales Engineering Expert - Evaluator in New York, NY vacancy
  • Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico... 
    Suggested
    Temporary work
    10 hours per week

    Obsidian

    New York, NY
    4 days ago
  •  ...experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design...  ...portals, UX writing and product content, and design-to-engineering/production handoff) Score AI-generated and human work samples... 
    Suggested

    Obsidian

    New York, NY
    5 days ago
  • Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with... 
    Suggested
    Remote job
    For contractors
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    3 days ago
  • $100 - $150 per hour

     ...Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: B2B Sales ExpertType:ContractCompensation:$100-$150/hourLocation:Remote...  ...reviewed judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital... 
    Suggested
    Summer work
    Remote work

    United States Digital Space LLC

    New York, NY
    4 days ago
  •  ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with... 
    Suggested
    Remote job
    Contract work
    Flexible hours

    Handshake

    New York, NY
    5 days ago
  • About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade... 
    Hourly pay
    Work at office
    Remote work

    Obsidian

    New York, NY
    3 days ago
  • $80 - $120 per hour

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    New York, NY
    16 days ago
  • $80 - $120 per hour

     ..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $14 per hour

     ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...  ...experience as a music producer, audio engineer, or sound mixer. ~ College degree in... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $80 - $120 per hour

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $50 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Spanish (Mexico) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 10–20 hours/week Role... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    26 days ago
  • $15 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $50 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:... 
    Contract work
    Summer work
    10 hours per week

    Mercor

    New York, NY
    17 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $39 per hour

     ...Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract...  ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation...  ...of experience as a music producer, audio engineer, or sound mixer. ~ College degree in... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $80 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour...  ...judgment. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $90 per hour

     ..., Larry Summers , and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type: Contract Compensation...  ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    New York, NY
    10 days ago
  • $106.8k - $157.5k

    Dataminr, Inc. is hiring a Sales Engineer who will act as a trusted advisor and security-focused technical expert. This role involves leading the technical sales process, designing cybersecurity solutions, and providing technical guidance to customers across the US and... 
    Remote job

    Dataminr, Inc.

    New York, NY
    5 days ago
  • $30 per hour

     ...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  •  ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role...  ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify... 

    Mercor

    New York, NY
    4 days ago
  • $151k - $251.6k

    LSEG's Evaluated Pricing Service provides end-of-day valuations across global CLO markets. We are seeking an expert Senior Evaluator to own the valuation and market analysis of CLO securities...  ...Economics, Mathematics, Accounting, Engineering, or a related field.7+ years of... 
    Full time
    Part time
    Internship

    London Stock Exchange Group

    New York, NY
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    4 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    2 days ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    2 days ago
  • $154.88k - $221.25k

     ...age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity.RoleWe are looking for a Senior Sales Engineer to join our Majors Account team. This is an East role in NYC Metro, reporting to the Sales Engineering Manager in the Americas... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Zscaler

    New York, NY
    4 days ago
  • SummaryEnica Engineering, a division of Willdan Group Inc, provides services built on its industry-leading controls expertise and unique,...  ...pharmaceutical and industrial firms in the greater New York area.The Sales Engineer addresses client's financial, business, operational... 
    Base plus commission
    Contract work
    Local area

    Willdan

    New York, NY
    1 day ago
  • $194k - $291k

     ...will allow employees of all backgrounds to thrive.As a Senior Sales Engineer at Amplitude, you'll be the technical quarterback for our...  ...pipeline.What You'll DoDeal Execution (70% of time)Lead technical evaluation phases for deals ranging from 100K to 1M+ ARRConduct deep... 
    Work at office
    Remote work
    Home office

    Amplitude

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!