Sales Engineering Expert - Evaluator
Mercor
1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. 2. Key Responsibilities Design precise, task-specific grading criteria for real-world pre-sales and solutions-engineering deliverables (technical discovery plans, tailored product demonstrations, proof-of-concept and technical evaluation plans, security questionnaires and RFP responses, integration/API/architecture explanations, and product-fit and technical-risk assessments) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, Solutions Consultant, Pre-Sales Consultant, or Technical Sales Consultant Deep fluency in the pre-sales craft: leading technical discovery, translating customer requirements into product solutions, delivering tailored demos, handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk Hands-on experience with technically complex B2B software — SaaS, cloud infrastructure, cybersecurity, data platforms, developer tools, or enterprise applications Exceptionally strong written communication, with the ability to explain exactly why a piece of technical work would or would not land with both technical and business stakeholders Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human-data projects is a strong plus 4. Application Process Qualified applicants may be asked to complete a brief assessment or submit additional information #J-18808-Ljbffr Mercor
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...SuggestedTemporary work10 hours per week
- ...experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design... ...portals, UX writing and product content, and design-to-engineering/production handoff) Score AI-generated and human work samples...Suggested
- Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with...SuggestedRemote jobFor contractorsFlexible hoursWeekday work
$100 - $150 per hour
...Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: B2B Sales ExpertType:ContractCompensation:$100-$150/hourLocation:Remote... ...reviewed judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital...SuggestedSummer workRemote work- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...SuggestedRemote jobContract workFlexible hours
- About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade...Hourly payWork at officeRemote work
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workFlexible hours$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Contract workSummer workImmediate startRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$50 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Spanish (Mexico) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 10–20 hours/week Role...Contract workSummer workRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against...Contract workSummer workImmediate startRemote work$50 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:...Contract workSummer work10 hours per week$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$39 per hour
...Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation... ...of experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Contract workSummer workImmediate startRemote work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...judgment. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote work$90 per hour
..., Larry Summers , and Jack Dorsey . Position: Frontend Engineer — Web Replication Preference Rater Type: Contract Compensation... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...Contract workSummer workLocal areaRemote work$106.8k - $157.5k
Dataminr, Inc. is hiring a Sales Engineer who will act as a trusted advisor and security-focused technical expert. This role involves leading the technical sales process, designing cybersecurity solutions, and providing technical guidance to customers across the US and...Remote job$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote jobWork from homeFlexible hours- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
$151k - $251.6k
LSEG's Evaluated Pricing Service provides end-of-day valuations across global CLO markets. We are seeking an expert Senior Evaluator to own the valuation and market analysis of CLO securities... ...Economics, Mathematics, Accounting, Engineering, or a related field.7+ years of...Full timePart timeInternship- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
$154.88k - $221.25k
...age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity.RoleWe are looking for a Senior Sales Engineer to join our Majors Account team. This is an East role in NYC Metro, reporting to the Sales Engineering Manager in the Americas...Full timeTemporary workWork at officeLocal areaRemote work- SummaryEnica Engineering, a division of Willdan Group Inc, provides services built on its industry-leading controls expertise and unique,... ...pharmaceutical and industrial firms in the greater New York area.The Sales Engineer addresses client's financial, business, operational...Base plus commissionContract workLocal area
$194k - $291k
...will allow employees of all backgrounds to thrive.As a Senior Sales Engineer at Amplitude, you'll be the technical quarterback for our... ...pipeline.What You'll DoDeal Execution (70% of time)Lead technical evaluation phases for deals ranging from 100K to 1M+ ARRConduct deep...Work at officeRemote workHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sales Engineering Expert - Evaluator. Be the first to apply!
- sales solution engineer New York, NY
- sales engineer technical sales New York, NY
- sales engineer New York, NY
- senior sales engineer New York, NY
- software sales engineer New York, NY
- internal sales engineer New York, NY
- sales engineer remote New York, NY
- pre-sales engineer New York, NY
- director sales engineering New York, NY
- technology expert New York, NY


