AI Sales Engineering Evaluation Designer
Mercor Inc
Mercor is partnering with a leading AI research organization to recruit experienced sales engineers who will define evaluation criteria for real-world technical sales work. You will score samples, provide written justifications, and help ensure reproducible, defensible judgments across pre-sales deliverables.
Strong communication and 4+ years in sales engineering or related roles are required, with a focus on translating customer needs into solutions and delivering tailored demonstrations.
#J-18808-Ljbffr$229.9k - $262.4k
...AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good.... ...and how our customers interact with Capital One. Design, develop, test, deploy, and support AI software components...SuggestedFull timePart timeLocal area$197.3k - $225.1k
AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability)At Capital One, we are creating responsible and reliable AI systems, changing banking... ...and how our customers interact with Capital One.* Design, develop, test, deploy, and support AI software...SuggestedFull timePart timeLocal area$220k - $260k
...securing the evolving Artificial Intelligence (AI) landscape with our FortiAIGate AI... ...seeking a passionate and experienced AI Sales Engineer to support the technical execution for... ...technical architecture reviews, integration evaluations, product demonstrations, and technical...SuggestedWorldwideHome office- ...SaidGig seeks a skilled software engineer to evaluate frontier AI models by reviewing AI-generated code against real-world tasks and shaping evaluation datasets. You will diagnose correctness, performance, and reliability, enabling high-quality benchmarks and grading...SuggestedRemote work
- ...Founding AI Engineer, Agents & Evaluation New York City Full time On-site Engineering We're building the intelligence layer for all home-based... ...policies, scheduling rules, compliance constraints). Design the retrieval layer that gets the right context to the right...SuggestedPermanent employmentFull timeWork at officeRemote workNight shift
- ...seRevel is seeking an engineer to own the AI worker end to end, building prompts, tooling, and retrieval... ..., Slack, Jira, and Confluence. You will design evaluation harnesses and guardrails to ensure grounded, fast insights for Sales Engineers and leadership. You will...
- ...Zingage (Kuzushi Inc.) is building the intelligence layer for home-based care in New York City. We seek a founding AI engineer to own evaluation, simulation, retrieval, and alignment infrastructure for autonomous agents in a high-impact healthcare setting. You will ship...
$229.9k - $262.4k
...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluations) At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...how our customers interact with Capital One. Design, develop, test, deploy, and support AI software...Full timePart timeLocal area$229.9k - $262.4k
...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...how our customers interact with Capital One. Design, develop, test, deploy, and support AI software...Full timePart timeLocal area- ...Senior Sales AI Engineer Bluefish is looking for a SaaS-experienced Sales Engineer to drive... ...guiding them through complex technical evaluations and implementation strategies to... ...sales, product, and customer teams to design and present high-impact solutions tailored...Immediate startShift work
$229.9k - $262.4k
...Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing... ...customers interact with Capital One Oversee the design, development, testing, deployment, and support...Full timePart timeLocal area- ...People in AI is hiring an Applied AI Engineer for Agents & Evaluation in New York City, onsite. You will design, build, and iterate on production AI agents, with emphasis on context management, orchestration, prompts, and guardrails to ensure reliability. You’ll own the...
- ...BMC Software, Inc. is seeking a skilled AI evaluation engineer to build evaluation frameworks, golden datasets, and rubrics for generative AI... ...You will collaborate with DS, engineering, and product teams, design robust testing strategies for multi-agent systems, and champion...
$152k - $241.5k
...models are foundational to American AI leadership and cybersecurity, and that... ...scientific scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps find,... ...program knows what is true. You will design the metrics, choose the baselines,...Full timeRemote work- Skan AI is hiring a senior sales engineer to join our early team, working with three account executives on... ...deals from qualification to signature, evaluating what processes to automate and how... ...architecture and security reviews, design deployment options (cloud, on-prem,...
$115k - $260k
...Culture, Great Rewards, and Great Careers. Sr. Staff AI Engineer, AI Agent Platform (Agent & Evaluation Harness) Why Join GEICO? GEICO is transforming how... ...the intelligence layer of that platform: the agent design patterns, context strategies, and evaluation...Hourly payWork experience placementLocal area- BMC Software, Inc. in the United States is hiring a Principal Quality Automation Engineer to shape evaluation frameworks for Generative AI and agentic AI systems. You will own the end-to-end evaluation process and build robust datasets, rubrics, and CI-tested evaluation...Remote job
- ...SaidGig seeks an experienced administrative professional to design realistic evaluation tasks for next‑generation AI systems. This remote contract role translates complex workflows into benchmark scenarios; no prior AI experience is required. You will create task materials...Contract workRemote work
- ...Invoca is hiring a Sales Engineer in New York who partners with Account Executives to win strategic, high-value deals. You will run technical discovery, perform integration reviews, and develop proofs of concept using the prospect’s actual data. You’ll lead technical...
- ...Weekday AI is an AI-native recruiting platform offering a remote, contract-based role... ...experienced legal professionals. You will design complex legal tasks, judge AI-driven... ...precise rationales to guide model training and evaluation. This senior, task-based position is...Contract workRemote workFlexible hoursWeekday work
- ...Encore AI is seeking a Senior Sales Engineer to serve as the technical anchor for US and ANZ sales across banks, lenders, insurers, and fintechs. This role is based in New York and involves virtual discovery calls, demos, and workshops with cross‑functional stakeholders...
- ...Fortinet is seeking an AI Sales Engineer to support pre-sales for our AI security solutions. You will partner with the AI Sales Specialist to drive greenfield opportunities and expand existing accounts, delivering live demonstrations and architectural reviews. You will...
- ...Model ML seeks a dynamic sales leader to own the regional go-to-market strategy in the United States. You will identify prime clients, including private equity firms, investment banks, and top consultancies, and drive the complete sales lifecycle from lead to close. You...
- ...A Frontier AI Company is seeking a Senior Digital Designer for a remote, part-time independent contract role. The work focuses on reviewing, grading, and... ...improvements, with an emphasis on consistent evaluation and growth-design judgment rather than creating original...Contract workPart timeRemote work
- ...Prolific in the United Kingdom is seeking Senior Python Developers to join our Expert Network and help train and evaluate cutting-edge AI models. You will review AI-generated Python code for correctness, audit logic and run integration tests in appropriate environments...Remote work
- 1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will...
- YO AI Labs is seeking a detail-oriented QA Engineer for a remote contractor role to support AI training projects. You will validate AI outputs, review data annotations, and ensure data quality through rigorous testing and documentation. The position emphasizes analytical...Remote jobFor contractors
$180k - $200k
...Forward Deployed AI Engineer Location: New York, NY Compensation: $180-200K + Bonus US Citizens only; No Visa Sponsorship Candidates... ...-in-the-loop controls, fallback mechanisms, and telemetry to evaluate performance, latency, cost, and business impact....Full timeLocal areaRelocationVisa sponsorship- ...AI Engineer (GenAI Workflows for OTC Derivatives) Location: New York City (SoHo) — In-Person... ...lifecycle. You’ll own key parts of the evaluation and context engineering infrastructure—... ...engineers and domain experts to design retrieval, grounding, and validation pipelines...Full time
$150 per hour
...Junior Software Engineer – AI Code Evaluation (Remote) ~ Contract Our client is a leading organization in the artificial intelligence industry... .... This fully remote, contract-based opportunity is designed for software engineers with experience at leading...Hourly payContract workFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Sales Engineering Evaluation Designer. Be the first to apply!
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- sales engineer remote New York, NY
- director sales engineering New York, NY




