Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Sales Engineering Evaluation Designer

Mercor Inc

Mercor is partnering with a leading AI research organization to recruit experienced sales engineers who will define evaluation criteria for real-world technical sales work. You will score samples, provide written justifications, and help ensure reproducible, defensible judgments across pre-sales deliverables.

Strong communication and 4+ years in sales engineering or related roles are required, with a focus on translating customer needs into solutions and delivering tailored demonstrations.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Sales Engineering Evaluation Designer in New York, NY vacancy
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good....  ...and how our customers interact with Capital One. Design, develop, test, deploy, and support AI software components... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability)At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...and how our customers interact with Capital One.* Design, develop, test, deploy, and support AI software... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Group

    New York, NY
    2 days ago
  • $220k - $260k

     ...securing the evolving Artificial Intelligence (AI) landscape with our FortiAIGate AI...  ...seeking a passionate and experienced AI Sales Engineer to support the technical execution for...  ...technical architecture reviews, integration evaluations, product demonstrations, and technical... 
    Suggested
    Worldwide
    Home office

    Fortinet

    New York, NY
    4 days ago
  •  ...SaidGig seeks a skilled software engineer to evaluate frontier AI models by reviewing AI-generated code against real-world tasks and shaping evaluation datasets. You will diagnose correctness, performance, and reliability, enabling high-quality benchmarks and grading... 
    Suggested
    Remote work

    SaidGig

    New York, NY
    2 days ago
  •  ...Founding AI Engineer, Agents & Evaluation New York City Full time On-site Engineering We're building the intelligence layer for all home-based...  ...policies, scheduling rules, compliance constraints). Design the retrieval layer that gets the right context to the right... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work
    Night shift

    Zingage

    New York, NY
    4 days ago
  •  ...seRevel is seeking an engineer to own the AI worker end to end, building prompts, tooling, and retrieval...  ..., Slack, Jira, and Confluence. You will design evaluation harnesses and guardrails to ensure grounded, fast insights for Sales Engineers and leadership. You will... 

    seRevel

    New York, NY
    2 days ago
  •  ...Zingage (Kuzushi Inc.) is building the intelligence layer for home-based care in New York City. We seek a founding AI engineer to own evaluation, simulation, retrieval, and alignment infrastructure for autonomous agents in a high-impact healthcare setting. You will ship... 

    Zingage

    New York, NY
    4 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluations) At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...how our customers interact with Capital One. Design, develop, test, deploy, and support AI software... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...how our customers interact with Capital One. Design, develop, test, deploy, and support AI software... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  •  ...Senior Sales AI Engineer Bluefish is looking for a SaaS-experienced Sales Engineer to drive...  ...guiding them through complex technical evaluations and implementation strategies to...  ...sales, product, and customer teams to design and present high-impact solutions tailored... 
    Immediate start
    Shift work

    Bluefish AI

    New York, NY
    4 days ago
  • $229.9k - $262.4k

     ...Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing...  ...customers interact with Capital One Oversee the design, development, testing, deployment, and support... 
    Full time
    Part time
    Local area

    ITSMF

    New York, NY
    4 days ago
  •  ...People in AI is hiring an Applied AI Engineer for Agents & Evaluation in New York City, onsite. You will design, build, and iterate on production AI agents, with emphasis on context management, orchestration, prompts, and guardrails to ensure reliability. You’ll own the... 

    People In AI

    New York, NY
    4 days ago
  •  ...BMC Software, Inc. is seeking a skilled AI evaluation engineer to build evaluation frameworks, golden datasets, and rubrics for generative AI...  ...You will collaborate with DS, engineering, and product teams, design robust testing strategies for multi-agent systems, and champion... 

    BMC Software

    New York, NY
    3 days ago
  • $152k - $241.5k

     ...models are foundational to American AI leadership and cybersecurity, and that...  ...scientific scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps find,...  ...program knows what is true. You will design the metrics, choose the baselines,... 
    Full time
    Remote work

    Nvidia

    New York, NY
    6 days ago
  • Skan AI is hiring a senior sales engineer to join our early team, working with three account executives on...  ...deals from qualification to signature, evaluating what processes to automate and how...  ...architecture and security reviews, design deployment options (cloud, on-prem,... 

    Skanai

    New York, NY
    2 days ago
  • $115k - $260k

     ...Culture, Great Rewards, and Great Careers. Sr. Staff AI Engineer, AI Agent Platform (Agent & Evaluation Harness) Why Join GEICO? GEICO is transforming how...  ...the intelligence layer of that platform: the agent design patterns, context strategies, and evaluation... 
    Hourly pay
    Work experience placement
    Local area

    Government Employees Insurance Company

    New York, NY
    2 days ago
  • BMC Software, Inc. in the United States is hiring a Principal Quality Automation Engineer to shape evaluation frameworks for Generative AI and agentic AI systems. You will own the end-to-end evaluation process and build robust datasets, rubrics, and CI-tested evaluation... 
    Remote job

    BMC Software, Inc.

    New York, NY
    3 days ago
  •  ...SaidGig seeks an experienced administrative professional to design realistic evaluation tasks for next‑generation AI systems. This remote contract role translates complex workflows into benchmark scenarios; no prior AI experience is required. You will create task materials... 
    Contract work
    Remote work

    SaidGig

    New York, NY
    2 days ago
  •  ...Invoca is hiring a Sales Engineer in New York who partners with Account Executives to win strategic, high-value deals. You will run technical discovery, perform integration reviews, and develop proofs of concept using the prospect’s actual data. You’ll lead technical... 

    Invoca

    New York, NY
    16 hours ago
  •  ...Weekday AI is an AI-native recruiting platform offering a remote, contract-based role...  ...experienced legal professionals. You will design complex legal tasks, judge AI-driven...  ...precise rationales to guide model training and evaluation. This senior, task-based position is... 
    Contract work
    Remote work
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    14 hours ago
  •  ...Encore AI is seeking a Senior Sales Engineer to serve as the technical anchor for US and ANZ sales across banks, lenders, insurers, and fintechs. This role is based in New York and involves virtual discovery calls, demos, and workshops with cross‑functional stakeholders... 

    Encore AI

    New York, NY
    2 days ago
  •  ...Fortinet is seeking an AI Sales Engineer to support pre-sales for our AI security solutions. You will partner with the AI Sales Specialist to drive greenfield opportunities and expand existing accounts, delivering live demonstrations and architectural reviews. You will... 

    Fortinet

    New York, NY
    4 days ago
  •  ...Model ML seeks a dynamic sales leader to own the regional go-to-market strategy in the United States. You will identify prime clients, including private equity firms, investment banks, and top consultancies, and drive the complete sales lifecycle from lead to close. You... 

    Model ML

    New York, NY
    3 days ago
  •  ...A Frontier AI Company is seeking a Senior Digital Designer for a remote, part-time independent contract role. The work focuses on reviewing, grading, and...  ...improvements, with an emphasis on consistent evaluation and growth-design judgment rather than creating original... 
    Contract work
    Part time
    Remote work

    A Frontier AI Company

    New York, NY
    21 hours ago
  •  ...Prolific in the United Kingdom is seeking Senior Python Developers to join our Expert Network and help train and evaluate cutting-edge AI models. You will review AI-generated Python code for correctness, audit logic and run integration tests in appropriate environments... 
    Remote work

    Prolific

    New York, NY
    3 days ago
  • 1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will... 

    Mercor Inc

    New York, NY
    2 days ago
  • YO AI Labs is seeking a detail-oriented QA Engineer for a remote contractor role to support AI training projects. You will validate AI outputs, review data annotations, and ensure data quality through rigorous testing and documentation. The position emphasizes analytical... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • $180k - $200k

     ...Forward Deployed AI Engineer Location: New York, NY Compensation: $180-200K + Bonus US Citizens only; No Visa Sponsorship Candidates...  ...-in-the-loop controls, fallback mechanisms, and telemetry to evaluate performance, latency, cost, and business impact.... 
    Full time
    Local area
    Relocation
    Visa sponsorship

    Open Systems Technologies

    New York, NY
    2 days ago
  •  ...AI Engineer (GenAI Workflows for OTC Derivatives) Location: New York City (SoHo) — In-Person...  ...lifecycle. You’ll own key parts of the evaluation and context engineering infrastructure—...  ...engineers and domain experts to design retrieval, grounding, and validation pipelines... 
    Full time

    Nxt Level

    New York, NY
    1 day ago
  • $150 per hour

     ...Junior Software Engineer – AI Code Evaluation (Remote) ~ Contract Our client is a leading organization in the artificial intelligence industry...  .... This fully remote, contract-based opportunity is designed for software engineers with experience at leading... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    ELITEBRAIN

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Sales Engineering Evaluation Designer. Be the first to apply!