AI Evaluation Architect for Sales Engineering
Mercor
Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. You will define what excellent work looks like by designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. You will design precise evaluation criteria for real-world pre-sales deliverables, score AI-generated and human samples with #J-18808-Ljbffr Mercor
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Architect for Sales Engineering in New York, NY vacancy
$137.5k - $239k
...capture of new business opportunities, architecting solutions, coordinating internal resources... ...of the following: Master's degree in engineering, computer science or other technical... ...Verizon is an equal opportunity employer. We evaluate qualified applicants without regard to...SuggestedFull timeTemporary workPart timeWork experience placementFlexible hoursShift work$150k - $350k
...realizing the full potential of their AI investments. The KX platform... ...This is a principal-level, hands-on architect role with the Forward Deployed Engineering Team at KX. You assess customer environments... ...prove the case with numbers. Evaluate AI and agent use cases:...SuggestedWork at officeKX
New York, NY3 days ago$270k - $330k
...cybersecurity SaaS company, focused on shaping AI strategy and designing large-scale AI... ...scalable, production‑grade systems. Evaluate and define AI governance, safety, and... ...focused product environment. Partner with engineering, product, and research stakeholders to...SuggestedWork at officeClera
New York, NY2 days ago$215k - $275k
...journeys. We blend design, product engineering, analytics, automation, and AI-native delivery to build... ...at enterprise scale. As an AI/ML Architect, you’ll design and deliver production... ...orchestration, agentic workflows, evaluation, deployment, monitoring, optimization...SuggestedTemporary workSlalom Build
New York, NY1 day ago- ...A tech-focused research lab is seeking Property Manager Experts to design and evaluate property management challenges for training AI models. This remote role allows you to leverage your expertise in real estate operations while making a significant impact on AI solutions...SuggestedRemote work
AfterQuery Experts
New York, NY1 day ago $153.6k - $207.8k
...Amazon Web Services, Inc. Applied AI Solutions Architects in AWS help customers build and use... ...patterns, tool and context design, evaluation and guardrails, and latency/cost optimization... ...with internal teams including sales, engineering, and support to translate customer...Local areaFlexible hoursDay shift$100k - $220k
...Description BMO is establishing a dedicated AI Engineering function, and this role is its Senior AI Architect BMO is establishing a dedicated AI Engineering... ...adjudicate Microsoft AI boundary questions, and evaluate preview features against bank governance. Enterprise...Part timeLocal area- ...lead technical execution across AI, data, and platform teams Guide engineers (AI, data, full-stack) and ensure... ...access layer, prompt management and evaluation AI & GenAI Enablement... ...field Profile Type : Hands-on architect with ability to balance strategy...
Inizio Partners
New York, NYa month ago - ...Solutions Engineer The Technical Success team is responsible for the customer experience... ...stakeholders to understand their pre-sales needs, guide their AI strategy, and identify the highest... ...customer relationships during the evaluation, validation, and purchasing process....Work at officeRelocation package
- Socket.dev is seeking a hands-on AI Operations Specialist to own customer AI implementations from discovery through launch and ongoing... .... You will configure and improve LLM-powered workflows, evaluate production behavior, and troubleshoot issues to ensure reliable...Remote job
$155.94k - $259.87k
Principal Architect, AI Where Ambition Meets Innovation Build a career that matches all your... ...partners with Enterprise Architecture, AI Engineering, Security, Infrastructure, Data, and... ...and proof-of-concept (POC) efforts to evaluate emerging AI models, frameworks, and architectural...Immediate startWork from home- Senior Agentic AI Engineer Are you looking to join an innovative, market-leading company where... ..., agentic workflows, quality evaluators, constraint validation, and query-time... ...practical, product-oriented solutions. Architect large-scale graph, semantic, and data platforms...Work at officeRemote workFlexible hours
$80 - $90 per hour
AI Architect -26-02164 Hybrid/Onsite in NYC 2yrs Duration TempW2orC2C NTT DATA strives... ...(US). AI Architect - Principal/Staff Engineer, Agentic AI Systems Why: Client's SenSei... ...-native scale‑up) Experience building evaluation systems that proved the agent was reliable...Hourly payTemporary workRemote workFlexible hours$55 per hour
A leading technology firm is seeking an Evaluation Scenario Writer - QA to ensure the quality of evaluation scenarios for AI projects. This part-time, flexible role involves reviewing tests, spotting inconsistencies, and collaborating on automation. Ideal for those with...Remote jobPart timeFlexible hours- Obsidian in New York builds high‑fidelity simulated work environments to evaluate AI agents on real marketing tasks. You will design creator and influencer scenarios, including briefs, artifacts, and the judging criteria that separate strong responses from plausible but...
- Hybrid/Onsite in NYC 2yrs Duration Job Description AI Architect --- Principal/Staff Engineer, Agentic AI Systems Why: Client's AIOps team needs someone... ...equivalent AI-native scale-up) Experience building evaluation systems that proved the agent was reliable enough to run...
- Senior AI Architect - Finance Technology AI Enablement We are looking for a Senior AI Architect... ...makes that strategy real, and guide engineering teams through detailed design and... ...data processing and analytics pipelines. Evaluate and select tools, platforms, and frameworks...
$134.36k - $244.04k
The Principal AI Architect serves as a senior individual contributor responsible for defining... ...Architects, Data Architects, Platform Engineers, and Product teams to embed Generative... ...strategy and solution design, identifying, evaluating, and applying emerging technologies...Local areaRemote work- Overview The AI Solutions Architect defines the technical direction for AI, ML, and data‑driven capabilities... ...across delivery teams. Mentor engineering teams and contribute to architecture... ..., inference layers, and governance. Evaluate emerging AI and cloud capabilities...
$180k
...a highly talented and self-motivated AI Principal Architect to join it in advancing the technological... ...for lineage, observability, and evaluation (e.g., RAGAS). Cross-Cloud & Vendor... ...a strong background in both software engineering and enterprise-scale cloud architecture...Temporary workLocal areaWorldwide- Principal AI Architect Location: Tristate C2H 8+ years of experience in engineering, ML, data platforms and/or distributed systems as a senior architect. Deep hands-on... .... Awareness of Responsible AI frameworks, evaluation standards and frameworks. Strong architecture...
- Mercor seeks senior litigation professionals to design evaluation tasks for AI systems in civil litigation and dispute resolution contexts. The role spans US Federal Rules and international procedure, with opportunities on both tracks. You will draft reference outputs,...
- Position: Generative AI Architect Location: Allentown PA(Remote) Generative AI Architect The... ...Integration: Collaborate with software engineering teams to integrate generative AI... ...preprocessing, feature engineering, and model evaluation techniques. Knowledge of API...Remote job
$122.67k - $204.46k
...Identity and Access Management (IAM) Architect with a strong AI and agent-integration focus to lead the... ...expertise with practical engineering skills—building POCs, configuring OAuth... ...orchestration, and observability. Evaluate and implement scalable Non-Human Identity...Full timeWork from home$155k - $175k
.... About the Role We're looking for an AI Architect to lead the design, evolution, and scaling... ...controls as pipeline volume grows Evaluate and integrate new LLM providers and embedding... ...into pipeline designs Work across the engineering organization to integrate AI pipelines...Work experience placementWork at officeImmediate startFlexible hours$240k - $315k
...interpretable, and steerable AI systems. We want AI to be... ...of committed researchers, engineers, policy experts, and... ...develop strategies and plans to evaluate and adopt leading-edge AI... ...Deployed Engineer, Sales Engineer, Solutions Architect, or Cybersecurity Engineer...Full timeWork at officeVisa sponsorshipFlexible hours- Conversational & Agentic Ai Architect You want more out of a career. A place to share your... ...technical architecture, a product-led engineering mindset, and extensive expertise in both... ...prompt engineering, distillation, and evaluating small/efficient models for latency-sensitive...Temporary workPart timeWork experience placementRemote workWork from homeShift work
- ...human customer experiences with AI. We partner with industry... ...the end-to-end technical pre-sales process by scoping customer use... ...our Sales, Product and Agent Engineering teams to both drive our GTM function... ...job description. We strive to evaluate all applicants consistently...Full timeFlexible hours
- ...Enterprise Sales Engineer Build a safer world with us, one incident at a time. Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by... ...compelling product demos, support customer evaluations and pilots, and help prospects envision how...Full timeLocal areaRemote workFlexible hours
$120k - $200k
...Enterprise Sales Engineer WorkWave is looking for an Enterprise Sales Engineer to play a key... ...With the launch of Wavelytics, our new AI-powered analytics suite, we're unlocking... ...track record of building quick rapport, evaluating complex customer requirements, and delivering...Casual workWork at officeLocal areaRemote workWork from homeWorldwideHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Architect for Sales Engineering. Be the first to apply!
Related searches
- sales engineer New York, NY
- sales engineer remote New York, NY
- director sales engineering New York, NY
- sales engineer technical sales New York, NY
- senior sales engineer New York, NY
- internal sales engineer New York, NY
- pre-sales engineer New York, NY
- water sales New York, NY
- feed sales New York, NY
- bike sales New York, NY