AI Evaluation Architect for Sales Engineering
Mercor
Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. You will define what excellent work looks like by designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. You will design precise evaluation criteria for real-world pre-sales deliverables, score AI-generated and human samples with #J-18808-Ljbffr Mercor
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Architect for Sales Engineering in New York, NY vacancy
- Synthires is seeking an experienced Management Consulting professional to contribute to advanced AI research and evaluation projects. The role centers on defining excellence in consulting work, developing task-specific criteria, and providing rigorous written justifications...Suggested
- Mercor is seeking a domain expert to craft original Thai law questions for an AI evaluation dataset. You will draft exam-style items with ten answer options and a worked solution, remotely and on a flexible schedule. Requirements: law degree or Thai equivalent, ideally...SuggestedRemote jobWeekly payFor contractorsFreelanceFlexible hours
- Rise Data Labs seeks a Media & Information AI Training Specialist to craft realistic media tasks and rubrics for AI training in journalism... ..., editing, writing, or video production experience and comfort evaluating professional-grade work to benchmark AI performance. #J-18808-...Suggested
$124.5k - $239k
...capture of new business opportunities, architecting solutions, coordinating internal resources... ...of the following:Master’s degree in engineering, computer science or other technical discipline... ...is an equal opportunity employer. We evaluate qualified applicants without regard to...SuggestedFull timeTemporary workPart timeWork experience placementFlexible hoursShift work$122k - $240.5k
Position Summary Google AI Architect/AI and EngineeringJoin our AI & Engineering team in transforming technology platforms, driving innovation, and helping... ...reliability, security, and cost.Design, fine-tune, evaluate, and govern LLM solutions with Gemini on Vertex AI...SuggestedLocal areaVisa sponsorshipFlexible hours$222.5k - $261.9k
...West Monroe is seeking a Senior Architect to lead the technical vision, architecture, and engineering strategy for the firm's Asset... ...of proprietary software assets, AI capabilities, and reusable platforms... ...AI platforms and frameworks. Evaluate emerging technologies and...Local areaImmediate startFlexible hours$187.6k - $220.7k
Are you ready to make an impact?Agentic AI Architect-Google Cloud West Monroe is seeking an... ...will lead the strategy, architecture, and engineering delivery of enterprise agentic AI... ...clients, exercising sound judgment in evaluating outputs. Apply AI technologies (e.g., generative...Local areaImmediate startFlexible hours- ...your goals. EisnerAmper is seeking an AI Platform Architect, Strategy & Enablement who will serve... ...The role will build model lifecycle, evaluation, and multi-vendor orchestration as... ...intersection of platform architecture, AI engineering, and strategic operations. The...Full timeLocal areaRemote workWork visa
$187.6k - $220.7k
...West Monroe is looking for an Advisory Architect, Data/AI due diligence to join our Technology &... ...; M&A Transaction Services-Data Engineering & Analytics and deliver on technology... ...Individual salaries are determined by evaluating a variety of factors including geography...H1bLocal areaImmediate startFlexible hours- ...Experience 10-15 YearsJob Summary We are seeking a highly skilled AI/ML Engineer with extensive knowledge in Generative AI (Gen AI) and Multi-... ...Gen AI and LLMs.Implement best practices for model training, evaluation, and optimization.Mentor junior engineers and contribute to...Full time
$220k - $290k
Harness is the AI Software Delivery Platform company, led by technologist and entrepreneur... ...185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests... ...even faster.Position SummaryThe Senior Sales Engineer lives and works in the intersection...Local areaImmediate startFlexible hoursShift work$118k - $157k
...seeking a motivated and experienced Security Sales Engineer to join our dynamic enterprise sales... ...sales cycle, including during customer evaluations and proof-of-value initiatives.Develop and... ...and security platform for the AI era, providing businesses with unified visibility...Work at office- ...A tech-focused research lab is seeking Property Manager Experts to design and evaluate property management challenges for training AI models. This remote role allows you to leverage your expertise in real estate operations while making a significant impact on AI solutions...Remote work
AfterQuery Experts
New York, NY4 days ago $190k
...Transformation, Data & Digital Platforms, AI at Scale, Cybersecurity and... ....What You'll DoLead AI Tech Architects - AI Platforms at BCG... ...working relationships across engineering, data, product, and client... ..., and operational complexity.Evaluate emerging Ai frameworks and tooling...Work at officeLocal area$119k - $299.93k
...Description & SummaryThe OpportunityAs an AI/Blockchain Architect Senior Manager, you will design and... ..., Computer Applications, Computer Engineering, Engineering & Business, Information... ...collaborating closely with team members. We evaluate these factors thoughtfully to...Full timeH1b$134k - $348.5k
...Description & SummaryThe OpportunityAs an AI Architect Director, you will lead the design and... ..., Computer Applications, Computer Engineering, Engineering & Business, Information Technology... ...- Establishing AI design patterns, evaluates platforms and tools, and guides...Full timeH1b- ...our team.KPMG is currently seeking an AI Architect to join our Audit Technology Alliance organization... ...the product visionPartner with senior engineering managers, product leaders, and data... ...engineering standards and advanced AI evaluation frameworks like LangSmith, taking...H1bLocal area
$141.2k - $278.3k
Position Summary Google AI Lead Architect/AI & Engineering:Join our AI & Engineering team in transforming technology platforms, driving innovation... ..., reliability, security, and cost.Design, fine-tune, evaluate, and govern LLM solutions with Gemini on Vertex AI (...Local areaVisa sponsorshipFlexible hours- ...their hybrid cloud and AI journeys. With support... ...Solution Architecture ~Architect end-to-end enterprise... ...capability Platform Engineering & Cloud Infrastructure... ...and more reliably ~Evaluate and recommend emerging... ...practices ~Engage in pre-sales and solutioning...Worldwide
IBM
New York, NY3 days ago $150k
...Senior AI Tech Architects At BCG Platinion Locations: Atlanta | Austin | Boston | Brooklyn... ...modules in IT implementation projects. Evaluating products, SW packages, and solutions,... ...systems, or system controls & engineering or a related field (Master's degree is...Work at officeBoston Consulting Group
New York, NY2 days ago- ...AI/ML Architect Location: New York or Texas – Onsite Hybrid Job Type: Contract Experience:... ...pipelines and model deployment frameworks. Evaluate, select, and integrate ML tools and... .... Collaborate with data scientists, engineers, and business teams to align solutions...Contract work
Argyle Infotech
New York, NY3 days ago $120k - $140k
...Summary: Nexstar is seeking a senior AI Architect to lead our efforts to design, develop... ...all agents built on the architecture Evaluate and select LLM frameworks and... ...systems Comfortable working across data engineering, analytics, and business stakeholder teams...Full timeTemporary workLocal areaNexstar Broadcasting
New York, NY5 days ago$180k - $240k
As a Director, Enterprise Sales Engineering, you will lead a team of frontline leaders, driving... ...world increasingly dominated by Agentic AI.Partner confidently with senior Sales leadership... ...sales cycles in the region, including evaluations, customer engagements, and deal...Work at office$165k - $175k
...annually. Role Overview The Enterprise Sales Engineer is a senior pre‑sales and solution‑design... ...not just answering questions, but shaping evaluation criteria Capture detailed client... ...scoping and deal strategy Ability to leverage AI-tools effectively to drive operational efficiency...Socket
New York, NY4 days ago- Mercor partners with a leading AI research organization to recruit experienced UI/UX and product designers for a project evaluating how AI systems perform real-world digital product design work. You will define what exemplary work looks like by designing task-specific...
- ...our team.KPMG is currently seeking an AI Architect to join our Audit Technology Alliance organization... ..., automated testing, and AI model evaluation using LangSmith, directly contributing to the continuous improvement of our engineering standardsLead the detailed technical...Local area
$171.6k - $392.1k
...ServiceNow – ServiceNow AI Architect Senior Manager In the digital... ...with ServiceNow or evaluating how AI can streamline service... ...Ability to drive and support sales activities along-side EY pursuit... ...solutions Skill in prompt engineering and Retrieval-Augmented...Summer holidayWorldwideFlexible hoursEY
New York, NY4 days ago- ...Partners Corp. is seeking an experienced Senior Architect to define end-to-end architecture for an agentic AI-enabled platform, covering data, AI, orchestration... ...search patterns while shaping tool access and prompt evaluation. You will lead architecture decisions across AI,...
- SME Careers is hiring a Brand & Strategy Subject Matter Expert (SME) for a remote contractor role. You will evaluate AI-generated brand strategies and create expert content to improve AI outputs. This position requires strong brand strategy expertise and a minimum of 5...Remote jobContract workFor contractors
- TELUS Digital is seeking a Full-Stack AI Logic Specialist to join our remote team. You... ...logic, and teach AI to think like a Senior Engineer. Responsibilities include auditing AI-generated code in Python and JavaScript, evaluating security, debugging across turns, and optimizing...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Architect for Sales Engineering. Be the first to apply!
Related searches
- sales solution engineer New York, NY
- sales engineer technical sales New York, NY
- sales engineer New York, NY
- senior sales engineer New York, NY
- software sales engineer New York, NY
- internal sales engineer New York, NY
- sales engineer remote New York, NY
- pre-sales engineer New York, NY
- director sales engineering New York, NY
- apparel sales New York, NY