Staff Applied Scientist — AI Agent Interfaces & Evaluation
Datadog
Datadog is seeking a Staff Applied Scientist in New York to own evaluation strategies for AI agent integrations. The role involves defining metrics, building datasets, and collaborating with AI engineers to enhance tool selection and retrieval relevance. The ideal candidate will have 10+ years of experience, a high level of expertise in machine learning, and a proven track record in product-driven environments. Competitive salary and benefits package offered. #J-18808-Ljbffr Datadog
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Applied Scientist — AI Agent Interfaces & Evaluation in New York, NY vacancy
- ...States Digital Space LLC located in New York, New York, seeks a seasoned leader for the Dashboards product. The role involves owning evaluation strategies, building datasets, and improving machine learning systems. With a proven record in product-driven ML initiatives, you...Suggested
$276k - $345k
Team description At Datadog, AI agents are becoming first-class... ...Dev Agent. The Agentic Interfaces team owns the platform that... ...into, and — critically — the evaluation systems that tell us... ...last piece. We're hiring a Staff Applied Scientist to define what good means...Suggested$231k - $318k
...About the Role As a Staff Applied AI/ML Scientist on the Search Group, you’ll drive the technical vision... ...discovery systems , enabling intelligent agents to generate relevant and personalized... ...in browsing, filtering, and evaluation. Lead model development and GPU‑based...SuggestedWork experience placementImmediate startFaire Inc
New York, NY16 hours ago$302.4k - $378k
At Scale AI, our mission is to accelerate the development of AI applications. For 8 years... ...(AGI), and building upon our prior model evaluation work with enterprise customers and... ...using Pytorch/Jax. Hands-on experience with agent frameworks such as OpenHands, Swarm,...SuggestedFull time$260k - $382k
Garnerhealth in New York City is seeking a Staff Applied Researcher to join our Applied Science team. This role involves building algorithmic systems to evaluate healthcare providers and optimize outcomes. The ideal candidate has 6+ years of experience or a relevant advanced...Suggested$80 per hour
...specialists with project-based AI opportunities for leading... ...companies, focused on testing, evaluating, and improving AI systems. Participation... ...on building React‑based interfaces and robust Back‑end systems... ...- B2 How It Works Apply → Pass qualification(s) → Join...Permanent employmentTemporary work$230k - $325k
About the Team The Codex Core Agent team builds the kernel of... ...the core execution loop and interfaces that turn models into useful... ...the Role We're looking for applied AI engineers to help bring Codex... ...better real-task data into evaluation and research. Work with product...- Afresh Technologies, Inc. is seeking a Staff Applied Scientist to lead R&D on AI models for replenishment technology. Your work will tackle complex inventory problems, aimed at reducing food waste and enhancing produce freshness globally. With a focus on operations research...
- Capital One is seeking an Applied Researcher I in New York to drive innovations in AI-driven banking. You will collaborate with cross-functional teams to build scalable AI architectures, apply state-of-the-art technologies, and carry out impactful research. Ideal candidates...
$224k - $308k
...join ours. About this role As a Staff Applied AI/ML Scientist on the Search Group, you’ll drive the... ...systems , enabling intelligent agents to generate relevant and personalized... ...retailers in browsing, filtering, and evaluation. Lead model development and GPU-based...Work experience placementWork at officeLocal areaImmediate startRemote work2 days per week$80 per hour
...intelligence to ethically shape the future of AI. What We Do The Mindrift platform... ...can design realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that... ...reusable How To Get Started Simply apply to this post, qualify, and get the...Part timeFreelanceRemote workFlexible hours$262.5k - $299.6k
...creating trustworthy and reliable AI systems, changing banking for... ...to building world‑class applied science and engineering teams... ...cross‑functional team of data scientists, software engineers, machine‑... ...design through training, evaluation, validation, and implementation...Full timePart timeLocal areaCapital One
New York, NY4 days ago$218.7k - $249.6k
...Applied Researcher I (AI Foundations, LLM Customization, Finetuning, Reinforcement Learning) Overview... ...with a cross‑functional team of data scientists, software engineers, machine learning... ..., from design through training, evaluation, validation, and implementation. Engage...Full timePart timeLocal areaFlexible hoursCapital One
New York, NY4 days ago$262.5k - $299.6k
...Applied Researcher II (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating trustworthy... ...with a cross‑functional team of data scientists, software engineers, machine learning... ..., from design through training, evaluation, validation, and implementation....Full timePart timeLocal areaFlexible hoursCapital One National Association
New York, NY2 days ago$218.7k - $249.6k
...Applied Researcher I (AI Foundations, LLM Customization, Finetuning, Reinforcement Learning) Overview... ...with a cross‑functional team of data scientists, software engineers, machine learning... ..., from design through training, evaluation, validation, and implementation. Engage...Local areaFlexible hoursCapital One National Association
New York, NY4 days ago$260k - $382k
...We are seeking an exceptional Staff Applied Researcher to join our... ...Garner — determining how we evaluate providers, make recommendations... ...are all open design questions AI primary care doctor. Fine-tune... ...industry experience as an Applied Scientist, Machine Learning Engineer,...Work at officeFlexible hours3 days per weekGarnerhealth
New York, NY16 hours ago$260k - $382k
...impact on healthcare at scale. About the role We are seeking an exceptional Staff Applied Scientist to build the algorithmic systems that power Garner. These systems determine how we evaluate providers, make recommendations, and optimize for outcomes across cost, quality...Work at officeWork visaFlexible hours3 days per weekGarner Health
New York, NY17 hours ago$230k - $325k
A leading AI research company is looking for applied AI engineers to enhance the performance of Codex agents for real software engineering tasks. You'll collaborate with research... ...Python, and an understanding of system evaluation. This role offers a competitive salary with...$150k - $250k
...About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical... ...Responsibilities Define how progress is measured. Researchers design evaluation frameworks that capture reasoning depth, interaction...Work at office3 days per weekDistyl
New York, NY3 days ago$205.6k - $257k
Scale has been the leading AI data foundry, helping fuel the most... ...vertical within our Agents Data & Reinforcement Learning... ...workflows that labs use to train and evaluate agents) and the “data as a product... ..., clinicians & clinical staff using EHRs daily, revenue cycle...$276k - $345k
...transforming Dashboards into an AI‑native control surface and the... .... What You’ll Do Own the evaluation strategy for Dashboards and related... ...and widgets through agents. Drive measurable improvements... ...years of relevant engineering or applied science experience, including...$218.7k - $249.6k
Applied Researcher I (AI Foundations) Overview: At Capital One, we are creating trustworthy and reliable... ...with a cross‑functional team of data scientists, software engineers, machine learning... ..., from design through training, evaluation, validation, and implementation. Engage...Full timePart timeLocal areaFlexible hours- ...creating trustworthy and reliable AI systems, changing banking for... ...We are building world-class applied science and engineering teams... ...-functional team of data scientists, software engineers, machine... ...from design through training, evaluation, validation, and implementation...Full timePart time
- J.P. Morgan is seeking an Associate Applied Researcher to join their Quantitative Trading & Research Team in New York. This role involves... ...field, and experience with LLMs. Responsibilities include evaluating emerging research techniques and integrating them into...
$212k - $265k
...better mental health outcomes. As a Staff Data Scientist, Product Analytics, you will be a senior... ...will influence what we build, how we evaluate it, and how we scale what works. This... ...For areas like matching, ranking, or applied AI experiences, build measurement approaches...Work from homeFlexible hours- ...the other. Crosby is the first AI-native law firm, helping... ...You’ll explore, develop, and apply state-of-the-art techniques in... ...closely with engineers, data scientists, and legal experts to translate... ...Design and run experiments to evaluate new architectures, prompting strategies...Work at office
- ...the Position As a Senior Data Scientist focusing on Analytics, you'll... ...closely with Data Analysts, Applied Researchers, and cross‑functional... ...benchmarking, state of AI) Support ad‑hoc deep‑dives —... ...feature engineering, and model evaluation Business acumen — you translate...Work at office
- ...customer experiences with AI. We are primarily an in... ...production-grade AI agents: You'll build and ship... ...Previous roles where you interfaced with customers or led... ...team. We encourage you to apply even if your experience... .... We strive to evaluate all applicants consistently...Full timeFlexible hours
$400 per month
Obsidian is seeking frontend engineers in New York to support an AI project. You will evaluate AI coding models and complete engineering tasks using... ...development and the ability to work with AI coding agents. Compensation is task-based at $400 per accepted task, with...$207k - $300k
Google is seeking a Staff Applied AI Agent Developer in New York. This role involves developing custom conversational AI solutions to address complex customer challenges. Candidates should have extensive experience in testing and launching software products, with a strong...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Applied Scientist — AI Agent Interfaces & Evaluation. Be the first to apply!
Related searches