Applied Researcher: Agent Evaluation & Data Pipelines
Jobleads-US
Human Intuition Inc. is building the autonomous company and seeks a candidate who can turn workflows, decision histories, and outcomes into datasets and evaluations that distinguish plausible actions from correct ones.
You will design tasks, evaluation environments, and verifiers, build data pipelines with provenance, and create repeatable reports to compare quality, reliability, latency, and cost.
#J-18808-Ljbffr Jobleads-USVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Applied Researcher: Agent Evaluation & Data Pipelines in New York, NY vacancy
$200k - $250k
...Applied AI Engineer, Agents & Evaluation Compensation: $200k–$250k base + equity Location: New York... ...businesses, contractors, and associated data. With the core backend,... ...engineers on the systems and data pipelines that agents rely on. Build for a...PipelineDataFull timeFor contractorsPeople In AI
New York, NY4 days ago- ...Applied AI/ML Researcher As an Applied AI/ML Researcher within the AI4Tech... ...- Design, prototype, and evaluate AI-driven tools and frameworks... ...Deep understanding of CI/CD pipelines, developer productivity tooling... ...software development, data privacy, access controls, and...PipelineData
Chase
New York, NY5 days ago $265k - $331k
...AIScale AI is the data foundation for AI,... ...build production AI agents that automate... ...architectures, and research papers emerge every... ...Frontier Agent Engineer (Applied AI), you'll bridge... ...to design, evaluate, and deploy intelligent... ...layers, retrieval pipelines, memory systems,...PipelineDataFull timeScale AI
New York, NY1 day ago- Bring your applied research and machine learning skills to a team... ...Intelligence and Machine Learning Data Platforms team in... ...Conducts experiments to evaluate and benchmark latest AI and agents techniques, analyzing... ...with large-scale MLOps pipelines, working with and deploying...PipelineData
JP Morgan Chase
New York, NY2 days ago - ...Francisco; New York Apply Our mission is... ...of inventive research, design, and engineering... ...Engineer on the Agent Quality team at... ...the measurement, evaluation, and feedback-loop... ...of product, data, and engineering:... ...judge quality, build pipelines and tooling to analyze...PipelineDataFull timeWork at office
Anysphere, Inc
New York, NY5 days ago - ...Member of Technical Staff: Agents, Evaluations, and Environments... ...We’re hiring for the research-leaning side of that work... ...carries no customer data, package it with tasks... ...Build environment pipelines that convert real cases... ...You’re encouraged to apply even if you don’t believe...PipelineData
$183.8k - $248.7k
...Sr. Applied Scientist, Agent Evaluation and Experimentation, DTx Science Job ID: 10572608 | Amazon.com Services... ...roadmap, promote a culture of data-driven decision-making, and deliver... ...Master's degree and 6+ years of applied research experience ~ Experience...DataWorldwideFlexible hours- ...and ACL—and see that research deployed to a user base... ...million customers.As an AI Agents Applied Research/Engineering... ...governance, and evaluation frameworks.Implement privacy... ...practical exposure to data collection, labeling, and evaluation pipelines.MLOps/LLMOps...PipelineData
JP Morgan Chase
New York, NY1 day ago $147.6k - $274k
...makes us Roche.Advances in AI, data, and computational sciences... ...and development. Roche’s Research and Early Development organisations... ...Learning Scientist building agents for applied small-molecule drug design.... ...or multi-agent scientific pipelines.Hand-on experience working...PipelineDataFull timeLocal areaWorldwideRelocation packageGenentech
New York, NY13 hours ago$197.3k - $225.1k
...Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At... ...to build world-class applied science and engineering... ...team of engineers, research scientists,... ...accelerate model inference pipelines Lead cross-functional... ...ensuring security, data governance, and...PipelineDataFull timePart timeLocal areaCapital One
New York, NY3 days ago- ...opportunity to build agents that learn from how work... ...into datasets and evaluations that distinguish a plausible... ...recovery. Build data pipelines that preserve the... ...reports that let researchers and engineers compare... ...actionable causes. Apply Show us something...PipelineDataShift work
$115k - $260k
...Staff AI Engineer, AI Agent Platform (Agent & Evaluation Harness) Why Join... ...prototype to a data-backed conclusion about... ...discover, load, and apply skills (packaged instructions... ...be. Track the research frontier and... ...and human annotation pipelines, using tools such as...PipelineDataHourly payWork experience placementLocal area- ...seeking a Quantitative Researcher to join our... ...research, prototyping, data analysis, and workflow... ...commodities, logistics, or applied modeling environment.•... ...transport constraints• pipeline, terminal, warehouse,... ...risk platforms, trade evaluation, or idea generation.•...PipelineData
Balyasny Asset Management
New York, NY4 days ago - ...looking for a Quantitative Researcher to fit into our... ...handling real-time market data, and producing... ...trading opportunities. Apply statistical and machine... ...maintain signal-generation pipelines, feature stores, and... ...-trade analytics to evaluate execution quality, slippage...PipelineDataContract workLocal areaImmediate startHome officeFlexible hours
Injective Labs Inc.
New York, NY3 days ago - ...Director, AI Architecture & Agent Platform sets TKO's... ...designed, connected, evaluated, secured, observed and... ...prompts, tools, identity, data access and evaluation... ...technical standard they apply. Business units own... ...depth Data platform or pipeline engineering experience...PipelineDataFull timeLocal area
TKO
New York, NY7 hours ago $218.7k - $249.6k
Applied Researcher 4 (AI Foundations, LLM Customization and Finetuning) At Capital One, we are creating... ...with a cross-functional team of data scientists, software engineers, machine... ...development, from design through training, evaluation, validation, and implementation....DataFull timePart timeLocal areaFlexible hoursCapital One
New York, NY2 days ago$150k - $300k
...deeply embedded in AI research, and we’re... ...building the premier AI agent lab for the... ...even when labeled data is limited or nonexistent... ...: Prototype and evaluate novel prompting strategies... ...: Explore and apply fine‑tuning,... ...Experimentation: Design pipelines to generate...PipelineDataFull timeWork at officeFlexible hours- ...The Research & Intelligence team builds the machine... ...and causal modeling, data valuation systems, and... ...are seeking a Senior Applied Scientist to lead and... ...deploy machine learning pipelines for entity resolution,... ...rigorous standards for model evaluation, monitoring, and...PipelineDataWork at officeLocal areaRemote work
Carbon Arc, Inc.
New York, NY3 days ago - ...Capital One is seeking an Applied Researcher 4 in New York, NY to advance AI foundations and multimodal guardrails. You will collaborate with data scientists, engineers and product teams to design, train and evaluate large models, translating research findings into impactful...Data
$306.3k - $349.5k
Staff Applied Researcher At Capital One, we are creating trustworthy and reliable AI systems, changing... ...with a cross-functional team of data scientists, software engineers, machine... ...development, from design through training, evaluation, validation, and implementation....DataFull timePart timeLocal areaFlexible hoursCapital One
New York, NY4 days ago$192.2k - $260k
...volumes of advertiser data every single day.... ...approaches in how AI agents access and reason over... ...are constantly evaluating themselves and improving... ...an exceptional Applied Scientist to research and develop novel approaches... ...MCP servers, data pipelines, and sandbox...PipelineDataLocal areaImmediate startFlexible hoursNight shiftDay shiftAmazon
New York, NY2 days ago- ...Applied AI Engineer New York, NY - hybrid... ...orchestration patterns, and evaluation strategies. •... ...for entitlements, data security, and PII... ...and extraction pipelines with measurable... ...Experience with coding agents (Claude code,... ...engineering role, not a research or prototype track...PipelineData
Veterans Sourcing Group, LLC
New York, NY1 day ago $200k - $265k
...Software Engineer - Agent QualityP-1567At... ...obsessed with enabling data teams to solve the... ...The Databricks AI Research organization is... ...team focused on evaluating and continuously improving... ...systems, data pipelines, or large-scale... ...discretion whether to apply for a U.S....PipelineDataLocal areaWorldwideDataBricks
New York, NY6 hours ago- ...Amazon.com Services LLC in New York is seeking a Sr. Applied Scientist for the DTx Science team to advance agent evaluation and experimentation. You will shape the applied science roadmap, partner with business leaders, and deliver impact for millions of advertisers...Worldwide
- ...Applied AI Engineer Must have: • 5+ years of strong... ...expertise, including evaluation harnesses, prompt and... ...to enable document data extraction, embedded productivity... .... • This is not a research or demo role. • We... ...-first data ingestion pipelines with measurable...PipelineData
Saxon Global
New York, NY5 days ago $216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs... ...the leading data and evaluation partner for frontier... ...hardest problems in agent robustness, AI control... ...and instrumenting ML pipelines, writing evaluation harnesses... ...we encourage you to apply, even if your...PipelineDataFull timeScale AI
New York, NY3 days ago$183.8k - $248.7k
...more secure? The AppStar Data Analytics &... ...organization is looking for an Applied Scientist III to... ...implement production-grade ML pipelines (feature extraction,... ...by proposing new research initiatives, conducting... ...models using rigorous evaluation methodologies- Partner...PipelineDataFlexible hoursAmazon
New York, NY13 hours ago$183.8k - $248.7k
We are seeking a Sr. Applied Scientist to develop and... ...You will own the full pipeline from algorithm... ...hardware, and real-world data, while prototyping, testing... ...maintain calibration, evaluation, and benchmarking... ...technical projects from research prototyping through production...PipelineDataFlexible hoursAmazon
New York, NY4 days ago- ...Mistral AI is seeking Applied Scientists and Research Engineers to drive innovative... ...Generate and curate data for pre-training and post-training, working on evaluations and making sure the model... ...complex use cases using agents and RAG pipelines. Manage research projects...PipelineDataRelocation package
Mistral AI
New York, NY1 day ago $295k
...customers. Cohere is a team of researchers, engineers, designers, and... .... Join us!Role Overview:Evaluation is critical to making progress... ...judges; refining LLM-based data synthesis pipelines; and improving evaluation... ...we still encourage you to apply. We strive to create an inclusive...PipelineDataFull timeWork at officeLocal areaRemote workHome officeCohere
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied Researcher: Agent Evaluation & Data Pipelines. Be the first to apply!
Related searches
- criminal researcher New York, NY
- security researcher New York, NY
- court researcher New York, NY
- field researcher New York, NY
- human factors researcher New York, NY
- academic researcher New York, NY
- content researcher New York, NY
- title researcher New York, NY
- independent researcher New York, NY
- survey researcher New York, NY