Head of Research: Data Evaluation & Training
Snorkel AI
Snorkel AI is seeking a data-evaluation leader to guide a team focused on evaluation, error analysis, and data valuation methods for frontier AI applications. You will translate research insights into actionable datasets and benchmarks to influence product direction and customer impact. You will build and mentor a team of researchers, shaping multi-quarter roadmaps and aligning findings with product, GTM, and client needs, while maintaining high standards of rigor and speed. #J-18808-Ljbffr Snorkel AI
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Head of Research: Data Evaluation & Training in New York, NY vacancy
$148.1k - $282.1k
The Research and AI team builds foundational generative AI models and applications... ...PM to define and drive our data roadmap, including sourcing and processing training data as we develop the next... ...that close the gap between model evaluation and data approach.Build institutional...TrainingFull timeTemporary workLocal areaWorldwideAdobe Systems
New York, NY1 day ago$250k - $300k
Our client, an innovative AI and Data company, is hiring a Head of Research to join the team in New York. The successful candidate will transform... ...data streams into a gold standard for AI training and evaluation by shaping the company’s research strategy, collaborating...TrainingFull timeAlldus International Consulting Ltd
New York, NYmore than 2 months ago$163k - $221k
...leader to join our team as the Global Head of External Data Vendor Management. In this pivotal... ...savings while implementing metrics to evaluate vendor ROI. Team Leadership and... ...on factors such as experience, skills, training, location, certifications, education,...TrainingMinimum wageWork at officeLocal areaRemote workFlexible hours3 days per week1 day per weekOliver Wyman Group
New York, NY1 day ago$178.69k - $293.56k
The Enterprise Data Solutions & Operations (EDSO) team... ...is looking to staff a Head of Data Solutions (the... ...participants, etc.), training, and activation in support... ...and information research skillsAbility to manage... ...members, contribute to the evaluation of proposed tools, technologies...TrainingFull timeH1bVisa sponsorshipWork visaFlexible hoursGuardian Life Insurance
New York, NY4 days ago- ...of what you will be doing: The Role We're looking for a Head of Data & AI to build the intelligence that powers Burq. You'll... ...systems that make this real and reliable: feature pipelines, training, serving, evaluation, and drift monitoring. Design the learning loop —...TrainingRemote work
Burq, Inc.
New York, NY12 hours ago - ...leading AI labs and advanced AI organizations, translating their research and post-training objectives into technically rigorous, deliverable programs across evaluations, RL environments, and training data.The Senior Director, Frontier AI Research is EPAM's first...Training
EPAM Systems
New York, NY2 days ago $250k - $350k
...Position Summary:The Director of Research & Intelligence provides... ...systems, knowledge management, and data analytics, with proven... ...tools and resources.Lead the evaluation, implementation, and optimization... ...platformsDesign and deliver training programs on AI research tools...TrainingWork at officeFried, Frank, Harris, Shriver & Jacobson LLP
New York, NY1 day ago$140k - $230k
...TCC) is seeking a Director for Research Administration who will also... ...innovative cancer research, training the next generation of cancer... ...Support Grant.ResponsibilitiesCCSG Data Reporting. Ensures the... ...resource development, as well as evaluating current TCC programs, shared...TrainingContract workTemporary workTraineeshipWork at officeLocal areaMount Sinai Health System
New York, NY4 days ago$105k - $157.49k
DescriptionThe Research Program Director is responsible for administrative, operational and... ...Federal, State and local regulations. Evaluates research projects through a health equity... .... Directs the Community Scientist Training and Mentorship Program, including recruitment...TrainingTraineeshipLocal areaMount Sinai Health System
New York, NY3 days ago$290.4k - $363k
...AI systems by providing the data, infrastructure, and tooling... ...intersection of cutting-edge research, large-scale engineering, and... ...building the foundational research, evaluation methodologies, and agent/RL... ...large-language models, post-training, evaluation, and agentic/RL...TrainingFull timeScale AI
New York, NY1 day ago$84.58k - $143.72k
Research --> AdministrationNew York • ID: 1166269_RR001240... ...Grossman School of Medicine has trained thousands of physicians and... ...annual employee performance evaluation processes.Supports the Divisional... ...mentoring processes through data collection/reporting....TrainingPermanent employmentFull timeTraineeshipH1bWork at officeRemote workNYU Langone Medical Center
New York, NY9 hours ago$200k - $225k
...the Broadridge team. The VP, Head of Policy & Data Operations leads the data,... ...support high-quality proxy research and voting execution... ...considers various factors when evaluating a candidate's final salary... ...including formal classes, training programs and events. To enable...TrainingLocal areaRemote workJobleads-US
New York, NY4 days ago$185k - $265k
...essential to the division's data strategy, playing a key... ...level, skill set, training, licenses and certifications... ...teams at Director or Head of Engineering level,... ...in LLMOps, model evaluation, and prompt orchestration... ...based concepts, data and research, and home to iconic financial...TrainingLive inWorldwideFlexible hours$103.7k - $155.6k
...by forward-thinking peers.The Research Services Manager leads the... ...research tools, standards, and training across the firm.What You Will... ...intelligence and recommend new tools, data sources, and process... ...Research strategy and source evaluation.#LI-JM1Benefits and MoreAt Goodwin...TrainingFull timeContract workGoodwin Procter
New York, NY1 day ago$105k - $120k
...looking to add an experienced Clinical Research Manager to a growing national organization... ...quality metrics are upheld. Recruits, trains, develops, and supervises clinical research... ...and employee relations, including evaluating the performance of CRC personnel; approving...TrainingFull timeContract workWork experience placementLive inLocal areaRemote workMedix
New York, NY1 day ago- ...Prolific is recruiting Mental Health Professionals to train and evaluate AI models as Domain Experts. You will be invited after a quick... ...influence AI development and receive competitive pay, with potential for ongoing tasks from researchers globally. #J-18808-LjbffrTrainingRemote workFlexible hours
Prolific Academic Ltd
New York, NY1 day ago - ...Chief Data Officer Role: Chief Data Officer w/ Banking Location... ...for data and analytics. Evaluate and implement modern data infrastructure... ...strategic partner to the heads of Retail Banking and Private... ...organization by developing training programs, self-service analytics...TrainingFull timeLocal areaRelocationShift work
InterSources
New York, NY2 days ago $280k - $425k
# Research Manager, EvaluationTechnical StaffResearchNYC$280K - $425K • Offers Equity## About... ...work all the way to a result.## About Evaluation ResearchEvaluation Research determines... ...subgroup. Determine whether the issue is data coverage, model structure, selection,...Work at officeRelocationVisa sponsorshipRelocation packageShift work$175k - $200k
...Position Summary The Director of Data Management and Reporting is a key member of the... ...reviews, and internal program evaluations. Oversee analytics initiatives to deliver... ...planning, career laddering, onboarding, training, professional development, and performance...TrainingPermanent employmentFull timeImmediate startShift workUS Family Health Plan- A TRICARE Prime option
New York, NY3 days ago- ...millions of families each year, training educators in underserved... ...Center's portfolio of survey research, epidemiologic studies, measurement... ..., and psychometric evaluations, ensuring alignment with organizational... ...and regulatory requirements, data quality standards, and...TrainingFull timeFor contractorsWork experience placementWork at officeRemote work
Child Mind Institute
New York, NY8 days ago $156k - $234k
...posting date to ensure consideration. Job Description: As the Head of Quality, AI Data Operations , you will be responsible for ensuring that the quality of our training data, adversarial testing, and model evaluation services meets the highest standards. You will drive...TrainingRemote workTaskUs
New York, NY1 day ago$80k - $90k
...Summary: The Manager, HRIS & Data Analytics leads the... ...distance to our headquarters and training center in NYC. Serving... ...Responsibilities include: ~ Evaluate current system functionality... ...efficiency and user experience. ~ Research and implement new...TrainingFull timeContract workLocal areaRemote workFlexible hoursSafe Horizon, Inc.
New York, NY5 days ago$200k
...stop thinking about the intersection of data, technology, and marketing?With over 200... ...agent harnesses — orchestration layers, evaluation frameworks, guardrails, and observability... ...tuning and model adaptation pipelines — training data curation, supervised fine-tuning,...TrainingArtefact
New York, NY2 days ago- ...TEAM DESCRIPTION The Data Management team provides oversight of the data generated throughout... ...to the right projects Periodically evaluates and re-evaluates new and existing... ...Project scoping experience Drives adoption, training, and ownership of departmental...TrainingFull timeContract workTemporary work
Omnicom
New York, NY4 days ago $198.2k - $368k
...JREQ199086**Senior Director, Applied Research**Are you excited about working at... ...engines and end-to-end solutions for data management, filing, audit, and compliance... ...* Experience with AI agent evaluation, language model training with verifiable rewards, and synthetic...TrainingLocal areaFlexible hours- JPMorganChase AI Research is a global team of research scientists,... ...agent systems, foundation model training, reinforcement and continual... ...verification, and synthetic data generation - alongside experts... ...innovation and rigorous evaluation to production-scale delivery...TrainingWork at officeShift work
JP Morgan Chase
New York, NY1 day ago - The Director of Research and Engagement provides leadership and management... ...the design, delivery, evaluation, and quality of SFA’s grant programs... .... Conduct research, data gathering, and analysis for the... ...of a research advocacy training program. Lead SFA’s Research...TrainingFull timeWork at officeRemote work
$269.1k - $307.2k
...Director, Data Scientist - Generative AI Systems Data is at the center of everything... ...these technologies, and contributing research to major NLP and AI/ML conferences.... ...phases of development, from design through training, evaluation, and validation; partnering with engineering...TrainingFull timePart timeLocal areaFlexible hoursCapital One Group
New York, NY1 day ago- ...initiatives focused on expanding data access, self-service business... ..., and delivering technical training, onboarding programs, or... ...educational resources. 3. Directs research to determine management and... ...and distribution. 8. Evaluates effectiveness of training and...TrainingFull time
NYC Health + Hospitals
New York, NY2 days ago $300k
...and academic reviewers. As Head of Research, you’ll own that case. You... ...owning how our systems are evaluated. That includes benchmarks, patient... ...Nice to have Clinical training. Practising or former... ...and clinical accuracy. But data without action is surveillance...TrainingFull timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of Research: Data Evaluation & Training. Be the first to apply!
Related searches
- clinical research director New York, NY
- research coordinator New York, NY
- research program manager New York, NY
- director institutional research New York, NY
- director of research New York, NY
- research lab manager New York, NY
- research coordinator remote New York, NY
- senior research manager New York, NY
- research data manager New York, NY
- clinical research manager New York, NY