Radiology AI Benchmarking Specialist
Mpathic
mpathic.ai is seeking experienced radiologists to evaluate next-gen multimodal AI systems in radiology. You will design tasks evaluating how models interpret images, reports, and clinical instructions, crafting expert prompts and rubrics to judge diagnostic accuracy, safety, and adherence to instructions. You will collaborate with leading AI researchers, participate in onboarding and calibration, and help identify edge cases across imaging modalities to improve benchmark quality. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Radiology AI Benchmarking Specialist in New York, NY vacancy
- SemiAnalysis LLC is seeking a Technical Consultant to lead ClusterMAX benchmarking and due diligence engagements for AI infrastructure ecosystems. You will translate benchmarking insights into actionable recommendations for clients and collaborate with major neocloud providers...Suggested
$197.3k - $225.1k
AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...SuggestedFull timePart timeLocal areaCapital One
New York, NY2 days ago- ...Thomson Reuters Corp. is seeking a Lead Research Engineer to design and deliver production-quality software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure enabling research and product teams to compare large language models...Suggested
Thomson Reuters
New York, NY2 days ago - ...LatchBio seeks an AI Neuroscientist to serve as the scientific authority on ground truth for AI agents across biological workflows... ...Collaboration with software engineers and neuroscientists will shape benchmarks for normal and diseased nervous systems. You will judge agent...SuggestedRemote work
LatchBio
New York, NY2 days ago - Dscout is building a human-grounded layer to teach AI to work in the real world and stay aligned there. We seek a research-focused expert to design rubrics, benchmarks, and evaluation methods using real-world data from diverse contexts. You will lead long-horizon studies...SuggestedRemote work
- ...Turing is seeking a remote contractor to support AI evaluation efforts for eight weeks, working 40 hours per week with eight hours of overlap with Pacific Time. The role focuses on verifying task instructions, reference materials, and evaluation criteria for accuracy...For contractorsRemote work
Brain Trust Inc
New York, NY5 days ago - ...AI Creative Specialist Freelance - MX WITHIN About the role: The AI Creative Specialist is a hands-on expert in generative image and video production... ...coding is preferred. Track emerging models and techniques, benchmark them against what we already use, and make clear cases for...FreelanceWork at officeRemote work
Within
New York, NY4 days ago - ...Biz Tech Consultants seeks a radiologist evaluator for AI-driven quality assessments. You will review diagnostic reports, ensure accuracy... ...on structured evaluation tasks. Requirements include MBBS with radiology qualification and US/European board certification, plus 2+ years...Remote work
Biz Tech Consultants
New York, NY4 days ago $11 - $30.65 per hour
...Audio Specialist- Freelance AI Trainer Project World Wide - Remote A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support...Hourly payContract workFor contractorsFreelanceRemote workMeridial
New York, NY5 days ago$80k - $110k
...best bar none…impressive achievements and excellent reputation”—Benchmark Litigation), and the firm’s reputation for integrity and... ...over 50 staff attorneys. About the Team and the Role The Junior AI Specialist will support the firm’s efforts to evaluate, test, and...Full timeContract workWork at officeWork from homeWorldwideBernstein Litowitz Berger & Grossmann
New York, NY4 days ago$176k
...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a full-time paid internship program spanning... ...agentic workflows that push the boundaries of current industry benchmarks. Design and optimize the critical infrastructure of our AI...Full timePart timeSummer workInternshipLocal areaCapital One
New York, NY2 days ago- ...professional for a remote contract role focused on creating and evaluating AI-generated academic content. This position requires a Master's... ..., and excellent analytical abilities. The candidate will draft benchmarks for AI performance and collaborate with research teams on...Remote jobContract work
$11 - $30.65 per hour
...A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. Responsibilities Create and execute role-play–based...Hourly payFor contractorsFreelanceAgency.com
New York, NY2 days ago$28.74 per hour
...Location: Remote Role Responsibilities Red team conversational AI models and agents (jailbreaks, prompt injections, misuse cases,... ...vulnerabilities, and flagging systemic risks. Apply structured taxonomies, benchmarks, and playbooks to ensure consistent adversarial testing. Produce...Hourly payFull timeContract workPart timeRemote workCrossing Hurdles
New York, NY4 days ago- Looking for an AI SDLC Solutions Consultant to join our AI Adoption sub-stream in the Engineering Excellence Program. The ideal candidate... ...(e.g., code review automation, test coverage optimization) by benchmarking platforms to determine fit-for-purpose integrations for the...
- 1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are looking for... ...Collaborate with a global network of experts shaping next-generation AI benchmarks. Gain exposure to cutting-edge model evaluation strategies in...Full timeContract workFor contractorsSummer workFreelanceRemote work
Turing
New York, NY6 hours ago - 1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are seeking researchers... ...with a global network of experts shaping next-generation AI benchmarks. Gain exposure to cutting-edge model evaluation strategies in...Contract workFor contractorsFreelanceRemote work
Turing
New York, NY6 hours ago $40 per hour
...the role We create high-quality STEM training data for frontier AI models. Our data is used directly in training and evaluation... ...quantum mechanics, or related fields Experience evaluating model reasoning, benchmarking, or designing technical assessments #J-18808-Ljbffr...Contract workPart timeRemote workAnyone AI Inc.
New York, NY6 hours ago$125 per hour
...experienced computational biologists and bioinformaticians to help train AI models. You’ll design realistic analysis tasks from your own... ...a pipeline. Your judgment of when a result is real becomes the benchmark those models are measured against. What you’ll actually do...Full timeRemote workFlexible hoursDataAnnotation
New York, NY4 days ago$150k
...customized, innovative client solutions.Tech Advisory & Delivery Senior AI Tech Consultants at BCG Platinion are: Technical experts. They... ...technology ecosystems.AI / LLM cost optimization and FinOps.IT Benchmarking and recommendations for IT cost take-out initiatives.Developing...Work at officeLocal areaThe Boston Consulting Group Inc
New York, NY3 days ago- ...Project Lead – Software Engineering to own and deliver production-scale SWE data programs for AI/LLM initiatives. You will oversee data coaching, evaluation artifacts, and benchmarking while guiding cross-functional teams in a remote setting. The ideal candidate has...Remote work
Prointegrate World It Consulting
New York, NY3 days ago $135k - $180k
...@Medidata. About the Team : We are seeking a Lead AI & Data Engineer to design, build, and deploy production-grade... ...SDTM and ADaM. Experience with AI evaluation frameworks, benchmarking, and continuous monitoring of AI solution performance. Experience...Hourly payInternshipWork at officeLocal areaRemote workFlexible hoursDassault Systèmes
New York, NY6 hours ago$100k - $160k
...Join Senpilot, the AI system revolutionizing Utilities, as we build the future of intelligent infrastructure. The opportunity Senpilot... ...regulatory practices and workflows Build quality systems and benchmarks to evaluate regulatory outputs Work with world-class software engineers...Full timeSenpilot
New York, NY3 days ago$8 - $30 per hour
...Project Overview We are sourcing independent LaTeX Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate complex long-form content that blends mathematical and technical formatting with creative prose, their...Hourly payFor contractorsFreelanceRemote workAgency.com
New York, NY2 days ago$110k - $170k
...to the firm maintaining its competitive edge.We are seeking an AI Engineer to join BXTI’s Alternative Asset Management Technology... ...engineering, agentic workflows, retrieval, or model evaluation and benchmarking.Demonstrated experience shipping and maintaining production...Full timeLocal areaBlackstone Group
New York, NY3 days ago- ...Introduction About the Team IBM's AI-First Transformation organization is redefining... ...is to help IBM become the world's benchmark AI-first enterprise. To date, the organization... ..., data and AI experts, workflow specialists, and senior stakeholders across IBM....Full timeContract workPart timeFixed term contractInternshipShift work1 day per week
IBM
New York, NY3 days ago - ...We are seeking an experienced AI Data Scientist to join Deltek’s growing AI Center of Excellence team to design, build, evaluate,... ...Optimization Establish evaluation frameworks for AI solutions Design benchmarks for quality, accuracy, groundedness, hallucination detection,...
Deltek
New York, NY3 days ago $254.6k - $350k
...operate. By combining frontier agentic AI, an enterprise-grade platform, and deep... ...product built off of Harvey's acquisition of Benchmark. Harvey Deals is where investment teams... ...-middle-market buyout funds, sector specialists, and serial acquirers throughout the pre...Harvey AI
New York, NY2 days ago- ...part of Intelligent Operations team: "We support and guardrail AI forward deployed engineering engagements across SAP industries,... ...design. AI quality in production: Drift detection, performance benchmarking, guardrails validation, retraining triggers. The solutions we...Permanent employmentFull timeFlexible hours
SAP
New York, NY1 day ago $100 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position:...Odd jobFull timeContract workSummer workLocal areaRemote workMercor
New York, NY9 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Radiology AI Benchmarking Specialist. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- radiology associates New York, NY
- outpatient radiology New York, NY
- director of radiology New York, NY
- interventional radiology rn New York, NY
- radiology scheduler New York, NY
- radiology - rn New York, NY
- radiology locum tenens New York, NY
- radiology manager New York, NY