Research Scientist, Agentic AI & LLM Evaluation
The American Ceramic Society
Johns Hopkins University seeks a PREP Research Associate to support the collaboration's AI research initiatives. The role involves developing agentic AI research pipelines, evaluating citations, and designing adversarial probes to test factual grounding against trusted documents. Ideal candidates hold an MS/PhD in CS with 3+ years of experience, strong Python skills, and a track record in communication and presenting complex results at conferences. #J-18808-Ljbffr The American Ceramic Society
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Scientist, Agentic AI & LLM Evaluation in Gaithersburg, MD vacancy
- Johns Hopkins University in Gaithersburg, MD, invites applications for a PREP Research Associate to support the NIST PREP program. The role focuses on agentic AI research, developing evaluative pipelines and fully cited reports. Responsibilities include building LM-judge...Suggested
- Johns Hopkins University invites applications for a PREP Research Associate to support the Citation Injector project. You will develop agentic AI evaluations, LLM pipelines, and source-grounded citation systems within a collaborative research environment. Ideal candidates...Suggested
- IBM Consulting is seeking an AI Research Scientist with active TS/SCI clearance to design and deploy AI solutions leveraging foundation models and NLP techniques. You will lead projects through research, prototyping, and production, collaborating with stakeholders across...Suggested
$50k - $70k
PREP Research Associate Salary: $50,000-$70,000 a year This position... ...: Source Attribution for AI-Generated Text The work... ...only expertise in building agentic AI and LLM pipelines, but also in designing... ...limited to Developing agentic AI evaluations and LLM pipelines to improve...SuggestedWork experience placementSeasonal workWork at officeLocal area$80k - $100k
...0-$100,000 a year PREP Research Associate This position... ...Title: Research Associate - Agentic Artificial Intelligence (AI) Scientist Position Description The... ...design, development, evaluation, and deployment of trustworthy... ...-using AI systems, or LLM-based applications....SuggestedWork experience placementSeasonal workWork at office- ...Higher Education, Inc. is hiring an Artificial Intelligence Data Researcher to work at Johns Hopkins University. This role involves researching and documenting AI solutions for public safety, evaluating tools, and assisting with a Public Safety AI Workshop. Ideal candidates...
- Johns Hopkins University is hiring a PREP Research Associate in Gaithersburg, Maryland to support measurement science research in automated... ...strong programming skills in Python and C++, experience with AI/ML frameworks, and familiarity with autonomous vehicle simulation...
- A leading research university in Maryland is seeking an Assistant Research Scientist to develop real-time image processing algorithms for additive manufacturing using FPGA... ...candidate will work on image analysis algorithms and AI workflows, requiring a graduate degree in...
- Ripple Effect is seeking a Public Health Evaluation Scientist to lead technical components of evaluations and provide methodological guidance. You will independently execute complex research tasks, oversee quality control, and ensure timely, high-quality deliverables. The...Remote job
- Overview Job Title: Computational Biologist (AI/ML)- Essex Management Location US Remote... ...for clients in the Federal Government, research academia, and private sectors. Primary... ...candidate interviews to begin developing evaluation skills. Participate in internal training...Casual workWork at officeLocal areaRemote workWork from homeFlexible hours
- A research institution in Gaithersburg seeks a PREP Research Associate to support projects at NIST. This role involves technical work on AI risk assessments, developing annotation frameworks, and collaborating with various stakeholders. Ideal candidates should hold a degree...
- ...join our team in support of a government research organization dedicated to investing in high... ...technical deliverables, milestones, and evaluation results. Track risks, dependencies, and... ...analytics, RF signal classification, or other AI/ML methods relevant to sensing...Work experience placement
- PREP Research Associate This position is part of the National Institute of Standards... ...Title Reliability of Human and LLM Annotations for AI Risk Assessment The work will entail... ...Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the...Work experience placementSeasonal workWork at office
- Overview PREP Research Associate - National Institute of Standards and Technology (... ...Research Title: Reliability of Human and LLM Annotations for AI Risk Assessment. The project focuses... ...(LLMs) to provide annotations of evaluation data (LLM as judge) and designing an...
- Job Title: Sr. Researcher - Generative Waveforms AI Location: Bethesda, MD Clearance: Ability to Obtain Top Secret / SCI with Polygraph Job Description... ...the paradigm of waveform development. You will be evaluating technology developed by several teams. Required Qualifications...
- Johns Hopkins University is seeking a Senior Researcher for Applied AI in Cybersecurity under the PREP program. The role leads design, development and deployment of AI solutions to secure critical infrastructure in collaboration with NIST and industry partners. The successful...
- ...We are looking for a Research Scientist Intern to push the state of the art of our AI models. As a Research Scientist Intern at Whiterabbit.ai, you will: Play a key role in architecting the algorithms and models that will power our products Train on a dedicated...Remote jobInternship
Whiterabbit.ai
Gaithersburg, MD2 days ago - Johns Hopkins University seeks a PREP Research Associate to contribute to experimental flow measurement and instrumentation projects.... ...Python. The candidate will plan experiments, perform uncertainty evaluation, and apply CFD tools to optimize designs. Strong communication...
$80k - $110k
PREP Research Associate Salary: $80,000-$110,000 a year The National Institute of Standards and Technology (NIST) Professional Research... ...on projects of scientific research. This position focuses on evaluating low-damage rocking structural systems for seismic performance....- A research organization is seeking a PREP Research Associate to support projects focusing on life-cycle assessment and uncertainty quantification... ...involves integrating natural hazard impacts into assessments, evaluating structural designs against changing hazards, and documenting...
- General Description PREP Research Associate This position is part of the National Institute... ...candidate will design and implement the AI component of ROADMAP, which will determine... ...Geometric platform for building and evaluating Graph Neural Networks. Working knowledge...Work experience placement
- Johns Hopkins University seeks a PREP Research Associate in Gaithersburg, Maryland, to collaborate on projects related to indoor localization... ...include conducting research, developing algorithms, and evaluating technologies. Candidates should have a Doctoral degree in a...
$120.58k - $149.32k
The American Ceramic Society seeks a PREP Research Associate in Gaithersburg, MD. This role requires expertise in biometric systems and... ...include generating deepfake artifacts, developing evaluation frameworks, and collaborating on significant cybersecurity research...- General Description PREP Research Associate This position is part of the National Institute... .... Description of Work A research scientist is sought to support a project on life-cycle... ...(LCA) is a method commonly employed to evaluate the lifelong impacts of a building. However...
- The Emmes Company, LLC is seeking a Computational Biologist (AI/ML) within the Bioinformatics Department of the BIDS Division at Essex. This role focuses on applying AI, ML and Deep Learning to biomedical data, with ownership of well-defined tasks and small projects in...Remote job
- The Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc. is seeking a part-time Qualitative AI Research Scientist based in Bethesda, Maryland. The role focuses on leading qualitative research initiatives to develop patient-centered clinical support...Part timeFlexible hours
- Jobs / AI Research Scientist - TS/SCI Clearance AI Research Scientist - TS/SCI Clearance Full-time About the Role IntroductionJoin a dynamic team at IBM Consulting, where you will build lasting client relationships while collaborating with top-tier companies globally. This...Full time
- General Description PREP Research Associate at the National Institute of Standards (NIST). The role involves collaborating with academic... ...novel indoor localization methods, algorithms, and systems. Evaluate performance using modeling, simulation, and prototype development...
- Associate Research Scientist (PREP0004446) This position is part of the National Institute of Standards and Technology (NIST) Professional... ...localization and tracking methods, algorithms, and systems Evaluating the performance of such methods, algorithms, and systems via...Work experience placementSeasonal workWork at office
- PREP Research Associate — CHIPS Project This position is part of the National Institute of Standards (NIST) Professional Research Experience... ...vision systems with robotic arms and conducting experiments to evaluate performance, supporting the development of new metrics and...Full timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist, Agentic AI & LLM Evaluation. Be the first to apply!
Related searches
- scientist 1 Gaithersburg, MD
- image scientist Gaithersburg, MD
- qc scientist Gaithersburg, MD
- research scientist Gaithersburg, MD
- analytical scientist Gaithersburg, MD
- research scientist - biology Gaithersburg, MD
- research associate scientist Gaithersburg, MD
- quality control scientist Gaithersburg, MD
- applied scientist Gaithersburg, MD
- protein scientist Gaithersburg, MD