AI Evaluation Scientist: Build Trust & Safe AI Systems
Steampunk, Inc.
Steampunk, Inc. seeks an AI Evaluation Scientist to design and implement evaluation frameworks ensuring accuracy, safety, and alignment with mission requirements for predictive and generative AI systems. You will collaborate with engineers, data scientists, governance analysts, and product teams to build metrics, tests, and deployment guidance. This role emphasizes structured error analysis, benchmarking, and human‑in‑the‑loop evaluation workflows, documenting findings for technical and #J-18808-Ljbffr Steampunk, Inc.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist: Build Trust & Safe AI Systems in Mc Lean, VA vacancy
$105k - $145k
Overview We are looking for an AI Evaluation Scientist to design and execute... ...and generative AI systems are accurate, reliable, safe, and aligned with mission... ...essential for establishing trust in AI solutions and... ...develop evaluation metrics, build test harnesses, analyze...SuggestedLocal area$105k - $145k
...Steampunk is seeking an AI Evaluation Scientist in McLean, Virginia, to design evaluation processes for AI systems ensuring accuracy and reliability. Responsibilities include implementing evaluation frameworks and performing error analysis. Ideal candidates will have...SuggestedSteampunk.com
McLean, VA1 day ago- A leading financial institution seeks a Lead AI Engineer to design, develop, and optimize AI-powered solutions. The successful candidate will work with cross-functional teams to build scalable AI systems that enhance customer experiences. Applicants should have a strong...Suggested
$269.1k - $307.2k
...Director, Data Scientist - Generative AI Systems Data is at the center of everything we do. As a startup... ...) team within Card Data Science builds state-of-art, generative AI-based solutions... ..., from design through training, evaluation, and validation; partnering with engineering...SuggestedFull timePart timeLocal areaFlexible hoursCapital One Financial Corp
McLean, VA2 days ago$77.6k - $176k
...Number: R0244056 AI Engineer The Opportunity... ..., automation, systems development,... ...team, you'll help build and refine multi-step... ...and perform prompt evaluations to ensure consistency... ...maintain a Public Trust or Suitability/Fitness... ...error handling, or safe handling of model outputs...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
McLean, VA2 days ago- ...Tokenized Asset Markets Data Systems Engineer Own the technical architecture... ...FOR THIS ROLE THE OPPORTUNITY Building the compliance data platform... ..., and supervisory visibility. Trusted by leaders across TradFi and... ...in production. Must-Have: AI Literacy & Automation AI agent...Full timeContract workRemote workWorldwide
$197.3k - $225.1k
Manager, Data Scientist - Recommendation & Personalization Systems Data is at the center of everything... ...Join an elite Applied AI team within AI Foundations... ...and textual data Build machine learning models... ...design through training, evaluation, validation, and implementation...Full timePart timeLocal areaFlexible hours$99k - $225k
...Opportunity As an AI/ML Engineer, you’re... ...You understand that building dependable AI capabilities... ...foundation in IT, systems, software, data,... ...maintain a Public Trust or Suitability/... ...output validation, or safe handling of model... ...Experience building evaluation sets for prompt testing...Local areaBooz Allen Hamilton
McLean, VA4 days ago$88.97k - $287.91k
...Salesforce is the #1 AI CRM, where humans with... ...meets action. Tech meets trust. And innovation isn’t a... ...Technical Builders who design, build, and deploy agentic AI... ...who've shipped agentic systems at scale, and have a... ...ship quality code and evaluate AI outputs with...Live in- ...you a driven Data Scientist with a robust foundation... ...for Agentic AI, and human-in-the-loop... ...(HITL) multi-agent systems? If so, an exciting... ...products are effective, safe, and of the highest... ...learning (MARL). Evaluate agent performance... ...for IT solution builds and deployment. Keep...Work at officeRemote workFlexible hours3 days per week
- ...enterprise. Leveraging AI‑powered intelligence, Delinea... ...is seeking a Senior Systems Engineer - Data Center... ...while also delivering builds and implementations,... ...passion to everything we do Trust - We act with integrity... ...process for hiring, evaluating, and promoting...H1bWork at officeLocal areaRemote work
$113k - $188k
About Our AI And Data Capability Team Our consultants... ...complexity, increase trust, and improve... ...developing actionable insights, building data pipelines, and designing... ...and secondary sources, evaluating and addressing data... ...in data and AI system development, with a proven...Temporary workWork experience placementFlexible hours- Seekr’s Mission Seekr builds trusted AI for mission‑critical decisions.... ...with the distributed training systems that make that work... ...deployment. As a Research Scientist you lead the modeling side... ...‑training recipes, and the evaluations that tell us whether the model...Work at officeRemote workFlexible hours3 days per week
$145k - $165k
...Publicis Sapient is looking for an AI Scientist & Training Specialist to... ...scientists, engineers, and system administrators, translating... ...training, optimization, and evaluation Support and instruct on the... ...HPC workflows Experience building reproducible training materials...Work at office$160k - $180k
...Description The Data & AI Engineer sits... ...production systems. Reporting to... ...responsible for building and operating... ...teams to deliver trusted, AI‑consumable... ...enterprise data safely, with... ..., logging, and evaluation hooks. Partner... ...architects, data scientists, AI engineers,...Work at office$138k - $185k
...sustainable solutions while building your future as a... ...including Architects, Data Scientists, and DevOps, to ensure... ...sources and evaluate suitability. Integrate... ...production-grade ETL/ELT systems. ~ Strong... ...maintain a DHS Public Trust (requires US Citizenship...Work from homeHome officeFlexible hoursExcella
Arlington, VA18 days ago- ...seeking a Forward Deployed AI Engineer (FDE) to... ...within our End-to-End System Test Automation. This role... ...Identify where AI can safely and effectively reduce... ...and validation layers Evaluate emerging AI tools and frameworks... ...), with experience building orchestration,...
$125k - $160k
...to apply for the Data Scientist (Generative AI) role at Steampunk,... ...cutting-edge solutions. Evaluate foundation models (e.... ...-shot examples, and system instructions to... ...a position of public trust with the US government... ...Hands-on experience in building and deploying generative...Full time$119.5k - $146k
...Slalom's Responsible AI practice is seeking... ...in realizing AI systems that are both innovative... ...explainability evaluations in collaboration with... ...objectives. Build alignment among technical... ...that support safe, ethical, and compliant... ...guidance. Establishes trust with client...Temporary workLocal area- ...Junior Data Engineer supports system-specific implementations that... ...ingestion by assisting in the design, build, and operation of automated... ...Junior Data Engineer helps safely extract metadata from... ...MAINTAIN a Federal or DoD "PUBLIC TRUST". Candidates with an ACTIVE SECRET...Temporary workInternshipFlexible hours
Dovel Technologies
Arlington, VA4 days ago $161k - $266k
...customers, we're helping build a sustainable economy... ...and Summary Lead Data & AI Security Engineer... ...by making transactions safe, simple, smart, and accessible... ...and architects to evaluate business needs, determine... ...including reviewing code/systems for vulnerabilities....Worldwide$130k - $150k
...AI Engineer BLENers are passionate about using... ...— modernizing legacy systems, building cloud-native... ...that ground answers in trusted sources, and MCP servers... ...reliable, observable, and safe. This isn't a research... ...), and retrieval evaluation ~ Comfort with prompt...BLEN Corp
Washington DC3 days ago- Steampunk, Inc. is seeking a knowledgeable Data Scientist to focus on Generative AI for Federal use cases. The role involves designing advanced ML models and collaborating with engineers to implement AI solutions. Candidates should possess strong programming skills, particularly...
$114k - $231k
...company, is seeking an AI Implementation Engineer... ...be part of our Warfare Systems team based in Arlington... ...demonstrated the ability to build end‑to‑end capabilities... ..., and take action safely and reliably. Develop Retrieval... .... Implement and Evaluate AI Workflows for on‑...Full timeWork at officeLocal areaImmediate startShift workInnovative Defense Technologies
Arlington, VA3 days ago- ...ensuring data flows seamlessly from various sources into our data systems. The ideal candidate will have a strong background in data... ...field is mandatory, and candidates must be clearable for DoD Public Trust or higher. #J-18808-Ljbffr Credence Management Solutions, LLC
$123k - $145k
...level Associate Data Scientist. This is a full-... ...geographic information systems (GIS), etc.).* At... ...intelligence (AI) models.* Large Data... ...refresh and reset. This builds upon our flexible... ...facts, and provide trusted, unbiased information... ...vacation, sick and safe paid time off, paid...Agency workFull timeContract workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$161.8k - $184.6k
...Overview Principal Associate, Data Scientist - US Card (Generative AI Systems) Data is at the center of... ...Genesis) team within Card Data Science builds state-of-art, generative AI-based... ..., from design through training, evaluation, validation, and implementation...Full timePart timeLocal areaFlexible hours- ...through a variety of sources and to build a diverse workforce. All... ...integration, sustainment, and evaluation of software, databases, data collection... ..., interoperability with DoD systems, data processing, technical... ..., automation, analytics, or AI‑assisted methods. Experience...For contractorsFlexible hours
ROLE
Washington DC4 days ago - ...currently seeking a Manager, AI Engineer to join our... ..., and tools, and evaluate their applicability for... ...with core business systems with demonstrated ability... ...deliverables, and build trusted client relationships;... ...manage stress and work safely and respectfully with...H1bLocal area
KPMG
Washington DC2 days ago - DATA SYSTEMS ENGINEER Concurrent Technologies Corporation Crystal City, VA Minimum Clearance Required: N/A Clearance Level Must Be... ...Able to Obtain: Secret Background Investigation Required As a trusted partner and leader in providing energy and sustainability consulting...
https:/www.scheurer.org/careers/
Arlington, VA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist: Build Trust & Safe AI Systems. Be the first to apply!
