AI Evaluation Scientist: Build Trust & Safe AI Systems
Steampunk.com
Steampunk, Inc. seeks an AI Evaluation Scientist to design and implement evaluation frameworks ensuring accuracy, safety, and alignment with mission requirements for predictive and generative AI systems. You will collaborate with engineers, data scientists, governance analysts, and product teams to build metrics, tests, and deployment guidance. This role emphasizes structured error analysis, benchmarking, and human‑in‑the‑loop evaluation workflows, documenting findings for technical and #J-18808-Ljbffr Steampunk.com
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist: Build Trust & Safe AI Systems in Mc Lean, VA vacancy
$105k - $145k
...are looking for an AI Evaluation Scientistto design... ...and generative AI systems are accurate, reliable, safe, and aligned with mission... ...for establishing trust in AI solutions and... ...The AI Evaluation Scientist will work closely... ...evaluation metrics, build test harnesses, analyze...SuggestedLocal area- ...and modernize their systems, so that they can... ...a highly skilled AI Systems Engineer who... ...that supports and builds modern, usable, and... ...and product teams to evaluate emerging tools,... .../maintain a Public Trust clearance. Preferred... ..., or designing safe action execution patterns...Suggested
Tria Federal
Arlington, VA4 days ago $104k - $166k
ResponsibilitiesNext-Gen AI/ML Systems Engineer - Data Fusion... ...strategies, building organizational AI literacyArticulate... ..., validation, and evaluation methodologiesBroad... ...provider, we deliver trusted, highly differentiated... ...people around the world safe and secure.Target Salary...SuggestedFull timeContract workImmediate startShift work$170.87k
...Join EY and help to build a better working... ...Technology Consulting - AI and Quantitative... ...Intelligence Data Scientist (Manager) (... ...transforming data and evaluating results to make... ...Mathematics, Information Systems, Statistics,... ...society and build trust in the capital markets...SuggestedFull timeWork experience placementSummer holidayImmediate startMonday to Friday$104k - $166k
ResponsibilitiesPeraton Labs is seeking AI/ML Research Scientists to support the development... ...CTO to perform analysis, build software, develop prototypes... .../maintain an FAA Public Trust suitabilityMust be local to... ...people around the world safe and secure.Target Salary Range...SuggestedContract workLocal areaShift work$125k - $155k
...services, cloud services, or build new facilities. This... ...one-line diagrams and evaluating mission-critical electrical distribution systems, including utility... ...standards, and the ability to safely perform work in... ...ability to serve as a trusted subject matter expert while...Work at officeLocal areaHome officeFlexible hours- ...a PREP Research Associate to advance agentic AI research within the NIST PREP program. You will design, develop, and evaluate AI agents, build experimental platforms, and contribute to benchmarks and methodologies for safe, trustworthy agentic AI across multiple domains...
$105k - $145k
Steampunk is seeking an AI Evaluation Scientist in McLean, Virginia, to design evaluation processes for AI systems ensuring accuracy and reliability. Responsibilities include implementing evaluation frameworks and performing error analysis. Ideal candidates will have a...$77.6k - $176k
AI and ML Data ScientistThe Opportunity: As an Agentic... ...AI Engineer and Data Scientist for military... ...and deploy advanced AI systems that help analysts transform... ...Booz Allen, you’ll help build intelligent systems that... ...generation pipelines, evaluation frameworks, prompt strategies...Full timeContract workPart timeWork at officeLocal areaRemote work$180k - $200k
...resides with Warfare Systems (WS), a... ...range from C5ISR, AI and Big Data,... ...Senior AWS Data Scientist 4 (AI/ML Engineer... ...integrate and evaluate datasets.... ...and auditability.Build scalable data pipelines... ...and SMEs) in a SAFe Agile... ...including Zero Trust, RMF, Section 5...Full timeWork at officeLocal areaWork from homeWorldwideHome office$161.8k - $184.6k
...Overview Principal Data Scientist - Recommendation & Personalization Systems Data is at the... ...Join an elite Applied AI team within AI Foundations... ...numeric and textual data Build machine learning models... ...design through training, evaluation, validation, and...Full timePart timeLocal areaFlexible hoursCapital One
McLean, VAa month ago- ...design team through schematic design, development, and contract documents, shaping systems for commercial and institutional facilities. The role requires a PE license, experience with building systems design, and proficiency in MS Office and design software. HDR values...Contract work
$204.44k - $324.99k
..., and Clinical Data Build Apex classes, triggers,... ...templates and grounded AI experiences using Salesforce... ...agent testing, evaluation, observability, and guardrails... ...with external systems (e.g., Epic, Genesys, MuleSoft... ...manage stress and work safely and respectfully with...H1bLocal area- ...currently seeking a Manager, AI Engineer to join our... ..., and tools, and evaluate their applicability for... ...with core business systems with demonstrated ability... ...deliverables, and build trusted client relationships;... ...manage stress and work safely and respectfully with...H1bLocal area
KPMG
McLean, VA1 day ago $146.83k - $192.72k
...positive change to build a healthier,... ...Enterprise Data & AI team is a strategic... ...and delivery of a trusted unified data foundation... ...an Applied AI/ML Scientist, you design, develop... ...engineering system. You contribute to... ...experimentation frameworks and evaluation approaches to...Permanent employmentPart timeWork visalululemon
Washington DC13 days ago$161.8k - $184.6k
...Overview Principal Associate, Data Scientist - US Card (Generative AI Systems) Data is at the center of... ...Genesis) team within Card Data Science builds state-of-art, generative AI-based... ..., from design through training, evaluation, validation, and implementation...Full timePart timeLocal areaFlexible hoursCapital One
McLean, VAmore than 2 months ago- ...Job Description AI/ML Engineer – Subject... ...CyberArgo Cyber Systems is a Service-... ...workflow automation to build scalable AI... ...cyber analysts, data scientists, software... ...pipelines.Support model evaluation, tuning,... ...to maintaining a safe, secure, and trusted workplace for all...Local area
Argo Cyber Systems
Arlington, VA7 days ago - ...Public Trust: None Requisition Type: Regular... ...our country safe and secure. Job... ...Principal Agentic AI/ML Engineer to support... ...workflow design, evaluation, integration, deployment... ...responsible for building practical, reliable... ...with external systems under defined controls...Contract work
General Dynamics Information Technology
Arlington, VA1 day ago $269.1k - $307.2k
...Overview Director, Data Scientist - Generative AI Systems Data is at the center of everything we do... ...Genesis) team within Card Data Science builds state-of-art, generative AI-based... ...development, from design through training, evaluation, and validation; partnering with...Full timePart timeLocal areaFlexible hoursCapital One
McLean, VAa month ago$225.4k - $257.2k
...Senior Manager, Data Scientist - US Card (Generative AI Systems) Data is at the center of everything we do.... ...Genesis) team within Card Data Science builds state-of-art, generative AI-based... ..., from design through training, evaluation, validation, and implementation...Full timePart timeLocal areaFlexible hoursCapital One
McLean, VA3 days ago$229.9k - $262.4k
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP) Overview At Capital One, we are... ...and reliable AI systems, changing banking for good... ...committed to continuing to build world-class applied science... ...team of engineers, research scientists, technical program...Full timePart timeLocal area$274k - $376.2k
...Every Identity, from AI to Human... ...Okta secures AI by building the trusted, neutral infrastructure... ...organizations to safely embrace this new... ...Applied AI Scientist to take product ideas... ...Create and maintain evaluation and training... ...practical ML or AI systems ~ Strong Python...Work at officeLocal areaWorldwideFlexible hours$176k - $230k
...new era, we seek AI-native thinkers across... ...AI as a high-trust collaborator that... ...the sweet spot for building big, moving fast,... ...hiring an AI Research Scientist (New Grad) for our... ...self-improving AI systems — building agents... ...strategies Build and evaluate auto research...Full timeFlexible hoursSnowflake
Washington DC10 days ago$160k - $180k
...The Data & AI Engineer sits within... ...production systems. Reporting to the... ...responsible for building and operating the... ...to deliver trusted, AI-consumable... ...enterprise data safely, with appropriate... ..., logging, and evaluation hooks. Partner... ..., data scientists, AI engineers,...Work at officeCarlyle
Washington DC2 days ago- ...community, but around the world. We believe building engineering is more than systems and structures, it’s about powering... ...data centers driving the future of AI to dynamic commercial environments,... ...to region, it becomes harder to trust, harder to reuse, and harder to...Local area
$140k - $190k
...looking for a highly skilled AI Developer to design, build, and optimize advanced... ..., and autonomous system domains. This role requires... ...collaboration with Data Scientists and AI Evaluation Scientists.Design and implement... ...a position of public trust with the U.S. government...$112k - $179k
ResponsibilitiesOverviewPeraton is seeking a Senior AI Engineer to to design and build production-grade AI systems and lead the next... ..., reuse)Implement evaluation pipelines to measure... ...provider, we deliver trusted, highly differentiated... ...around the world safe and secure.Target...Contract workRemote workShift work$116k - $175k
...builder in Cherry Bekaert’s AI Center of Excellence —... ...writes the prompts, builds the skills and ships... ...Participates in use case intake, evaluating submitted ideas from... ...Science, Information Systems, Engineering or a... ...integrity, collaboration, trust, and mutual respectThe...Full timeWork experience placementLocal area$128k - $252.5k
...account executives and data scientists to AI strategists, machine... ...trials, autonomous systems and edge AI, and... ...work productAbility to build and sustain professional... ...engineers, they serve as trusted advisors to executives... ...them understand and evaluate new and essential areas...Local areaVisa sponsorship- ...organizations design, build, and scale modern digital... ...technology, and AI-powered decisioning to... ...and implement Agentic AI systems enabling intelligent decision... ...detectionImplement LLM evaluation metrics, structured... ...clients reinvent and build trusted, lasting relationships....Full timeLive inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist: Build Trust & Safe AI Systems. Be the first to apply!
