AI Evaluation Scientist - Trustworthy AI Metrics & Testing
$105k - $145kSteampunk
Steampunk is seeking an AI Evaluation Scientist in McLean, Virginia, to design evaluation processes for AI systems ensuring accuracy and reliability. Responsibilities include implementing evaluation frameworks and performing error analysis. Ideal candidates will have a Bachelor’s or Master’s degree in a relevant field, with 2+ years of experience in AI model evaluation and proficiency in Python. The expected salary range is $105,000 to $145,000 annually, backed by a comprehensive benefits package. #J-18808-Ljbffr Steampunk
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist - Trustworthy AI Metrics & Testing in Mc Lean, VA vacancy
$90k - $120k
...Description Data Scientist AArete is one-of-a-kind... ...requirements. In the new age of AI, this role will help design, evaluate, and operationalize... ...and other associated metrics necessary for the business... ...ambiguous business questions, test hypotheses, and deliver...SuggestedTemporary workWork experience placementWork at officeFlexible hoursAArete
Vienna, VA2 days ago$100k - $120k
...Transportation Data Scientist at the junior to... ...the intersection of AI, data science, and... ...ecosystems for trustworthy AI. The ideal candidate... ...applications. • Evaluate AI model... ...model evaluation metrics (e.g., AUC, accuracy... ...scalability) and testing AI systems under varied...SuggestedFull timeLocal areaImmediate startLeidos
Derwood, MD4 hours ago$190k - $235k
...services. Summary: The AI/ML SME will be the Analytic... ...Job Functions: Evaluate and assess DEA enterprise... ...propose different data‑scientist techniques and implementations... ..., trained, and fully tested, the team shall... ...accuracy and performance metrics. Document model assumptions...SuggestedContract workFor contractorsFlexible hoursGoldbelt
Arlington, VA22 hours ago- ...Full Stack Developer – Agentic AI and Data Engineer (2)... ...pipelines o Implement automated tests, logging/observability, and security... ...programs Role success metrics: · Demonstrated mission utility... ...celebrated. Honest - Be Trustworthy. Honesty serves as our compass...SuggestedFull timeFor contractorsFor subcontractorWork at officeRemote work
Agile Defense
McLean, VA21 hours ago $86.25k - $172.5k
...data analysis, feature engineering, model training, testing, and validation. • Use Python to write clean, efficient... ...well documented code for modeling and analysis. • Evaluate model performance using appropriate metrics and ensure robustness and accuracy. • Prepare...SuggestedFull timeTemporary workPart timeWork experience placementWork at officePNC
Vienna, VA21 hours ago$229.9k - $262.4k
...Senior Manager, Data Scientist - Experimentation Lead Data is at... ...is validated through rigorous testing and providing a clear, defensible... ...the organization to ensure metric improvements are tied to... ...and risk policies, effectively evaluating external data, and institutionalizing...Full timePart timeLocal areaCapital One Financial Corp
McLean, VA2 days ago$99k - $225k
Computer Scientist The Opportunity: As an analytics professional, you'... ...and artifi cia l intelligence (AI). If you care about moving a... ...national security team, you'll evaluate AI methodologies to make a real... ...in continuous auditing, testing, evaluation, verification, and...Full timeContract workPart timeWork at officeLocal areaRemote workBOOZ, ALLEN & HAMILTON, INC.
McLean, VA2 days ago$135.6k - $154.8k
...data-driven decision-making. As a Data Scientist at Capital One, you’ll be part of a team... ...news “ Banks Pass Federal Reserve Stress Tests ” and wondered how Capital One determines... ..., from design through training, evaluation, validation, and implementation Flex your...Full timePart timeLocal areaFlexible hoursCapital One
McLean, VA22 hours ago$145.56k
Senior Data Scientist Job Locations US Job ID... ...machine learning, and AI strategy across the organization... ...model development and evaluation, and experimentation... ...code quality, testing, and reproducibility... ...and related performance metrics Target Pay Range...Contract workWork experience placementFlexible hoursPyramid
Fairfax, VA4 days ago$40 per hour
...and contribute to developing cutting-edge AI systems, while enjoying the flexibility... ...state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving... ..., and experiment design (e.g., A/B testing, hypothesis testing, regression, classification...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC3 days ago- ...integrate data-intensive systems and Generative AI capabilities. This role sits at the... ...Generative AI / LLM Integration Build, test, and deploy LLM-powered applications and workflows... ...platforms and user experiences Evaluate and assess LLM outputs for performance, accuracy...Full time
Interimage
Arlington, VA21 hours ago $145k - $165k
...Defense is seeking a Data Scientist / Engineer to support... ...of scalable, AI-enabled data solutions... ...value reproducibility, testing, and continuous delivery... ...testing, and performance evaluation techniques. Excellent... ...celebrated. Honest - Be Trustworthy. Honesty serves as our...Temporary workWork experience placementAgile Defense
Washington DC21 hours ago$135k - $160k
...infrastructure and strategy for our AI/ML Maintenance, Sustainment,... ..., and monitoring (metrics, logging, alerting). Strong... ...validation and data contract testing within CI/CD pipelines. Automation... ...workflows. Collaboration with data scientists on feature engineering, data...Contract workWork at officeLocal area3 days per weekSteerBridge
Vienna, VA3 hours ago- ...government. We are seeking a Data Scientist as part of a bid process... ...(KPIs) and operational metrics. Translate highly technical... ...Information Technology (OIT) to evaluate new tools and ensure data... ...regression, forecasting, hypothesis testing, and machine learning...Work at officeLocal areaImmediate start
- ...operational needs into high-performing AI features, operating across... ...rigor: clean data, measurable evaluation, and repeatable experiments... ...evaluation frameworks and test harnesses to measure quality,... ...designing or using evaluation metrics and testing procedures for LLMs...Full timeWork at officeFlexible hours
Twenty Inc.
Washington DC3 days ago - ...Associate AI Engineer Innovative Defense Technologies (IDT), provider of cutting-edge cloud-based integration, automated testing and data analysis for complex, mission-critical systems in... ...system interactions. Implement and Evaluate AI Workflows: Translate technical...Full timeWork at officeImmediate start
Innovative Defense Technologies
Arlington, VA1 day ago - ...Applied AI Engineer We're looking for an Applied AI Engineer... ...Engineering team to design, build, evaluate, and deploy intelligent AI... ...evaluation pipelines, define metrics, and establish performance and... ...engineering practices: clean code, testing, version control (Git), and...Work at office
Atomicwork
Washington DC3 hours ago $150k - $180k
...The AI Integration Specialist is a pivotal role bridging the... ...DOE. Work closely with data scientists to understand model... ...ML models, ensuring automated testing, deployment, and monitoring.... ...resilient solutions. Research and evaluate new technologies, frameworks,...Contract workWork at officeASM Research, An Accenture Federal Services Company
Washington DC4 days ago$90k - $210k
...technology. MORSE boasts a specially selected team of scientists, engineers, and software developers to... ..., time sequenced data, and advanced metrics. You will be part of teams performing Test and Evaluation (T&E) of AI and machine learning models and algorithms to...Full time$77.6k - $176k
...candidate with us. As an experienced AI engineer, you know that AI... ...Air Power team, you’ll train, test, deploy, and maintain models... ...with data engineers, data scientists, solutions architects, and product... ..., automated testing, or model evaluation Secret clearance Bachelor’s...Full timeContract workPart timeWork at officeLocal areaRemote work- ...We are looking for a highly skilled AI Systems Engineer who will be part of a collaborative... ...with engineering and product teams to evaluate emerging tools, build technical... ...LLMOps/MLOps principles including versioning, testing, deployment automation, monitoring, and governance...
Tria Federal
Arlington, VA4 days ago $146.95k
## AI DeveloperApplylocations: Headquarterstime type... ...the next generation of scientists - even stretching into... ...: systems versioned, tested, deployed through CI/CD... ...regression with a clean evaluation. Bring real ML and DL... ...drift, business outcome metrics, and A/B tests where they...Visa sponsorship$77.6k - $176k
Job Number: R0239120 AI Developer As an experienced AI engineer... ...Air Power team, you'll train, test, deploy, and maintain models that... ...with data engineers, data scientists, solutions architects, and product... ..., automated testing, or model evaluation and monitoring in constrained...Full timeContract workPart timeWork at officeLocal areaRemote work$140k - $190k
...looking for a highly skilled AI Developer to design, build,... ...in collaboration with Data Scientists and AI Evaluation Scientists. Design and... ...Implement secure-by-design and trustworthy AI practices, including... ...integration of evaluation metrics. Contribute to internal AI...- ...Overview BigBear.ai is seeking a Lead Data Engineer to support... ...deliverables and performance metrics where applicable. Applies a... ...major technology assignments. Evaluates performance results and recommends... ...to work with automated testing tools to perform testing and maintenance...Temporary workRemote work
BigBear Inc
Washington DC2 hours ago - ...AI/ML Engineer Arlington, VA 540 is seeking an AI/ML Engineer... ..., data engineers, data scientists, cybersecurity teams, and mission... ...model training, validation, testing, deployment, and monitoring... ...inference ~ Understanding of model evaluation, performance monitoring,...Temporary workWork at officeLocal areaFlexible hours
540
Arlington, VA21 hours ago - ...Senior AI/ML Engineer Arlington, VA 540 is seeking a Senior... ..., data engineers, data scientists, cybersecurity teams, and mission... ...model training, validation, testing, deployment, and monitoring... ...Strong understanding of model evaluation, monitoring, drift detection,...Temporary workWork at officeLocal areaFlexible hours
540
Arlington, VA3 hours ago - ...AI/ML Engineer Senior At GDIT, our people are... ...engineers and data scientists to develop and implement... ...machine learning models. Evaluating the performance of... ...using the applicable metrics and techniques. Completion... ..., configuring, testing, and maintaining operating...Temporary workRemote workFlexible hours
General Dynamics
Springfield, VA2 days ago $150k - $175k
...Agile Defense is seeking a Data Scientist / Engineer to support the... ...operational deployment of scalable, AI-enabled data solutions within... ...that value reproducibility, testing, and continuous delivery.... ...testing, and performance evaluation techniques. Excellent technical...- ...management is fragmented. Range is building AI-powered wealth management that actually... .... Set the standards . Define how we do testing, documentation, orchestration, and alerting... ...Help shape the platform decision. We're evaluating our long-term data platform and whether...Work at officeRelocationMonday to Friday
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist - Trustworthy AI Metrics & Testing. Be the first to apply!
