QA/Evaluation Lead: AI Data Quality & Metrics
Innodata Inc.
Innodata in McLean, VA, is seeking a QA/Evaluation Lead to own quality across the platform. You will design the evaluation framework, establish IAA metrics, and partner with the Delivery Owner and engineering leads to make quality measurable at each milestone. This role requires rigorous, evidence-backed thinking about evaluation, experience with Cohen's kappa, Fleiss' kappa, Krippendorff's alpha, and Python for QC tooling. #J-18808-Ljbffr Innodata Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the QA/Evaluation Lead: AI Data Quality & Metrics in Mc Lean, VA vacancy
$45 - $50 per hour
...INOD) is a global data engineering... ...responsible advancement of AI by providing data, evaluation frameworks, and... ...legacy of high-quality data and outcomes... ...partner with a leading systems integrator... ...the Role As the QA/Evaluation Lead,... ...demonstration corpus — metric selection (Cohen'...DataQualityHourly pay$116.35k - $210.33k
...is seeking a Test and Evaluation (T&E) Lead to define the strategy... ...built on a hybrid cloud data mesh architecture,... ...experience applying modern quality engineering practices,... ...planningEstablish AI-assisted and model-based... ...quality metrics that measure operational...DataQualityFull timeTemporary workWork from home$105k - $145k
OverviewWe are looking for an AI Evaluation Scientistto design and... ...work closely with engineers, data scientists, governance analysts... ...teams to develop evaluation metrics, build test harnesses, analyze... ...experimentation, model hardening, and quality improvements. Contribute to...DataQualityLocal area- The One 23 Group is seeking a Quality Assurance Manager, Metrics and Reporting Lead to support the DISN Consolidated Provisioning contract. You will develop,... ...on-time deliverables and continuous improvement of data collection, reporting formats, and #J-18808-Ljbffr...DataQualityContract work
- ...Resources in Falls Church, VA seeks a SAR Data Scientist/Imagery Scientist to join... ...clearance and involves supporting AI/ML testing with SAR imagery and... ...engineers and analysts to ensure data quality and readiness for model evaluation in dynamic security environments. #J...DataQuality
$208k - $300k
...Engineer - Model Evaluations, Public Sector... ...deploys advanced AI systems—including... ...robustness, and safety metrics, including LLM-judge... ...regression testing, and quality assurance for ML... ...in algorithms, data structures, and... ...power the world's leading models, and help enterprises...DataQualityFull timeScale Ai
Washington DC13 hours ago- ...Position Overview: The Quality Assurance (QA) Lead is responsible for overseeing... ...standards, scorecards, and evaluation methodologies across... ...quality findings and operational data. Develop and maintain... ...Reporting Analyze quality metrics and operational performance...DataQualityWork at office
SteerBridge
Vienna, VA25 days ago - ...seeking a skilled Senior Data Scientist to support... ...data governance, data quality, data modeling, metadata... ...platforms and mission-ready AI to federal agencies at... ...and analysis to evaluate enterprise data, business... ...performance.Develop performance metrics, dashboards, and...DataQualityFull timeWork at office
- ...LMI is seeking a skilled Data Management Engineer to... ...data governance, data quality, data modeling, metadata... ...and mission-ready AI to federal agencies at... ...research and analysis to evaluate enterprise data, business... ...performance.Develop performance metrics, dashboards, and...DataQualityFull timeWork at office
- ...a Machine Learning Engineer (Evaluation & Experimentation) at Cynnovative... ...Implement and apply metrics over model outputs at scale... ...derived metrics Ensure experiment data is structured, complete, and... ...on experiment execution, data quality, and metric behavior Support...DataQuality
- SAR Data/Imagery Scientist (TS/SCI Clearance required... ...supporting advanced AI and machine learning initiatives... ...program focuses on evaluating AI models against... ...evaluating SAR imagery quality metrics and interpreting sensor... ...Responsibilities Support the Lead SAR Scientist in...DataQualityRemote work
- ...VTI Aerospace builds AI-powered perception and... ...Senior Software Engineer – Evaluation, you will design and... ...with machine learning and data engineering teams to... ...a direct impact on the quality and reliability of our... ...performance and evaluation metrics Collaborate with ML...DataQuality
VTI Aerospace
Washington DC9 days ago - ...a difference with us.The HR Data Scientist develops analytical... ...definitions and workforce metrics, and builds reproducible analytical... ...data models.Improve the quality, reliability, and... ...architecture and governance.Evaluate emerging AI and analytical techniques for...DataQualityWork experience placementInternshipLocal area
- Integral Federal is seeking a Quality Assurance Analyst to... ...through monitoring, evaluating, and enhancing the... ...interactions; and you will be the lead in providing Root Cause... ...service and meet set metric goals. The ideal... ...identify trends found in data coming from multiple sources...DataQualityTemporary workInterim roleFlexible hours
- ...experience and a strong AI development background.... ...organization, tagging, data management, and... ...Ready / Definition of Done quality checklists Create a scalable... ...health signals (logs/metrics/traces if available)... ...automated review agents that evaluate user stories/...DataQualityContract work
$105.4k - $207.8k
...organizational risk profiles of leading companies? Do you want to build the data foundations that... ...next generation of AI-enabled cyber... ....Implementing data quality checks, lineage,... ..., compliance metrics, governance, risk,... ...function calling, evaluation or monitoring, prompt...DataQualityLocal areaVisa sponsorship$151.9k - $173.4k
...responsible for performing quality assurance on testing... ...Perform final test reviews to evaluate the accuracy of tests... ...staff as needed Lead innovation initiatives,... ...piloting new testing tools and AI-assisted methodologies (... ...the need for improved data sourcing and partner...DataQualityFull timePart timeLocal areaFlexible hoursCapital One
McLean, VA1 day ago- ...Project Manager to lead complex enterprise... ...across engineering, QA, product, and business... ...and ensure high-quality, integrated outcomes... ...microservices, and data pipelines (... ...artificial intelligence (AI) tools as part of its... .... All AI-assisted evaluations and responses are reviewed...DataQualityHourly payLocal area2 days per week3 days per week
Eliassen Group
McLean, VA25 days ago $123k - $163k
...Requirements: Experience in a comparable data governance, data quality, or stewardship-focused role, or... ...into governance controls, quality metrics, and AI governance workflows Familiarity... ...Analyze data movement patterns and evaluate lineage across enterprise systems...DataQualityFull timeKforce Technology Staffing
Washington DC3 days ago- ...government clients with evaluating and achieving their... ...: Research and Data Analysis, Advanced-... ...Manager, Data & AI to join our growing... ...measurable definitions of quality, including accuracy... ...frontend teams. Lead discovery with... ...datasets, model metrics, confidence thresholds...DataQualityFull timeLocal areaRemote workFlexible hours
ICA.ai
Arlington, VA11 days ago $100 - $110 per hour
...experience and a strong AI development background.... ...organization, tagging, data management, and... ...Ready / Definition of Done quality checklists Create a scalable... ...health signals (logs/metrics/traces if available) Defect... ...review agents that evaluate user stories/requirements...DataQualityHourly payContract workLocal areaVisa sponsorship$140k - $190k
...looking for a highly skilled AI Developer to design,... ...AI development, from data ingestion and model... ...Data Scientists and AI Evaluation Scientists.Design and implement... ...of evaluation metrics.Contribute to internal... ...accelerators that raise delivery quality across the AI & Data...DataQuality- ...serve as the technical lead for the Microsoft 365... ...architecture leveraging data, AI readiness, and modular... ...phases, POA&Ms, metrics, and heat maps using Power... ...environments; and architecture evaluation. Microsoft... ...unwavering commitment to quality, precision, and...DataQualityFull timeTemporary workWork at officeLocal areaFlexible hours
INTECON
Arlington, VA2 days ago - ...time improving content quality, site health, search visibility... ...SEO and web analytics data to recommend content... ...to monthly SEO and AI search performance research... ...and defined success metrics, as aligned with the... ...of the user first. Evaluate, test, edit and optimize...DataQualityLong term contractFor contractorsLocal area
System One Holdings, LLC
Falls Church, VA1 day ago - Cynnovative is seeking a Machine Learning Engineer (Evaluation & Experimentation) in Arlington, VA. The ideal candidate will design evaluation pipelines, run large-scale experiments, and ensure data quality. This role requires U.S. Citizenship and an active TS/SCI security...DataQuality
- Head of Enterprise Data Strategy and Governance... ...and Governance leads the Bank's enterprise data and AI strategy, and oversees... ..., data product and quality management,... ...contracts, operational metrics, and performance targets... ...scenarios. • Guide evaluation and selection of...DataQualityFull timeWork at officeRemote work2 days per week
- ...services company that partners with leading commercial healthcare/life sciences organizations... ...on cutting edge innovations - think AI, automation and data transformation. We then bring those... ...consumer. Join rockITdata as a Quality / QA Lead (CMMI ML3) supporting one of the...DataQualityFull timeLocal area
rockITdata
Arlington, VA28 days ago $75k - $90k
...innovation meets mission. Our AI, cloud, cyber, and... ...members, 1,500+ AI/data experts, and 100+ prime... ...methodology development and evaluation, business process... ...Recommend and facilitate quality improvement efforts Communicate... ...(MAPAD) Logistics Metrics Analysis Reporting...DataQualityContract workWorldwideCredence
McLean, VA1 day ago$27 per hour
...Snacks! Position: Quality Assurance Lead - 1st Shift Type: Onsite... ...and ongoing training of QA techs. Reviews data collection for accuracy... ...established standards. Evaluate adequacy of quality... ...test information and QA metrics to determine operating efficiency...DataQualityHourly payTemporary workWorldwideRelocationDay shiftOberto Snacks Inc
Washington DC1 day ago- ...Quality Assurance Lead Empowering Connections, Inspiring... ...Center, multiple data centers, and a nationwide... ...for building QA capabilities from... ...automation frameworks and AI-driven testing... ...and coverage Evaluate, select, and... ...Establish quality metrics, reporting, and dashboards...DataQualityFull timeFor contractorsCasual workWork at officeRemote work
SageNet
Reston, VA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to QA/Evaluation Lead: AI Data Quality & Metrics. Be the first to apply!
Related searches
- data intern Mc Lean, VA
- data governance Mc Lean, VA
- data collection researcher Mc Lean, VA
- sap master data Mc Lean, VA
- clinical data Mc Lean, VA
- data visualization Mc Lean, VA
- data loss prevention engineer Mc Lean, VA
- clinical data coordinator remote Mc Lean, VA
- data recovery Mc Lean, VA
- data internship Mc Lean, VA