Test and Evaluation SME

Job Description

Job Description

Test & Evaluation (T&E) Subject Matter Expert (SME)

Location: Washington, DC Metro Area (Primarily Remote with Limited Travel)

Clearance: Active SECRET Clearance (Required)

Employment Type: Full-Time

Powell Consulting Group (PCG) is a Service-Disabled Veteran-Owned Small Business that delivers systems engineering, digital engineering, test and evaluation, cybersecurity, artificial intelligence, organizational transformation, and workforce development solutions to the Federal Government. Our mission is to align people, systems, and purpose to deliver measurable mission impact. We are seeking an experienced Test & Evaluation Subject Matter Expert with direct, hands-on AI/ML evaluation experience to support the Department of Homeland Security's Science and Technology mission.

The T&E SME will provide senior-level technical leadership supporting developmental, operational, cyber, and emerging technology test activities, with particular emphasis on the test and evaluation of AI-enabled and machine-learning-enabled systems. The successful candidate will advise Government leadership on test strategy, planning, execution, data analysis, reporting, and evaluation of complex systems while working as part of integrated systems engineering and acquisition teams.

• Evaluate AI-enabled systems, machine-learning models, digital engineering products, automation technologies, and other emerging capabilities - a core focus of this role.
• Provide senior Test & Evaluation expertise across developmental, operational, cybersecurity, and emerging technology programs.
• Develop test strategies, plans, methodologies, success criteria, and evaluation approaches, including approaches tailored to AI/ML system behavior, performance drift, and model risk.
• Support integrated product teams, technical working groups, design reviews, and milestone decision events.
• Develop objective data collection and analysis strategies that produce measurable evidence of system performance and mission effectiveness.
• Review and assess TEMPs, operational test plans, cyber resilience test plans, evaluation reports, and related acquisition documentation.
• Provide technical assessments and recommendations to Government leadership.
• Observe developmental, operational, cyber, and integrated test events and prepare executive-level findings.
• Collaborate with systems engineers, cybersecurity professionals, acquisition personnel, and operational users throughout the system lifecycle.
• Support continuous process improvement and adoption of best practices in T&E.

• Direct, hands-on experience applying Artificial Intelligence (AI) or Machine Learning (ML) within a Test & Evaluation context is required - e.g., developing or executing test methodologies for AI/ML model performance, robustness, bias, drift, or safety.
• Cybersecurity Test & Evaluation experience is required.
• BS with 20+ years or MS with 15+ years of relevant experience.
• DHS T&E Level III certification or willingness to obtain equivalent certification.
• Experience supporting large Federal acquisition programs (DHS preferred; DoD acceptable).
• Knowledge of DHS Acquisition Lifecycle Framework (or comparable DoD processes).
• Experience with cyber resilience testing, vulnerability assessments, penetration testing, and adversarial assessments.
• Knowledge of NIST Risk Management Framework (RMF) and DHS 4300A.
• Ability to analyze complex technical problems and deliver high-quality products under tight deadlines.
• Excellent written and verbal communication skills.
• Active SECRET clearance.

• Knowledge of Digital Engineering, Digital Thread, and Digital Twin concepts.
• Model-Based Systems Engineering (MBSE) experience using Cameo, MagicDraw, Capella, or similar tools.
• Experience with DevSecOps, automated testing, and CI/CD pipelines.
• Python, R, MATLAB, or similar scripting experience for automation or analytics.
• Experience building dashboards using Power BI, Tableau, or similar platforms.
• Cloud testing experience (AWS, Azure Government, Google Cloud).
• Knowledge of Zero Trust Architecture.
• Agile, Scrum, or SAFe experience.
• Experience evaluating autonomous systems, robotics, IoT, or advanced analytics.
• INCOSE ASEP, CSEP, or ESEP certification.

PCG offers competitive compensation, comprehensive benefits, flexible work arrangements, professional development opportunities, and the opportunity to support high-impact national security missions while working alongside an exceptional team.

If you are passionate about advancing the nation's homeland security mission and possess the qualifications described above - particularly direct, hands-on AI/ML experience combined with Test & Evaluation expertise - we encourage you to apply and join our growing team.