AI Assurance Engineer
$100kThe Johns Hopkins University Applied Physics Laboratory
Description Are you an engineer with hands-on experience evaluating, testing, and assessing AI-enabled systems within the Department of Defense (DoD) or a similar mission-focused environment? Do you have experience with generative AI models, agentic systems, AI security, and the evolving AI threat landscape? Are you passionate about designing rigorous evaluations and applying benchmarks and test frameworks to assess model performance, safety, robustness, and mission suitability? If you thrive in a collaborative, fast-paced environment and enjoy solving complex technical challenges, we want to hear from you. We are seeking an AI Assurance Engineer to help develop and execute comprehensive evaluations of generative AI models and agentic systems, leveraging state-of-the-art testing methodologies, measurement techniques, and assurance frameworks. You will work across the AI lifecycle to ensure models and agentic systems meet rigorous security, reliability, and operational assurance standards, helping enable the safe and effective adoption of AI for mission-critical applications. As an AI Assurance Engineer, you will... Design and execute assurance evaluations for generative AI models and agentic systems supporting defense and healthcare missions. Develop test strategies, evaluation plans, test cases, and success criteria to assess AI performance, security, robustness, and mission suitability. Apply AI evaluation methods, benchmarks, and test frameworks to identify model limitations, vulnerabilities, and assurance risks. Collaborate with AI researchers, engineers, and mission partners to advance AI assurance capabilities and support operational deployment. Analyze evaluation results and communicate technical findings, recommendations, and assurance decisions to government sponsors. Evaluate AI capabilities in realistic mission environments to enable informed, risk-based deployment decisions. Qualifications You meet our minimum qualifications for the job if you have... A Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Machine Learning, Statistics, Cybersecurity, or other relevant technical field. Experience with Python and software development for AI, data analysis, or test automation. Familiarity with generative AI models, agentic systems, or machine learning concepts and the AI threat landscape. Knowledge of test and evaluation principles, including developing test cases, defining success criteria, and analyzing results. Strong analytical, written, and verbal communication skills, with the ability to collaborate effectively in a multidisciplinary team environment. The ability to obtain an Interim Secret level security clearance by your start date and can ultimately obtain a Top-Secret level clearance. If selected, you will be subject to a government security clearance investigation and must meet the requirements for access to classified information. Eligibility requirements include U.S. citizenship. You'll go above and beyond our minimum requirements if you have... A Master's degree or higher in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Statistics, Cybersecurity, or a related technical field. Familiarity with AI risk management frameworks, assurance best practices, and governance principles for deploying trustworthy AI systems. Experience evaluating generative AI models or agentic systems using AI benchmarks, test frameworks, or adversarial testing methodologies. Experience presenting technical findings, risk assessments, and evaluation results to senior leaders, government sponsors, or other technical and non-technical stakeholders. About Us Why Work at APL? The Johns Hopkins University Applied Physics Laboratory (APL) brings world-class expertise to our nation's most critical defense, security, space and science challenges. While we are dedicated to solving complex challenges and pioneering new technologies, what makes us truly outstanding is our culture. We offer a vibrant, welcoming atmosphere where you can bring your authentic self to work, continue to grow, and build strong connections with inspiring teammates. At APL, we celebrate our differences of perspectives and encourage creativity and bold, new ideas. Our employees enjoy generous benefits, including a robust education assistance program, unparalleled retirement contributions, and a healthy work/life balance. APL's campus is located in the Baltimore-Washington metro area. Learn more about our career opportunities at All qualified applicants will receive consideration for employment without regard to race, creed, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, genetic information, veteran status, occupation, marital or familial status, political opinion, personal appearance, or any other characteristic protected by applicable law.APL is committed to providing reasonable accommodation to individuals of all abilities, including those with disabilities. If you require a reasonable accommodation to participate in any part of the hiring process, please View email address on click.appcast.io. The referenced pay range is based on JHU APL's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level with consideration for internal parity. For salaried employees scheduled to work less than 40 hours per week, annual salary will be prorated based on the number of hours worked. APL may offer bonuses or other forms of compensation per internal policy and/or contractual designation. Additional compensation may be provided in the form of a sign-on bonus, relocation benefits, locality allowance or discretionary payments for exceptional performance. APL provides eligible staff with a comprehensive benefits package including retirement plans, paid time off, medical, dental, vision, life insurance, short-term disability, long-term disability, flexible spending accounts, education assistance, and training and development. Applications are accepted on a rolling basis. Minimum Rate $100,000 Annually Maximum Rate $245,000 Annually The Johns Hopkins University Applied Physics Laboratory
$100k
AI Assurance Engineer Are you an engineer with hands-on experience evaluating, testing, and assessing AI-enabled systems within the Department of Defense (DoD) or a similar mission-focused environment? Do you have experience with generative AI models, agentic systems, AI...SuggestedInterim role$99k - $225k
Wireless and Edge AI/ML EngineerThe Opportunity:At Booz Allen, we power possibility for... ...consultants, technologists, researchers, engineers, and cyber experts builds innovative... ...location on a single platformApply security and assurance practices to the ML lifecycle: model...SuggestedFull timeContract workPart timeLocal areaRemote work$105k
...are graduating with a PhD in computer science, mathematics, engineering, or a related field, we are looking for someone like you to assist... ..., Javascript, Java, Kotlin, or C++ Have experience with AI assurance, explainable AI, or related techniques Have experience with...SuggestedTemporary workWork experience placementInterim roleRelocation packageFlexible hours- ...Job Title: AI Engineer Location: Columbia, MD Position Type : Full Time Clearance Required: TS/SCI with Polygraph We're seeking... ...application development. Familiarity with human-in-the-loop workflows, AI assurance, and evaluation methodologies #J-18808-LjbffrSuggestedFull time
$225k - $247k
Columbia, MDDescriptionAssured Information Security (AIS) has an opening for a SMEAI Engineer with our Mission Services team. In this role you will provide... ....Familiarity with human-in-the-loop workflows, Al assurance, and evaluation methodologies .Clearance Required: TS/...Suggested- Roles and Responsibilities:We have an immediate need for an Artificial Intelligence (AI) Engineer to support TO-005, Report Authoring and Dissemination (RAD). The AI Engineer will work closely with system and software engineers to design, prototype, and integrate AI advancements...Immediate start
$99k - $225k
Agentic AI EngineerThe Opportunity:As an Agentic AI Engineer, you will design, build, and deploy AI agents capable of autonomously using tools, interacting with software systems, and executing multi-step tasks. You will develop agent architectures, including decision-making...Full timeContract workTemporary workPart timeLocal areaRemote work$3,500 per month
...you work with. ARSIEM is looking for an amazingly talented AI Engineer to join our team! In this role you will get to provide... ...development. Familiarity with human-in-the-loop workflows, AI assurance, and evaluation methodologies. The ARSIEM pay range for this...- ...days/week remote and 2 days/week onsite in Annapolis Junction, MD. We have an immediate need for an Artificial Intelligence (AI) Engineer to support the development and sustainment of mission-focused AI capabilities. The AI Engineer will work closely with system and...Immediate startRemote work2 days per week3 days per week
- ...Business Unit: BU-USA_FC-USDWe are seeking an experienced data engineer to join our team! OTECH produces and maintains unique... ...data formats such as JSON, XML, or Avro is also valuable.The assurance portion of the role requires strong knowledge of data verification...
$86.8k - $198k
...Job Number: R0238008 AI Software Engineer, Senior The Opportunity: As an AI sof t war e engineer, you know that good sof t war e is more than just a nice-looking interface + data. Today, you need to develop user-focused solutions that increase organizational...Full timeContract workPart timeLocal areaRemote work$86.8k - $198k
...Job Number: R0234279 AI Software Engineer, Senior The Opportunity: As an AI sof t war e engineer, you know that good sof t war e is more than just a nice-looking interface and data. Today, you need to develop user-focused solutions that increase organizational...Full timeContract workPart timeWork at officeLocal areaRemote work- Talented Engineers Wanted Residency All applicants must currently reside in the United States Overview BigBear.ai is seeking a talented engineers to join a high-impact team delivering mission-critical infrastructure awareness and analytics. In this role, you will help...
$120k - $200k
...Senior AI Engineer Location US-MD-Annapolis Junction ID 2026-8635 Category Engineering Position Type Full-Time Remote No Clearance Level TS/SCI FS Poly Description PLEX Solutions, A Part of...Full timeTemporary workRemote workFlexible hours- ...Residency All applicants must currently reside in the United States Overview BigBear.ai is seeking a motivated Senior AI Engineer with a proven track record in software engineering and deep understanding of Artificial Intelligence/Machine Learning (AI/ML) techniques...
$10k
...or similar languages commonly used in AI application development. Due to federal... ...tools, and workflows. Degree in Systems Engineering, Computer Science, Engineering, Data... ...Familiarity with human-in-the-loop workflows, AI assurance, and evaluation methodologies. The...Contract workTemporary workImmediate start$155k - $175k
...DC, Maryland, Virginia (DMV) area; ET zone work schedule. Daily Responsibilities Serve as a senior, hands-on full-stack AI engineer and technical authority, leading the technical strategy, design, and delivery of large-scale mission-critical AI systems supporting...Permanent employmentFull timeRemote work$210k - $249k
...Job Description ACTIVE SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED We are seeking an experienced Lead AI / NLP Engineer specializing in agentic AI frameworks and automated knowledge extraction to join our team supporting critical defense and...Hourly payContract workWork experience placementImmediate startFlexible hours$125.1k - $225.2k
...full potential. Unleash your talent and redefine what’s possible. Job Description: Parsons is looking for an amazingly talented AI Engineer to join our team! Ready for a challenge that will keep you on the edge of Cybersecurity? Are you an experienced software...Full timeFlexible hours- ...Description Overview General Dynamics Mission Systems (GDMS) engineers a diverse portfolio of high technology solutions,... ..., risks, and recommendations; mentor Information Assurance personnel; and identify AI, automation, or analytics opportunities to improve security...Work experience placementRelocationRelocation packageFlexible hours
$239k
...considered. Summary: • Develop and test components of agentic AI solutions using Python, MCP servers, and specialized tools. • Collaborate... ...deliver dependable, accurate results. • Apply modern software engineering practices using Git version control, debugging tools, and AI...$130k - $155k
AI Software Engineer 1 Annapolis Junction, MD Clearance Unspecified Full Scope Polygraph Early Career (2+ yrs experience) $130,000 - $155,000 Job Description Minimum of 3 years of experience and a BS degree. Skills requirements: Software development experience with strong...Immediate start$150k
...AI/ML Engineer Opportunity Founded in 2007 and headquartered in Columbia, Maryland, Synergy ECP is a leading provider of cybersecurity, software and systems engineering and IT services to the U.S. intelligence and defense communities. The company leverages its expertise...Work at officeFlexible hours$75.4k - $140k
...applies requirements to development code, integrating autonomy, AI or machine learning algorithms to LM products and platforms; Determines... ...human-machine interfacesBasic QualificationsSeeking an AIML1 Engineer, responsible for building, training, fine-tuning, and evaluating...Full timeTemporary workWork experience placementCasual workFlexible hours$166.9k - $309.9k
...applies requirements to development code, integrating autonomy, AI or machine learning algorithms to LM products and platforms;... ...substituted for a Master's degree. Demonstrated abilities in software engineering and AI/ML model test and evaluation. Desired SkillsPay...Full timeTemporary workWork experience placementCasual workFlexible hours$135.7k - $251.9k
...functionality in LM products and platforms; Translates requirements and applies requirements to development code, integrating autonomy, AI or machine learning algorithms to LM products and platforms; Determines software methods to best acquire and execute knowledge;...Full timeTemporary workWork experience placementCasual workFlexible hours$274k
Job Title Architect and implement agentic AI platforms, Model Context Protocol (MCP) servers, and scalable integration frameworks using Python and Kubernetes. Job Description Integrate large language models (LLMs) and enterprise APIs into backend services leveraging retrieval...$86.8k - $198k
...Job Number: R0234280 AI-Assisted Tooling Software Engineer, Senior The Opportunity: As an embedded sof tware engineer, you know how to create and maintain cru cia l pieces of sof tware. You use your knowledge to write and optimize code that creates a bridge between...Full timeContract workPart timeLocal areaRemote work$346k
...to be considered. Summary: Develop and integrate cutting-edge AI-enabled tooling and agentic harnesses for vulnerability research... ...document architectural decisions, and mentor junior and mid-level engineering staff. About SYSTOLIC: SYSTOLIC is dedicated to giving our...$170k - $230k
...security clearance is REQUIRED. Please do not apply if you currently do not possess this level of clearance.*** Are you an Senior AI/ML Engineer who is ready for a new challenge that will launch your career to the next level? Tired of being treated like a company drone?...16 hoursFull timeContract workRemote workWork from homeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Assurance Engineer. Be the first to apply!




