Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Software Engineer

$140.82k - $190.52k

Gdit

Type of Requisition:
Pipeline

Clearance Level Must Currently Possess:
Secret

Clearance Level Must Be Able to Obtain:
Top Secret

Public Trust/Other Required:
None

Job Family:
Data Science and Data Engineering

Job Qualifications:

Skills:
Agile Software Development, Back-End Development, Microservices Architecture
Certifications:
None
Experience:
7 + years of related experience
US Citizenship Required:
Yes

Job Description:

GDIT is seeking a highly motivated and experienced Senior AI Software Engineer to support the development, modernization, integration, and sustainment of our on-premises, AI-powered enterprise chatbot platform supporting the U.S. Department of State in Sterling, VA.

The selected candidate will design, develop, and integrate software solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), vector databases, document processing technologies, and modern AI inference frameworks.

This role requires a strong foundation in software engineering, Python development, API integration, containerization, and AI application architecture. The engineer will help transition existing AI services toward a scalable, containerized architecture while introducing new capabilities that enhance system performance, reliability, security, and user experience.

The ideal candidate is a hands-on software engineer who can work across the AI application stack, from backend development and model serving integration to data processing, automated testing, and deployment.

The individual will collaborate with AI/ML engineers, data engineers, infrastructure specialists, cybersecurity teams, and government stakeholders to deliver secure, reliable AI capabilities in highly controlled, classified, and air-gapped environments.

Key Responsibilities

1. AI Application Development & Integration
  • Design, develop, test, and maintain Python-based applications, microservices, and APIs supporting an on prem chatbot.
  • Extend, configure, and integrate OpenWebUI with enterprise AI services and backend systems.
  • Develop custom OpenWebUI Functions, Tools, and integrations to support mission-specific use cases.
  • Integrate approved LLMs into chatbot using OpenAI-compatible APIs and inference frameworks such as vLLM and Ollama.
  • Develop reusable software components for AI model access, prompt management, response processing, and application workflows.
  • Collaborate with AI/ML engineers to improve model inference performance, response quality, and application reliability.
  • Support multimodal AI use cases, including document understanding, optical character recognition, and vision-language model integration.
  • Develop backend capabilities to support secure enterprise AI workflows.
2. Retrieval-Augmented Generation (RAG) & Document Processing
  • Design, implement, and optimize RAG workflows for enterprise document search and question answering.
  • Integrate document processing technologies such as Docling, Tesseract, and vision-language models into automated ingestion pipelines.
  • Develop document chunking, metadata extraction, embedding generation, and retrieval workflows.
  • Integrate embedding models and reranking models to improve retrieval accuracy and relevance.
  • Work with PostgreSQL and pgvector to support vector search, semantic retrieval, and document indexing.
  • Develop APIs and background processing services for document ingestion and knowledge base management.
  • Collaborate with data engineers to ensure accurate storage, indexing, and retrieval of enterprise information.
  • Implement testing and evaluation approaches to measure RAG accuracy, retrieval relevance, and answer quality.
3. AI Model Serving & Inference Integration
  • Integrate and maintain AI inference services using vLLM, Ollama, and compatible model-serving frameworks.
  • Support the deployment and configuration of approved open-weight LLMs, embedding models, rerankers, and vision-language models.
  • Develop software integrations using OpenAI-compatible REST APIs.
  • Assist in optimizing inference configurations, including context length, GPU memory utilization, concurrency, and model serving performance.
  • Support the transition from existing inference frameworks to improved architectures as technologies mature.
  • Collaborate with AI/ML engineers to troubleshoot inference errors, model loading issues, and integration failures.
  • Develop benchmarking and performance-testing utilities for AI workloads.
4. Containerization & Platform Modernization
  • Support the migration of DS Chat components from traditional deployments into containerized services.
  • Develop, configure, and maintain container images using Podman or Docker.
  • Create and maintain Podman Compose configurations defining application services, networking, volumes, and environment variables.
  • Integrate services such as OpenWebUI, vLLM, Docling, PostgreSQL, pgvector, PgBouncer, and Redis.
  • Develop scripts and automation for repeatable installation, deployment, upgrades, and recovery.
  • Implement health checks, readiness checks, logging, and service dependency management.
  • Troubleshoot container networking, authentication, storage, GPU access, and service connectivity.
  • Collaborate with infrastructure and cybersecurity teams to improve deployment consistency and security.
5. Agentic AI & Future Capabilities
  • Research, prototype, and develop agentic AI capabilities for future DS Chat releases.
  • Implement controlled tool-calling and multi-step AI workflows.
  • Develop integrations that allow approved AI models to interact with authorized enterprise APIs and services.
  • Explore emerging technologies involving AI orchestration, workflow automation, and Model Context Protocol (MCP).
  • Design secure execution boundaries, permissions, audit logging, and approval mechanisms for AI-driven actions.
  • Collaborate with stakeholders to evaluate new AI capabilities for mission relevance, security, and operational feasibility.
  • Implement safeguards to support human oversight and prevent unauthorized actions by AI-enabled systems.
6. Software Engineering, Testing & DevSecOps
  • Apply software engineering best practices, including modular architecture, code reviews, documentation, and version control.
  • Develop automated unit, integration, regression, and performance tests using frameworks such as pytest.
  • Build integration tests validating communication between OpenWebUI, inference services, document processing components, and databases.
  • Support CI/CD processes appropriate for disconnected and classified environments.
  • Troubleshoot production issues through application logs, metrics, traces, and system diagnostics.
  • Integrate operational logging and monitoring capabilities with tools such as Splunk.
  • Assist with vulnerability remediation, dependency management, software supply chain reviews, and container security assessments.
  • Produce technical documentation, deployment procedures, architecture diagrams, and operational runbooks.
  • Participate in Agile development activities, including sprint planning, technical design reviews, and demonstrations.
7. Security & Classified Environment Support
  • Design software solutions suitable for secure, on-premises, air-gapped government environments.
  • Implement secure authentication integration, role-based access controls, API authorization, and data protection measures.
  • Ensure AI services communicate only through authorized internal network paths.
  • Support software packaging and offline deployment using preapproved dependencies, container images, and model artifacts.
  • Collaborate with cybersecurity personnel to address security findings and support Risk Management Framework (RMF) activities.
  • Assist with technical documentation and evidence required for TRB/CCB reviews and Authority to Operate (ATO) processes.
  • Follow approved procedures for handling sensitive and classified information.
Required Qualifications
  • Minimum Secret Clearance, no sponsorship
  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Computer Engineering, or a related technical field, or equivalent practical experience.
  • 5+ years of professional software engineering experience, including backend application development.
  • Strong proficiency in Python and experience developing production-quality software.
  • Experience developing RESTful APIs and integrating distributed application services.
  • Hands-on experience integrating LLMs or generative AI capabilities into software applications.
  • Understanding of transformer-based models, inference APIs, prompt engineering, and LLM application development.
  • Experience with RAG concepts, including document ingestion, embeddings, vector search, and retrieval pipelines.
  • Experience working with relational databases such as PostgreSQL.
  • Familiarity with container technologies such as Podman or Docker.
  • Experience with Linux-based development and application deployment.
  • Proficiency with Git, automated testing, debugging, and software development best practices.
  • Experience troubleshooting applications across multiple interconnected services.
  • Strong analytical, problem-solving, communication, and technical documentation skills.
  • Ability to work effectively with cross-functional teams and government stakeholders.
Preferred Qualifications
  • Experience with OpenWebUI, including configuration, integration, custom Functions, Tools, or application extensions.
  • Hands-on experience with vLLM, Ollama, Hugging Face Transformers, or other LLM inference technologies.
  • Experience serving or integrating open-weight LLMs in on-premises environments.
  • Experience with NVIDIA GPUs, CUDA, GPU memory management, and AI inference optimization.
  • Experience with PostgreSQL pgvector, vector similarity search, and semantic retrieval.
  • Familiarity with embedding models, rerankers, and cross-encoder architectures.
  • Experience with Docling, Tesseract, or document intelligence technologies.
  • Experience implementing production RAG pipelines and evaluation frameworks.
  • Familiarity with agentic AI frameworks, tool calling, and Model Context Protocol (MCP).
  • Experience developing or maintaining containerized microservice architectures.
  • Familiarity with Redis, PgBouncer, and asynchronous background processing.
  • Experience with Red Hat Enterprise Linux and Windows Server.
  • Experience with FastAPI, Pydantic, pytest, and related Python technologies.
  • Experience using Splunk for application monitoring and troubleshooting.
  • Familiarity with software supply chain security, vulnerability scanning, and container hardening.
  • Experience supporting federal government systems, classified networks, or air-gapped deployments.
  • Knowledge of federal cybersecurity requirements, RMF, and ATO processes.

The likely salary range for this position is $140,821 - $190,523. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours:
40

Travel Required:
Less than 10%

Telecommuting Options:
Onsite

Work Location:
USA VA Sterling

Additional Work Locations:

Total Rewards at GDIT:
Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

Our Identity Verification Process:
As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work:
We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at
gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Software Engineer in Sterling, VA vacancy
  • $96.25k - $158.13k

     ...design, build, and deployment of autonomous AI agents and securely grounded RAG...  ...time inference Drive alignment of AI engineering deliverables with departmental OKRs and operational...  ...experience in AI/ML engineering, cloud software development, or a related role... 
    Senior
    Software
    Local area
    Flexible hours

    EchoStar

    Herndon, VA
    9 days ago
  •  ...must also be eligible to obtain a Public Trust clearance. Senior AI Engineer/Data Scientist – AI Business Pilots POSITION SUMMARY:...  ...Experience • 10+ years of experience in data science, software engineering, AI engineering, advanced analytics, or related... 
    Senior
    Software

    Ampcus Inc

    Chantilly, Fairfax County, VA
    15 days ago
  •  ...Senior Agentic AI Engineer We are seeking a highly skilled Senior Agentic AI Engineer to design, develop, and deploy modern Agentic AI solutions...  ...Microsoft Azure. You will collaborate with architects, software engineers, data engineers, and business stakeholders to... 
    Senior
    Software

    NESC Staffing Corp.

    Reston, VA
    4 days ago
  •  ...Artificial Intelligence/Machine Learning Systems Engineer to join our team of professionals...  ...and capabilities:Evaluation of advanced AI/ML concepts, systems, technologies, designs...  ...to space systemsKubernetes and/or software containerizationSoftware system engineering... 
    Senior
    Software
    Work experience placement
    Work at office

    Science Applications International Corporation

    Chantilly, Loudoun County, VA
    2 days ago
  •  ...mission support. Its capabilities include data science, software development, network engineering, intelligence, surveillance, and reconnaissance (ISR), and...  ...is contingent upon contract award*SOSi is seeking a AI/ML Engineer to support our government customer in Chantilly... 
    Senior
    Software
    Contract work
    Work at office

    SOSi

    Chantilly, Fairfax County, VA
    2 days ago
  •  ...Senior Developer - Python / AWS Workflow Automation About the Role We are seeking a skilled and motivated Senior Developer to join our...  ...and automation. Required Skills & Experience • 7+ years of software development experience with a strong focus on Python (Java experience... 
    Senior
    Software
    Long term contract
    3 days per week

    3B Staffing LLC

    Herndon, VA
    5 days ago
  • $50 per hour

     ...Translates requirements and applies requirements to development code, integrating autonomy, AI or machine learning algorithms to LM products and platforms; Determines software methods to best acquire and execute knowledge; Implements algorithms into software to train systems... 
    Senior
    Software
    Full time
    Temporary work
    Work experience placement
    Casual work
    Flexible hours

    Lockheed Martin

    Herndon, VA
    3 days ago
  • $142.5k - $237.5k

     ...Your Privacy Choices Team Overview The AI Engineering and Platforms team designs, builds, and...  ...AI platforms and AI-enabled solutions. The Senior Architect, AI Engineering and Platforms will report to Director for Software Development and is a highly technical,... 
    Senior
    Software
    Full time
    Temporary work
    Work experience placement
    Work at office
    Flexible hours
    2 days per week

    Trans Union LLC

    Reston, VA
    1 day ago
  •  ...Award Winning Digital Services Firm in Ashburn, Virginia(1 day on-site a week) is hiring a senior software engineer for its elite applications team. This person will work on a large scale, data-driven microservices modernization venture utilizing: Java21, Spring Boot,... 
    Senior
    Software
    Full time
    Work experience placement
    1 day per week

    Stem IT

    Ashburn, VA
    13 days ago
  • $120k - $160k

     ...Sterling, VA, US Date Posted: 2026-09-22 Category: Software Subcategory: DevSecOps Schedule: Full-Time...  ...SAIC is seeking a highly skilled and versatile Senior SecDevOps & Systems Engineer with strong full-stack development capabilities to join... 
    Senior
    Software
    Full time
    Remote work
    Shift work
    2 days per week

    SAIC

    Sterling, VA
    2 days ago
  •  ..., safer and more secure. TestPros is seeking a  Senior Artificial Intelligence (AI) System Test Engineer with an analytical, customer-focused mindset and experience...  ...Type: Part-time consulting Overview Focus: Software test end evaluation Regulatory Basis: OWASP AI... 
    Senior
    Software
    Remote job
    Contract work
    Part time
    For contractors
    Work experience placement
    Local area
    Immediate start

    TestPros

    Sterling, VA
    1 day ago
  • $143.49k - $197.29k

    The Senior AI/ML Engineer is a highly skilled and experienced professional responsible for leading the development of complex AI/ML systems,...  ...sensor fusion.Familiarity with Agile/DevOps methodologies for software development.Certifications in AI/ML or related fields, such... 
    Senior
    Software
    Full time
    Work experience placement
    Work at office

    Sierra Nevada Corporation

    Herndon, VA
    5 days ago
  •  ...Job Description Job Description TITLE: Senior DevSecOps Engineer LOCATION: Sterling, VA (Relocation assistance considered) CLEARANCE...  ...engineers and cybersecurity professionals to accelerate software delivery and keep critical capabilities mission-ready.... 
    Senior
    Software
    Full time
    Relocation package

    Modern Government Solutions

    Sterling, VA
    a month ago
  • $140k - $180k

     ...Ashburn, VA, US Date Posted: 2026-11-10 Category: Software Subcategory: SW Engineer Schedule: Full-Time Shift: Day Job Travel: No...  ...motivated, career and customer oriented, and hands on senior-level Java Backend Developer with cloud experience to... 
    Senior
    Software
    Full time
    Remote work
    Shift work
    2 days per week

    SAIC

    Ashburn, VA
    2 days ago
  • $75k - $155k

     ...Job Description Job Description Description: CMS is currently seeking Senior Software Engineers in support of a multi-year modernization effort for a customer based in Ashburn, VA. The Senior Software Engineer must be able to design, develop, enhance, debug, and implement... 
    Senior
    Software
    Work experience placement

    C. Mack Solutions, LLC

    Ashburn, VA
    25 days ago
  • $80k - $120k

     ...Responsibilities: Employ participatory design, creative brainstorming, and other techniques to collaborate with software developers, systems engineers and other product team members as part of an agile software development team. Ensure quality product and timely... 
    Senior
    Software
    Full time
    Remote work
    Shift work
    2 days per week

    SAIC

    Ashburn, VA
    1 day ago
  • $80k - $120k

     ...SAIC is seeking a highly skilled and experienced Senior DevOps Engineer with a strong focus on DevOps methodologies to join our IT...  ...reliability. This role requires a deep understanding of both software development and IT operations, aiming to bridge gaps between... 
    Senior
    Software
    Full time
    Remote work
    Shift work
    2 days per week

    SAIC

    Sterling, VA
    1 day ago
  • $140k - $180k

     ...Ashburn, VA, US Date Posted: 2026-11-10 Category: Software Subcategory: SW Engineer Schedule: Full-Time Shift: Day Job Travel: No...  ..., career and customer-oriented Java/JEE Developer (Senior) to begin an exciting and challenging career with our large... 
    Senior
    Software
    Full time
    Remote work
    Shift work
    2 days per week

    SAIC

    Ashburn, VA
    2 days ago
  • $107.9k - $195.05k

     ...sophisticated systems and data more effectively. As a Sr. UI/IX Engineer, you will play a critical role at the intersection of user...  ...engineering, design, and mission needs. You’ll work alongside talented software engineers, systems engineers, product owners, testers, and... 
    Senior
    Software
    Contract work
    Local area
    Immediate start

    Leidos

    Herndon, VA
    3 days ago
  • $120k - $160k

     ...Ashburn, VA, US Date Posted: 2026-10-06 Category: Software Subcategory: SW Engineer Schedule: Full-Time Shift: Day Job Travel: No...  ...Working closely with the tech lead and senior developers, the developer will participate in the system... 
    Senior
    Software
    Full time
    Remote work
    Shift work

    SAIC

    Ashburn, VA
    4 days ago
  •  ...Onsite in Herndon, VA Our client seeks a Senior Configuration Management Engineer to lead and mature CM practices for a globally distributed mission...  ...Define and maintain configuration baselines for hardware, software, firmware, cloud resources, and documentation across... 
    Senior
    Software
    Permanent employment
    Full time
    Immediate start

    Eliassen Group

    Herndon, VA
    a month ago
  • $39.4k - $75.9k

    Job Title: AI Prompt Engineer High School Intern - Summer 2027 Job Category: Intern/Co-op Time...  .... You'll work alongside experienced software delivery personnel and mentors who will...  ...Currently enrolled in high school (senior year) and on track to graduate by June... 
    Software
    Full time
    Contract work
    Part time
    Work experience placement
    Summer work
    Internship
    Flexible hours

    CACI International, Inc.

    Ashburn, VA
    3 days ago
  •  ...seeks a motivated, career- and customer-oriented Senior Full Stack Developer to join our AI innovation team in Ashburn, VA . This is currently...  ...for the frontend. Contribute to all phases of the software engineering lifecycle (SELC), including requirements gathering,... 
    Senior
    Software
    Work at office
    Local area
    2 days per week
    3 days per week

    ManTech

    Ashburn, VA
    2 days ago
  •  ...Senior DevOps EngineerREI Systems is seeking a Senior DevOps Engineer to lead the design, implementation, automation, and operation of enterprise-scale cloud environments and software delivery platforms supporting mission-critical federal applications.This individual will... 
    Senior
    Software
    2 days per week

    REI Systems

    Sterling, VA
    5 days ago
  •  ...Job Description Job Description Senior AI/ML Engineer Location: Herndon, VA (Hybrid Work) Preferred: US Citizenship Node.Digital is an innovative solutions development company that combines agile development services with next-generation technologies in... 
    Senior
    Remote work

    Node.Digital

    Herndon, VA
    5 days ago
  •  ...Senior Foundry Developer Location: Ashburn, VA Work Type :...  ...growth objectives through Agile software development. You will work in...  ...Python and PySpark for data engineering workflows. Proficiency with...  ...365 (A365). Azure Data/AI stack familiarity (Azure Databricks... 
    Senior
    Software
    Full time
    Part time
    Remote work

    Gridiron IT

    Ashburn, VA
    11 days ago
  • $113.2k - $237.8k

    Job Title: Senior Data Scientist / AI Machine Learning Research Engineer Job Category: Science Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Continental US... 
    Senior
    Full time
    Contract work
    Work experience placement
    Flexible hours

    CACI International, Inc.

    Sterling, VA
    4 days ago
  • $135k - $216k

    ResponsibilitiesPeraton is seeking an experienced Senior Network Engineer specializing in Software Defined Wide Area Networking (SD WAN) to support enterprise network infrastructure and modernization initiatives. This individual will serve as a subject matter expert (SME... 
    Senior
    Software
    Full time
    Contract work
    Shift work

    Peraton Corporation

    Ashburn, VA
    4 days ago
  • $122k - $253k

     ...surveillance, data intelligence, lifecycle mission enablement, and software modernization. Nightwing brings disruptive technologies,...  ..., civil, and commercial markets.We’re seeking a skilled Senior Network Engineer to support implementation and sustainment of enterprise... 
    Senior
    Software
    Full time

    Nightwing

    Sterling, VA
    4 days ago
  •  ...understands what's happening on Earth. We are an AI-native, agentic intelligence platform...  ...incremental AI – this is intelligence engineered for global impact. Responsibilities...  ...Design, develop, and deploy AI-native software products that transform large-scale geospatial... 
    Software
    Permanent employment
    Remote work

    Maxar by Vantor

    Herndon, VA
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Software Engineer. Be the first to apply!