AI Platform Engineer

AI Platform Engineer (LLM & MLOps)

MEANINGFUL WORK AND PERSONAL IMPACT

As an AI Platform Engineer (LLM & MLOps), the work you'll do at GDIT will be impactful to the mission of USCENTCOM. You will play a crucial role in the design, deploy, and operate secure, scalable AI inference and orchestration platforms supporting USCENTCOM's Data Analytical Environment (DAE) and AI environment. This role focuses on platform reliability, workflow stability, and operationalizing commercial LLMs in on-premises and hybrid environments.

The engineer will work with GPU-enabled Kubernetes clusters, model serving frameworks, vector databases, and secure APIs to enable Retrieval-Augmented Generation (RAG) and agent-based AI workflows. This position does not focus on model training or AI research; instead, it emphasizes execution, integration, and platform resilience. This role supports the evolution of enterprise AI capabilities from foundational platforms to reusable, governed agent-based services.

Duties and Responsibilities

• Design, deploy, and maintain GPU-enabled Kubernetes environments for AI inference and orchestration.
• Operationalize commercial LLM inference services using frameworks such as Text Generation Inference (TGI), KServe, FastChat, Triton, or similar.
• Integrate vector databases and knowledge repositories to support RAG and graph-augmented LLM workflows.
• Build and maintain secure REST APIs for AI job submission, inference requests, and workflow orchestration.
• Implement MLOps and platform lifecycle practices, including model versioning, containerization, CI/CD, and reproducibility.
• Enforce multi-tenant isolation, RBAC, namespace quotas, and resource controls across teams.
• Implement monitoring, logging, and alerting for AI services, GPU utilization, and workflow health.
• Support secure deployment in air-gapped, on-prem, and hybrid environments, adhering to DoW security requirements.
• Collaborate with platform, automation, and data teams to align AI capabilities with mission workflows.
• Support prompt, rule, and heuristic-based agents by ensuring reliable inference, retrieval, and context delivery.
• Maintain conversation-aware context pipelines used for tagging and classification agents.

WHAT YOU'LL NEED TO SUCCEED

Bring your expertise and drive for innovation to GDIT. The Data Engineer Principal must have:

• Education: Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent experience)

• Certification: DoW Directive 8140 compliant

• Experience: 8+ years of related experience

• Required Skills

  • Strong experience with Kubernetes, containerization (Docker/Podman), and GPU scheduling.

  • Hands-on experience deploying LLM inference services (commercial or open-source).

  • Proficiency with Python and API development for platform services.

  • Experience integrating vector databases (e.g., FAISS, Milvus, Weaviate, OpenSearch).

  • Familiarity with MLOps toolchains (MLflow, CI/CD pipelines, artifact registries).

  • Experience operating systems in secure DoW environments.

  • Knowledge of monitoring/logging stacks (Prometheus, Grafana, ELK/Loki).

• Desired Skills

  • Experience with RAG or agent-based AI architectures.

  • Familiarity with Kubernetes-native workflow engines (Argo, Kubeflow).

  • Exposure to cost tracking or usage metering for shared compute platforms.

  • Understanding of DoW AI governance, ethical AI, and responsible deployment.

• Security clearance level: Active Secret clearance required; TS/SCI preferred or eligible

• US citizenship required

GDIT IS YOUR PLACE

At GDIT, the mission is our purpose, and our people are at the center of everything we do.

• Growth: AI-powered career tool that identifies career steps and learning opportunities

• Support: An internal mobility team focused on helping you achieve your career goals

• Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay and paid time off

• Community: Award-winning culture of innovation and a military-friendly workplace

The likely salary range for this position is $127,500 - $172,500. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours: 40

Travel Required: Less than 10%

Telecommuting Options: Onsite

Work Location: USA FL MacDill AFB

Additional Work Locations: Total Rewards at GDIT

Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

Our Identity Verification Process:

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work:

We are GDIT. A global technology and professional services company that delivers consulting, technology and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50 countries worldwide, offering leading capabilities in digital modernization, AI/ML, Cloud, Cyber and application development. Together with our clients, we strive to create a safer, smarter world by harnessing the power of deep expertise and advanced technology.

Join our Talent Community to stay up to date on our career opportunities and events at

gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans