AI Implementation Engineer - JobID-0245

About The Role Innovative Defense Technologies (IDT), a leading defense technology company, is seeking an AI Implementation Engineer to be part of our Warfare Systems team and based out of our Arlington, VA or Mount Laurel, NJ location. The AI Implementation Engineer will design and deliver engineering-focused AI solutions that move beyond demos into reliable, mission-relevant systems. This role is ideal for an engineer who has extensive experience with commercially available AI tooling/chat, hosting LLM servers and has demonstrated ability to build end-to-end capabilities including MCP integrations, RAG pipelines, tool-using agents, and production-grade AI workflows. Clearance & Location Requirements All applicants must be able to obtain/maintain an active Secret U.S. Security Clearance. This is an on-site position requiring at least 3 days in office, based out of Arlington, VA or Mount Laurel, NJ. Job Details Department: Engineering Employment Type: Full Time Location: Mount Laurel, NJ (also Arlington, VA option) Workplace Type: Hybrid (minimum 3 on-site days) Compensation: $114,000–$231,000 per year Responsibilities Design and build AI solutions for on-prem, air-gapped systems. Integrate models and tools across LLMs, APIs, data sources, and Model Context Protocol interfaces. Develop Retrieval-Augmented Generation pipelines to connect models to live knowledge sources. Engineer conversational and agentic interfaces with memory and contextual awareness. Implement and evaluate AI workflows, run experiments, and iterate on prompts and system performance. Architect local infrastructure, size and optimize CPU/GPU workloads, and apply quantization techniques. Orchestrate disconnected environments, design offline model update pipelines and local package mirrors. Scope and define technical requirements from project artifacts and stakeholders. Collaborate across teams and participate in technical reviews and design discussions. Support technical quality through testing, debugging, and performance optimization of AI-enabled applications. Stay current on advances in LLMs, agent frameworks, and AI engineering practices. Communicate technical work by documenting architectures, workflows, and implementation decisions. Qualifications Bachelor’s Degree in Information Technology, Computer Science, Engineering, Physics, Math, or equivalent; Master’s Degree desired. 5–10+ years of experience in software engineering, machine learning engineering, or AI engineering. Proficiency in Python and libraries such as NumPy, Pandas. Hands‑on experience with production local inference engines (vLLM, SGLang, Triton Inference Server, TensorRT‑LLM). Experience building software with AI/ML frameworks (PyTorch, TensorFlow, LangChain, LangGraph, Semantic Kernel, AutoGen). Experience with Linux hardening, commercial AI tooling/chat, hosting LLM servers and different models. Experience with distributed networking, containerization, and model optimization (quantization, VRAM, parallelism). Strong documentation, leadership, and communication skills. Ability to work independently and shift between projects in an agile environment. Travel up to 10% of the time. Preferred Experience Hosting LLM servers on local hardware. Experience with NVIDIA GPU architectures. Experience with AI gateways, LLM tool‑calling, RAG, vector stores, and Model Context Protocol. Experience with container orchestration and personnel management. Benefits Generous benefits package. Competitive PTO and paid holidays. 401(k) with immediate vesting and matching. Optional 9/80 schedule. Tuition assistance and professional development resources. Pre‑tax commuter benefits and monthly tech connect events. Annual employee recognition awards and social events. EEO Statement IDT is an Equal Opportunity employer. #J-18808-Ljbffr Innovative Defense Technologies