Senior AI Infrastructure Engineer
Seekr
Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large‑scale training, serving, evaluation, and deployment of foundation models and autonomous AI agents. You will work across distributed systems, Kubernetes, GPU infrastructure, high‑performance inference, and enterprise AI platforms to build secure, scalable, and highly reliable systems capable of serving workloads ranging from edge AI deployments to trillion‑parameter foundation models. This role requires deep expertise in distributed systems, cloud‑native infrastructure, AI platform engineering, and production software development. You will collaborate with research scientists, software engineers, product teams, and infrastructure engineers to define the architecture and technical direction of Seekr’s AI platform. Duties and Responsibilities Design, develop, deploy, and maintain production AI infrastructure supporting model training, fine‑tuning, inference, evaluation, and agentic AI workloads. Design and operate scalable Kubernetes‑based infrastructure supporting GPU‑accelerated workloads across cloud, on‑premises, hybrid, and edge environments. Architect and optimize high‑performance inference platforms capable of serving models ranging from resource‑constrained edge deployments to trillion‑parameter foundation models, with a focus on latency, throughput, scalability, reliability, and cost efficiency. Build and maintain distributed systems that enable reliable scheduling, orchestration, deployment, monitoring, and lifecycle management of AI workloads. Develop enterprise platforms supporting autonomous and multi‑agent AI systems, including secure tool execution, orchestration, memory, evaluation, governance, and observability. Design, implement, and automate AI infrastructure using Infrastructure‑as‑Code, GitOps, CI/CD pipelines, and modern software engineering practices. Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware accelerators, and cloud‑native platforms to improve platform performance, scalability, and reliability. Collaborate with engineering, research, product, and cross‑functional teams to deliver secure, scalable, and production‑ready AI platforms. Lead technical design discussions, perform architecture reviews, mentor engineers, and establish engineering standards and best practices across the AI Infrastructure organization. Participate in production support activities, including troubleshooting complex distributed systems, performance tuning, incident response, and continuous operational improvement. Skills and Qualifications 5–8 years of professional software engineering experience building distributed systems, cloud infrastructure, or large‑scale platform services Strong production ML infra experience, executes complex work independently, owns significant components 4 year or higher degree or additional relevant experience, in addition to years of work experience Demonstrated success designing and operating production Kubernetes environments supporting cloud‑native applications and distributed services. Strong software engineering skills using Python and one or more modern programming languages such as Go, Rust, or C++. Proven ability to design, build, and operate production AI or machine learning infrastructure. Expertise developing and optimizing large‑scale AI inference platforms, including GPU utilization, distributed inference, batching, caching, quantization, and accelerator performance. Familiarity with modern AI serving technologies such as vLLM, SGLang, TensorRT‑LLM, Triton Inference Server, Ray Serve, or similar platforms. Knowledge of distributed computing, networking, storage systems, cloud‑native architectures, and infrastructure automation using technologies such as Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, and Infrastructure‑as‑Code tools. Experience developing enterprise AI platforms, autonomous agents, or multi‑agent systems, including orchestration, tool execution, governance, observability, and evaluation. Familiarity with event‑driven architectures, distributed messaging systems, and public cloud platforms including AWS, Azure, Oracle Cloud Infrastructure, or Google Cloud Platform. Demonstrated technical leadership, including driving architectural decisions, mentoring engineers, and leading complex technical initiatives across cross‑functional teams. Demonstrated ability to analyze, profile, and optimize AI systems for performance, scalability, reliability, and cost across distributed compute environments. Company Benefits Meaningful Mission & Impact – Work with a deeply talented, collaborative team solving some of the toughest AI challenges that matter. Equity Ownership – RSUs that let you share directly in Seekr’s long‑term success and growth. Time Off That Respects Real Life – Unlimited PTO plus 14 paid company holidays to truly recharge. Work Your Way – A flexible hybrid work environment with offices in Reston, VA and Austin, TX. Competitive Total Rewards – A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role. 401(k) with Company Match – Build your future with a retirement plan that includes employer matching. Comprehensive Health & Wellness – Medical, dental, vision, and life insurance coverage starting day one—for you and your family. Parental Leave – Paid parental leave to support employees as they welcome a new child through birth, adoption, or foster placement. #J-18808-Ljbffr Seekr
- Belay Technologies, Inc. seeks a Senior Software Engineer in Laurel, Maryland to build next-generation AI infrastructure. This experienced engineer will design and optimize scalable components, lead AI service development, and ensure system reliability. Qualifications include...Senior
- Expression is seeking a Senior AI Platform Engineer to join their Product Team and contribute to the evolution of their Agentic AI platform. You will design scalable architectures for enterprise AI applications and lead production-grade LLM services, orchestration layers...Senior
- GEICO is seeking a Senior Staff Engineer to lead the design and delivery of large-scale, production-ready underwriting platforms powered by AI and LLM capabilities. You will architect secure, scalable services in a cloud-native environment across AWS/Azure/GCP and mentor...Senior
- Expression is seeking an experienced Senior AI Platform Engineer to evolve the Agentic AI platform for Federal Civilian and National Security... ...LLM services, and lead across product, security, and infrastructure teams. You will develop high-performance Python APIs with...SeniorRemote job
$131.3k - $237.35k
ChatGPT Jobs is looking for a Senior Software Engineer - AI-Enabled Platforms based in the National Capital Region. The role involves designing and implementing scalable systems, developing AI capabilities, and leading architecture decisions within an Agile environment....Senior- QuantumBlack, AI by McKinsey located in Washington, DC is seeking a Software/Platform Engineer to deploy and scale an advanced AI platform. You will ensure that AI capabilities are seamlessly integrated into real-world environments while collaborating with a global community...Senior
- A leading security solutions company is seeking a Senior Software Engineer to revolutionize offensive security through AI. The role involves developing innovative AI capabilities for vulnerability discovery and enhancing security workflows. Candidates should have over 5...SeniorRemote workFlexible hours1 day per week
- McKinsey & Company is seeking a Platform Engineer to deploy and scale advanced AI platforms. The role involves working on cloud infrastructures like AWS and Azure, and requires strong engineering fundamentals, particularly in Python and Kubernetes. As part of QuantumBlack...Senior
- ...motivated candidate to join our talented Team. Job Title: Senior AI Cloud Engineer Locations: Washington, DC Responsibilities Builds next-... ...and turn data into insights. Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics...SeniorWork experience placement
$113.2k - $237.8k
CACI International Inc is seeking an experienced AI/ML Engineer Level 3 to join their team in Suitland, MD. This role requires a strong background in AI/ML development, proficiency in designing scalable AI systems, and a solid understanding of cloud platforms such as Azure...Senior- A technology consulting firm is seeking a Senior AI Cloud Engineer in Washington, DC. The role involves building an AI & analytics framework, leveraging AWS services to address business challenges, and leading multi-functional teams. Candidates should have a bachelor’s...Senior
$165k - $180k
Karsun Solutions, LLC is seeking a highly skilled Sr. AI Data Engineer to design and maintain data platforms with a focus on Generative AI. This role requires expertise in Databricks and experience operationalizing MLOps. The ideal candidate will work directly with AI/...Senior- The Carlyle Group is seeking a Data & AI Engineer to build and operate enterprise-scale data pipelines, semantic models, and AI-ready data products. You will work under the Senior AI & Data Architect to deliver production-ready pipelines that power analytics, automation...Senior
- Cicero™, part of MGT, is seeking a Senior AI Developer in Washington, DC to join their AI Operating Group. This hands-on role requires building production AI solutions, particularly with the Microsoft Azure AI stack. The ideal candidate will have over 5 years of software...Senior
- Booz Allen Hamilton seeks a senior Backend Infrastructure & Agentic AI Software Engineer for the GRACE team. You will own GRACE’s Azure-backed infrastructure, data layers, security, and observability while building agentic AI systems on top. You’ll ensure reliable, scalable...Senior
- Surge IT is seeking a hands-on Senior AI/ML Platform Engineer located in Alexandria, Virginia, with over 10 years of IT experience. The ideal candidate... ...with AWS, Kubernetes, and Terraform for scalable infrastructure. Candidates must have exceptional coding abilities in...Senior
- HackerOne is redefining how the world's leading organizations manage cyber risk with AI-powered platforms and a global security researcher community. As Senior Manager, AI Engineering, you will own two strategic surfaces—AI-Native Intelligence Dashboard and Payments &...SeniorWork at officeRemote work
- Expression is seeking an experienced Senior AI Platform Engineer to join our Product Team and contribute to the evolution of our Agentic AI... ...delivery of AI services. Collaborate with Product, UX, Infrastructure, Security, and other cross‑functional teams to continuously...SeniorFor contractorsWork at officeImmediate startRemote work
$155k - $185k
...providing technical guidance while mentoring junior specialists. Candidates should have a Bachelor's degree and extensive experience in AWS, AI/ML, and software deployment. The position offers a competitive salary between $155k and $185k along with excellent benefits including...SeniorRemote job- Saransh Inc is seeking a Sr Gen AI Engineer with expertise in Azure Cognitive Services. The role requires extensive experience in machine learning and data engineering, aiming to design and deploy AI solutions on Microsoft Azure. This position is onsite from day one in...Senior
$229.9k - $262.4k
Capital One is seeking a Sr. Lead AI Engineer in McLean, VA, to develop AI-powered products and optimize large scale AI systems. The ideal candidate has a strong background in AI and ML algorithms, programming skills in Python or similar languages, and experience with cloud...Senior$70.5k - $203.4k
Accenture in Washington, DC is looking for a Senior SAP AI Developer to design, develop, and deploy advanced AI-driven solutions within the SAP ecosystem. The role involves integrating SAP AI Core and GenAI Hub to enhance decision-making and business processes. Candidates...Senior- Capital One is seeking a Senior Lead AI Engineer to drive AI-powered products and scalable AI infrastructure. You will collaborate with engineers, scientists, PMs, and other stakeholders to design and deploy foundation models, inference pipelines, and governance frameworks...Senior
$229.9k - $262.4k
A major banking institution is seeking a Senior Lead AI Engineer to develop and optimize AI systems. This role involves collaboration with engineers and product managers to create AI products and improve operational efficiencies. The ideal candidate will have extensive...Senior- Capital One is seeking a Senior Lead AI Engineer to spearhead the development of AI-powered products that enhance customer interactions and internal operations. This role involves collaboration with a diverse team of engineers and scientists to build scalable, responsible...SeniorVisa sponsorship
- Capital One is seeking a Senior Manager, AI Engineering in McLean, VA. In this role, you will lead AI product initiatives and collaborate with diverse teams to innovate AI solutions that enhance customer experiences. The ideal candidate should have a strong background...Senior
- EY-Parthenon is seeking an AI ML Engineering Senior Associate/Consultant to build core advanced analytics platforms and drive high-visibility client projects. This role involves collaborating with key business leaders to refine technical solutions for machine learning...SeniorFlexible hours
- Ernst & Young Oman is seeking an AI ML Engineering Director to drive innovative growth strategies. In this role, you will partner with business leaders and employ your expertise to develop advanced analytics and machine learning solutions, crucial for high-visibility engagements...SeniorWork experience placement
$229.9k - $262.4k
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...SeniorFull timePart timeLocal area- ...digital transformation, specializing in AI/ML technology to empower government agencies... ...to join our team as a Software Engineer. At Credence, we offer an exciting opportunity... ...iterative delivery environment? We are seeking Senior Full Stack Software Engineers who are...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infrastructure Engineer. Be the first to apply!
- ai engineer Washington DC
- ai ml engineer Washington DC
- senior ai engineer Washington DC
- machine learning ai engineer Washington DC
- ai developer Washington DC
- ai prompt engineer Washington DC
- ai engineer remote Washington DC
- principal infrastructure engineer Washington DC
- infrastructure engineering manager Washington DC
- infrastructure automation engineer Washington DC
