Senior AI Infrastructure Engineer
Seekr
Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI agents.
You will work across distributed systems, Kubernetes, GPU infrastructure, high-performance inference, and enterprise AI platforms to build secure, scalable, and highly reliable systems capable of serving workloads ranging from edge AI deployments to trillion-parameter foundation models.
This role requires deep expertise in distributed systems, cloud-native infrastructure, AI platform engineering, and production software development. You will collaborate with research scientists, software engineers, product teams, and infrastructure engineers to define the architecture and technical direction of Seekr’s AI platform.
Duties and Responsibilities
- Design, develop, deploy, and maintain production AI infrastructure supporting model training, fine-tuning, inference, evaluation, and agentic AI workloads.
- Design and operate scalable Kubernetes-based infrastructure supporting GPU-accelerated workloads across cloud, on-premises, hybrid, and edge environments.
- Architect and optimize high-performance inference platforms capable of serving models ranging from resource-constrained edge deployments to trillion-parameter foundation models, with a focus on latency, throughput, scalability, reliability, and cost efficiency.
- Build and maintain distributed systems that enable reliable scheduling, orchestration, deployment, monitoring, and lifecycle management of AI workloads.
- Develop enterprise platforms supporting autonomous and multi-agent AI systems, including secure tool execution, orchestration, memory, evaluation, governance, and observability.
- Design, implement, and automate AI infrastructure using Infrastructure-as-Code, GitOps, CI/CD pipelines, and modern software engineering practices.
- Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware accelerators, and cloud-native platforms to improve platform performance, scalability, and reliability.
- Collaborate with engineering, research, product, and cross-functional teams to deliver secure, scalable, and production-ready AI platforms.
- Lead technical design discussions, perform architecture reviews, mentor engineers, and establish engineering standards and best practices across the AI Infrastructure organization.
- Participate in production support activities, including troubleshooting complex distributed systems, performance tuning, incident response, and continuous operational improvement.
Skills and Qualifications
- 5–8 years of professional software engineering experience building distributed systems, cloud infrastructure, or large-scale platform services
- Strong production ML infra experience, executes complex work independently, owns significant components
- 4 year or higher degree or additional relevant experience, in addition to years of work experience
- Demonstrated success designing and operating production Kubernetes environments supporting cloud-native applications and distributed services.
- Strong software engineering skills using Python and one or more modern programming languages such as Go, Rust, or C++.
- Proven ability to design, build, and operate production AI or machine learning infrastructure.
- Expertise developing and optimizing large-scale AI inference platforms, including GPU utilization, distributed inference, batching, caching, quantization, and accelerator performance.
- Familiarity with modern AI serving technologies such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar platforms.
- Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure automation using technologies such as Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, and Infrastructure-as-Code tools.
- Experience developing enterprise AI platforms, autonomous agents, or multi-agent systems, including orchestration, tool execution, governance, observability, and evaluation.
- Familiarity with event-driven architectures, distributed messaging systems, and public cloud platforms including AWS, Azure, Oracle Cloud Infrastructure, or Google Cloud Platform.
- Demonstrated technical leadership, including driving architectural decisions, mentoring engineers, and leading complex technical initiatives across cross-functional teams.
- Demonstrated ability to analyze, profile, and optimize AI systems for performance, scalability, reliability, and cost across distributed compute environments.
About the Company
Seekr is a leader in explainable and trustworthy artificial intelligence designed to power mission-critical decisions in enterprises, government, and regulated industries. SeekrFlow™, our end-to-end AI platform, provides secure, auditable AI solutions tailored to sectors where transparency, accuracy, and compliance are paramount. Available across cloud, on-premises, and edge environments, SeekrFlow reduces bias, strengthens data integrity, and simplifies model oversight so organizations can rely on trusted AI decisions in high-stakes settings that impact society’s most sensitive and vital systems. Trusted by leading enterprises and government agencies, we partner with defense, finance, telecom, and critical infrastructure leaders to enable AI solutions that drive real-world results with unmatched transparency and control. We are a team of strategic thinkers and problem-solvers tackling the toughest challenges facing critical infrastructure and global enterprises through best-in‑class AI models and customer deployment.
- We are driven by outcomes—our customers' success is what we strive for every day.
- We believe trust is earned, which is why we build explainability and transparency into the entire AI lifecycle.
- We take our responsibility to deliver secure AI seriously.
- We believe innovation drives progress—we are building the technologies that power the systems our society depends on.
Company Benefits
- Meaningful Mission & Impact - Work with a deeply talented, collaborative team solving some of the toughest AI challenges that matter.
- Equity Ownership – RSUs that let you share directly in Seekr’s long‑term success and growth.
- Time Off That Respects Real Life – Unlimited PTO plus 14 paid company holidays to truly recharge.
- Work Your Way – A flexible hybrid work environment with offices in Reston, VA and Austin, TX.
- Competitive Total Rewards – A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role.
- 401(k) with Company Match – Build your future with a retirement plan that includes employer matching.
- Comprehensive Health & Wellness – Medical, dental, vision, and life insurance coverage starting day one—for you and your family.
- Parental Leave – Paid parental leave to support employees as they welcome a new child through birth, adoption, or foster placement.
Important Notice
To conform to U.S. Government international trade regulations, applicant must be a U.S. Citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State or U.S. Department of Commerce.
Seekr is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other characteristic protected by applicable law.
#J-18808-Ljbffr$184k - $287.5k
AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical...SeniorFull timeRemote work- ...complex problems in distributed systems, networking, multi-tenant Infrastructure-as-a-Service (IaaS), and Software Defined Networking (SDN)... ...networking, needs to have good leadership skills and can influence senior leadership in a positive way to make the business successful....Senior
$126.2k - $264.1k
...systems, networking, multi-tenant Infrastructure-as-a-Service (IaaS), and... ...leadership skills and can influence senior leadership in a positive way... ...life-saving care. And with AI embedded across our products... ...Science, Electrical/Hardware Engineering or related field.Ability to...SeniorTemporary workFlexible hours$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research... ...an AI infrastructure software engineer to join our team. You'll be instrumental... ...availability of AI systems.As a senior DGX Cloud AI Infrastructure...SeniorFull timeRemote work- ...software solutions harness the power of AI and shape the future of digitalization.We... ...’ll help build the data, platform, and infrastructure capabilities that support reliable AI-powered... ...data sources.Collaborate with AI engineers, software engineers, product, security,...SeniorTemporary workCasual workWorldwide
- Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large‑scale training, serving, evaluation, and deployment of foundation models and...Senior
- Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure. Bitdeer is committed to providing... ...more, visit Position Overview We are seeking a Senior AI Storage Infrastructure Engineer to build the critical data-delivery fabric of our...SeniorLocal area
$112.8k - $153.7k
...willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and... ..., Databricks) and own BI delivery infrastructure (e.g., Power BI, Tableau). You set the... ...Databricks, etc.) are a plus.Hands-on AI/ML/GenAI enablement experience (model...SeniorFull timeContract workLocal areaFlexible hours$70 - $74 per hour
...Description: Our client is currently seeking a Systems Engineer - Senior / AI Platform Engineer Work Location: Austin, TX (Hybrid: 4... ...using languages such as Python, PowerShell, or similar for infrastructure management, system integration, and process automation....SeniorHourly payRemote work- CrowdStrike is seeking a Sr. AI Growth Engineer to architect and build the infrastructure behind our agentic marketing platform. You’ll own integrations, orchestration, UIs, and tooling used by marketing teams across CrowdStrike. You will work with leadership to ship features...SeniorRemote job
- Cloudflare is seeking a highly autonomous systems engineer to design and build the core infrastructure powering AI inference across our global network. You will work with AI/ML engineers, hardware partners, and product teams to tackle sub-second model cold starts, multi...Senior
- Aravo Solutions, Inc. seeks a Senior Software Engineer to design and build our AI agent platform, including autonomous agents, retrieval-augmented generation systems, and GPU-based model deployment in production. You will collaborate with Product Management, DevOps, and...Senior
- TeamViewer is seeking a senior security leader to own the security architecture of our AI platform in Austin, TX. You will drive security strategies across agent-... ...strengthen defenses while partnering with product and engineering teams. The role requires 7+ years in product or...Senior
- RealPage, Inc. is seeking a Senior Agentic AI Platform Engineer to help build the shared foundation for production-grade AI agents across product teams. You’ll work in an AI Platform pod, focusing on agent orchestration or runtime, delivering reliable platform services...SeniorRemote job
- RWE Americas, LLC is seeking a Principal AI Engineer to lead platform-level AI capabilities, setting engineering patterns and reference implementations used across squads and business units. You will own the technical design, build, and operation of shared AI services aligned...Senior
- Gyde is building the first AI-native insurance brokerage platform. You will lead development of AI-driven voice, chat, and analytics applications, aligning with the CTO/COO on workflows and roadmap prioritization. You will collaborate across functions to deliver secure...SeniorRemote job
- PayPal is seeking a Senior Staff Product Security Engineer, AI Security, to protect hundreds of millions of accounts and trillions in annual volume. You will drive security across AI‑assisted development, AI‑enabled products, and vulnerability detection, partnering with...Senior
$172.8k - $359k
...working world. The opportunity We are seeking a senior leader for our AI Platform Engineering group, the team that builds and operates the... ...AI-native platform. This role is accountable for the infrastructure and cloud-native platform layers of our AI runtime,...SeniorContract workSummer holidayFlexible hours- NinjaOne is seeking a Senior Software Engineer to join the Application Security Engineering team in building an AI platform that discovers vulnerabilities in production code and proposes tested fixes. You will own software from design through production, working across...Senior
- NinjaOne is seeking a Senior Software Engineer to build an AI-based vulnerability platform, enabling discovery, validation, and fixes across our cloud and endpoint agents. You’ll own end-to-end development from design to production, tackling agent orchestration, secure...SeniorRemote work
- News Corp (Realtor.com) is seeking a senior AI security engineer to secure AI and agent platforms across AWS and GCP, focusing on guardrails, containment, supply chain integrity, detection and response, and threat modeling. You will educate teams and lead AI security strategy...Senior
$105.4k - $207.8k
Position Summary Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build, and secure next-generation AI-enabled... ..., containers, serverless workloads, Kubernetes, and infrastructure-as-code controlsBuilding AI-assisted capabilities to identify...SeniorWork experience placementLocal areaVisa sponsorship$178.4k - $267.6k
Company:Qualcomm Technologies, Inc.Job Area:Engineering Group, Engineering Group > Machine Learning EngineeringGeneral Summary:AI Performance Engineer (Cloud AI Engineering) Qualcomm is utilizing its traditional strengths in digital wireless technologies to play a central...SeniorWork experience placementWork from home- ...confidence through expert guidance.Realtor.com is looking for a Senior AI Platform Engineer to architect, build, and continuously improve the... ...our LLM gateway layer (leveraging Portkey or custom infrastructure) to centralize model access, routing, semantic caching,...SeniorWork at officeLocal area
- ...instinct to spot a "normalized" problem and the AI-native curiosity to create a solution... ...to build. About the Role As the Senior Manager of Solutions Architecture for the... ...gap between technical sales and product engineering, ensuring your team effectively acts as the...Senior
- Cloudflare is seeking a Senior Manager of Solutions Architecture for the AI & Developer Platform. You will lead a high‑performing technical team to demonstrate... .... You will bridge technical sales and product engineering, ensuring the team acts as a feedback loop for product...Senior
- We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered... ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),...Full timeWork experience placementLive inWork at officeLocal area
- ...Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure. Bitdeer is committed to providing comprehensive... ...We are seeking a highly skilled and motivated Cloud Senior DevOps Engineer to join our AI Cloud team. In this high-impact role,...SeniorRemote jobFull timeLocal area
- ...work work better. Our software solutions harness the power of AI and shape the future of digitalization.We believe that our diverse... ...and impactful customer-facing capabilities.Contribute to engineering best practices and leverage AI-assisted development tools to increase...SeniorTemporary workCasual workWorldwide
- ...and reliable technology products and services. As a Senior Manager, Software Development and Engineering within the thinkorswim Service Availability Engineering... ...that connect enterprise applications with Generative AI and large language model capabilities. In...SeniorFull timeWork experience placementWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infrastructure Engineer. Be the first to apply!
- machine learning ai engineer Austin, TX
- ai developer Austin, TX
- ai engineer remote Austin, TX
- ai ml engineer Austin, TX
- ai prompt engineer Austin, TX
- senior ai engineer Austin, TX
- ai engineer Austin, TX
- lead infrastructure engineer Austin, TX
- infrastructure developer Austin, TX
- infrastructure engineering manager Austin, TX


