AI Infrastructure Engineer
$215k - $350kFortinet Inc
We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.Key ResponsibilitiesAI Infrastructure & Performance EngineeringOperate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization.Develop new testing frameworks, automation, and validation methodologies as requirements evolve.Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.Server, Hardware & Platform OperationsDeploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware.Support availability and utilization of compute resources for engineering, testing, and AI workloads.Evaluate and integrate new hardware technologies to improve performance and efficiency.Reliability Engineering & AI Platform DevelopmentImplement monitoring, logging, alerting, failover, and incident response for critical infrastructure.Develop, deploy, and maintain internal AI server applications and shared compute platforms.Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.Laboratory AdministrationSupport day-to-day lab operations: access control, network administration, resource allocation, and capacity planning.Contribute to operational standards and best practices for lab governance.Documentation & Knowledge SharingCreate and maintain technical documentation: benchmarking reports, design notes, and internal runbooks.Share technical insights and best practices with the broader engineering organization.Required Qualifications (Must-Have).Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization).Experience with KVM or containerization (Docker/Kubernetes).Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks).Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows.Practical experience with GPU-based compute environments or AI/ML infrastructure.Preferred QualificationsBachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome).Experience with performance testing, benchmarking, or traffic-generation methodologies.Exposure to network security concepts and enterprise security technologies.Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions — a plus, not required.Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations.Experience creating technical documentation, white papers, or delivering internal training.Core CompetenciesInfrastructure EngineeringAI Platform DevelopmentDevOps & AutomationPerformance Testing & BenchmarkingTechnical DocumentationFortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program. Wage ranges are based on various factors including the labor market, job type, and job level. On target earnings for this position is expected to be $215,000 - $350,000 per year. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.All roles are eligible to participate in the Fortinet equity program, and this position is also eligible for commissions based on the terms of the Sales Compensation PlanFortinet makes possible a digital world that we can always trust through its mission to protect people, devices, and data everywhere. This is why the world’s largest enterprises, service providers, and government organizations choose Fortinet to securely accelerate their digital journey. The Fortinet Security Fabric platform delivers broad, integrated, and automated protections across the entire digital attack surface, securing critical devices, data, applications, and connections from the data center to the cloud to the home office. Ranking #1 in the most security appliances shipped worldwide, more than 615,000 customers trust Fortinet to protect their businesses. And the Fortinet NSE Training Institute, an initiative of Fortinet’s Training Advancement Agenda (TAA), provides one of the largest and broadest training programs in the industry to make cyber training and new career opportunities available to everyone.Full timePosting Date: 2026-08-28
- We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered... ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),...SuggestedFull timeWork experience placementLive inWork at officeLocal area
$105k - $115k
...Description Cloud AI Engineer (Mid-Level) Location: Various U.S. Federal Client Sites (Onsite) Travel: Travel required... ...trusted provider of enterprise cloud modernization, AI, and infrastructure solutions supporting U.S. Federal Government agencies. As we...SuggestedFull timeTemporary workImmediate start$175k - $275k
...About Traversal Traversal is the AI Site Reliability Engineer (SRE) for the enterprise—already trusted by some of the largest companies in... ...would be possible. The Role As an AI Engineer - Cloud Infrastructure on Traversal’s Infrastructure team, you’ll design,...SuggestedFull timeWork at officeFlexible hours- ...About Build AI for the Built World: Build has created the agentic AI stack for institutional... ...most important built projects - digital infrastructure, energy, industrial - from concept to... ...create and configure workflows without engineering. The interfaces through which clients...SuggestedFull timeLive in
$160k - $220k
...of: The role We are looking for an experienced AI Engineer to lead the implementation of Azure AI Foundry within an established... ...our existing data platform, governance model, and analytics infrastructure. You will work closely with data engineering,...SuggestedFull timeRemote work- ...Infrastructure EngineerPalona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems... ...experience.We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software...
$112.29k - $161.28k
...live and work, in ways they value.In an AI era, we remain ""Guided By Humanity,"" a... ...OverviewWe are looking for a Senior AI & Cloud Engineer to design, build, and operate... .... You will bridge the gap between cloud infrastructure, data engineering, and applied AI — developing...Temporary workFreelanceWork at officeLocal areaFlexible hours$162k - $215k
...AI-Enabled Infrastructure And Systems EngineerAladdin Platform Engineering powers the technology foundation behind BlackRock's Aladdin platform - a unified system that connects risk, portfolio management, trading, and operations for investors globally. We build the mission...ApprenticeshipWork at officeWork from homeWorldwideFlexible hours1 day per week$229.9k - $262.4k
Senior Lead AI Engineer, Gen AI Platform Overview: At Capital One, we are creating responsible and reliable... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in...Full timePart timeLocal area$180k - $225k
AI Infrastructure Engineer - Agent Sandbox PlatformAs a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both...Full timeImmediate startRemote work- ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations...Full timeWork experience placementLive inWork at officeLocal area
$152.29k - $250.2k
As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation of our enterprise platform’s execution... ...design reviews, architecture standards, testing, CI/CD, infrastructure automation, incident response, SLOs, runbooks, and...Full timeLocal areaVisa sponsorshipWork visaFlexible hours- ...and technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco... ...are seeking a Director of AI Platform Engineering to lead the design, development, and... ...platform engineers, architect critical infrastructure, and drive the strategy for multi-agent...Ongoing contractFull timeCasual workWork at officeFlexible hours
$175k - $200k
...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant... ...into production, and our external agent infrastructure (the Agency Connect MCP server, which... ...early partner adoption. Both need a senior engineering owner, and both need to grow into the...Full timeInternship- ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits...
$230k - $290k
...York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large... ...same enterprises design, build, and run AI agent platforms on top of it. This role... ...delivery leadership attached. You will write infrastructure code, agent code, and the documents that...Full timeWork at officeShift work- The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data...
- ...Job Title: AI Platform Engineer Location: NYC, NY (Hybrid Model) - 10003 Zip code Energy & Utility domain with experience in Google... ...Platform Engineer: Design and implement AI/ML infrastructure using Vertex AI, Kubeflow, TensorFlow Extended (TFX), and...Local area
$229.9k - $262.4k
...Senior Lead AI Engineering (GenAI Platform Services: Agentic Systems) Overview: At Capital One, we are creating responsible and reliable... ...customer experiences. Our investments in technology infrastructure and world-class talent along with our deep experience in machine...Full timePart timeLocal area$205k - $235k
...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with... ...Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data...Full timeFor contractorsWork experience placementSummer holidayFlexible hours- Google Cloud is seeking a mid-level Practice Customer Engineer with a Cloud AI specialization to accelerate adoption of complex workloads. You will partner with sales to differentiate Google Cloud, write code for prototypes, and address AI-facing challenges, influencing...
$152k - $241.5k
...weight models are foundational to American AI leadership and cybersecurity, and that... ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling... ...and maintain the agent harness.Evaluation infrastructure: Build the systems we use to run and...Full timeRemote work$229.9k - $262.4k
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...Full timePart timeLocal area- Role: Senior AI Platform Engineer Location: NYC, NY (Hybrid) Project description As an AI Platform Engineer for AI & Emerging Tech, you... ...cost guardrails (budgets, alerts, quota enforcement) using Infrastructure as Code. Act as a subject matter expert (SME) on Gen AI platform...
- Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You will collaborate with engineers, researchers, and PMs to build scalable AI-powered products for customers and associates....
- HireNow Staffing is seeking a Real-Time Voice AI Agent Systems Engineer for our NYC client. You will own production-grade voice AI infrastructure from LiveKit orchestration to prompting, latency, and KPI-driven improvements. Candidates must have 3+ years in platform/infra...Visa sponsorship
- ...für Werkstudenten oder Vollzeit im Praktikum und einer Vergütung von 17 € pro Stunde. Du baust Services in Node.js/TypeScript oder Java, arbeitest an KI-Komponenten wie SAP AI Core, Joule-Erweiterungen und Tool-Calling, sowie an Frontends #J-18808-Ljbffr nfaculty GmbHInternshipRemote work
- ...office) Must have 6+ years of progressive engineering experience, including 1-2+ years in AI platform, cloud platform, or emerging-tech... ...cost management and usage/credit monitoring. Infrastructure as Code (Terraform, Puppet, Docker) and containerized...Full timeWork at office
$180k - $230k
...About the Role The Platform Infrastructure team at iCapital plays a critical role in ensuring... ...and intellectually curious MLOps/DevOps Engineers with deep expertise in machine learning... ...). Enable production workloads for AI/ML and Generative AI systems, including...Full timeWork at officeRemote work- ...Head of AI Platform Engineering, Execution Services About the Company Enterprise-focused organization building secure, scalable AI... ...background in distributed systems, cloud-native platforms, AI/ML infrastructure, and large-scale data ecosystems, as well as experience...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
- ai research engineer New York, NY
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai engineer remote New York, NY
- ai developer New York, NY
- ai prompt engineer New York, NY
- machine learning ai engineer New York, NY
- ai engineer New York, NY
- infrastructure developer New York, NY
- principal infrastructure engineer New York, NY




