Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$215k - $350k

Fortinet Inc

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.Key ResponsibilitiesAI Infrastructure & Performance EngineeringOperate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization.Develop new testing frameworks, automation, and validation methodologies as requirements evolve.Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.Server, Hardware & Platform OperationsDeploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware.Support availability and utilization of compute resources for engineering, testing, and AI workloads.Evaluate and integrate new hardware technologies to improve performance and efficiency.Reliability Engineering & AI Platform DevelopmentImplement monitoring, logging, alerting, failover, and incident response for critical infrastructure.Develop, deploy, and maintain internal AI server applications and shared compute platforms.Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.Laboratory AdministrationSupport day-to-day lab operations: access control, network administration, resource allocation, and capacity planning.Contribute to operational standards and best practices for lab governance.Documentation & Knowledge SharingCreate and maintain technical documentation: benchmarking reports, design notes, and internal runbooks.Share technical insights and best practices with the broader engineering organization.Required Qualifications (Must-Have).Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization).Experience with KVM or containerization (Docker/Kubernetes).Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks).Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows.Practical experience with GPU-based compute environments or AI/ML infrastructure.Preferred QualificationsBachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome).Experience with performance testing, benchmarking, or traffic-generation methodologies.Exposure to network security concepts and enterprise security technologies.Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions — a plus, not required.Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations.Experience creating technical documentation, white papers, or delivering internal training.Core CompetenciesInfrastructure EngineeringAI Platform DevelopmentDevOps & AutomationPerformance Testing & BenchmarkingTechnical DocumentationFortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program. Wage ranges are based on various factors including the labor market, job type, and job level. On target earnings for this position is expected to be $215,000 - $350,000 per year. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.All roles are eligible to participate in the Fortinet equity program, and this position is also eligible for commissions based on the terms of the Sales Compensation PlanFortinet makes possible a digital world that we can always trust through its mission to protect people, devices, and data everywhere. This is why the world’s largest enterprises, service providers, and government organizations choose Fortinet to securely accelerate their digital journey. The Fortinet Security Fabric platform delivers broad, integrated, and automated protections across the entire digital attack surface, securing critical devices, data, applications, and connections from the data center to the cloud to the home office. Ranking #1 in the most security appliances shipped worldwide, more than 615,000 customers trust Fortinet to protect their businesses. And the Fortinet NSE Training Institute, an initiative of Fortinet’s Training Advancement Agenda (TAA), provides one of the largest and broadest training programs in the industry to make cyber training and new career opportunities available to everyone.Full timePosting Date: 2026-08-28

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
  • $215k - $350k

     ...We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering... 
    Suggested
    Full time
    Worldwide
    Home office

    Fortinet

    New York, NY
    4 days ago
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered...  ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    8 hours ago
  • $112.29k - $161.28k

     ...live and work, in ways they value.In an AI era, we remain ""Guided By Humanity,"" a...  ...OverviewWe are looking for a Senior AI & Cloud Engineer to design, build, and operate...  .... You will bridge the gap between cloud infrastructure, data engineering, and applied AI — developing... 
    Suggested
    Temporary work
    Freelance
    Work at office
    Local area
    Flexible hours

    Publicis Media

    New York, NY
    4 days ago
  •  ...Palona’s AI agents operate continuously in production, handle real-time guest interactions...  ...systems, and face sharp traffic peaks. Infrastructure is therefore part of the product:...  ...We are looking for an Infrastructure Engineer who combines cloud and reliability depth... 
    Suggested
    Temporary work

    Palona AI

    New York, NY
    5 days ago
  • $200k

     ...AI Infrastructure Engineer Location: New York (4 Days Onsite) Base Salary: $200k + 50% bonus This is a rare opportunity to shape the AI foundations of a complex, global organisation at a pivotal moment in its technology journey. You will play a central role... 
    Suggested
    Work at office

    Harnham

    New York, NY
    4 days ago
  • $350k

     ...Machines The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier...  ...want to build it. About the Role We're hiring an AI Infrastructure Engineer to keep our post-training and reinforcement learning (RL)... 
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package
    Shift work

    Thinking Machines Lab

    New York, NY
    4 days ago
  • $120k - $240k

     ...About Build AI for the Built World: Build has created the agentic AI stack for institutional...  ...most important built projects - digital infrastructure, energy, industrial - from concept to...  ...create and configure workflows without engineering. The interfaces through which clients... 
    Full time
    Live in

    Build Technologies

    New York, NY
    3 days ago
  • $180k - $225k

    AI Infrastructure Engineer - Agent Sandbox PlatformAs a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both... 
    Full time
    Immediate start
    Remote work

    Scale AI

    New York, NY
    2 days ago
  • $152.29k - $250.2k

    As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation of our enterprise platform’s execution...  ...design reviews, architecture standards, testing, CI/CD, infrastructure automation, incident response, SLOs, runbooks, and... 
    Full time
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    4 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...into production, and our external agent infrastructure (the Agency Connect MCP server, which...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the... 
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    2 days ago
  • $250.8k - $286.2k

    Senior Lead AI Engineer (GenAI Platform Services, Agentic Platform) Overview: At Capital One, we are creating responsible and reliable...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    5 days ago
  •  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...  ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    3 days ago
  • $200k - $230k

     ...and technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco...  ...are seeking a Director of AI Platform Engineering to lead the design, development, and...  ...platform engineers, architect critical infrastructure, and drive the strategy for multi-agent... 
    Ongoing contract
    Full time
    Casual work
    Work at office
    Flexible hours

    SS&C Technologies

    New York, NY
    1 day ago
  •  ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits... 

    Farther Advisors

    New York, NY
    4 days ago
  • $230k - $290k

     ...York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large...  ...same enterprises design, build, and run AI agent platforms on top of it. This role...  ...delivery leadership attached. You will write infrastructure code, agent code, and the documents that... 
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    3 days ago
  • The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data... 

    Goldman Sachs

    New York, NY
    4 days ago
  • $205k - $235k

     ...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with...  ...Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data... 
    Full time
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    3 days ago
  • The Opportunity MassMutual's AI Platform Engineering team is seeking an impact-driven AI Platform Engineer to serve as the technical anchor...  .... The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience—delivering foundational... 

    MassMutual

    New York, NY
    16 hours ago
  • $152k - $241.5k

     ...weight models are foundational to American AI leadership and cybersecurity, and that...  ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling...  ...and maintain the agent harness.Evaluation infrastructure: Build the systems we use to run and... 
    Full time
    Remote work

    Nvidia

    New York, NY
    4 days ago
  • $60 - $70 per hour

    Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large-... 
    Remote work

    The Leadership Agency Inc.

    New York, NY
    3 days ago
  • United States Digital Space LLC is seeking an experienced AI/ML architect for a remote engagement supporting a Fortune 100 pharmaceutical...  ...citizenship or Green Card and a Google Cloud Professional Data Engineer certification. You will leverage Gemini Enterprise, Vertex AI... 
    Remote job

    United States Digital Space LLC

    New York, NY
    3 days ago
  • Google Cloud is seeking a Customer Engineer specializing in Cloud AI to accelerate technical wins and adoption of complex workloads. You will partner with technical sales, write code for prototypes, and deliver demos that showcase new AI solutions to customers. You will... 

    Google

    New York, NY
    1 day ago
  • Crusoe Cloud is seeking a Solutions Engineer to help enterprise customers deploy AI/ML workloads on Crusoe's GPU infrastructure. Based in New York City, you will run technical discovery, deliver demos and PoCs, and ensure customers land successfully on the platform. This... 
    Full time

    Linuxconfig

    New York, NY
    5 days ago
  •  ...Title : Senior AI Platform Engineer Location: New York City, NY Onsite Job Type: Contract Responsibilities...  ...cost guardrails (budgets, alerts, quota enforcement) using Infrastructure as Code. Act as a subject matter expert (SME) on Gen... 
    Contract work

    Lorven technologies

    New York, NY
    1 day ago
  • $120k - $150k

     ...Job Description Job Description Lead Cloud AI Engineer (Lead / Senior) Location: Various U.S. Federal Client Sites (Onsite)...  ...provider of enterprise IT modernization, cloud transformation, and infrastructure solutions supporting U.S. Federal Government agencies. As we... 
    Full time
    Temporary work
    Immediate start

    PGTEK

    New York, NY
    4 days ago
  • $80k - $100k

     ...Job Description Job Description Associate Cloud AI Engineer (Entry Level) Location: Various U.S. Federal Client Sites (Onsite)...  ...federal customers. You'll participate in cloud migrations, infrastructure deployments, automation initiatives, and AI platform implementations... 
    Full time
    Temporary work
    Immediate start

    PGTEK

    New York, NY
    4 days ago
  • $229.9k - $286.2k

     ...Requirements: ~ Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields along with a minimum...  ...as an industry leader. With our advanced technology infrastructure and a talented team, we strive to continue enhancing our... 
    Full time

    Capital One

    New York, NY
    1 day ago
  • Azure AI Engineer - Job Description We are seeking an experienced Azure AI Engineer to join our Windows team and collaborate with various sectors within infrastructure, such as Security and Networking, to create, launch, and support AI-based cloud and hybrid applications... 

    TechDigital Group

    New York, NY
    3 days ago
  • An established industry player is looking for an Azure AI Engineer to join their dynamic Windows team. This role involves collaborating with various sectors to create and support AI-driven cloud applications. The ideal candidate will have a strong background in Generative... 

    TechDigital Group

    New York, NY
    1 day ago
  •  ...Ellis seeks a Platform Developer, Innovation Delivery to build AI-powered workflows on Palantir Foundry and AIP. You will own projects...  ...with global teams. Bring 3+ years in software/data engineering, Palantir expertise, and strong Python/SQL skills. This role emphasizes... 

    Jobzhr

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!