Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$215k - $350k

Fortinet Inc

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.Key ResponsibilitiesAI Infrastructure & Performance EngineeringOperate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization.Develop new testing frameworks, automation, and validation methodologies as requirements evolve.Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.Server, Hardware & Platform OperationsDeploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware.Support availability and utilization of compute resources for engineering, testing, and AI workloads.Evaluate and integrate new hardware technologies to improve performance and efficiency.Reliability Engineering & AI Platform DevelopmentImplement monitoring, logging, alerting, failover, and incident response for critical infrastructure.Develop, deploy, and maintain internal AI server applications and shared compute platforms.Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.Laboratory AdministrationSupport day-to-day lab operations: access control, network administration, resource allocation, and capacity planning.Contribute to operational standards and best practices for lab governance.Documentation & Knowledge SharingCreate and maintain technical documentation: benchmarking reports, design notes, and internal runbooks.Share technical insights and best practices with the broader engineering organization.Required Qualifications (Must-Have).Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization).Experience with KVM or containerization (Docker/Kubernetes).Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks).Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows.Practical experience with GPU-based compute environments or AI/ML infrastructure.Preferred QualificationsBachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome).Experience with performance testing, benchmarking, or traffic-generation methodologies.Exposure to network security concepts and enterprise security technologies.Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions — a plus, not required.Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations.Experience creating technical documentation, white papers, or delivering internal training.Core CompetenciesInfrastructure EngineeringAI Platform DevelopmentDevOps & AutomationPerformance Testing & BenchmarkingTechnical DocumentationFortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program. Wage ranges are based on various factors including the labor market, job type, and job level. On target earnings for this position is expected to be $215,000 - $350,000 per year. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.All roles are eligible to participate in the Fortinet equity program, and this position is also eligible for commissions based on the terms of the Sales Compensation PlanFortinet makes possible a digital world that we can always trust through its mission to protect people, devices, and data everywhere. This is why the world’s largest enterprises, service providers, and government organizations choose Fortinet to securely accelerate their digital journey. The Fortinet Security Fabric platform delivers broad, integrated, and automated protections across the entire digital attack surface, securing critical devices, data, applications, and connections from the data center to the cloud to the home office. Ranking #1 in the most security appliances shipped worldwide, more than 615,000 customers trust Fortinet to protect their businesses. And the Fortinet NSE Training Institute, an initiative of Fortinet’s Training Advancement Agenda (TAA), provides one of the largest and broadest training programs in the industry to make cyber training and new career opportunities available to everyone.Full timePosting Date: 2026-08-28

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered...  ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  •  ...Role Overview: Primary hiring focus is an AI Infrastructure Senior Engineer supporting the build-out of the company's Azure-based technology stack. The role will be the first hire on the infrastructure engineering team and will work under the infrastructure... 
    Suggested
    Currently hiring
    Work at office
    Remote work

    ConsultNet

    New York, NY
    1 day ago
  • $176k - $264k

     ...Senior AI Software Engineer is required to design and build secure, production-ready AI solutions for one of the top five law firms in...  ...resilient AI solutions on Microsoft Azure , collaborating with infrastructure and security teams across cloud, on-premise and hybrid... 
    Suggested
    Permanent employment
    Full time
    H1b
    3 days per week

    Onward Legal Innovation

    New York, NY
    3 days ago
  •  ...Type AnnuallyIndustry Law PracticeSelling Points Lead innovative AI platform engineering projects at a forward-thinking organization. Collaborate on cutting-edge Azure AI/ML solutions and cloud infrastructure. Enhance your expertise in MLOps and applied AI technologies.... 
    Suggested

    Green Key Resources

    New York, NY
    1 day ago
  • $110 - $130 per hour

     ...diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY! AIVA is the firm's governed AI execution platform, built to give engineers and... 
    Suggested

    Eleven Recruiting

    New York, NY
    1 day ago
  •  ...Sr Cloud AI Platform Engineer Contract Hybrid in NYC Must be local. This is not a Full Stack Developer role. We'd like candidates...  ...~ Working knowledge of AWS services. ~ Experience using Infrastructure as Code tools, with Terraform preferred. ~ Familiarity... 
    Contract work
    Local area

    PRI Technology

    New York, NY
    3 days ago
  •  ...Purpose of Functional Assignment: The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows... 
    Full time

    NYC Health + Hospitals

    New York, NY
    12 hours ago
  •  ...Postman Fern, the Fern division of Postman, is hiring a Software Engineer in New York. You’ll build APIs, scale AI infrastructure, and design developer experiences for millions of users. Your work will involve real production workloads on Vercel, AWS, and Turbopuffer... 

    Jobleads-US

    New York, NY
    2 days ago
  • $200k - $230k

    SVP, Lead AI/MLOps Infrastructure Engineer - Full Time - HybridWe’re partnering with our client, a fast-growing fintech firm, on a senior-level hire to lead and own the infrastructure behind their AI and machine learning platforms. This is a highly visible, hands-on leadership... 
    Full time
    Remote work

    Benchmark IT

    New York, NY
    1 day ago
  •  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...  ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    4 days ago
  • $180k - $240k

    Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/Onsite)Employment Type: Full-TimeCompensation: $180-$240k base...  ...responsible for building secure, scalable, and resilient AI infrastructure that enables enterprise-wide adoption of AI capabilities.... 

    Yoh

    New York, NY
    2 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...into production, and our external agent infrastructure (the Agency Connect MCP server, which...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the... 
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    3 days ago
  • $160k - $220k

     .... As a global leader in residential wellness and healthcare infrastructure, we create vibrant, purpose-driven communities where housing...  ...infrastructure, we want you on our best-in-class team.SUMMARYThe AI Engineer, Platform and Data builds the core that everything else runs... 
    Full time

    Welltower

    New York, NY
    15 hours ago
  • $162k - $215k

     ...Requirements: We need at least 5 years of experience in infrastructure engineering, with a track record of delivering production-ready systems....  ...platform engineering concepts. We need experience supporting AI and machine learning workloads, including managed compute... 
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours
    1 day per week

    BlackRock

    New York, NY
    7 days ago
  •  ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits... 

    Farther Advisors

    New York, NY
    15 hours ago
  • $250.8k - $286.2k

    AI Engineer 5 (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services: Agentic AI) At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 hour ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services - Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $180k - $400k

     ...transform critical institutions with applied AI. We care that industries that power the...  ...: Forward-deployed expertise in engineering, product, and research Mosaic, our in...  ...About the role We're hiring an AI Infrastructure Engineer to own the infrastructure, deployment... 
    Full time
    Contract work
    Live in
    Work at office

    Percepta

    New York, NY
    1 day ago
  • AI Platform Engineer About Tessera Labs Tessera Labs is redefining how enterprises adopt and operationalize Artificial Intelligence. Backed...  ...team builds and operates the foundational AI agent infrastructure that lets Tessera run reliably, securely, and consistently... 

    Tessera Labs

    New York, NY
    2 days ago
  • $155k - $215k

    Our mission is to develop a firmwide Artificial Intelligence (AI) Development Platform that aligns with the firm's Technology principles...  ...of AI across our businesses.This role is for a platform engineering specialist who will help build a firmwide AI Development Platform... 
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago
  • $230k - $290k

     ...York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large...  ...same enterprises design, build, and run AI agent platforms on top of it. This role...  ...delivery leadership attached. You will write infrastructure code, agent code, and the documents that... 
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    15 hours ago
  • $144.25k - $256.25k

     ...(if applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift:...  ...technology and data insights.The Enterprise AI Platform organization builds...  ...strategiesRetrieval and grounding (RAG) pipelinesLLM infrastructure, inference, and model gatewaysEvaluation... 
    Visa sponsorship

    American Express

    New York, NY
    1 day ago
  • $180k - $230k

    About the RoleThe Platform Infrastructure team at iCapital plays a critical role in ensuring that...  ...and intellectually curious MLOps/DevOps Engineers with deep expertise in machine learning...  ...).Enable production workloads for AI/ML and Generative AI systems, including... 
    Full time
    Work at office
    Remote work

    iCapital Network

    New York, NY
    4 days ago
  •  ...Job Title: AI Platform Engineer Location: NYC, NY (Hybrid Model) - 10003 Zip code Energy & Utility domain with experience in Google...  ...Platform Engineer: Design and implement AI/ML infrastructure using Vertex AI, Kubeflow, TensorFlow Extended (TFX), and... 
    Local area

    Abode Tech Zone

    New York, NY
    3 days ago
  • The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data... 

    Goldman Sachs

    New York, NY
    15 hours ago
  •  ...Description Job Description Palona’s AI agents operate continuously in...  ...systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency...  ...We are looking for an Infrastructure Engineer who combines cloud and reliability depth... 
    Temporary work

    Palona AI

    New York, NY
    27 days ago
  • $244.7k - $279.2k

    Staff AI Engineer - Enterprise Analysis Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    2 days ago
  • $286.2k - $326.7k

    Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!