Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Network and Compute Engineer, AI Infrastructure

Apptad

Job Description: Network and Compute Engineer, AI Infrastructure Position Summary Network and Compute Engineer to design, deploy, validate, and operate high-performance infrastructure supporting enterprise artificial intelligence and accelerated-computing workloads. The engineer will work across compute, networking, operating systems, container orchestration, cluster management, storage integration, security, and observability. The successful candidate will be comfortable working hands-on with complex infrastructure, diagnosing issues across multiple technical layers, and translating platform requirements into reliable and repeatable operational solutions. The role is aligned to an NVIDIA AI Factory environment. The source material specifically covers NVIDIA Mission Control, Base Command Manager, Kubernetes installation, rack management, bare-metal management, observability, Run:ai, MGX architecture, Slurm, GB200 software and firmware, NVLink partitioning, XID troubleshooting, and telemetry. Key Responsibilities Compute and Cluster Engineering Deploy, configure, validate, and operate accelerated-compute clusters. Perform server and cluster bring-up, including operating-system imaging, boot validation, firmware alignment, hardware discovery, and post-deployment health checks. Support NVIDIA MGX-based infrastructure and understand the relationship between hardware architecture, firmware, operating systems, drivers, and the platform software stack. Install and administer Linux-based compute environments. Support Kubernetes installation, configuration, upgrades, and lifecycle operations. Deploy and administer Slurm-based workload environments. Assist with NVIDIA GB200 firmware updates, software-stack validation, sanity checks, and platform readiness testing. Support NVLink configuration and partitioning, where applicable. Troubleshoot GPU and system errors, including XID events, degraded nodes, boot failures, firmware inconsistencies, and workload-performance issues. Develop standardized, repeatable build and validation procedures for compute nodes and clusters. The PDF explicitly identifies MGX architecture and software stack, MGX sanity checks, image creation, Slurm deployment, ARM images and booting, GB200 firmware and software-stack validation, NVLink partitioning, XID troubleshooting, and telemetry as relevant subject areas. Network Engineering Design and support resilient network connectivity for accelerated-compute and AI cluster environments. Configure and troubleshoot high-speed Ethernet and, where applicable, InfiniBand fabrics. Support leaf-spine network architectures, network segmentation, routing, switching, addressing, name resolution, and time synchronization. Diagnose packet loss, latency, congestion, interface errors, cabling faults, routing issues, and workload connectivity failures. Validate host-to-host, node-to-storage, management-plane, and workload-plane connectivity. Support network configuration required for Kubernetes, cluster provisioning, telemetry, and distributed workloads. Work with security teams to implement network isolation, firewall rules, access controls, and secure administrative paths. Maintain accurate network diagrams, port maps, addressing plans, and configuration records. Hiring note: High-speed Ethernet, InfiniBand, leaf-spine topology, firewall design, and related network technologies are recommended market requirements for this type of position. They are not individually specified in the uploaded PDF. Platform Provisioning and Management Install, configure, and operate NVIDIA Base Command Manager. Support rack import, rack view, base view, node provisioning, and cluster lifecycle activities. Work with bare-metal management systems for server discovery, power operations, hardware health, firmware administration, and remote troubleshooting. Integrate cluster platforms with enterprise directory services. Support NVIDIA Mission Control processes and related AI Factory operational practices. Assist with the deployment and operation of Run:ai or equivalent workload-orchestration capabilities. Automate repetitive provisioning, validation, configuration, and reporting activities. The source material explicitly includes Base Command Manager bring-up, directory services, rack import, rack view, base view, bare-metal management, observability, and Run:ai installation. Monitoring, Reliability, and Operations Implement infrastructure monitoring for compute nodes, GPUs, network devices, interfaces, firmware, thermals, power, storage dependencies, and cluster services. Establish actionable dashboards, telemetry, alerts, and operational health checks. Lead technical diagnosis across hardware, firmware, Linux, Kubernetes, scheduler, network, and application layers. Perform root-cause analysis and document corrective and preventive actions. Develop operational runbooks for failure scenarios such as node loss, degraded network links, GPU errors, provisioning failures, and cluster-service disruption. Participate in incident response, problem management, capacity planning, lifecycle planning, and controlled change implementation. Identify automation and standardization opportunities that reduce manual effort, deployment defects, and recovery time. Work with infrastructure, cloud, security, storage, application, vendor, and service-management teams. Security and Compliance Responsibilities Apply least-privilege access to management, compute, network, and orchestration platforms. Integrate administrative access with approved enterprise identity and directory services. Secure management interfaces, service accounts, automation credentials, application programming interfaces, and remote-access pathways. Maintain separation between management, workload, storage, and out-of-band management networks. Support firmware, operating-system, container, Kubernetes, and network vulnerability remediation. Ensure administrative actions and infrastructure changes are traceable through logging and change records. Protect sensitive cluster configuration, credentials, certificates, logs, and telemetry. Follow secure configuration standards, change controls, and applicable customer or regulatory requirements. Hiring note: These security requirements are recommended additions for enterprise deployment. The PDF references directory services and hands-on operations, but it does not define a complete security or compliance control framework. Required Technical Skills Strong administration and troubleshooting experience with Linux. Strong knowledge of data-center networking, including Ethernet, Transmission Control Protocol/Internet Protocol, routing, switching, virtual local area networks, link aggregation, Domain Name System, Dynamic Host Configuration Protocol, and Network Time Protocol. Hands-on experience installing or operating Kubernetes clusters. Experience deploying and supporting physical compute infrastructure. Understanding of server boot processes, operating-system imaging, firmware, device drivers, hardware management, and remote management controllers. Experience diagnosing issues across server, operating-system, network, and application layers. Working knowledge of Python, Bash, Ansible, or equivalent infrastructure-automation technologies. Experience with monitoring, logging, metrics, dashboards, alerting, and telemetry. Ability to create clear architecture diagrams, build documents, operating procedures, and troubleshooting runbooks. Strong analytical skills and the ability to work effectively during complex infrastructure incidents. Preferred Technical Skills Experience with NVIDIA AI infrastructure, NVIDIA Mission Control, or NVIDIA Base Command Manager. Experience with NVIDIA MGX or GB200-based systems. Experience with Slurm and distributed-compute scheduling. Experience with Run:ai. Experience with InfiniBand, Remote Direct Memory Access, or Remote Direct Memory Access over Converged Ethernet. Knowledge of NVLink and multi-GPU communication. Experience interpreting NVIDIA XID errors and GPU telemetry. Experience with bare-metal provisioning and Redfish-compatible management interfaces. Experience with Prometheus, Grafana, OpenTelemetry, or equivalent observability platforms. Exposure to container runtimes, container registries, Kubernetes networking, and graphics-processing-unit operators. Experience supporting production AI, machine-learning, high-performance-computing, or large-scale data platforms. Qualifications Bachelor's degree in computer science, information technology, electronics, telecommunications, or a related field, or equivalent practical experience. Recommended 7 or more years of experience in infrastructure, compute, network, data-center, cloud-platform, or high-performance-computing engineering. Recommended 3 or more years of hands-on experience with Linux-based cluster platforms, Kubernetes, accelerated computing, or comparable large-scale infrastructure. Demonstrated experience owning complex technical problems from initial diagnosis through resolution and prevention. Hiring note: The experience thresholds and educational requirements above are suggested market-screening criteria. They are not specified in the source PDF and can be adjusted for Engineer, Senior Engineer, Lead, or Architect levels. Relevant Certifications Certifications are desirable but should not replace proven hands-on capability: NVIDIA Certified Associate or NVIDIA Certified Professional credentials relevant to AI infrastructure Red Hat Certified System Administrator or Red Hat Certified Engineer Certified Kubernetes Administrator Cisco Certified Network Professional, Data Center or Enterprise NVIDIA networking or InfiniBand training Linux Foundation certifications Security-focused credentials appropriate to the operating environment Behavioral Competencies Strong ownership and structured problem-solving. Willingness to diagnose problems independently and validate solutions through hands-on testing. Ability to work across organizational and technology boundaries. Clear communication with engineering teams, leadership, customers, partners, and vendors. Ability to explain complex infrastructure issues in plain business language. Disciplined approach to documentation, change control, risk management, and operational handover. Continuous-learning mindset in a rapidly evolving technology environment. The PDF emphasizes hands-on learning, foundational Linux, Kubernetes and networking knowledge, independent problem-solving, collaboration, and the ability to represent the platform effectively to customers and partner organizations. Measures of Success Successful, repeatable cluster and node deployments. High availability and operational stability of network and compute platforms. Reduced build time through automation and reusable configurations. Faster detection, diagnosis, and recovery from infrastructure failures. Lower configuration drift and fewer manual deployment errors. Complete operational documentation and effective knowledge transfer. Timely remediation of security vulnerabilities and unsupported firmware or software. Efficient use of expensive accelerated-compute capacity. Positive customer and stakeholder outcomes during deployments and production operations. Recommended Interview Focus Candidates should be assessed through scenario-based and hands-on questions rather than only theoretical discussion: Cluster bring-up: Explain how you would isolate a compute node that boots but does not join the cluster. Network diagnosis: Diagnose intermittent performance degradation across a group of distributed GPU nodes. Kubernetes: Explain how you would investigate a workload that requests GPUs but remains unscheduled. Firmware and drivers: Describe how you would manage a firmware or driver mismatch across a production cluster. GPU troubleshooting: Walk through the investigation of a recurring XID event. Automation: Provide an example of automating provisioning, validation, or configuration compliance. Security: Design secure access across the management, workload, storage, and out-of-band networks. Operations: Define what should be captured in telemetry and alerting for an accelerated-compute cluster. Customer communication: Explain a major infrastructure issue to a business stakeholder without relying on specialist terminology. Suggested Job-Posting Title Options Senior Network and Compute Engineer, AI Infrastructure AI Factory Network and Compute Engineer GPU Cluster Infrastructure Engineer Network and Accelerated Compute Platform Engineer NVIDIA AI Infrastructure Engineer Apptad

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Network and Compute Engineer, AI Infrastructure in New York, NY vacancy
  • $160k - $240k

    Senior Software Engineer - Cloud Native Compute Infrastructure Core Location New York Business Area Engineering...  ...GPU infrastructure supporting AI training and inferenceOur mission...  ...infrastructure by safely managing OS, firmware, network policy, and configuration changes... 
    Network
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    1 day ago
  •  ...About the Team: Compute Infrastructure builds the platform that turns enormous amounts of compute into a reliable engine for frontier AI. We design, provision, schedule, operate, and optimize...  ...systems that connect accelerators, CPUs, networks, storage, data centers,... 
    Network
    Full time

    OpenAI

    New York, NY
    7 days ago
  •  ...Head of Engineering (GPU Infrastructure / HPC) Investment Profile Greylock-backed...  ..., autonomy, and physical AI. The platform helps...  ...data pipelines, storage, and networking. You’ll make these systems...  ..., high-performance computing, render farms, or large-scale... 
    Network
    Full time
    Relocation

    Greylock Partners

    New York, NY
    1 day ago
  • $153k - $204k

     ...The Essential Cloud for AI. Built for pioneers by...  ...combines superior infrastructure performance with deep...  ...breakthroughs and turn compute into capability. Founded...  ...You’ll DoAs a Senior Engineer in Compute Services, you...  ...Linux networking expertiseAWX/Ansible tower... 
    Network
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  •  ...frontier of predictive intelligence, using AI to simulate and predict human...  ...build together. ABOUT THE ROLE As an infrastructure engineer at Aaru, you will build the systems that...  ...greater scale. You will work across compute, networking, data pipelines, and developer... 
    Network
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    Aaru

    New York, NY
    1 day ago
  • Compute Engineer - Infrastructure Resiliency Location: New York, NY; Pittsburgh, PA; Lake Mary, FL Schedule: Hybrid (3 days onsite, 2 days remote)...  ...systems. You'll collaborate with experts across storage, network, security, and applications, expanding both your technical... 
    Network
    Contract work
    Immediate start
    Remote work

    Indotronix International Corporation

    New York, NY
    1 day ago
  •  ...payroll, expenses, benefits, and computers. For the first time ever,...  ...growth trajectory, and our engineering team of 1000+ professionals...  ...of times every day. As an Infrastructure Security Engineer II, you...  ...Service Mesh, Data Stores, AI & ML, Network & Traffic, Supply Chain,... 
    Network
    Work at office
    3 days per week

    Rippling

    New York, NY
    2 days ago
  • $184k - $287.5k

    As a member of the HW Infrastructure Storage Strategy team, you will...  ...direct, measurable impact on engineering velocity. What you'll be...  ...teams, EDA operations, and networking to translate workload requirements...  ...for next-generation compute, AI workloads, and cloud-hybrid... 
    Network

    NVIDIA

    New York, NY
    1 day ago
  • IT Infrastructure and Communication Technology, part of Group...  ...three directions, Networking and Systems, Audio/Video...  ...office network and the compute platforms behind...  ...global expansion and AI transformation.You will...  ...Help Global RE system engineers with on-site infrastructure... 
    Network
    Work at office
    Worldwide
    Relocation

    TikTok

    New York, NY
    2 days ago
  • $141.2k - $278.3k

     ...Consulting offerings. The Quantum Computing team will drive the ecosystem...  ...Quantum Product & Engineering Manager to help build and scale...  ...teams in quantum computing, AI/ML, or a related technical domain...  ...specialized area, such as tensor networks, quantum machine learning,... 
    Network
    Local area

    Deloitte

    New York, NY
    3 days ago
  •  ...Responsibilities: Participate in network design, build-up, and...  ...'s degree or above in computer science, engineering, or related majors. Familiar...  ...and massive data center infrastructure. Opportunities to collaborate...  ..., cybersecurity, and AI disciplines. Required Skills... 
    Network
    Relocation

    ioTech Solutions

    New York, NY
    1 day ago
  • $300k - $400k

     ...of Thinking Machines is to build AI that extends human will and judgment...  ...Role We're hiring a Software Engineer, Infrastructure to design and build the distributed...  ...distributed failures across the stack, from networking and storage to compute and scheduling Write and... 
    Network
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    New York, NY
    1 day ago
  • $260k - $300k

     ...CognitionWe are an applied AI lab building end-to-end software...  ...Devin, the first AI software engineer.Our team is extremely talent-...  ...works without world-class infrastructure underneath it. You will own the compute, orchestration, networking, and platform systems that make... 
    Network

    Cognition AI

    New York, NY
    4 days ago
  •  ...things they had to do. Powerful AI will be the biggest lever...  .... Whoever deploys frontier compute infrastructure fastest will decide whether...  ...enrichment, and security tool engineering across IT, OT, cloud, and...  ...of telemetry from endpoints, network, cloud, OT/ICS, and physical... 
    Network
    Local area

    FluidStack

    New York, NY
    1 day ago
  • $150.4k - $277.6k

     ...results-oriented and versatile engineer who can excel in an Agile...  ...architectures to meet the unique ad network challenges we must solve. You...  ...development of foundational AI/ML platforms and tooling including...  ..., MS, or BS in computer science or a related field, with... 
    Network
    Immediate start
    Relocation

    Apple

    New York, NY
    1 day ago
  • $133k - $184k

     ...Software Engineer, InfrastructureChicago, IL, USA; New...  ...USAAbout the RoleThe Infrastructure Engineering organization...  ...Chime, including AWS, Networking, Kubernetes, Terraform...  ...layer and Compute layer.The base salary...  ...advocate and adopter of AI tools and evangelize agentic... 
    Network
    Full time
    Work at office
    Local area
    Remote work

    CHIME INC.

    New York, NY
    4 days ago
  • $208k

     ...and partnerships with AI labs. This role exists...  ...security: Research & infrastructure security. Securing how...  ...research agents, multi-cloud compute, and code/data/model-...  ...with our security and engineering teams (as well as with...  ..., zero-trust network segmentation and identity... 
    Network
    Full time
    Immediate start
    Remote work
    Relocation
    Visa sponsorship

    Resolution

    New York, NY
    1 day ago
  •  ...OpenAI is seeking a Security Engineer to join our Infrastructure Security (InfraSec) team....  ..., datacenters, networking, storage, and the critical...  ...services that power our frontier AI models. Our charter includes...  ...offer of employment: protect computer hardware entrusted to you... 
    Network

    OpenAI

    New York, NY
    1 day ago
  • $207k - $300k

     ...fabric availability, Network Deployment Integration...  ...team of high-performing engineers while fostering high-...  ...planning, cloud products, ML infrastructure teams, and system...  ...:Master's degree in Computer Science.10 years of experience...  ...innovations.The AI and Infrastructure... 
    Network
    Worldwide

    Google

    New York, NY
    3 days ago
  • $207k - $300k

     ...approximately 10 software engineers, mentoring and growing...  ...Spanner.Enable future-facing infrastructure capabilities for AI and Cloud, ensuring...  ...developing technical roadmaps for computing infrastructure.Experience...  ...-scale system design, networking, security, data... 
    Network

    Google

    New York, NY
    18 hours ago
  • $140k - $200k

     ...capabilities span Data & AI, Cybersecurity, Risk...  ...expertise with engineering excellence to help clients...  ...management of infrastructure powering enterprise Generative...  ...high-performance computing workloads and modern...  ..., data services, and networking layers. Infrastructure... 
    Network
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP

    New York, NY
    2 days ago
  • $134.6k - $217.8k

    Our MissionAt Palo Alto Networks, we’re united by a shared mission...  ..., and Inclusion. We weave AI into the fabric of everything...  ...SummaryWe're looking for an Infrastructure Engineer to build developer tooling that...  ...logic.Operating Systems & Compute: Deep knowledge of Linux... 
    Network
    Full time
    Local area
    Remote work

    Palo Alto Networks

    New York, NY
    1 day ago
  • $225k - $325k

     ...security-first enterprise AI company. We build...  ...team of researchers, engineers, designers, and more,...  ...experience running production infrastructure at a large...  ...in complex Linux-based computing environmentsExperience in compute/storage/network resource and cost managementExcellent... 
    Network
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  • $182k - $242k

     ...The Essential Cloud for AI. Built for pioneers by...  ...combines superior infrastructure performance with deep...  ...breakthroughs and turn compute into capability. Founded...  ...the Role:As a Senior Engineer on the Cloud Platform...  ...'ll drive large-scale networking migrations, such as moving... 
    Network
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $207k - $300k

     ...capacity efficiently and coordinate balanced compute, AI accelerator, memory, storage, networking, and power resources across large-scale...  ...Partner across product, model serving, cluster infrastructure, Site Reliability Engineering (SRE) and capacity planning teams to... 
    Network
    Worldwide

    Google

    New York, NY
    1 day ago
  • $175k - $315k

     ...with the world’s most advanced AI-native platform. We work on...  ...The CrowdStrike Cloud Detection Engine (CDE) team is building a powerful...  ...You'll Need: Degree in Computer Science (or professional experience...  ...of level or role Employee Networks, geographic neighborhood... 
    Network
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week
    New York, NY
    a month ago
  • $155k - $175k

     ...We Are Liqid is doing for AI infrastructure what VMware did for x86 servers...  ...rethink how they architect compute. Liqid is one of the few...  ...SVP of Worldwide Solutions Engineering and working directly with a...  ...server platforms, fabric and networking (CXL, PCIe Gen5/6, NVLink,... 
    Network
    Casual work
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    Liqid Inc

    New York, NY
    1 day ago
  • $164k - $295k

     ...world’s most advanced AI-native platform. We work...  ...-edge technologies to engineer robust backend...  ...platform ecosystem Infrastructure Design: Architect supporting...  ...Bachelor's degree in Computer Science/Engineering or...  ...level or role Employee Networks, geographic... 
    Network
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    New York, NY
    a month ago
  • $140k - $215k

     ...the world’s most advanced AI-native platform. We work on...  ...CrowdStrike is hiring a Sr. Software Engineer on the Infrastructure team to help grow our...  ...systems and cloud computing services. Proven experience...  ...of level or role Employee Networks, geographic neighborhood groups... 
    Network
    Remote job
    Full time
    Work experience placement
    Work at office
    Local area

    CrowdStrike

    New York, NY
    1 day ago
  • $184k - $287.5k

    Linux Systems Engineer We are seeking a Linux Systems Engineer to join our Infrastructure Engineering team, dedicated...  ...high-performance EDA compute farms. You will be responsible...  ...(LDAP/SSSD) and networked storage (NFS, Autofs)...  ...vacancy. NVIDIA uses AI tools in its... 
    Network
    Work experience placement

    NVIDIA

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Network and Compute Engineer, AI Infrastructure. Be the first to apply!