GPU Infrastructure Support Engineer
$140k - $170kFull-time
Yoh, A Day & Zimmermann Company
Job Title: AI Infrastructure Support Engineer
Location: New York, NY
Type - Hybrid 4 days Onsite
Terms; Full Time
Salary- $140000/yr - $170000/yr Our client provides a range of financial products and services in the United States and internationally. It operates through Securities Services, Market and Wealth Services, Investment and Wealth Management, and Other segments. The Securities Services segment offers custody, trust and depositary, accounting, exchange-traded funds, middle-office solutions, transfer agency, services for private equity and real estate funds, foreign exchange, securities lending, liquidity/lending services, and data analytics. In this role, you'll make an impact in the following ways:
Estimated Max Rate : $170000.00 What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
Fraudulent recruiting communications have become increasingly common. Emails from Yoh recruiters will only come from an @yoh.com email address. Yoh will never ask candidates to pay fees, purchase equipment, send gift cards, or transfer funds as part of the recruiting or hiring process. If you receive a communication that appears suspicious or requests payment, contact Yoh directly before responding or sharing personal information.
Location: New York, NY
Type - Hybrid 4 days Onsite
Terms; Full Time
Salary- $140000/yr - $170000/yr Our client provides a range of financial products and services in the United States and internationally. It operates through Securities Services, Market and Wealth Services, Investment and Wealth Management, and Other segments. The Securities Services segment offers custody, trust and depositary, accounting, exchange-traded funds, middle-office solutions, transfer agency, services for private equity and real estate funds, foreign exchange, securities lending, liquidity/lending services, and data analytics. In this role, you'll make an impact in the following ways:
- Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
- Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
- Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
- Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
- Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
- Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
- Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
- Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
- Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
- Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
- Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
- Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
- Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
- Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
- Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
- Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
- Understanding of identity and access management, including secure access controls such as Azure AD.
- Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
- Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
- Willingness to participate in on-call rotations and provide occasional weekend support as needed.
Estimated Max Rate : $170000.00 What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- MetLife Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Fraudulent recruiting communications have become increasingly common. Emails from Yoh recruiters will only come from an @yoh.com email address. Yoh will never ask candidates to pay fees, purchase equipment, send gift cards, or transfer funds as part of the recruiting or hiring process. If you receive a communication that appears suspicious or requests payment, contact Yoh directly before responding or sharing personal information.
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the GPU Infrastructure Support Engineer in New York, NY vacancy
$60k - $80k
...including pet insurance, identity theft insurance, legal plans, and voluntary ancillary benefits.JOB SUMMARY:ICL’s IT Infrastructure Support Engineer, contributes to the day-to-day deployment, management, monitoring, maintenance, support, and incident response for ICL’...SuggestedFull timeRemote workFlexible hoursInstitute for Community Living
New York, NY6 days ago$145k - $175k
...Senior Cloud Support Engineer Crusoe Cloud is revolutionizing high-performance computing by offering sustainable, low-cost GPU compute power. As a Senior Cloud Support Engineer, you... ...Developer - Associate, NVIDIA AI Infrastructure and Operations, Generative AI and...SuggestedFull timeTemporary workG2 Venture Partners
New York, NY3 days ago- ...seeking a future team member for the role of Vice President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team. This is a hand... ...support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services. Support...SuggestedFor contractors
TalentAlly
New York, NY1 day ago - ...Head of Engineering (GPU Infrastructure / HPC) Investment Profile Greylock-backed company in New York building a cloud simulation platform for robotics, autonomy, and physical AI. The platform helps engineering teams develop and evaluate autonomous systems, generate...SuggestedFull timeRelocation
Greylock Partners
New York, NY14 hours ago $122k - $163k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...high-performance experience. This team supports the infrastructure that powers the AI revolution... ...closely with the internal and customer engineering teams, offering valuable insights from...SuggestedPermanent employmentFull timeTemporary workWork experience placementCasual workWork at officeRemote workWorldwideFlexible hoursShift workCoreWeave
New York, NY7 days ago- ExtraHop, a cybersecurity company that provides network detection and response solutions, is seeking a remote-first support engineer in the United States. You will assist customers with hardware, firmware, and configuration issues while growing as an engineer. The role...Remote job
- ...ésumé matters more the longer a role has been live. No pay range in our index for this listing. Across 1,744 indexed Software Engineer roles in US that do publish one, the middle half sits between $185k and $288k , median $226k — JobLarper's read of the market,...Remote work
JobLarper
New York, NY1 day ago - Tantalus Systems seeks a Remote Technical Support Specialist to join the Customer Operations team in the United States. You will deploy, operate, maintain and troubleshoot for Tantalus customers, serving as the primary technical interface between Field Operations and Product...Remote job
$152k - $241.5k
...NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is... ...reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our... ...We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence...Full timeLocal areaRemote workNvidia
New York, NY3 days ago- Tines is seeking a seasoned SaaS support professional to guide Federal customers on Tines... ..., security, workflows, and self-hosted infrastructure. This role emphasizes building and... ...acting as the Voice of the Customer to Engineering and Product teams. #J-18808-Ljbffr Tines
$138.38k - $189.6k
Senior Cloud Support Engineer Akamai Technologies, Inc. is hiring for the following role in Cambridge, MA (multiple openings): Senior Cloud... ...complex technical issues related to Akamai products and infrastructure. Work with customer technical teams on pre- and post- sales...Work experience placementWork at officeRemote work- Opportunities in the BragDev network for U.S.-based technical professionals. Senior AI Infrastructure Engineer (GPU and Model Serving) Senior Full-time Remote, U.S. Python AWS PyTorch MLOps Distributed Systems You run the infrastructure behind AI workloads: GPU...Full timeRemote work
- Vultr seeks an Associate Infrastructure Production Engineer to ensure GPU hardware validation across a global production environment. The role requires strong Linux skills, Python scripting, and a detail-oriented approach to automation and testing. You will collaborate...
- Zuma is seeking a Support Engineer to bridge customers, engineering, and product vision. You’ll ensure onboarding, reliable integrations, and scalable support operations for property management clients across the US. You’ll dive into APIs, databases, and documentation...
- Nooks is seeking a Technical Support Engineer to help users get the most value from our B2B SaaS platform. You will troubleshoot complex issues, collaborate with the engineering team, and contribute to scalable support processes in an early-stage startup environment. As...
- United States Digital Space LLC is seeking a Technical Support Engineer to join our global technical support team. You will grow deep knowledge of our platform, serve as an escalation point for complex issues, and collaborate with Support, Engineering, and Product to surface...
$145k - $170k
...intelligence . As the only vertically integrated AI infrastructure company built from the ground up, we own and operate... ...computing by offering sustainable, low-cost GPU compute power. As a Cloud Support Engineer, you'll play a crucial role in empowering our customers...Full timeTemporary work- ...APIs, driving reliability, scalability, and performance. The role requires extensive production experience with Slurm in HPC environments using Go or Python, deep GPU infrastructure knowledge, and strong leadership across multiple engineering teams. #J-18808-Ljbffr Nscale
$108k - $172.5k
...computing. An era in which our GPU acts as the brains of... ...ll be immersed in a diverse, supportive environment where everyone is... ...motivated Senior HPC Support Engineer focussing on InfiniBand and... ...large-scale networking and AI Infrastructure environments and products such...Full timeWork experience placementNvidia
New York, NY5 days ago$40 - $45 per hour
iSoftStone, Inc. is seeking an SAP Commerce Cloud Production Support Engineer. to join our Team! Remote Opportunity Candidates must... ...readiness. Collaborate with business stakeholders, vendors, infrastructure teams, and development teams to assess business impact,...Hourly payPermanent employmentFull timeTemporary workFor contractorsRemote workWorldwideWeekend work$180k - $220k
.... As the only vertically integrated AI infrastructure company built from the ground up, we own... ...About the Role: As a Staff Cloud Support Engineer , you are a technical authority within... ...Infrastructure Expertise Troubleshoot NCCL, IB, GPU driver/firmware issues, distributed...Temporary work- Thales is seeking a Product Support Specialist to handle Level-2 and 3 support calls, working with Product Support, Engineering, QA, Sales Security Engineering, and Partners to resolve issues for Imperva customers. Remote - BC position, with a TTC range of CAD 78,800.25...Remote job
- Coforge is hiring a Production Support Engineer to provide ongoing support for US regional applications with focus on incident resolution... ...skills, SQL proficiency, and experience with Linux-based infrastructure and cloud services. You will work with Splunk, Dynatrace, GitHub...Remote job
- Lightning AI is seeking a Senior Backend Engineer for the Managed Services team to design, build, and operate backend services that power our GPU infrastructure platform. You will develop control planes and automation to provision and scale Kubernetes and Slurm clusters...Work at office2 days per week
$168k - $270.25k
...computing. An era in which our GPU acts as the brains of... ...ll be immersed in a diverse, supportive environment where everyone is... ...Experience (NVEX) Solutions Engineering team is looking for a senior... ...that link GPUs and AI compute infrastructure. Candidates must have a software...Full timeWeekend workNvidia
New York, NY6 days ago- HireHi ищет специалиста поддержки для обеспечения стабильности и доступности дата-платформы. Вы будете регистрировать обращения, помогать с доступом к интерфейсам и системам, анализировать логи и передавать сложные инциденты во вторую линию. Требуется базовое понимание ...Flexible hours
- HSI is seeking an Advanced Technical Support Specialist who provides expert assistance across our software solutions. You will troubleshoot complex platform issues, support data imports and migrations, and guide customers and internal teams on configurations and data mapping...Remote work
$152k - $241.5k
Performance Engineer NVIDIA is leading the way in groundbreaking developments in Artificial... ...Computing and Visualization. The GPU, our invention, serves as the visual cortex... ...lot of performance data; build tools and infrastructure to visualize and analyze the information...- ...provider, specializing in providing computer network and server support to small and medium-sized businesses based in the North Georgia... ...after-hours, weekends, and on-call in rotation with other IT engineers Any other duties that are expected of you to continue to provide...Full timeWork at officeLocal areaImmediate startWeekend work
$65 - $75 per hour
...has a client in NYC that is seeking an Infrastructure Engineer. Key Responsibilities:* Provision, configure... ...environments within Amazon EKS* Support deployment and operation of AI execution... ...AI platforms* Familiarity with NVIDIA GPU environments and AI infrastructure* Experience...KForce
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Infrastructure Support Engineer. Be the first to apply!
Related searches
- lead infrastructure engineer New York, NY
- infrastructure developer New York, NY
- infrastructure engineering manager New York, NY
- data infrastructure engineer New York, NY
- remote infrastructure engineer New York, NY
- associate infrastructure engineer New York, NY
- entry level infrastructure engineer New York, NY
- infrastructure engineer New York, NY
- infrastructure automation engineer New York, NY
- senior infrastructure engineer New York, NY