GPU Infrastructure Support Engineer
$140k - $170kFull-time
Yoh, A Day & Zimmermann Company
Job Title: AI Infrastructure Support Engineer
Location: New York, NY
Type - Hybrid 4 days Onsite
Terms; Full Time
Salary- $140000/yr - $170000/yr Our client provides a range of financial products and services in the United States and internationally. It operates through Securities Services, Market and Wealth Services, Investment and Wealth Management, and Other segments. The Securities Services segment offers custody, trust and depositary, accounting, exchange-traded funds, middle-office solutions, transfer agency, services for private equity and real estate funds, foreign exchange, securities lending, liquidity/lending services, and data analytics. In this role, you'll make an impact in the following ways:
Estimated Max Rate : $170000.00 What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
Fraudulent recruiting communications have become increasingly common. Emails from Yoh recruiters will only come from an @yoh.com email address. Yoh will never ask candidates to pay fees, purchase equipment, send gift cards, or transfer funds as part of the recruiting or hiring process. If you receive a communication that appears suspicious or requests payment, contact Yoh directly before responding or sharing personal information.
Location: New York, NY
Type - Hybrid 4 days Onsite
Terms; Full Time
Salary- $140000/yr - $170000/yr Our client provides a range of financial products and services in the United States and internationally. It operates through Securities Services, Market and Wealth Services, Investment and Wealth Management, and Other segments. The Securities Services segment offers custody, trust and depositary, accounting, exchange-traded funds, middle-office solutions, transfer agency, services for private equity and real estate funds, foreign exchange, securities lending, liquidity/lending services, and data analytics. In this role, you'll make an impact in the following ways:
- Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
- Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
- Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
- Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
- Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
- Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
- Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
- Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
- Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
- Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
- Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
- Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
- Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
- Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
- Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
- Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
- Understanding of identity and access management, including secure access controls such as Azure AD.
- Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
- Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
- Willingness to participate in on-call rotations and provide occasional weekend support as needed.
Estimated Max Rate : $170000.00 What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- MetLife Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Fraudulent recruiting communications have become increasingly common. Emails from Yoh recruiters will only come from an @yoh.com email address. Yoh will never ask candidates to pay fees, purchase equipment, send gift cards, or transfer funds as part of the recruiting or hiring process. If you receive a communication that appears suspicious or requests payment, contact Yoh directly before responding or sharing personal information.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the GPU Infrastructure Support Engineer in New York, NY vacancy
$60k - $80k
...including pet insurance, identity theft insurance, legal plans, and voluntary ancillary benefits.JOB SUMMARY:ICL’s IT Infrastructure Support Engineer, contributes to the day-to-day deployment, management, monitoring, maintenance, support, and incident response for ICL’...SuggestedFull timeRemote workFlexible hoursInstitute for Community Living
New York, NY2 days ago- Crusoe Cloud is transforming high-performance computing with sustainable, low‑cost GPU compute power. As a Senior Cloud Support Engineer, you will be the primary contact for technical support, helping customers leverage Crusoe Cloud to accelerate AI research and development...SuggestedFull time
- Crusoe Cloud is hiring a Cloud Support Engineer to empower customers using sustainable, low-cost GPU compute power. You will be the primary contact for technical support, enabling customers to achieve AI/ML, physics, and computational biology goals. The role centers on...Suggested
$145k - $175k
...intelligence . As the only vertically integrated AI infrastructure company built from the ground up, we own and operate... ...computing by offering sustainable, low-cost GPU compute power. As a Cloud Support Engineer, you'll play a crucial role in empowering our customers...SuggestedFull timeTemporary workShift workWeekend workWeekday workCrusoe
New York, NY27 days ago- ...Head of Engineering (GPU Infrastructure / HPC) Investment Profile Greylock-backed company in New York building a cloud simulation platform for robotics, autonomy, and physical AI. The platform helps engineering teams develop and evaluate autonomous systems, generate...SuggestedFull timeRelocation
Greylock Partners
New York, NY1 day ago $180k - $220k
.... As the only vertically integrated AI infrastructure company built from the ground up, we own... ...About the Role: As a Staff Cloud Support Engineer , you are a technical authority within... ...Infrastructure Expertise Troubleshoot NCCL, IB, GPU driver/firmware issues, distributed...Temporary workCrusoe
New York, NY29 days ago- Digital Room LLC in Van Nuys, CA hires an IT Support Engineer to diagnose and resolve software and hardware issues, support Windows/Mac, and manage IT assets. The role emphasizes service desk ticketing, remote assistance, and hands-on hardware setup in a fast-paced environment...Remote jobWork at officeMonday to Friday
- ...Job Description Job Description JOB SUMMARY: ICL’s Senior IT Infrastructure Support Engineer, contributes to the day-to-day deployment, management, monitoring, maintenance, support, and incident response for ICL’s IT infrastructure and cybersecurity. Network infrastructure...Work at officeRemote work
Institute for Comm Living
New York, NY7 days ago $122k - $163k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...high-performance experience. This team supports the infrastructure that powers the AI revolution... ...closely with the internal and customer engineering teams, offering valuable insights from...Permanent employmentFull timeTemporary workWork experience placementCasual workWork at officeRemote workWorldwideFlexible hoursShift workCoreWeave
New York, NY3 days ago- ExtraHop, a cybersecurity company that provides network detection and response solutions, is seeking a remote-first support engineer in the United States. You will assist customers with hardware, firmware, and configuration issues while growing as an engineer. The role...Remote job
- Tantalus Systems seeks a Remote Technical Support Specialist to join the Customer Operations team in the United States. You will deploy, operate, maintain and troubleshoot for Tantalus customers, serving as the primary technical interface between Field Operations and Product...Remote job
- ...Job Description Job: Aladdin Platform Support Engineer – Front Office \n Location: New York City, NY \n Interview Mode: In-Person \n \n Job Summary \n We are seeking an experienced Aladdin Platform Support Engineer with strong hands-on experience supporting...
TOPSYS IT
New York, NY7 days ago - ...resolve volume drivers ~ Execute deployment and procedures ~ Coordinate restoration actions with internal and external teams ~ Support outage recovery efforts ~ Log all actions in designated systems for audits and root cause analysis ~ Drive recovery efforts...Work at office3 days per week
SYSCOM GLOBAL SOLUTIONS INC.
New York, NY21 days ago - Tines is seeking a seasoned SaaS support professional to guide Federal customers on Tines... ..., security, workflows, and self-hosted infrastructure. This role emphasizes building and... ...acting as the Voice of the Customer to Engineering and Product teams. #J-18808-Ljbffr Tines
- NeoXam is looking for a Technical Support & Cloud Consultant in New York to provide client support and manage cloud infrastructure. The ideal candidate has 3-5 years in technical support, strong AWS skills, and experience with PostgreSQL. They will troubleshoot deployments...
- Nerdio, Inc. is hiring a client-facing Support Engineer to enable IT professionals and admins to maximize Nerdio platform value across Azure Virtual Desktop, Windows 365, and Intune. You will deliver hands-on support, drive efficient resolutions, and collaborate with engineering...Remote job
- Akamai Technologies GmbH is seeking a Senior Cloud Support Engineer to define and resolve complex technical issues related to Akamai products and infrastructure from Cambridge, MA. This role collaborates with customer technical teams on pre- and post-sales issues, analyzes...Remote job
$150k - $180k
...companies, bringing together early-stage engineers, product builders, and business... ...done that way at all. The Role As a Support Platform Engineer, you are the backbone... ...maintaining the AI tools and documentation infrastructure that keeps the entire operation improving...Work at officeRemote workWork from homeHome officeSoftware Engineering, Customer Service
New York, NYmore than 2 months ago- Zuma is seeking a Support Engineer to bridge customers, engineering, and product vision. You’ll ensure onboarding, reliable integrations, and scalable support operations for property management clients across the US. You’ll dive into APIs, databases, and documentation...
- Nooks is seeking a Technical Support Engineer to help users get the most value from our B2B SaaS platform. You will troubleshoot complex issues, collaborate with the engineering team, and contribute to scalable support processes in an early-stage startup environment. As...
- Talkdesk is seeking a Technical Support Engineer - Platform Support to be the first point of contact for platform related issues, accurately capturing incident details, classifying impact and severity, and pursuing rapid resolution. You will collaborate with Reporting,...
$45.07k - $79.5k
The Technical Support Engineer - Platform Support serves as the initial point of contact for Talkdesk’s platform related issues, accurately capturing incident details, classifying impact and severity, and attempting immediate resolution. Team Specific Duties and Responsibilities...Temporary workWork at officeImmediate startFlexible hours$138.38k - $189.6k
Senior Cloud Support Engineer Akamai Technologies, Inc. is hiring for the following role in Cambridge, MA (multiple openings): Senior Cloud... ...complex technical issues related to Akamai products and infrastructure. Work with customer technical teams on pre- and post- sales...Work experience placementWork at officeRemote work- Opportunities in the BragDev network for U.S.-based technical professionals. Senior AI Infrastructure Engineer (GPU and Model Serving) Senior Full-time Remote, U.S. Python AWS PyTorch MLOps Distributed Systems You run the infrastructure behind AI workloads: GPU...Full timeRemote work
- Vultr seeks an Associate Infrastructure Production Engineer to ensure GPU hardware validation across a global production environment. The role requires strong Linux skills, Python scripting, and a detail-oriented approach to automation and testing. You will collaborate...
- ...States (New York) is seeking a Platform Engineer for our Compute Platform team. You will... ...health checks, remediation, and scalable GPU workloads. Collaborate with training teams... ...strategies while shaping the infrastructure roadmap for future GPU deployments. #J-...
$108k - $172.5k
...computing. An era in which our GPU acts as the brains of... ...ll be immersed in a diverse, supportive environment where everyone is... ...motivated Senior HPC Support Engineer focussing on InfiniBand and... ...large-scale networking and AI Infrastructure environments and products such...Full timeWork experience placementNvidia
New York, NY1 day ago- Coforge is hiring a Production Support Engineer to provide ongoing support for US regional applications with focus on incident resolution... ...skills, SQL proficiency, and experience with Linux-based infrastructure and cloud services. You will work with Splunk, Dynatrace, GitHub...Remote job
- Thales is seeking a Product Support Specialist to handle Level-2 and 3 support calls, working with Product Support, Engineering, QA, Sales Security Engineering, and Partners to resolve issues for Imperva customers. Remote - BC position, with a TTC range of CAD 78,800.25...Remote job
$40 - $45 per hour
iSoftStone, Inc. is seeking an SAP Commerce Cloud Production Support Engineer. to join our Team! Remote Opportunity Candidates must... ...readiness. Collaborate with business stakeholders, vendors, infrastructure teams, and development teams to assess business impact,...Hourly payPermanent employmentFull timeTemporary workFor contractorsRemote workWorldwideWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Infrastructure Support Engineer. Be the first to apply!
Related searches
- lead infrastructure engineer New York, NY
- infrastructure developer New York, NY
- infrastructure engineering manager New York, NY
- data infrastructure engineer New York, NY
- remote infrastructure engineer New York, NY
- entry level infrastructure engineer New York, NY
- infrastructure engineer New York, NY
- infrastructure automation engineer New York, NY
- senior infrastructure engineer New York, NY
- security infrastructure engineer New York, NY