Staff Infrastructure Engineer - Cloud & GPU

Artmac Soft LLC

Who we are

Artmac Soft is a technology consulting and service-oriented IT company that provides innovative technology solutions and services to customers.

Job Description:

Job Title : Staff Infrastructure Engineer - Cloud & GPU

Job Type : W2/C2C

Experience : 8+ Years

Location : San Francisco, California (On-Site)

Role Summary:

We are seeking an experienced Staff Infrastructure Engineer to design, deploy, automate and maintain large-scale GPU computing infrastructure supporting AI/ML workloads.The ideal candidate will have strong hands-on experience with Linux, bare-metal provisioning, Kubernetes, infrastructure automation and GPU server operations.

Responsibilities:

Design, deploy and maintain large-scale bare-metal GPU server infrastructure.
Develop automation tools to support simultaneous provisioning and deployment of 80 100 servers or more.
Manage Linux servers, GPU hardware, BIOS, firmware and BMC/IPMI.
Implement automated bare-metal provisioning using PXE, MAAS or equivalent technologies.
Deploy, administer and troubleshoot Kubernetes clusters supporting AI/ML workloads.
Develop infrastructure automation using Golang or Python, Ansible and Terraform.
Coordinate with OEM vendors and data center operations to diagnose and resolve GPU server hardware failures, firmware compatibility issues and infrastructure incidents.
Troubleshoot GPU hardware, server failures and infrastructure performance issues.
Implement monitoring, health checks, automated recovery and infrastructure reliability improvements.

Required Experience & Skills :

8+ years of infrastructure, systems, platform engineering, DevOps or SRE experience.
Advanced Linux administration and bare-metal server provisioning.
Hands-on experience with PXE booting and large-scale server deployment.
Kubernetes deployment, administration and troubleshooting.
Strong programming experience with Python or Golang, preferably Golang.
Experience with Ansible and Terraform.
Knowledge of BMC/IPMI, BIOS, firmware and enterprise server management.
Experience troubleshooting physical servers, preferably GPU-based systems.

Preferred Skills:

NVIDIA DGX/HGX or equivalent GPU server infrastructure.
Canonical MAAS and NVIDIA GPU drivers/DCGM.
Prometheus, Grafana, and infrastructure monitoring.
Slurm, NVIDIA Run: ai, or equivalent GPU workload orchestration.
InfiniBand, RoCE, or hyperscale AI cloud infrastructure.

Qualification:

Bachelor's degree or equivalent combination of education and experience.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Staff Infrastructure Engineer - Cloud & GPU in San Francisco, CA vacancy

Senior Cloud Infrastructure Engineer, Cloud Foundations
...Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers... ...superintelligence. One person, one GPU. If you'd like to build the world'... ...with Security, GRC, IT, and the engineering teams that consume the foundation,...
Suggested
Work at office
Local area
Work from home
Flexible hours
Engg
San Francisco, CA
2 hours ago
Staff Infrastructure Engineer
$276.5k - $300k
...software, AI, cryptography, mobile engineering, and global operations. Our... ...About the Team Our Infrastructure team is a collaborative... ...Opportunity We are looking for a Staff Infrastructure Engineer to... ...with Linux, networking, and cloud environments like AWS or GCP...
Suggested
Flexible hours
Tools for Humanity
San Francisco, CA
4 days ago
Staff Infrastructure Engineer
...Every civilization runs on the same infrastructure: agreements between people who don't fully... ...grown 800% over the last 12 months. Engineering at Ivo Engineers at Ivo are inventors... ..., etc. When things break or go down, Cloud and LLM providers have "incidents." And...
Suggested
Contract work
Work at office
Visa sponsorship
Relocation package
Flexible hours
IVO Inc
San Francisco, CA
21 hours ago
Staff Platform Engineer
...insurance navigation. The infrastructure challenge is unlike anything... ...The Role We're hiring a Staff Platform Engineer to build and own the infrastructure... ...Citizen Health - the cloud platform, deployment systems... ...model serving, manage GPU and compute capacity, negotiate...
Suggested
Remote work
Flexible hours
Citizen Health
San Francisco, CA
1 day ago
Staff Infrastructure Engineer
$307k - $352k
...impact. About the Role Kikoff's infrastructure team builds the systems that enable engineering teams to move quickly without sacrificing... ..., and Data Infrastructure. As a Staff Infrastructure Engineer, you... ..., developer productivity, cloud compute, networking, storage, data...
Suggested
Permanent employment
Local area
Socket
San Francisco, CA
4 days ago
Staff Data Infrastructure Engineer
$246.5k - $339k
...community, come join ours.About this role:Our Engineering organization owns the software that... ...plumbing underneath.We are hiring a Staff Engineer to own that plumbing. Concretely... ...:You've built and run data infrastructure that other teams depended on, at meaningful...
Work experience placement
Work at office
Local area
Remote work
Monday to Friday
Flexible hours
3 days per week
Faire
San Francisco, CA
5 hours ago
Head of GPU Cloud
...Head of GPU Cloud About the Company Developing software foundation for next-generation... ...computing platform for large-scale AI infrastructure. Industry Information Technology... ...a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a...
Confidential
San Francisco, CA
2 days ago
Sr Engineering Manager, Cloud Infrastructure
...profitability for sustainable growth. This role The Senior Engineering Manager, Cloud Infrastructure leads the engineering team responsible for the company’... ..., and retain high-performing engineering managers, staff engineers, and senior individual contributors....
PayJoy
San Francisco, CA
6 days ago
Staff Engineer
...makes sense, PyTorch over legacy ML frameworks. The Work GPU inference : We run our own ASR models. Real-time... ...Celery for background jobs. PostgreSQL. There are no separate infrastructure and product teams. You will work on all of it. Stack...
Aqua Voice
San Francisco, CA
3 days ago
Cloud Infrastructure Engineer
$200k - $300k
...and performance matter. About the Role We're hiring a Cloud Infrastructure Engineer to own Salient's cloud footprint across AWS, GCP, and Render... ...telephony, WebRTC, or streaming systems. • Experience running GPU or LLM inference workloads, or managing spend on hosted AI...
Full time
Work at office
Salient
San Francisco, CA
4 days ago
Staff Cloud Engineer
$210k - $260k
...Staff Cloud Engineer - Earthly Lunar Write production software, design the cloud architecture behind it, and own how it runs in the real... .... You'll work on Lunar's core product and the infrastructure that runs it, across our hosted service and customer-managed...
Full time
Remote work
Earthly Technologies Inc.
San Francisco, CA
2 days ago
Lead Infrastructure Engineer - Cloud Networking
$61k - $101k
...000 per year Requirements: We have formal training or certification in infrastructure engineering concepts, plus 5+ years of hands-on experience. We bring substantial experience in cloud networking architecture and enterprise network design within regulated environments...
Full time
J.P. Morgan
San Francisco, CA
3 days ago
Staff Engineer, Command Center Insights & Actions
$210k - $255k
...only vertically integrated AI infrastructure company built from the... ...data center construction, and cloud services. If you want to... ...Role: We are looking for a Staff Engineer to be the detection authority... ...including straggler node detection, GPU health signals, and fleet-...
Full time
Temporary work
Crusoe
San Francisco, CA
5 days ago
Senior Software Engineer, Cloud Infrastructure
$200k - $400k
...reliable, and secure (across our multi-tenant cloud and inside customers' own locked-down environments) is an infrastructure problem, and that's the problem this role... ...infrastructure, Kubernetes, and networking that let engineers ship without becoming infrastructure experts....
Full time
Work at office
Local area
Shift work
Decagon
San Francisco, CA
1 day ago
Senior Software Engineer, Cloud Infrastructure / SRE
$180.5k - $236.91k
...Description Hi, we're Oscar. We're hiring a Senior Software Engineer, Cloud Infrastructure / SRE to join our Engineering team. Oscar is the first... ...security or stability. You will report into a Staff/Senior Staff Engineer. Work Location: This is a remote...
Full time
Work at office
Remote work
Oscar Health
San Francisco, CA
28 days ago
Staff Engineer, AI & Platform Engineering
$200k - $220k
...About this Role: We are looking for a Staff Engineer with deep technical experience and a track record of leading complex engineering... ...such as Lambda, DynamoDB, and API Gateway; experience with infrastructure as code tools such as AWS CDK, SST, or Pulumi is a plus ~...
Full time
Remote work
Jobs in JS
San Francisco, CA
1 day ago
Staff Engineer, AI-Driven Platform & Cloud Architecture
...Science Exchange is seeking a Staff Engineer to architect and scale a platform that accelerates scientific research. You will lead architectural decisions, mentor engineers, and advance AI-assisted development practices across a Salesforce-AWS powered stack. You will...
Jobleads-US
San Francisco, CA
1 day ago
IT Systems Engineer: Cloud Infrastructure
$182k - $242k
...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ..., CoreWeave combines superior infrastructure performance with deep technical expertise... ...Learn more at About the Team: The IT Engineering at CoreWeave designs, builds, and operates...
Permanent employment
Full time
Temporary work
Work experience placement
Casual work
Work at office
Remote work
Flexible hours
CoreWeave
San Francisco, CA
29 days ago
Staff Design Engineer
...which will de-risk the largest infrastructure build-out in history. When people finance GPU clusters, the datacenters housing... ...We're looking to hire an engineer to build extremely high-fidelity... ...functional, but genuinely good Staff+ level ability to operate...
Long term contract
Contract work
Fixed term contract
Work at office
Local area
Visa sponsorship
Shift work
The San Francisco Compute Company
San Francisco, CA
11 hours ago
Staff Platform Engineer
...team brings together deep expertise in engineering and finance. We've built accounting systems... ..., launched products from 0→1, scaled infrastructure processing billions of dollars, built... ...engineering problems we work on. As a Staff Engineer on the Platform team, you'll work...
Work at office
Remote work
Flexible hours
1 day per week
Quanta Financial, Inc
San Francisco, CA
11 hours ago
Staff Software Engineer (Cloud Infrastructure)
$215k - $260k
...As the only vertically integrated AI infrastructure company built from the ground up, we... ..., data center construction, and cloud services. If you want to do the... ...seeking a highly skilled and motivated GPU Fleet Operations Engineer to join Crusoe’s Fleet Operations team...
Full time
Temporary work
Work at office
Crusoe
San Francisco, CA
a month ago
Staff Cloud Support Engineer
$156k - $190k
...only vertically integrated AI infrastructure company built from the... ...data center construction, and cloud services. If you want... ...About the Role: As a Staff Cloud Support Engineer , you are a technical authority... ...Troubleshoot NCCL, IB, GPU driver/firmware issues, distributed...
Temporary work
Crusoe
San Francisco, CA
11 days ago
Senior Staff Network Engineer, Deployment
$225k - $275k
...vertically integrated AI infrastructure company built from the ground... ...center construction, and cloud services. If you want to... ...Cloud is seeking a Senior Staff Network Deployment Engineer to serve as the technical... ...performance compute (HPC) and GPU-based AI infrastructure,...
Temporary work
Remote work
Crusoe
San Francisco, CA
1 day ago
Staff Mechanical Engineer
$349k
Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers... ...superintelligence. One person, one GPU. If you'd like to build the world'... ..., building structure, hardware engineering, construction, commissioning, and...
Work at office
Local area
Work from home
Flexible hours
Lambda
San Francisco, CA
11 hours ago
Senior Staff Security Engineer - Cloud and Network Security
$210k - $270k
...the Role: We're looking for a Senior Staff Security Engineer to lead Gusto's edge and network... ...across the security org, partnering with infrastructure and product teams to make high-impact... ...high-leverage group responsible for cloud security posture, edge and network defense...
Full time
Work at office
Local area
Remote work
2 days per week
3 days per week
Gusto
San Francisco, CA
a month ago
Staff Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From Home
...Job Description Staff Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From... ...sits at the intersection of research, infrastructure, and product. You are responsible... ...Own production deployment, including GPU optimization, memory efficiency, latency...
Full time
Remote work
Work from home
Ginas Tech Jobs
San Francisco, CA
10 days ago
Member of Technical Staff - Platform Engineering
...and motivated Member of Technical Staff to join our Platform Engineering team in our San Francisco office. As... ...engineering, building RL environments or ML infrastructure - Strong knowledge of programming... ...Python, or C++ - Experience with cloud technologies such as AWS, Azure, or...
Permanent employment
Full time
Work at office
Upcoresolutions
San Francisco, CA
17 days ago
Director, Product Management - Cloud Infrastructure
$258k - $355k
...secures AI by building the trusted, neutral infrastructure that enables organizations to safely... ...US Federal business, as well as our cloud service provider posture. Finally, this... ...with cross-functional teams, including engineering, sales, and marketing, to ensure the successful...
Local area
Segment (Twilio)
San Francisco, CA
2 days ago
Staff Machine Learning Engineer, ML Platform
$184k - $314k
.... WHAT YOU'LL DO Braze is seeking a Staff Machine Learning Engineer to join our Predictive and Generative AI (PGAI... ...orchestration, overhauling deployment and cloud identity, or retiring a generation of infrastructure Build and ship at high velocity. Staff...
Full time
Work at office
Local area
Flexible hours
Braze
San Francisco, CA
3 days ago
Staff Infrastructure Security Engineer
$215k - $260k
.... As the only vertically integrated AI infrastructure company built from the ground up, we own... ...manufacturing, data center construction, and cloud services. If you want to do the most... ...a Senior Infrastructure Security Engineer dedicated to establishing a high-assurance...
Full time
Temporary work
Crusoe
San Francisco, CA
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Infrastructure Engineer - Cloud & GPU. Be the first to apply!