Staff Infrastructure Engineer - Cloud & GPU
Artmac Soft LLC
Who we are
Artmac Soft is a technology consulting and service-oriented IT company that provides innovative technology solutions and services to customers.
Job Description:
Job Title : Staff Infrastructure Engineer - Cloud & GPU
Job Type : W2/C2C
Experience : 8+ Years
Location : San Francisco, California (On-Site)
Role Summary:
We are seeking an experienced Staff Infrastructure Engineer to design, deploy, automate and maintain large-scale GPU computing infrastructure supporting AI/ML workloads.The ideal candidate will have strong hands-on experience with Linux, bare-metal provisioning, Kubernetes, infrastructure automation and GPU server operations.
Responsibilities:
- Design, deploy and maintain large-scale bare-metal GPU server infrastructure.
- Develop automation tools to support simultaneous provisioning and deployment of 80 100 servers or more.
- Manage Linux servers, GPU hardware, BIOS, firmware and BMC/IPMI.
- Implement automated bare-metal provisioning using PXE, MAAS or equivalent technologies.
- Deploy, administer and troubleshoot Kubernetes clusters supporting AI/ML workloads.
- Develop infrastructure automation using Golang or Python, Ansible and Terraform.
- Coordinate with OEM vendors and data center operations to diagnose and resolve GPU server hardware failures, firmware compatibility issues and infrastructure incidents.
- Troubleshoot GPU hardware, server failures and infrastructure performance issues.
- Implement monitoring, health checks, automated recovery and infrastructure reliability improvements.
Required Experience & Skills :
- 8+ years of infrastructure, systems, platform engineering, DevOps or SRE experience.
- Advanced Linux administration and bare-metal server provisioning.
- Hands-on experience with PXE booting and large-scale server deployment.
- Kubernetes deployment, administration and troubleshooting.
- Strong programming experience with Python or Golang, preferably Golang.
- Experience with Ansible and Terraform.
- Knowledge of BMC/IPMI, BIOS, firmware and enterprise server management.
- Experience troubleshooting physical servers, preferably GPU-based systems.
Preferred Skills:
- NVIDIA DGX/HGX or equivalent GPU server infrastructure.
- Canonical MAAS and NVIDIA GPU drivers/DCGM.
- Prometheus, Grafana, and infrastructure monitoring.
- Slurm, NVIDIA Run: ai, or equivalent GPU workload orchestration.
- InfiniBand, RoCE, or hyperscale AI cloud infrastructure.
Qualification:
-
Bachelor's degree or equivalent combination of education and experience.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Infrastructure Engineer - Cloud & GPU in San Francisco, CA vacancy
$152k - $221k
...and manage the deployment of cloud networking solutions according... ...Specialists, Product, and Engineering teams to package approaches,... ...years of experience automating infrastructure provisioning, Developer Operations... ...and inference workloads on GPU/TPU using frameworks such as...Suggested$173.5k - $331.05k
...these products. We are looking for a senior, hands-on engineer to own and evolve the cross-platform GPU rendering platform at the heart of that mission —... ...Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager,...SuggestedFull timeTemporary workLocal areaWorldwide- ...About the job FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud. As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built...SuggestedPermanent employmentFull timeFlexible hours
FriendliAI
San Francisco, CAa month ago $179k - $218k
...the only vertically integrated AI infrastructure company built from the ground up,... ...manufacturing, data center construction, and cloud services.If you want to do the... ...bridged.We are seeking a Senior Staff Data Center Operations Engineer, GPU Hardware Architecture to be the...SuggestedTemporary work$300 per month
...As the only vertically integrated AI infrastructure company built from the ground up, we... ..., data center construction, and cloud services. If you want to do the... ...seeking a highly skilled and motivated GPU Fleet Operations Engineer to join Crusoe’s Fleet Operations team...SuggestedFull timeTemporary workWork at officeCrusoe
San Francisco, CAmore than 2 months ago$156k - $190k
...only vertically integrated AI infrastructure company built from the... ...data center construction, and cloud services.If you want to do... ...Crusoe.About the Role:As a Staff Cloud Support Engineer, you are a technical authority... ...NCCL, IB, GPU driver/firmware issues, distributed...Temporary work$200k - $240k
...opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure &... ...infrastructure role. At the Senior-to-Staff level, we expect you to: Own domains... ...infrastructure for AI/ML workloads: GPU-enabled compute, SageMaker endpoints,...Work at officeImmediate start3 days per weekAltruist
San Francisco, CA5 days ago$175k - $300k
...goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands... ...the frontier forward. The Production Engineering Team Examples of key exciting... ...facing platforms, so every new site and GPU generation lands cleanly from day zero....Local areaFluidstack
San Francisco, CA5 days ago- ...intelligence powering every AI surface at Rippling.As a Staff Machine Learning Engineer, you will own the end-to-end ML lifecycle: problem... ...enterprise domain Build robust evaluation and experimentation infrastructure: offline benchmarks, A/B testing, and continuous...Work at office3 days per week
$132k - $165k
...Visa sponsorship.Overall PurposeThe Staff Platform Security Engineer is a highly technical individual contributor... ...security into the software and infrastructure lifecycle by building secure-by-... ...engineering, software engineering, cloud infrastructure, security engineering...Hourly payFull timeImmediate startVisa sponsorshipWork visaFlexible hours$276.5k - $300k
...software, AI, cryptography, mobile engineering, and global operations. Our... ...About the Team Our Infrastructure team is a collaborative... ...Opportunity We are looking for a Staff Infrastructure Engineer to... ...with Linux, networking, and cloud environments like AWS or GCP...Flexible hoursTools for Humanity
San Francisco, CA3 days ago- ...Every civilization runs on the same infrastructure: agreements between people who don't fully... ...grown 800% over the last 12 months. Engineering at Ivo Engineers at Ivo are inventors... ..., etc. When things break or go down, Cloud and LLM providers have "incidents." And...Contract workWork at officeVisa sponsorshipRelocation packageFlexible hours
IVO Inc
San Francisco, CA5 days ago - ...addresses.About the roleRippling's Infrastructure organization owns the... ...company. Supporting more than 1,000 engineers and millions of end users, the Cloud Infrastructure team is responsible... ...programsExperience developing senior engineers, Staff Engineers, and Principal...Work at office3 days per week
$215k - $265k
Staff Infrastructure Engineer At Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data is... ...the way. Komodo Health is growing quickly, and so is the cloud infrastructure underneath it. You will join the Infrastructure...Work experience placementLocal areaFlexible hours$307k - $352k
...impact. About the Role Kikoff's infrastructure team builds the systems that enable engineering teams to move quickly without... ...and Data Infrastructure. As a Staff Infrastructure Engineer, you will... ...observability, developer productivity, cloud compute, networking, storage,...Permanent employmentLocal area- ...insurance navigation. The infrastructure challenge is unlike anything... ...The Role We're hiring a Staff Platform Engineer to build and own the infrastructure... ...Citizen Health - the cloud platform, deployment systems... ...model serving, manage GPU and compute capacity, negotiate...Remote workFlexible hours
$350k
...opportunities? Join a rapidly growing AI infrastructure provider delivering large-scale... ...and inference across global cloud and GPU environments. The organization partners... .... This opportunity is for a Staff Site Reliability Engineer to lead the reliability of large-...Full timeSan Francisco, CAmore than 2 months ago$126k - $204.5k
...work truly matters.Job SummaryJob SummaryWe're looking for an Infrastructure Engineer to build developer tooling that enables developer velocity... ...deployments, and releases. You’ll be working with the latest cloud-native technologies as you build an infrastructure platform...Full timeLocal areaRemote work- ...profitability for sustainable growth. This role The Senior Engineering Manager, Cloud Infrastructure leads the engineering team responsible for the company’... ..., and retain high-performing engineering managers, staff engineers, and senior individual contributors....
PayJoy
San Francisco, CA29 days ago $180.5k - $236.91k
...Hi, we're Oscar. We're hiring a Senior Software Engineer, Cloud Infrastructure / SRE to join our Engineering team. Oscar is the first health insurance... ...security or stability. You will report into a Staff/Senior Staff Engineer. Work Location: This is a remote...Remote jobFull timeWork at officeOscar Health
San Francisco, CAa month ago$168k - $247k
...in minutes.About the RoleAs a Senior/Staff Deep RL Engineer, you will design, train, and deploy deep... ...model-based deep RL agents using GPU-accelerated simulation at massive scale... ...Build and maintain distributed training infrastructure in JAX across large compute clusters.Build...Hourly payWork at officeLocal areaRemote workFlexible hours$210k - $255k
...only vertically integrated AI infrastructure company built from the... ...data center construction, and cloud services.If you want to do the... ...the Role:We are looking for a Staff Engineer to be the detection... ...including straggler node detection, GPU health signals, and fleet-...Temporary work- ...About the Team The Applied Engineering team works across research, engineering, product,... ...team responsible for running the core infrastructure that supports products like ChatGPT and... ...infrastructure deployment, our networking stack, cloud abstractions, and more. We seek to...Full timeRelocation package
OpenAI
San Francisco, CAmore than 2 months ago $200k - $400k
...as a team. About the Team The Infrastructure team builds and operates the foundations... ..., and secure (across our multi-tenant cloud and inside customers' own locked-down... ...infrastructure, Kubernetes, and networking that let engineers ship without becoming infrastructure...Full timeWork at officeLocal areaShift workDecagon
San Francisco, CA15 days ago$170.4 per hour
...world's best data and AI infrastructure platform so our... ...their business.Founded by engineers, we leap at every opportunity... ...internal teams.As a Staff Backline Engineer, you... ..., memory/CPU/GPU issues, distributed execution... ...such as Kubernetes, cloud ML platforms, CI/CD,...Local areaWorldwide- ...manufacturing, large-scale infrastructure, logistics, and legacy environments... ...We're looking for a Senior/Staff DevOps Engineer who has spent the last... ..., and resilient — from GPU-backed training and inference... ...environments across cloud and on-prem/edge deployments...Remote work
Nexxa.ai
San Francisco, CA4 days ago - ...team that is dedicated to excellence in its craft, apply. The Role Accord is going Multi-Cloud, and we’re looking for our first Cloud Infrastructure Engineer to own and expand the infrastructure that powers our core product. You’ll work across Kubernetes,...Full timeWork at officeImmediate start3 days per week
Accord.
San Francisco, CA29 days ago $147k - $210k
...experience with developing large - scale infrastructure, distributed systems or networks, or... ...diagnosis and resolution, and software test engineering.Google's software engineers develop the... ...and enhance software solutions.Google Cloud accelerates every organization’s...$148.5k - $223.9k
...you are the future of Salesforce.The ExperienceOur Public Cloud engineering teams are responsible for innovating and maintaining a large... ...back-end systems.What You'll Actually Be DoingDeliver cloud infrastructure automation tools, frameworks, workflows, and validation...Full timeWork experience placement$180k - $220k
San Francisco, CaliforniaSoftware Engineering /Full time Exempt /RemoteRETHINK MANUFACTURING... ...to manufacture the AI and data center infrastructure at the edge. We believe unifying... ...compute and networking, AWS and Azure cloud, Terraform (IaC), ArgoCD, Kubernetes (self...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Infrastructure Engineer - Cloud & GPU. Be the first to apply!
Related searches
- staff data engineer San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- senior staff engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant chief engineer San Francisco, CA
- engineering aide San Francisco, CA
- software engineer staff San Francisco, CA
- staff design engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant engineer San Francisco, CA