Senior AI Infra Engineer: GPU Compute on Kubernetes
Harell Data
Harell Data is seeking an experienced engineer to lead the compute platform in Palo Alto, focusing on GPU clusters and scalable ML infrastructure. You will own the end-to-end ML pipeline, from data ingestion to deployment, while guiding architectural choices and collaborating closely with customers to translate needs into reliable systems. You will pair with the CTO and shape the engineering direction, implementing Kubernetes-based orchestration, autoscaling, and efficient resource management to #J-18808-Ljbffr Harell Data
- SpaceX is seeking a Sr. Software Engineer for AI Infrastructure (Starshield) to design, deploy, and scale on-prem and GPU-enabled AI clusters. You will automate Kubernetes/AI systems, manage core infra, and partner with AI teams to deliver highly available services at...Senior
- SpaceX seeks a Sr. Software Engineer, AI Infrastructure (Starshield) to design and operate the software and GPU infrastructure supporting critical national-... ...missions. You will deploy on-premise compute resources, automate Kubernetes/AI clusters, and collaborate with AI...Senior
- ...deployment of a private AI data center, from hardware... ...-based engagement for an engineer who has built and operated GPU infrastructure. The planned... .... Confidential computing and storage are core requirements... .... Select and configure Kubernetes, Slurm, or an appropriate...SeniorTemporary workFor contractorsRemote work
- Infrinia.ai, powered by SoftBank, in Silicon Valley seeks a Senior Software Engineer to build foundational AI infrastructure on GPU systems and Kubernetes. You will own major chunks of the infrastructure software, drive automation, and collaborate with engineering leads...Senior
- ...seeking a Sr. Site Reliability Engineer (STARSHIELD) to design, operate, and scale on‑premise GPU and AI infrastructure for a national... ...role emphasizes automation, Kubernetes, and cross‑team collaboration... ...engineers, lead critical infra initiatives, and work across...SeniorWork at office
$148k - $235.75k
...NVIDIA is looking for a Senior AI Compute Engineer to join its Infrastructure Specialists team. Academic... ...as HPL, NCCL tests, MLPerf as well as Kubernetes experience. Ways to stand out... ...InfiniBand experience. Experience with GPU (Graphics Processing Unit) focused...Senior$148k - $287.5k
...NVIDIA Gruppe is seeking a Senior AI Compute Engineer to join their Infrastructure Specialists team in Santa Clara, California. This role involves deploying and managing AI Compute infrastructure in Linux-based environments and requires 8+ years of experience in support...Senior$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure... ...to see:BS or similar background in Computer Science or related area (or... ...& orchestration (e.g., Slurm, Kubernetes, LSF), high-speed networking (e.g.,...Full time- LinkedIn is seeking a Staff Software Engineer for its Compute Infrastructure team, based in a hybrid setup. You will help design... ...real-time services, analytics pipelines, and AI/ML at scale. The role emphasizes Kubernetes‑centric operations, multi‑cluster management, and...
- CoreWeave is Hiring for a senior role in Sunnyvale, CA, focusing on Applied Training and a Kubernetes-native research cluster platform. You will design, build, and own infrastructure that accelerates AI research and training at scale, collaborating closely with customers...SeniorFull time
- JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology team. You will design... ...Python, ML framework experience, and hands-on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong data analysis...Senior
- Kardow in Sunnyvale, CA seeks a senior software engineer to design high-performance AI frameworks for large-scale distributed... ...systems. You will optimize GPU-driven workloads, integrate LLMs, and lead test-automation infra across Kubernetes-based clusters. You are expected...Senior
- SpaceX is seeking a Sr. Site Reliability Engineer for AI Infrastructure (Starshield) to design, operate, and scale... ...security data. You will deploy and manage AI GPU clusters, GPU as a service, and core infra with Kubernetes, databases, and distributed storage. You will...Senior
- JPMorganChase is seeking a Lead Software Engineer in the AI/ML Data Platforms group to design, build, and operate scalable ML training systems on AWS and Kubernetes. You will drive GPU-based training pipelines, performance optimizations, and governance across environments...Senior
$237k - $298k
...utilization are critical. The Planner Compute team is responsible for the... ...is looking for an expert in GPU performance. You will... ...latency and GPU memory usageSupport engineers within Planner as a subject matter... ...use artificial intelligence (AI) tools to support parts of the...SeniorFull timeTemporary workRelocation package- NVIDIA is seeking a Compute Systems Software Engineer to design and maintain kernel drivers and embedded software for Data Center GPU platforms. You will collaborate with global teams to deliver features for clock, thermal and power management, telemetry, and device management...Senior
- Waymo LLC is seeking a senior GPU software engineer to develop high-performance GPU primitives and abstractions, collaborating with the internal hardware team on SoC projects. You will bring up and optimize the onboard stack on new GPU platforms, and enhance CI/CD tooling...Senior
- Tencent Americas is seeking a Senior AI Infrastructure Engineer to own end-to-end AI infrastructure deployments, from data center due diligence to... ...expertise, and hands-on experience with cluster orchestration tools like Slurm and Kubernetes, #J-18808-Ljbffr Tencent AmericasSenior
- NVIDIA in Santa Clara is seeking a software engineer with a strong background in parallel processing and GPU architecture to push performance at the intersection of AI, high‑performance computing, and financial markets. You will design and optimize CUDA-based workloads,...Senior
- JPMorgan Chase is seeking a Software Engineer III to join the Commercial & Investment Banking... ...products, leveraging enterprise AI tools to improve code quality and delivery... ...APIs, and cloud-native platforms (Docker/Kubernetes) with emphasis on reliability and security...Senior
- Google is seeking a software engineer to advance Kubernetes networking within GKE and GDC, working on large-scale distributed systems powering Google... ...across multiple platforms. The role emphasizes tackling compute, storage and networking challenges with OSS exposure and...Senior
- NVIDIA is seeking software engineers with SRE or Production Engineering experience to help... ...scale our BMaaS/IaaS infrastructure for GPU systems. You will build automation for bare... ...diagnosing complex issues across Linux, Kubernetes, and hardware. On-call duties and cross-...Senior
$184k - $287.5k
...the world’s leading AI company, and we... ...innovative accelerated computing platforms focused... ...with business and engineering teams on product... ...next-generation GPU architectures. Build... ...validated ML/DL Infra experience in Autonomous... ..., Docker, and Kubernetes. Strong...Senior$275.8k - $340.5k
...the team: The AV ML Infra team at GM builds ML infrastructure... ...the unique demands of AI and ML innovation,... ...the productivity of ML engineers, and drive the adoption... ...pipelines. ML Compute: Streamlines andoptimizeslarge... .... Experience with Kubernetes. Understanding...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$152k - $241.5k
...a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs... ...everything from generative AI to autonomous systems,... ...that enable researchers and engineers to develop the next... ...FlinkExperience working with Kubernetes and cloud-native infrastructureStrong...SeniorFull time$176k - $276k
...looking for an experienced HPC-AI Engineer to join the Networking... ...player to the most exciting computing hardware and software to contribute... ...artificial intelligence and GPU computing. Provide insights on... ...GPU architectureKnowledge of Kubernetes, container related microservice...SeniorFull time$220k - $350k
...enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE,... ...QUALIFICATIONS:Bachelor's degree in computer science, mathematics,... ...years of experience working with Kubernetes or similar tooling for... ...pre-staged.Familiarity with GPU infrastructure, including NVIDIA...SeniorPermanent employmentTemporary workImmediate startWeekend work$144k - $236k
...the team.Responsibilities: AI is at the core of how LinkedIn... ..., and trust platforms. As a Senior AI Software Engineer you will own end-to-end... ...efficacy, and managing the GPU fleets that run them at scale... ...Qualifications:BA/BS Degree in Computer Science, Machine Learning or...SeniorFor contractorsWork at officeImmediate startFlexible hours$152k - $241.5k
...work at NVIDIA is dedicated towards a computing model focused on visual and AI computing. For two decades, NVIDIA... ..., with our invention of the GPU. The GPU has also shown to be spectacularly... ...looking for Architects, Software Engineers, and AI application developers to...SeniorFull time- ...spanning estimating, projects, finances, and money movement. AI is at the center of our product. Contractors can upload... ...in minutes. About the Role We're looking for a Senior Computer Vision / Applied AI Engineer to improve how KonstructIQ reads construction plans and...SeniorFor contractorsImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infra Engineer: GPU Compute on Kubernetes. Be the first to apply!
- ai developer Palo Alto, CA
- ai prompt engineer Palo Alto, CA
- senior ai engineer Palo Alto, CA
- ai engineer Palo Alto, CA
- senior living Palo Alto, CA
- senior app developer Palo Alto, CA
- senior ml engineer Palo Alto, CA
- senior application support engineer Palo Alto, CA
- senior devops Palo Alto, CA
- senior property accountant Palo Alto, CA



