Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Infra Engineer: GPU Compute on Kubernetes

Harell Data

Harell Data is seeking an experienced engineer to lead the compute platform in Palo Alto, focusing on GPU clusters and scalable ML infrastructure. You will own the end-to-end ML pipeline, from data ingestion to deployment, while guiding architectural choices and collaborating closely with customers to translate needs into reliable systems. You will pair with the CTO and shape the engineering direction, implementing Kubernetes-based orchestration, autoscaling, and efficient resource management to #J-18808-Ljbffr Harell Data

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Infra Engineer: GPU Compute on Kubernetes in Palo Alto, CA vacancy
  • SpaceX is seeking a Sr. Software Engineer for AI Infrastructure (Starshield) to design, deploy, and scale on-prem and GPU-enabled AI clusters. You will automate Kubernetes/AI systems, manage core infra, and partner with AI teams to deliver highly available services at... 
    Senior

    Spacex

    Palo Alto, CA
    17 hours ago
  • SpaceX seeks a Sr. Software Engineer, AI Infrastructure (Starshield) to design and operate the software and GPU infrastructure supporting critical national-...  ...missions. You will deploy on-premise compute resources, automate Kubernetes/AI clusters, and collaborate with AI... 
    Senior

    SpaceX

    Palo Alto, CA
    3 days ago
  •  ...deployment of a private AI data center, from hardware...  ...-based engagement for an engineer who has built and operated GPU infrastructure. The planned...  .... Confidential computing and storage are core requirements...  .... Select and configure Kubernetes, Slurm, or an appropriate... 
    Senior
    Temporary work
    For contractors
    Remote work

    Simulation 95

    Menlo Park, CA
    2 days ago
  • Infrinia.ai, powered by SoftBank, in Silicon Valley seeks a Senior Software Engineer to build foundational AI infrastructure on GPU systems and Kubernetes. You will own major chunks of the infrastructure software, drive automation, and collaborate with engineering leads... 
    Senior

    SB Telecom America Corp.

    Sunnyvale, CA
    1 day ago
  •  ...seeking a Sr. Site Reliability Engineer (STARSHIELD) to design, operate, and scale on‑premise GPU and AI infrastructure for a national...  ...role emphasizes automation, Kubernetes, and cross‑team collaboration...  ...engineers, lead critical infra initiatives, and work across... 
    Senior
    Work at office

    Starlink

    Palo Alto, CA
    1 day ago
  • $148k - $235.75k

     ...NVIDIA is looking for a Senior AI Compute Engineer to join its Infrastructure Specialists team. Academic...  ...as HPL, NCCL tests, MLPerf as well as Kubernetes experience. Ways to stand out...  ...InfiniBand experience. Experience with GPU (Graphics Processing Unit) focused... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $148k - $287.5k

     ...NVIDIA Gruppe is seeking a Senior AI Compute Engineer to join their Infrastructure Specialists team in Santa Clara, California. This role involves deploying and managing AI Compute infrastructure in Linux-based environments and requires 8+ years of experience in support... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure...  ...to see:BS or similar background in Computer Science or related area (or...  ...& orchestration (e.g., Slurm, Kubernetes, LSF), high-speed networking (e.g.,... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • LinkedIn is seeking a Staff Software Engineer for its Compute Infrastructure team, based in a hybrid setup. You will help design...  ...real-time services, analytics pipelines, and AI/ML at scale. The role emphasizes Kubernetes‑centric operations, multi‑cluster management, and... 

    LinkedIn

    Mountain View, CA
    5 days ago
  • CoreWeave is Hiring for a senior role in Sunnyvale, CA, focusing on Applied Training and a Kubernetes-native research cluster platform. You will design, build, and own infrastructure that accelerates AI research and training at scale, collaborating closely with customers... 
    Senior
    Full time

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology team. You will design...  ...Python, ML framework experience, and hands-on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong data analysis... 
    Senior

    Testing Site - JPMC

    Palo Alto, CA
    17 hours ago
  • Kardow in Sunnyvale, CA seeks a senior software engineer to design high-performance AI frameworks for large-scale distributed...  ...systems. You will optimize GPU-driven workloads, integrate LLMs, and lead test-automation infra across Kubernetes-based clusters. You are expected... 
    Senior

    Kardow

    Sunnyvale, CA
    1 day ago
  • SpaceX is seeking a Sr. Site Reliability Engineer for AI Infrastructure (Starshield) to design, operate, and scale...  ...security data. You will deploy and manage AI GPU clusters, GPU as a service, and core infra with Kubernetes, databases, and distributed storage. You will... 
    Senior

    Spacex

    Palo Alto, CA
    1 day ago
  • JPMorganChase is seeking a Lead Software Engineer in the AI/ML Data Platforms group to design, build, and operate scalable ML training systems on AWS and Kubernetes. You will drive GPU-based training pipelines, performance optimizations, and governance across environments... 
    Senior

    JPMorgan Chase & Co.

    Palo Alto, CA
    1 day ago
  • $237k - $298k

     ...utilization are critical. The Planner Compute team is responsible for the...  ...is looking for an expert in GPU performance. You will...  ...latency and GPU memory usageSupport engineers within Planner as a subject matter...  ...use artificial intelligence (AI) tools to support parts of the... 
    Senior
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  • NVIDIA is seeking a Compute Systems Software Engineer to design and maintain kernel drivers and embedded software for Data Center GPU platforms. You will collaborate with global teams to deliver features for clock, thermal and power management, telemetry, and device management... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Waymo LLC is seeking a senior GPU software engineer to develop high-performance GPU primitives and abstractions, collaborating with the internal hardware team on SoC projects. You will bring up and optimize the onboard stack on new GPU platforms, and enhance CI/CD tooling... 
    Senior

    Waymo LLC

    Mountain View, CA
    2 days ago
  • Tencent Americas is seeking a Senior AI Infrastructure Engineer to own end-to-end AI infrastructure deployments, from data center due diligence to...  ...expertise, and hands-on experience with cluster orchestration tools like Slurm and Kubernetes, #J-18808-Ljbffr Tencent Americas
    Senior

    Tencent Americas

    Palo Alto, CA
    2 days ago
  • NVIDIA in Santa Clara is seeking a software engineer with a strong background in parallel processing and GPU architecture to push performance at the intersection of AI, high‑performance computing, and financial markets. You will design and optimize CUDA-based workloads,... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • JPMorgan Chase is seeking a Software Engineer III to join the Commercial & Investment Banking...  ...products, leveraging enterprise AI tools to improve code quality and delivery...  ...APIs, and cloud-native platforms (Docker/Kubernetes) with emphasis on reliability and security... 
    Senior

    Aumni

    Palo Alto, CA
    1 day ago
  • Google is seeking a software engineer to advance Kubernetes networking within GKE and GDC, working on large-scale distributed systems powering Google...  ...across multiple platforms. The role emphasizes tackling compute, storage and networking challenges with OSS exposure and... 
    Senior

    Google

    Sunnyvale, CA
    3 days ago
  • NVIDIA is seeking software engineers with SRE or Production Engineering experience to help...  ...scale our BMaaS/IaaS infrastructure for GPU systems. You will build automation for bare...  ...diagnosing complex issues across Linux, Kubernetes, and hardware. On-call duties and cross-... 
    Senior

    Devopsroles

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...the world’s leading AI company, and we...  ...innovative accelerated computing platforms focused...  ...with business and engineering teams on product...  ...next-generation GPU architectures. Build...  ...validated ML/DL Infra experience in Autonomous...  ..., Docker, and Kubernetes. Strong... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $275.8k - $340.5k

     ...the team: The AV ML Infra team at GM builds ML infrastructure...  ...the unique demands of AI and ML innovation,...  ...the productivity of ML engineers, and drive the adoption...  ...pipelines. ML Compute: Streamlines andoptimizeslarge...  .... Experience with Kubernetes. Understanding... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $152k - $241.5k

     ...a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs...  ...everything from generative AI to autonomous systems,...  ...that enable researchers and engineers to develop the next...  ...FlinkExperience working with Kubernetes and cloud-native infrastructureStrong... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $176k - $276k

     ...looking for an experienced HPC-AI Engineer to join the Networking...  ...player to the most exciting computing hardware and software to contribute...  ...artificial intelligence and GPU computing. Provide insights on...  ...GPU architectureKnowledge of Kubernetes, container related microservice... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $220k - $350k

     ...enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE,...  ...QUALIFICATIONS:Bachelor's degree in computer science, mathematics,...  ...years of experience working with Kubernetes or similar tooling for...  ...pre-staged.Familiarity with GPU infrastructure, including NVIDIA... 
    Senior
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Palo Alto, CA
    4 days ago
  • $144k - $236k

     ...the team.Responsibilities: AI is at the core of how LinkedIn...  ..., and trust platforms. As a Senior AI Software Engineer you will own end-to-end...  ...efficacy, and managing the GPU fleets that run them at scale...  ...Qualifications:BA/BS Degree in Computer Science, Machine Learning or... 
    Senior
    For contractors
    Work at office
    Immediate start
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  • $152k - $241.5k

     ...work at NVIDIA is dedicated towards a computing model focused on visual and AI computing. For two decades, NVIDIA...  ..., with our invention of the GPU. The GPU has also shown to be spectacularly...  ...looking for Architects, Software Engineers, and AI application developers to... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...spanning estimating, projects, finances, and money movement. AI is at the center of our product. Contractors can upload...  ...in minutes. About the Role We're looking for a Senior Computer Vision / Applied AI Engineer to improve how KonstructIQ reads construction plans and... 
    Senior
    For contractors
    Immediate start
    Remote work

    KonstructIQ

    Los Altos, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Infra Engineer: GPU Compute on Kubernetes. Be the first to apply!