Senior AI Infra Engineer — Distributed Training & Inference
$184k - $356.5kNVIDIA
NVIDIA is looking for a Senior Software Engineer in Santa Clara, California, to lead the benchmarking and optimization of AI workloads across GPU platforms. This engineer will set technical standards, profile performance, and mentor team members. The role requires deep experience in distributed computing, AI applications, and strong programming skills in Python and C/C++. With a competitive base salary range from $184,000 to $356,500, the position also offers equity and benefits, catering to a diverse and inclusive work environment. #J-18808-Ljbffr NVIDIA
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Infra Engineer — Distributed Training & Inference in Santa Clara, CA vacancy
- NVIDIA is hiring engineers to scale AI infrastructure, focusing on end-to-end automation of datacenter... ...integration from hardware to AI training applications. Ideal candidates have a... ...Linux expertise, and experience with distributed systems and high-performance...SeniorTraining
$218.8k - $335.3k
Job Description Staff AI/ML Engineer, AV ML Infra We're General Motors (GM), a company... ...includes: AI Validation & Inference: Ensures robust model... ...-scale ML training and inference across cloud... ...implement, and test scalable distributed computing and data processing...TrainingLocal areaWork from homeFlexible hours- Kodiak Robotics, Inc. is seeking engineers to accelerate model training for autonomous driving data pipelines in Mountain View, CA. The role focuses on building high‑throughput data loading, scalable distributed training, and GPU‑level optimizations to saturate modern...SeniorTraining
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs...SeniorTraining
$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical... ...required for large-scale AI model training and inference. You will ensure our machine... ...infrastructure services tailored for distributed AI model training and low-latency...SeniorTrainingLocal areaArcher56
San Jose, CA1 day ago$184k - $287.5k
We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency... ...investigating, and resolving, training & inference performance end to end... ...Experience with debugging large-scale distributed training using NCCL...SeniorTraining- Crusoe Energy Systems seeks a Senior Software Engineer to join their Cloud Managed AI team in California. This on-site role... ...design and implementation of AI inference platform infrastructure,... ...advanced degree and expertise in distributed systems, cloud services, and AI...Senior
$180k - $200k
...only company applying AI Digital Twin... ...and innovative ML Ops Engineer. The ideal candidate... ...focusing on backend distributed systems, microservices... ...alignment across Data, Infra, and ML Engineering.... ...workflows for model training, real‑time inference, monitoring, and troubleshooting...SeniorTrainingRemote workFlexible hours- ...computing experiences—from AI and data centers, to PCs... ...models, and enabling RL training and SOTA LLM and Multimodal inference at scale across multi-... .... THE PERSON: Skilled engineer with strong technical and... ...and RL‑training. Distributed System Optimization: Tune...SeniorTraining
$152k - $241.5k
...unlimited potential of AI to define the next... ...are looking for a Senior Solutions... ...support our Industrial Engineering accounts — the CAE... ...teams. Deliver trainings, hackathons, and technical... ..., GPU‑based distributed systems, and HPC... ..., and large‑scale inference. Experience supporting...SeniorTraining$184k - $287.5k
NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master...Senior$184k - $287.5k
NVIDIA Corporation is seeking a Senior Software Engineer to help build a platform for ML/AI infrastructure specifically focusing on topology data aggregation. This role requires strong experience in distributed systems and Kubernetes, along with proficiency in Go. The...SeniorRemote job$174k - $255k
Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s... ...developing large-scale infrastructure, distributed systems or networks, or... ...experience, and relevant education or training. Your recruiter can share more about...SeniorTrainingFull time- NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. This role will involve building production-quality APIs, collaborating across teams, and enhancing...Senior
$182k - $242k
CoreWeave is seeking an experienced professional to contribute to building distributed systems and ML infrastructure. The successful candidate will play a pivotal role in designing an optimal research cluster experience, including a Python SDK, while collaborating closely...SeniorTraining- NVIDIA is seeking a data storage engineer to advance cloud-native storage across AI workloads. You will design storage technologies, client libraries... ...management in hybrid environments. You will optimize training and inference data paths, build observability tooling, and work...SeniorTraining
$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...Senior- NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD...Senior
$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and over...Senior- NVIDIA is seeking a Senior AI Infrastructure Engineer to design, build, and maintain large-scale production systems for the DGX Cloud group... ...networks, storage, and cloud-native tooling to support AI training and inference. You will work on automation, capacity planning,...SeniorTraining
- NVIDIA is seeking an experienced software engineer for its DGXC Data Services team to... ...infrastructure supporting exabyte-scale AI workloads. You will contribute to storage... ..., and data management for GPU-based training and inference jobs. You will design and implement high...SeniorTraining
- ...passionate and talented AI Engineer to develop cutting‑... ...the next level. As a Senior AI Engineer, you will... ...data processing, model training, evaluation, and deployment... ...model training/inference, latency, and resource... ...deployments). Experience in distributed/parallel systems,...SeniorTraining
- ...creating responsible and reliable AI systems, changing banking for good.... ...build world‑class applied science and engineering teams to deliver our industry‑... ...components including foundation model training, large language model inference, similarity search, guardrails, model...SeniorTrainingFull timeLocal area
SwiftCruit
San Jose, CA2 days ago - Netris is seeking a Senior DevOps/Integration Engineer to design, build, and maintain software packages, kubernetes... ..., and integration plugins powering AI infrastructure and cloud networking.... ...a highly technical team solving distributed systems challenges, collaborating...Senior
$110k - $190k
We are hiring a Senior Software & AI Engineer to build production-grade AI systems, with a strong emphasis... ...right solution: data preparation, training, evaluation, deployment, and... ...infrastructure (training pipelines, inference optimization, monitoring) Experience...SeniorTraining$168k - $322k
NVIDIA in Santa Clara is hiring a Senior AI Platform Engineer to build and maintain next-gen AI-powered enterprise products. This role requires... ...will have strong Python skills and deep experience with distributed systems and AI/ML platforms. A competitive salary range of...Senior$230k - $250k
...seeking a Sr. Member of Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience with...Senior$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...Senior- ...Type On-site Department Robotics Title: Senior Embodied AI Engineer About Us: UnitX builds the world's... ...grounds for our fleet, but also design, train, and deploy the advanced machine... ...and optimizing ML models for real-time inference on robotic hardware (e.g., NVIDIA Jetson...SeniorTrainingFull time
- ...Product Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino... ...ecosystems, enabling ML training and inference at scale, optimal... ...contribute to and influence engineering discussions around technology... ...inference Experience with distributed computing and parallel processing...SeniorTraining
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infra Engineer — Distributed Training & Inference. Be the first to apply!
Related searches
- ai engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- senior app developer Santa Clara, CA
- senior international account manager Santa Clara, CA
- senior magento developer Santa Clara, CA
- senior business development director Santa Clara, CA
- sr marketing manager Santa Clara, CA