Sr. AI Software Engineer (GPU/C++)
$166.7k - $283.4kKLA
Sr. AI Infrastructure Software Engineer – C++ Focus Love C++? Fascinated by GPUs? Curious about how AI frameworks with CUDA, TensorFlow, JAX and PyTorch really work under the hood? We’re building the next‑gen software stack that powers the future of AI and we’re looking for sharp, curious engineers who want to get close to the product, and grow to the architect level. If you’re passionate about low system‑level development, this is your chance to make a real impact in AI infrastructure. You’ll work alongside a world‑class team, top‑notch architects, solving tough problems at the intersection of software and hardware, and growing your skills in a space that’s shaping the future of computing. What You’ll Do Design and implement core infrastructure components that support AI/ML workloads across multiple frameworks and hardware platforms. Write high‑performance, maintainable C++ code for system‑level software that interfaces directly with GPUs and low‑level hardware. Collaborate with cross‑functional teams to integrate AI frameworks into a unified development environment. Contribute to build systems and toolchains using Makefiles, CMake, Clang, and GCC. Learn from experienced engineers and grow into broader architectural and leadership responsibilities over time. What We’re Looking For Degree in Computer Science, Electrical Engineering, or a related field. Strong C++ programming skills and solid software engineering fundamentals. Solid experience and hands‑on knowledge with GPU programming (e.g., CUDA) and Linux development environments. Familiarity with build tools (Makefile, CMake) and compilers (Clang, GCC). Bonus: Exposure to AI/ML frameworks like TensorFlow, PyTorch, or JAX. Bonus: Experience with embedded systems or companies building physical products. Excellent attention to detail, planning, and execution skills—especially for multi‑month projects. Strong communication skills and a collaborative, customer‑focused mindset. A plus if you’ve transitioned from software development into technical project coordination or aspire to do so. Minimum Qualifications Doctorate (Academic) Degree and related work experience of 3 years; Master's Level Degree and related work experience of 6 years; Bachelor's Level Degree and related work experience of 8 years Base Pay Range $166,700.00 - $283,400.00 Annually Primary Location USA-CA-Milpitas-KLA Benefits KLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(k) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave. Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job‑related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process. Equal Opportunity Employer and Accommodation KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at View email address on click.appcast.io or at View phone number on click.appcast.io to request accommodation. #J-18808-Ljbffr KLA
- KLA is seeking a Sr. AI Infrastructure Software Engineer focused on C++. You’ll design and implement core AI infrastructure components that leverage GPUs, collaborate... .... The role requires a strong background in C++, GPU programming (CUDA), and knowledge of build tools...Senior
$184k - $287.5k
NVIDIA Gruppe is seeking a skilled software engineer to develop high-performance solutions for GPU data storage. The ideal candidate... ...have extensive experience in C, C++, Rust, and data architecture, and... ...benefits. Join a leader in AI computing and contribute to groundbreaking...Senior- AMD is seeking a senior C++/Linux expert to optimize and develop deep learning frameworks for AMD GPUs. You will work on GPU kernels, model performance, and multi-GPU/multi-node scales while collaborating with internal teams and open‑source maintainers. The ideal candidate...Senior
- Clockwork.io is seeking an experienced systems engineer to design and implement low-level systems software for GPU clusters. You will work on distributed systems and... ...systems software development and possess strong C/C++ skills. Clockwork.io offers competitive compensation...Senior
- NVIDIA seeks experienced engineers and scientists in Santa Clara to enhance open-source software libraries for GPU data processing. This role involves developing algorithms, implementing solutions in C++, and contributing to projects like cuDF and Spark. The ideal candidate...Senior
- ...computing experiences—from AI and data centers, to... ...critical in enhancing GPU kernels, deep learning... ...technologies and advanced engineering principles to drive... ...Industry Leading Expert C++ developer with advanced... ...integrating graph compilers. Software Engineering Best...Senior
- ..., Inc. is seeking an experienced Systems Engineer to design and implement high-performance distributed GPU training systems. This role involves working... ...candidates will have 8+ years in systems software, a strong background in C/C++, and familiarity with distributed systems...Senior
$184k - $356.5k
...is looking for a Developer Technology Engineer to drive innovation in AI and accelerated computing. In San... ...internal teams and partners to tackle GPU deployment challenges. Ideal candidates... ...years in GPU profiling, proficiency in C/C++, and experience with AI technologies....Senior- ...Corporation is seeking an experienced Software Engineer in Santa Clara, CA to develop... ...and debugging tools that empower AI research and applications running on GPU clusters. The ideal candidate will... ...software development, particularly with C++ and Python, along with experience...Senior
$152k - $241.5k
...computing model focused on visual and AI computing. For two decades,... ..., with our invention of the GPU. The GPU has also shown to be... ...is looking for Architects, Software Engineers, and AI application developers... ...related areas Proficiency in C++, Python and ML frameworks like...Senior- A leading AI technology firm in California is seeking an experienced Senior Software Engineer to develop and optimize AI infrastructure software using state-of-the-art GPU systems. Candidates should have a Bachelor's degree in a technical field and a minimum of 5 years...Senior
$160k - $225k
United States Digital Space LLC is seeking a Senior Software Engineer for AI Runtime in Mountain View, California. This role involves building and scaling systems for large-scale GPU training, contributing to the architecture of a managed training stack and mentoring fellow...Senior- NVIDIA is hiring engineers to scale AI infrastructure, focusing on end-to-end automation of datacenter operations for large-scale ML systems. You will work on GPU asset provisioning, monitoring, and NVLINK topology, collaborating across teams to ensure seamless integration...Senior
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD...Senior
- ...experienced professional to optimize AI workloads at DGX Station (... ...applications, profiling multi-GPU environments, and collaborating to enhance NVIDIA's software stack. The ideal candidate has... ...experience in systems software engineering and strong expertise with deep...Senior
- ...for a motivated Deep Learning engineer in Santa Clara, California, to... ...communication technologies in AI environments. This role focuses... ...and scalability in multi-GPU computing. The ideal candidate... ...should have a strong background in software engineering and AI,...Senior
$152k - $287.5k
NVIDIA is seeking a Senior AI Infrastructure Engineer for our DGX Cloud group. This role involves designing, building, and maintaining large-scale production systems, ensuring GPU cloud services perform with maximum reliability. The ideal candidate will have a strong background...Senior- AMD is seeking a highly motivated AI Software Engineer to join its team in Santa Clara, California. This... ...and optimizing AI models for advanced GPU computational accelerators. Candidates should have strong programming skills in C++ and Python, along with experience in...
- NVIDIA is seeking a Senior AI Infrastructure Engineer to design, build, and maintain large-scale production... ...group in California. The role covers software and systems engineering practices... ...analysis, and lifecycle management for multi-GPU clusters, with opportunities for...Senior
- Broadcom in Palo Alto is seeking an experienced Principal Software Engineer to join the GPU Virtualization Team. In this role, you will develop and integrate an AI Virtualization Stack to provide hardware-agnostic acceleration for AI/ML workloads on Virtual Machines. Candidates...
- ...looking for a skilled and experienced C++ Engineer to design and build high-performance software on Linux. You will be a key... ...disciplinary system that integrates AI modules, hardware interfaces, and... ...Optimization Tools CUDA or OpenCL for GPU acceleration Python for tooling,...Senior
$160k - $225k
Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In this role, you'll drive the architecture and evolution of AIR's managed GPU training platform, ensuring scalable and resilient training. The ideal candidate has 5+ years of experience...Senior- Crusoe Energy Systems in Sunnyvale, CA is looking for a Virtualization Validation Engineer responsible for validating large-scale GPU clusters. You will validate the interconnect fabric and collective communication libraries, ensuring efficient workloads across virtualized...Senior
- NVIDIA is seeking an experienced software professional in Santa Clara, CA to design and develop... ...computing. Join our team to help optimize GPU-accelerated implementations for various... ...ideal candidate will have strong Python, C++, and CUDA skills, as well as a solid foundation...Senior
$184k
NVIDIA Gruppe is seeking an experienced software professional to design and develop GPU-accelerated Python APIs for numerical computing. This role involves... ...with 6+ years of experience and strong skills in Python, C++, and CUDA. A competitive salary is offered based on...Senior$165k - $242k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...more at About The Role Senior engineers are area owners who lead... ...hardware teams to evolve our GPU performance testing platform to... ...Proficiency in Go and/or Python software development. Hands‑on experience...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours- NVIDIA Corporation is seeking an experienced software professional in Santa Clara to contribute to the development of GPU-accelerated Python APIs for numerical computing.... ...have a strong programming background in Python, C++, and CUDA, along with substantial experience in...Senior
- NVIDIA is looking to hire an innovative engineer for its CUTLASS team in Santa Clara, California. You will develop core components for high-performance linear algebra using C++ and collaborate with GPU architecture teams. A Masters or PhD degree in Computer Science, along...Senior
$152k - $241.5k
Nvidia Corporation in Santa Clara seeks a talented software engineer to develop core components of the CUTLASS platform, including Tensor Core MMAs and other GPU features. This position requires a strong background in C++ and experience in high-performance computing. The...Senior- ...company in California is looking for a Senior Engineer to enhance its Math Libraries team. The... ...and implement high-performance numerical software on GPUs, engaging closely with product... ...mentoring peers. A strong background in C++ and HPC software development with at least...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. AI Software Engineer (GPU/C++). Be the first to apply!
- ai engineer Milpitas, CA
- ai developer Milpitas, CA
- senior app developer Milpitas, CA
- senior magento developer Milpitas, CA
- sr technical product manager Milpitas, CA
- senior manager pmo Milpitas, CA
- senior accountant part time Milpitas, CA
- senior electrical designer Milpitas, CA
- senior application support engineer Milpitas, CA
- sr industrial engineer Milpitas, CA

