Sr. AI Software Engineer (GPU/C++)
$166.7k - $283.4kKLA
Sr. AI Infrastructure Software Engineer C++ Focus
KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem. Virtually every electronic device in the world is produced using our technologies. No laptop, smartphone, wearable device, voice-controlled gadget, flexible screen, VR device or smart car would have made it into your hands without us. KLA invents systems and solutions for the manufacturing of wafers and reticles, integrated circuits, packaging, printed circuit boards and flat panel displays. The innovative ideas and devices that are advancing humanity all begin with inspiration, research and development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world's leading technology providers to accelerate the delivery of tomorrow's electronic devices. Life here is exciting and our teams thrive on tackling really hard problems. There is never a dull moment with us.
The AI & Modeling Center of Excellence was setup with the mission of advancing KLA's traditional strengths in physics and data and providing implementation solutions for multiple KLA Inspection and Metrology products targeted at the semiconductor manufacturing industry. The AI & Modeling Center of Excellence is part of the company's Central Engineering organization providing product development expertise in a critical area for a wide variety KLA products. As a part of this group, you will be part of a world class team of physicists, HPC system designers, machine learning and application engineers who build cutting edge solutions for modeling complex imaging techniques and semiconductor processes. You will also work with a data scientists and AI infrastructure engineers whose mission is to build and scale machine learning based solutions for our semiconductor customers. We are looking for engineers in a few different fields. If you are passionate about Physics Modeling, High Performance Computing - HPC (including GPU), Machine Learning, Deep Learning, Data Sciences, or cutting-edge Cloud technologies this is the place for you!
You'll work alongside a world-class team, top-notch architects, solving tough problems at the intersection of software and hardware, and growing your skills in a space that's shaping the future of computing.
What You'll Do
- Design and implement core infrastructure components that support AI/ML workloads across multiple frameworks and hardware platforms.
- Write high-performance, maintainable C++ code for system-level software that interfaces directly with GPUs and low-level hardware.
- Collaborate with cross-functional teams to integrate AI frameworks into a unified development environment.
- Contribute to build systems and toolchains using Makefiles, CMake, Clang, and GCC.
- Learn from experienced engineers and grow into broader architectural and leadership responsibilities over time.
What We're Looking For
- Degree in Computer Science, Electrical Engineering, or a related field.
- Strong C++ programming skills and solid software engineering fundamentals.
- Solid experience and hands-on knowledge with GPU programming (e.g., CUDA) and Linux development environments.
- Familiarity with build tools (Makefile, CMake) and compilers (Clang, GCC).
- Bonus: Exposure to AI/ML frameworks like TensorFlow, PyTorch, or JAX.
- Bonus: Experience with embedded systems or companies building physical products.
- Excellent attention to detail, planning, and execution skillsespecially for multi-month projects.
- Strong communication skills and a collaborative, customer-focused mindset.
- A plus if you've transitioned from software development into technical project coordination or aspire to do so.
Minimum Qualifications
Doctorate (Academic) Degree and related work experience of 3 years; Master's Level Degree and related work experience of 6 years; Bachelor's Level Degree and related work experience of 8 years
Base Pay Range: $166,700.00 - $283,400.00 AnnuallyPrimary Location: USA-CA-Milpitas-KLAKLA's total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.
Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.
KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at View email address on click.appcast.io or at View phone number on click.appcast.io to request accommodation.
Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees. KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA . Please ensure that you have searched KLA's Careers website for legitimate job postings. KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers. If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to View email address on click.appcast.io to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information.
KLA$166.7k - $283.4k
Sr. AI Infrastructure Software Engineer - C++ Focus Love C++? Fascinated by GPUs? Curious about how AI frameworks with CUDA, TensorFlow, JAX and PyTorch really... .... Solid experience and hands‑on knowledge with GPU programming (e.g., CUDA) and Linux development environments...SeniorMinimum wageWork experience placement- KLA is seeking a Sr. AI Infrastructure Software Engineer focused on C++. You’ll design and implement core AI infrastructure components that leverage GPUs, collaborate... .... The role requires a strong background in C++, GPU programming (CUDA), and knowledge of build tools...Senior
$184k - $287.5k
...NVIDIA Gruppe is seeking a skilled software engineer to develop high-performance solutions for GPU data storage. The ideal candidate... ...have extensive experience in C, C++, Rust, and data architecture, and... ...benefits. Join a leader in AI computing and contribute to groundbreaking...Senior- ...Corporation in Santa Clara, CA is hiring a Senior Software Engineer to advance the Python experience for... ...infrastructure on top of native C/C++ foundations. You will own features end-to... ...to improve performance and usability for GPU developers. #J-18808-Ljbffr NVIDIASenior
- NVIDIA is hiring a Senior Software Engineer to advance the Python experience for CUDA Core Libraries... ...Pythonic APIs and bindings on top of C/C++ foundations and work across Python, C/... ...scalable, developer-friendly interfaces for GPU-accelerated workflows. #J-18808-Ljbffr...Senior
- AMD is seeking a senior C++/Linux expert to optimize and develop deep learning frameworks for AMD GPUs. You will work on GPU kernels, model performance, and multi-GPU/multi-node scales while collaborating with internal teams and open‑source maintainers. The ideal candidate...Senior
- Clockwork.io is seeking an experienced systems engineer to design and implement low-level systems software for GPU clusters. You will work on distributed systems and... ...systems software development and possess strong C/C++ skills. Clockwork.io offers competitive compensation...Senior
- ...computing experiences—from AI and data centers, to... ...critical in enhancing GPU kernels, deep learning... ...technologies and advanced engineering principles to drive... ...Industry Leading Expert C++ developer with advanced... ...integrating graph compilers. Software Engineering Best...Senior
- ..., Inc. is seeking an experienced Systems Engineer to design and implement high-performance distributed GPU training systems. This role involves working... ...candidates will have 8+ years in systems software, a strong background in C/C++, and familiarity with distributed systems...Senior
$184k - $356.5k
...is looking for a Developer Technology Engineer to drive innovation in AI and accelerated computing. In San... ...internal teams and partners to tackle GPU deployment challenges. Ideal candidates... ...years in GPU profiling, proficiency in C/C++, and experience with AI technologies....Senior$152k - $241.5k
...computing model focused on visual and AI computing. For two decades,... ..., with our invention of the GPU. The GPU has also shown to be... ...is looking for Architects, Software Engineers, and AI application developers... ...related areas Proficiency in C++, Python and ML frameworks like...Senior- A leading AI technology firm in California is seeking an experienced Senior Software Engineer to develop and optimize AI infrastructure software using state-of-the-art GPU systems. Candidates should have a Bachelor's degree in a technical field and a minimum of 5 years...Senior
- NVIDIA is hiring engineers to scale AI infrastructure, focusing on end-to-end automation of datacenter operations for large-scale ML systems. You will work on GPU asset provisioning, monitoring, and NVLINK topology, collaborating across teams to ensure seamless integration...Senior
$160k - $225k
United States Digital Space LLC is seeking a Senior Software Engineer for AI Runtime in Mountain View, California. This role involves building and scaling systems for large-scale GPU training, contributing to the architecture of a managed training stack and mentoring fellow...Senior- NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware... ...stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that designs...Senior
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD...Senior
$152k - $241.5k
NVIDIA is seeking a motivated Deep Learning Engineer based in Santa Clara, California. The role involves integrating communication libraries with advanced AI stacks and optimizing performance for multi-GPU applications. Ideal candidates should have a strong background in...Senior- ...experienced professional to optimize AI workloads at DGX Station (... ...applications, profiling multi-GPU environments, and collaborating to enhance NVIDIA's software stack. The ideal candidate has... ...experience in systems software engineering and strong expertise with deep...Senior
- ...for a motivated Deep Learning engineer in Santa Clara, California, to... ...communication technologies in AI environments. This role focuses... ...and scalability in multi-GPU computing. The ideal candidate... ...should have a strong background in software engineering and AI,...Senior
$152k - $287.5k
NVIDIA is seeking a Senior AI Infrastructure Engineer for our DGX Cloud group. This role involves designing, building, and maintaining large-scale production systems, ensuring GPU cloud services perform with maximum reliability. The ideal candidate will have a strong background...Senior- AMD is seeking a highly motivated AI Software Engineer to join its team in Santa Clara, California. This... ...and optimizing AI models for advanced GPU computational accelerators. Candidates should have strong programming skills in C++ and Python, along with experience in...
- Broadcom in Palo Alto is seeking an experienced Principal Software Engineer to join the GPU Virtualization Team. In this role, you will develop and integrate an AI Virtualization Stack to provide hardware-agnostic acceleration for AI/ML workloads on Virtual Machines. Candidates...
- NVIDIA is seeking a Senior AI Infrastructure Engineer to design, build, and maintain large-scale production... ...group in California. The role covers software and systems engineering practices... ...analysis, and lifecycle management for multi-GPU clusters, with opportunities for...Senior
$160k - $225k
Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In this role, you'll drive the architecture and evolution of AIR's managed GPU training platform, ensuring scalable and resilient training. The ideal candidate has 5+ years of experience...Senior- ...looking for a skilled and experienced C++ Engineer to design and build high-performance software on Linux. You will be a key... ...disciplinary system that integrates AI modules, hardware interfaces, and... ...Optimization Tools CUDA or OpenCL for GPU acceleration Python for tooling,...Senior
- Crusoe Energy Systems in Sunnyvale, CA is looking for a Virtualization Validation Engineer responsible for validating large-scale GPU clusters. You will validate the interconnect fabric and collective communication libraries, ensuring efficient workloads across virtualized...Senior
- NVIDIA is seeking an experienced software professional in Santa Clara, CA to design and develop... ...computing. Join our team to help optimize GPU-accelerated implementations for various... ...ideal candidate will have strong Python, C++, and CUDA skills, as well as a solid foundation...Senior
$165k - $242k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...more at About The Role Senior engineers are area owners who lead... ...hardware teams to evolve our GPU performance testing platform to... ...Proficiency in Go and/or Python software development. Hands‑on experience...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours- NVIDIA Corporation is seeking an experienced software professional in Santa Clara to contribute to the development of GPU-accelerated Python APIs for numerical computing.... ...have a strong programming background in Python, C++, and CUDA, along with substantial experience in...Senior
- NVIDIA is seeking outstanding AI systems engineers in Santa Clara to advance the inference software stack. You will build libraries, code generators, and GPU kernels for NVIDIA hardware, designing... ...models. The role emphasizes Python/C++ development, GPU kernel...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. AI Software Engineer (GPU/C++). Be the first to apply!
- ai engineer Milpitas, CA
- ai developer Milpitas, CA
- senior app developer Milpitas, CA
- senior magento developer Milpitas, CA
- sr technical product manager Milpitas, CA
- senior manager pmo Milpitas, CA
- senior accountant part time Milpitas, CA
- senior electrical designer Milpitas, CA
- senior application support engineer Milpitas, CA
- sr industrial engineer Milpitas, CA

