Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. AI Software Engineer (GPU/C++)

$166.7k - $283.4k

KLA

Sr. AI Infrastructure Software Engineer C++ Focus

KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem. Virtually every electronic device in the world is produced using our technologies. No laptop, smartphone, wearable device, voice-controlled gadget, flexible screen, VR device or smart car would have made it into your hands without us. KLA invents systems and solutions for the manufacturing of wafers and reticles, integrated circuits, packaging, printed circuit boards and flat panel displays. The innovative ideas and devices that are advancing humanity all begin with inspiration, research and development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world's leading technology providers to accelerate the delivery of tomorrow's electronic devices. Life here is exciting and our teams thrive on tackling really hard problems. There is never a dull moment with us.

The AI & Modeling Center of Excellence was setup with the mission of advancing KLA's traditional strengths in physics and data and providing implementation solutions for multiple KLA Inspection and Metrology products targeted at the semiconductor manufacturing industry. The AI & Modeling Center of Excellence is part of the company's Central Engineering organization providing product development expertise in a critical area for a wide variety KLA products. As a part of this group, you will be part of a world class team of physicists, HPC system designers, machine learning and application engineers who build cutting edge solutions for modeling complex imaging techniques and semiconductor processes. You will also work with a data scientists and AI infrastructure engineers whose mission is to build and scale machine learning based solutions for our semiconductor customers. We are looking for engineers in a few different fields. If you are passionate about Physics Modeling, High Performance Computing - HPC (including GPU), Machine Learning, Deep Learning, Data Sciences, or cutting-edge Cloud technologies this is the place for you!

You'll work alongside a world-class team, top-notch architects, solving tough problems at the intersection of software and hardware, and growing your skills in a space that's shaping the future of computing.

What You'll Do

  • Design and implement core infrastructure components that support AI/ML workloads across multiple frameworks and hardware platforms.
  • Write high-performance, maintainable C++ code for system-level software that interfaces directly with GPUs and low-level hardware.
  • Collaborate with cross-functional teams to integrate AI frameworks into a unified development environment.
  • Contribute to build systems and toolchains using Makefiles, CMake, Clang, and GCC.
  • Learn from experienced engineers and grow into broader architectural and leadership responsibilities over time.

What We're Looking For

  • Degree in Computer Science, Electrical Engineering, or a related field.
  • Strong C++ programming skills and solid software engineering fundamentals.
  • Solid experience and hands-on knowledge with GPU programming (e.g., CUDA) and Linux development environments.
  • Familiarity with build tools (Makefile, CMake) and compilers (Clang, GCC).
  • Bonus: Exposure to AI/ML frameworks like TensorFlow, PyTorch, or JAX.
  • Bonus: Experience with embedded systems or companies building physical products.
  • Excellent attention to detail, planning, and execution skillsespecially for multi-month projects.
  • Strong communication skills and a collaborative, customer-focused mindset.
  • A plus if you've transitioned from software development into technical project coordination or aspire to do so.

Minimum Qualifications

Doctorate (Academic) Degree and related work experience of 3 years; Master's Level Degree and related work experience of 6 years; Bachelor's Level Degree and related work experience of 8 years

Base Pay Range: $166,700.00 - $283,400.00 AnnuallyPrimary Location: USA-CA-Milpitas-KLAKLA's total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.

Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.

KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at View email address on click.appcast.io or at View phone number on click.appcast.io to request accommodation.

Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees. KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA . Please ensure that you have searched KLA's Careers website for legitimate job postings. KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers. If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to View email address on click.appcast.io to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information.

KLA
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Sr. AI Software Engineer (GPU/C++) in Milpitas, CA vacancy
  • $166.7k - $283.4k

    Sr. AI Infrastructure Software Engineer - C++ Focus Love C++? Fascinated by GPUs? Curious about how AI frameworks with CUDA, TensorFlow, JAX and PyTorch really...  .... Solid experience and hands‑on knowledge with GPU programming (e.g., CUDA) and Linux development environments... 
    Senior
    Minimum wage
    Work experience placement

    KLA

    Milpitas, CA
    1 day ago
  • KLA is seeking a Sr. AI Infrastructure Software Engineer focused on C++. You’ll design and implement core AI infrastructure components that leverage GPUs, collaborate...  .... The role requires a strong background in C++, GPU programming (CUDA), and knowledge of build tools... 
    Senior

    KLA

    Milpitas, CA
    1 day ago
  • $184k - $287.5k

     ...NVIDIA Gruppe is seeking a skilled software engineer to develop high-performance solutions for GPU data storage. The ideal candidate...  ...have extensive experience in C, C++, Rust, and data architecture, and...  ...benefits. Join a leader in AI computing and contribute to groundbreaking... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  ...Corporation in Santa Clara, CA is hiring a Senior Software Engineer to advance the Python experience for...  ...infrastructure on top of native C/C++ foundations. You will own features end-to...  ...to improve performance and usability for GPU developers. #J-18808-Ljbffr NVIDIA
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • NVIDIA is hiring a Senior Software Engineer to advance the Python experience for CUDA Core Libraries...  ...Pythonic APIs and bindings on top of C/C++ foundations and work across Python, C/...  ...scalable, developer-friendly interfaces for GPU-accelerated workflows. #J-18808-Ljbffr... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • AMD is seeking a senior C++/Linux expert to optimize and develop deep learning frameworks for AMD GPUs. You will work on GPU kernels, model performance, and multi-GPU/multi-node scales while collaborating with internal teams and open‑source maintainers. The ideal candidate... 
    Senior

    AMD

    Santa Clara, CA
    1 day ago
  • Clockwork.io is seeking an experienced systems engineer to design and implement low-level systems software for GPU clusters. You will work on distributed systems and...  ...systems software development and possess strong C/C++ skills. Clockwork.io offers competitive compensation... 
    Senior

    Clockwork.io

    Palo Alto, CA
    1 day ago
  •  ...computing experiences—from AI and data centers, to...  ...critical in enhancing GPU kernels, deep learning...  ...technologies and advanced engineering principles to drive...  ...Industry Leading Expert C++ developer with advanced...  ...integrating graph compilers. Software Engineering Best... 
    Senior

    AMD

    Santa Clara, CA
    1 day ago
  •  ..., Inc. is seeking an experienced Systems Engineer to design and implement high-performance distributed GPU training systems. This role involves working...  ...candidates will have 8+ years in systems software, a strong background in C/C++, and familiarity with distributed systems... 
    Senior

    Clockwork Systems, Inc.

    Palo Alto, CA
    1 day ago
  • $184k - $356.5k

     ...is looking for a Developer Technology Engineer to drive innovation in AI and accelerated computing. In San...  ...internal teams and partners to tackle GPU deployment challenges. Ideal candidates...  ...years in GPU profiling, proficiency in C/C++, and experience with AI technologies.... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...computing model focused on visual and AI computing. For two decades,...  ..., with our invention of the GPU. The GPU has also shown to be...  ...is looking for Architects, Software Engineers, and AI application developers...  ...related areas Proficiency in C++, Python and ML frameworks like... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • A leading AI technology firm in California is seeking an experienced Senior Software Engineer to develop and optimize AI infrastructure software using state-of-the-art GPU systems. Candidates should have a Bachelor's degree in a technical field and a minimum of 5 years... 
    Senior

    Intelliswift

    Sunnyvale, CA
    1 day ago
  • NVIDIA is hiring engineers to scale AI infrastructure, focusing on end-to-end automation of datacenter operations for large-scale ML systems. You will work on GPU asset provisioning, monitoring, and NVLINK topology, collaborating across teams to ensure seamless integration... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    1 day ago
  • $160k - $225k

    United States Digital Space LLC is seeking a Senior Software Engineer for AI Runtime in Mountain View, California. This role involves building and scaling systems for large-scale GPU training, contributing to the architecture of a managed training stack and mentoring fellow... 
    Senior

    United States Digital Space LLC

    Mountain View, CA
    2 days ago
  • NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware...  ...stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that designs... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD... 
    Senior

    AMD

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    NVIDIA is seeking a motivated Deep Learning Engineer based in Santa Clara, California. The role involves integrating communication libraries with advanced AI stacks and optimizing performance for multi-GPU applications. Ideal candidates should have a strong background in... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...experienced professional to optimize AI workloads at DGX Station (...  ...applications, profiling multi-GPU environments, and collaborating to enhance NVIDIA's software stack. The ideal candidate has...  ...experience in systems software engineering and strong expertise with deep... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  •  ...for a motivated Deep Learning engineer in Santa Clara, California, to...  ...communication technologies in AI environments. This role focuses...  ...and scalability in multi-GPU computing. The ideal candidate...  ...should have a strong background in software engineering and AI,... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    1 day ago
  • $152k - $287.5k

    NVIDIA is seeking a Senior AI Infrastructure Engineer for our DGX Cloud group. This role involves designing, building, and maintaining large-scale production systems, ensuring GPU cloud services perform with maximum reliability. The ideal candidate will have a strong background... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • AMD is seeking a highly motivated AI Software Engineer to join its team in Santa Clara, California. This...  ...and optimizing AI models for advanced GPU computational accelerators. Candidates should have strong programming skills in C++ and Python, along with experience in... 

    AMD

    Santa Clara, CA
    1 day ago
  • Broadcom in Palo Alto is seeking an experienced Principal Software Engineer to join the GPU Virtualization Team. In this role, you will develop and integrate an AI Virtualization Stack to provide hardware-agnostic acceleration for AI/ML workloads on Virtual Machines. Candidates... 

    Broadcom

    Palo Alto, CA
    1 day ago
  • NVIDIA is seeking a Senior AI Infrastructure Engineer to design, build, and maintain large-scale production...  ...group in California. The role covers software and systems engineering practices...  ...analysis, and lifecycle management for multi-GPU clusters, with opportunities for... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $160k - $225k

    Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In this role, you'll drive the architecture and evolution of AIR's managed GPU training platform, ensuring scalable and resilient training. The ideal candidate has 5+ years of experience... 
    Senior

    Databricks

    Mountain View, CA
    1 day ago
  •  ...looking for a skilled and experienced C++ Engineer to design and build high-performance software on Linux. You will be a key...  ...disciplinary system that integrates AI modules, hardware interfaces, and...  ...Optimization Tools CUDA or OpenCL for GPU acceleration Python for tooling,... 
    Senior

    Imagry | Autonomous Driving

    San Jose, CA
    5 days ago
  • Crusoe Energy Systems in Sunnyvale, CA is looking for a Virtualization Validation Engineer responsible for validating large-scale GPU clusters. You will validate the interconnect fabric and collective communication libraries, ensuring efficient workloads across virtualized... 
    Senior

    Crusoe Energy Systems

    Sunnyvale, CA
    1 day ago
  • NVIDIA is seeking an experienced software professional in Santa Clara, CA to design and develop...  ...computing. Join our team to help optimize GPU-accelerated implementations for various...  ...ideal candidate will have strong Python, C++, and CUDA skills, as well as a solid foundation... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $165k - $242k

    CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...more at About The Role Senior engineers are area owners who lead...  ...hardware teams to evolve our GPU performance testing platform to...  ...Proficiency in Go and/or Python software development. Hands‑on experience... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • NVIDIA Corporation is seeking an experienced software professional in Santa Clara to contribute to the development of GPU-accelerated Python APIs for numerical computing....  ...have a strong programming background in Python, C++, and CUDA, along with substantial experience in... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • NVIDIA is seeking outstanding AI systems engineers in Santa Clara to advance the inference software stack. You will build libraries, code generators, and GPU kernels for NVIDIA hardware, designing...  ...models. The role emphasizes Python/C++ development, GPU kernel... 

    Segment (Twilio)

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. AI Software Engineer (GPU/C++). Be the first to apply!