Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Development Engineer

Advanced Micro Devices , Inc.

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology has the power to solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.


Whether you're designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger - technology that moves the world forward. Join us and, together, we'll advance your career.

THE ROLE:

We are seeking a GPU performance engineering lead to join our team. This role focuses on maximizing performance and efficiency of large-scale AI training/RL/inference workloads on AMD GPU platforms. You will drive innovations across the full software-hardware stack, optimizing at scale and pushing the limits of system throughput, scalability, and utilization for generative AI workloads.

This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization.

THE PERSON:

The ideal candidate is a recognized technical leader with deep expertise in GPU performance optimization, large-scale distributed system, and system-level bottleneck analysis. You have a strong understanding of GPU architecture, interconnects, memory hierarchies, and communication patterns, and can translate this knowledge into measurable improvements in training efficiency at scale.

You are comfortable operating across layers-from kernels and runtimes to frameworks and distributed strategies-and have a track record of driving impactful optimizations and influencing technical direction.

KEY RESPONSIBILITIES:
  • Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
  • Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
  • Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
  • Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
  • Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
  • Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
  • Stay at the forefront of advancements in large-scale systems and performance optimization techniques.
PREFERRED EXPERIENCE:
  • Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
  • Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
  • Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
  • Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
  • Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
  • Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
  • Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
  • Demonstrated technical leadership and ability to influence cross-functional team
ACADEMIC CREDENTIALS:
  • Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field

This role is not eligible for visa sponsorship


#LI-JG1

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here.

This posting is for an existing vacancy.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Software Development Engineer in San Jose, CA vacancy
  • $135.2k - $306.4k

     ...core components for data planes. We are hoping to enhance engineering efficiency by concentrating our expertise on building...  ...collaborate with executives for investment and drive the software design and development for new major data-plane components of Oracle's Cloud Infrastructure... 
    Suggested
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    2 days ago
  • $156.4k - $253k

     ...Your Career In the Layer-7 Security Software team, we are responsible for at least one...  ...Application Identification and Content Inspection Engine runs on Hardware, Virtualized, Container...  ...teams throughout the entire software development cycle. Your Impact Innovate,... 
    Suggested
    Full time
    Work at office

    PaloAlto Networks

    San Jose, CA
    3 days ago
  • $266k - $298k

     ...About the role Muon seeks a Principal Software Engineer to join our Software Organization. This engineer will synthesize a broad understanding...  ...market needs - partnering closely with peers in Business Development, Product Management, Systems Engineering and Hardware.... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    1 day ago
  • $188.5k - $265k

     ...Principal Software Development EngineerZscaler accelerates digital transformation so customers can be more agile, efficient, resilient, and secure...  ...is a Hybrid role, reporting to the Director, Software Engineering in the Engineering department. You will join the team... 
    Suggested
    Full time
    Work at office
    Local area
    Worldwide

    Zscaler

    Santa Clara, CA
    2 days ago
  •  ...looking for a dynamic, energetic Lead / Principal Systems Design Engineer to join our growing team. As a key...  ...as facilitate continuous career development. THE PERSON: As a Leader in Systems...  ...high visibility position, your software systems engineering expertise will... 
    Suggested

    AMD

    San Jose, CA
    4 days ago
  •  ...advance your career. THE ROLE: AMD is looking for a strategic software engineer ing lead who is passionate about improving the performance...  ...ambiguous technical problems Experience with open-source software development including collaboration with community maintainers and... 

    AMD

    Santa Clara, CA
    3 days ago
  •  ...looking for a dynamic, energetic Lead/Principal Systems Design Engineer to join our growing team. As a key...  ...as facilitate continuous career development.The PersonAs a Leader in Systems Design...  ...high visibility position, your software systems engineering expertise will... 

    Advanced Micro Devices , Inc.

    San Jose, CA
    2 days ago
  •  ...Principal Software Development EngineerAs a Principal Software Development Engineer in the Oracle Cloud Infrastructure (OCI) Security Platform division, you will play a critical leadership role in the architecture, evolution, and delivery of OCI's Key Management Service... 

    Oracle

    Santa Clara, CA
    4 days ago
  • $161k - $299k

     ...of hardware verification technology. As a Senior Engineer in the System Verification Group, you will be at the...  .... We are looking for an experienced C/C++ software engineer to join the Xcelium Software Development Team to develop and enhance RTL/logic simulation products... 
    Full time

    Cadence Design Systems

    San Jose, CA
    4 days ago
  • $250.6k - $362.6k

     ...Meet The Team Splunk's Platform Engineering team is evolving the core platform to run reliably on Kubernetes across cloud and customer...  ...related work experience ~10+ years of professional software engineering experience building backend, platform, infrastructure... 
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    Cisco

    San Jose, CA
    3 days ago
  •  ...Principal Engineer For Agentcore We are seeking technically deep Principal Engineer to drive...  ...deliver large scalable systems, design new software systems and have a significant bottom-...  ...non-internship professional software development experience 8+ years of leading design... 
    Internship

    A W S

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

    We're looking for a Principal Engineer to join our CSP Engagements team as the technical focal point for end-to-end performance, working directly...  ...comparison and pattern analysis — identify configuration, software, or workload differences that explain performance gaps... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...performance, safety, and coverage. You will work with a diverse team of engineers in mapping, perception, reconstruction, localization, and...  ...skills in C++ and experience building production-quality software systems.Solid foundation in 3D computer vision, 3D geometry, multi... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $118.3k - $224.9k

     ..., world-class operations and investments in research and development, we offer capabilities and opportunity no one else can. Together...  ...and defense.Applied Signal Technology (AST) is seeking a Principal Software Engineer with specialization in Development, Security, and... 
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Raytheon

    San Jose, CA
    5 days ago
  • $220k - $250k

     ...California, United StatesProducts - Engineering /Fulltime /HybridOver 50,000 customers...  ...team.Position detailsTitle of position: Principal Software EngineerPosition type: Full...  ...distributed systems. You will help lead the development of core platforms and services that process... 
    Full time
    H1b
    Local area
    Work from home
    Work visa
    Shift work

    Extreme Networks, Inc.

    San Jose, CA
    1 day ago
  • $158.5k - $321k

    HPE Labs - Principal Software Engineer - HPE QuantumThis role has been designed as 'Hybrid' with a requirement that you will work on average 2...  ...toward practical applications. You will apply your software development expertise to quantum circuit compilation, circuit... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    Milpitas, CA
    2 days ago
  • $272k - $431.25k

    We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for fleet-scale reliability, working directly with engineering teams of key CSP / hyperscale customers to ensure NVIDIA platforms achieve target MTBI (Mean Time... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...accessible on a global scale. From chips and software to rack-scale systems, our team is...  ...3+ days per week.The Role: Principal Software Engineer, KernelsWhat you will do:The role requires...  ..., you will be responsible for the development, enhancement, and maintenance of... 
    Work experience placement
    3 days per week

    d-Matrix

    Santa Clara, CA
    2 days ago
  • $160k - $325k

    Principal Software Engineer SD-WANThis role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office...  ...external penetration testing companies and manage the secure development lifecycle of products through penetration testing.... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work

    Hewlett Packard Enterprise

    San Jose, CA
    1 day ago
  • $272k - $431.25k

    NVIDIA is seeking a strategic and technically proficient Principal Software Engineer to join the Data Center Systems and Software CSP engagements...  ...role contributing significantly to the architecture and development of next-generation Data Center products, acting as the... 
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $250.6k - $362.6k

     ...Defense team is a fast-growing, elite engineering group dedicated to securing the next...  ...global enterprise scale.YOUR IMPACTAs a Principal Software Engineer for AI Defense, you will...  ...organizational influence with hands-on systems development, translating complex AI safety... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    4 days ago
  •  ...Together, we advance your career. THE ROLE: AMD is looking for a Principal-level PyTorch training framework expert to help drive...  ...ambiguity to crisp execution. You communicate clearly with both engineers and stakeholders and can represent AMD credibly in upstream/open... 

    AMD

    San Jose, CA
    2 days ago
  • Principal Software Engineer - AI ADCA10 Networks is accelerating its AI‑driven innovation across the ADC and GSLB product lines. We are seeking...  ...highly experienced Sr. Staff Engineer to be part of the development of next‑generation AI‑aware traffic management and AI Gateway... 
    Full time
    For subcontractor
    Local area

    A10 Networks

    San Jose, CA
    5 days ago
  •  ...a brighter, more sustainable future while tackling the most pressing challenges of the 21st century.We are looking for a Principal Software Engineer, Edge Compute to join our team in one of today’s most exciting technologies. This role will report to Sr Director Software... 
    Full time
    Work at office
    Worldwide

    Bloom Energy

    San Jose, CA
    2 days ago
  • $272k - $431.25k

    We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for GPU firmware and GPU system software, working directly with engineering teams of key CSP / hyperscale customers to ensure they can reliably manage, update,... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...Forbes as one of the Best Workplaces for Engineers in 2026, reflecting a culture where engineers do meaningful work.The Principal Software Engineer - Mobile Applications will...  ...responsible for the architecture, design, development, integration, and delivery of Android and... 
    Hourly pay
    Work at office
    Local area
    Relocation package
    Shift work
    3 days per week

    Boston Scientific Corporation

    San Jose, CA
    19 hours ago
  • $135.2k - $306.4k

     ...data planes. We are hoping to enhance engineering efficiency by concentrating our expertise...  ...organizations, and drive the development of scalable validation frameworks that...  ...Level - IC5ResponsibilitiesAs a Senior Principal Engineer, you will lead the design and... 
    Temporary work
    Worldwide
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    3 days ago
  • $248k - $391k

     ...that improve business efficiency and productivity. This engineer is expected to be familiar with concepts of RAG,...  ...will play a pivotal role in shaping the architecture, development, and scaling of our software systems. This role will give an opportunity to collaborate... 
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    2 days ago
  • $221.2k - $387.1k

    Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious...  ...to production.We're looking for a Principal Engineer who has built 1.0 products before...  ...to improve both delivery velocity and software quality.Mentorship & Technical Excellence... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago
  • $221.2k - $387.1k

     ...DescriptionIt all started when engineer Fred Luddy wrote code that...  ..., application quality, and software delivery efficiency across the...  ...investing in AI-native development experiences, we're focused on...  ...practices.What You'll DoAs a Principal Software Engineer, you'll help... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Development Engineer. Be the first to apply!