Principal Software Development Engineer
Advanced Micro Devices , Inc.
ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.
Whether you're designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger - technology that moves the world forward. Join us and, together, we'll advance your career. THE ROLE: We are seeking a GPU performance engineering lead to join our team. This role focuses on maximizing performance and efficiency of large-scale AI training/RL/inference workloads on AMD GPU platforms. You will drive innovations across the full software-hardware stack, optimizing at scale and pushing the limits of system throughput, scalability, and utilization for generative AI workloads. This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization. THE PERSON: The ideal candidate is a recognized technical leader with deep expertise in GPU performance optimization, large-scale distributed system, and system-level bottleneck analysis. You have a strong understanding of GPU architecture, interconnects, memory hierarchies, and communication patterns, and can translate this knowledge into measurable improvements in training efficiency at scale. You are comfortable operating across layers-from kernels and runtimes to frameworks and distributed strategies-and have a track record of driving impactful optimizations and influencing technical direction. KEY RESPONSIBILITIES:
#LI-JG1 Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here. This posting is for an existing vacancy.
Whether you're designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger - technology that moves the world forward. Join us and, together, we'll advance your career. THE ROLE: We are seeking a GPU performance engineering lead to join our team. This role focuses on maximizing performance and efficiency of large-scale AI training/RL/inference workloads on AMD GPU platforms. You will drive innovations across the full software-hardware stack, optimizing at scale and pushing the limits of system throughput, scalability, and utilization for generative AI workloads. This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization. THE PERSON: The ideal candidate is a recognized technical leader with deep expertise in GPU performance optimization, large-scale distributed system, and system-level bottleneck analysis. You have a strong understanding of GPU architecture, interconnects, memory hierarchies, and communication patterns, and can translate this knowledge into measurable improvements in training efficiency at scale. You are comfortable operating across layers-from kernels and runtimes to frameworks and distributed strategies-and have a track record of driving impactful optimizations and influencing technical direction. KEY RESPONSIBILITIES:
- Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
- Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
- Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
- Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
- Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
- Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
- Stay at the forefront of advancements in large-scale systems and performance optimization techniques.
- Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
- Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
- Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
- Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
- Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
- Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
- Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
- Demonstrated technical leadership and ability to influence cross-functional team
- Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field
#LI-JG1 Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here. This posting is for an existing vacancy.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Software Development Engineer in San Jose, CA vacancy
$135.2k - $306.4k
...core components for data planes. We are hoping to enhance engineering efficiency by concentrating our expertise on building... ...collaborate with executives for investment and drive the software design and development for new major data-plane components of Oracle's Cloud Infrastructure...SuggestedTemporary workWork experience placementWorldwideFlexible hours$156.4k - $253k
...Your Career In the Layer-7 Security Software team, we are responsible for at least one... ...Application Identification and Content Inspection Engine runs on Hardware, Virtualized, Container... ...teams throughout the entire software development cycle. Your Impact Innovate,...SuggestedFull timeWork at office$266k - $298k
...About the role Muon seeks a Principal Software Engineer to join our Software Organization. This engineer will synthesize a broad understanding... ...market needs - partnering closely with peers in Business Development, Product Management, Systems Engineering and Hardware....SuggestedPermanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week$188.5k - $265k
...Principal Software Development EngineerZscaler accelerates digital transformation so customers can be more agile, efficient, resilient, and secure... ...is a Hybrid role, reporting to the Director, Software Engineering in the Engineering department. You will join the team...SuggestedFull timeWork at officeLocal areaWorldwide- ...looking for a dynamic, energetic Lead / Principal Systems Design Engineer to join our growing team. As a key... ...as facilitate continuous career development. THE PERSON: As a Leader in Systems... ...high visibility position, your software systems engineering expertise will...Suggested
- ...advance your career. THE ROLE: AMD is looking for a strategic software engineer ing lead who is passionate about improving the performance... ...ambiguous technical problems Experience with open-source software development including collaboration with community maintainers and...
- ...looking for a dynamic, energetic Lead/Principal Systems Design Engineer to join our growing team. As a key... ...as facilitate continuous career development.The PersonAs a Leader in Systems Design... ...high visibility position, your software systems engineering expertise will...
- ...Principal Software Development EngineerAs a Principal Software Development Engineer in the Oracle Cloud Infrastructure (OCI) Security Platform division, you will play a critical leadership role in the architecture, evolution, and delivery of OCI's Key Management Service...
$161k - $299k
...of hardware verification technology. As a Senior Engineer in the System Verification Group, you will be at the... .... We are looking for an experienced C/C++ software engineer to join the Xcelium Software Development Team to develop and enhance RTL/logic simulation products...Full time$250.6k - $362.6k
...Meet The Team Splunk's Platform Engineering team is evolving the core platform to run reliably on Kubernetes across cloud and customer... ...related work experience ~10+ years of professional software engineering experience building backend, platform, infrastructure...Full timeTemporary workWork experience placementLocal areaFlexible hours- ...Principal Engineer For Agentcore We are seeking technically deep Principal Engineer to drive... ...deliver large scalable systems, design new software systems and have a significant bottom-... ...non-internship professional software development experience 8+ years of leading design...Internship
$272k - $431.25k
We're looking for a Principal Engineer to join our CSP Engagements team as the technical focal point for end-to-end performance, working directly... ...comparison and pattern analysis — identify configuration, software, or workload differences that explain performance gaps...Full timeRemote work$272k - $431.25k
...performance, safety, and coverage. You will work with a diverse team of engineers in mapping, perception, reconstruction, localization, and... ...skills in C++ and experience building production-quality software systems.Solid foundation in 3D computer vision, 3D geometry, multi...Full timeWorldwide$118.3k - $224.9k
..., world-class operations and investments in research and development, we offer capabilities and opportunity no one else can. Together... ...and defense.Applied Signal Technology (AST) is seeking a Principal Software Engineer with specialization in Development, Security, and...Temporary workWork experience placementWork at officeRemote workFlexible hours$220k - $250k
...California, United StatesProducts - Engineering /Fulltime /HybridOver 50,000 customers... ...team.Position detailsTitle of position: Principal Software EngineerPosition type: Full... ...distributed systems. You will help lead the development of core platforms and services that process...Full timeH1bLocal areaWork from homeWork visaShift work$158.5k - $321k
HPE Labs - Principal Software Engineer - HPE QuantumThis role has been designed as 'Hybrid' with a requirement that you will work on average 2... ...toward practical applications. You will apply your software development expertise to quantum circuit compilation, circuit...Full timeWork experience placementWork at officeLocal areaImmediate start2 days per week$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for fleet-scale reliability, working directly with engineering teams of key CSP / hyperscale customers to ensure NVIDIA platforms achieve target MTBI (Mean Time...Full time- ...accessible on a global scale. From chips and software to rack-scale systems, our team is... ...3+ days per week.The Role: Principal Software Engineer, KernelsWhat you will do:The role requires... ..., you will be responsible for the development, enhancement, and maintenance of...Work experience placement3 days per week
$160k - $325k
Principal Software Engineer SD-WANThis role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office... ...external penetration testing companies and manage the secure development lifecycle of products through penetration testing....Full timeWork experience placementWork at officeLocal areaImmediate startRemote work$272k - $431.25k
NVIDIA is seeking a strategic and technically proficient Principal Software Engineer to join the Data Center Systems and Software CSP engagements... ...role contributing significantly to the architecture and development of next-generation Data Center products, acting as the...Full timeShift work$250.6k - $362.6k
...Defense team is a fast-growing, elite engineering group dedicated to securing the next... ...global enterprise scale.YOUR IMPACTAs a Principal Software Engineer for AI Defense, you will... ...organizational influence with hands-on systems development, translating complex AI safety...Full timeTemporary workWork at officeLocal areaFlexible hours- ...Together, we advance your career. THE ROLE: AMD is looking for a Principal-level PyTorch training framework expert to help drive... ...ambiguity to crisp execution. You communicate clearly with both engineers and stakeholders and can represent AMD credibly in upstream/open...
- Principal Software Engineer - AI ADCA10 Networks is accelerating its AI‑driven innovation across the ADC and GSLB product lines. We are seeking... ...highly experienced Sr. Staff Engineer to be part of the development of next‑generation AI‑aware traffic management and AI Gateway...Full timeFor subcontractorLocal area
- ...a brighter, more sustainable future while tackling the most pressing challenges of the 21st century.We are looking for a Principal Software Engineer, Edge Compute to join our team in one of today’s most exciting technologies. This role will report to Sr Director Software...Full timeWork at officeWorldwide
$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for GPU firmware and GPU system software, working directly with engineering teams of key CSP / hyperscale customers to ensure they can reliably manage, update,...Full timeRemote work- ...Forbes as one of the Best Workplaces for Engineers in 2026, reflecting a culture where engineers do meaningful work.The Principal Software Engineer - Mobile Applications will... ...responsible for the architecture, design, development, integration, and delivery of Android and...Hourly payWork at officeLocal areaRelocation packageShift work3 days per week
$135.2k - $306.4k
...data planes. We are hoping to enhance engineering efficiency by concentrating our expertise... ...organizations, and drive the development of scalable validation frameworks that... ...Level - IC5ResponsibilitiesAs a Senior Principal Engineer, you will lead the design and...Temporary workWorldwideFlexible hours$248k - $391k
...that improve business efficiency and productivity. This engineer is expected to be familiar with concepts of RAG,... ...will play a pivotal role in shaping the architecture, development, and scaling of our software systems. This role will give an opportunity to collaborate...Full timeImmediate start$221.2k - $387.1k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...to production.We're looking for a Principal Engineer who has built 1.0 products before... ...to improve both delivery velocity and software quality.Mentorship & Technical Excellence...Work at officeImmediate startRemote workFlexible hours$221.2k - $387.1k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ..., application quality, and software delivery efficiency across the... ...investing in AI-native development experiences, we're focused on... ...practices.What You'll DoAs a Principal Software Engineer, you'll help...Work at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Development Engineer. Be the first to apply!
Related searches
- principal software engineer San Jose, CA
- senior software design engineer San Jose, CA
- software web developer San Jose, CA
- senior software engineer San Jose, CA
- software developer fintech San Jose, CA
- security software engineer San Jose, CA
- software developer night shift San Jose, CA
- scientific software engineer San Jose, CA
- new graduate software engineer San Jose, CA
- senior software engineer ruby on rails San Jose, CA


