Principal Software Development Engineer - AI/ML
Advanced Micro Devices Inc
ADVANCE YOUR CAREER. ADVANCE THE WORLD.At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.THE ROLE: We are seeking a highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler and performance optimizations that enable state-of-the-art AI training and inference workloads on AMD GPU platforms. You will work at the intersection of compiler technology, machine learning frameworks, GPU architecture, and performance engineering, contributing to the ROCm software ecosystem and ONNX Runtime execution stack. The ideal candidate combines deep compiler expertise with hands-on experience optimizing AI workloads, and thrives in a fast-paced environment collaborating across architecture, kernel, runtime, and framework teams.THE PERSON: You are passionate about building high-performance AI software and solving complex optimization challenges. You possess strong compiler fundamentals, GPU programming expertise, and a proven ability to improve performance for large-scale AI models.You enjoy collaborating with architecture, compiler, runtime, and machine learning teams to deliver innovative solutions that scale across current and future AMD GPU platforms. You have a strong sense of ownership, excellent problem-solving skills, and a track record of driving meaningful performance improvements across software stacks.KEY RESPONSIBILITIES: Work with AMD’s architecture specialists to improve future productsDesign, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.Develop scalable solutions that improve portability and performance across AMD GPU architectures.Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.Implement, validate, and maintain ONNX operators and microbenchmark test suites.Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.Drive performance characterization and benchmarking across pre-silicon and post-silicon environments. PREFERRED EXPERIENCE: Strong proficiency in C++ and object-oriented software development.Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.Experience profiling and optimizing performance-critical software systems.Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.Strong analytical, communication, and problem-solving skills. ACADEMIC CREDENTIALS: Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent This role is not eligible for visa sponsorship.Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
- ...potential of generative AI to power the... ...at the forefront of software and hardware innovation... ...per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat... ...responsible for the development, enhancement, and... ...other software (ML and compilers) and hardware...Suggested3 days per week
- ...computing experiences—from AI and data centers, to... ...driving a unified ROCm software stack across AMD’s... ...silicon, system software, AI/ML frameworks, libraries,... .... Workload Performance Engineering: Lead the profiling,... ...Innovation: Drive the development of advanced tools and frameworks...Suggested
$142.8k - $274.8k
...than 25%Profession: Software EngineeringDiscipline... ...builds the end-to-end AI stack and is core to... ...as a Service, Azure ML, Cognitive Services,... ...We are looking for a Principal Software Engineer - Responsible AI who... ...observability.Lead project development across the...SuggestedOngoing contractWork at officeLocal area3 days per week$207k - $340k
...the team.LinkedIn's AI and Machine Learning Engineers are both data/research scientists and software engineers, who develop... .... As a Principal Staff Software Engineer... ...lead who will use AI/ML to push the boundaries... ...in software design, development, and algorithm related...SuggestedFor contractorsWork experience placementWork at officeFlexible hours- ...are seeking an innovative and highly skilled Software Engineer III specializing in agentic AI tool building to lead the development and deployment of AI agents, tools, and models... ..., APIs, web scraping libraries, and ML frameworks for predictive analytics and research...SuggestedFull timeLocal area
$193.3k - $261.5k
...(AWS) builds AWS Neuron, the software development kit used to accelerate deep learning... .... Neuron includes an ML compiler, runtime, collectives... ...hardware and software boundary, our engineers build the infrastructure that... ...help shape the direction of AI acceleration technology.You...InternshipLocal areaFlexible hours$147k - $211k
...and deploy scalable and agentic AI solutions for high-value, real-... ....2 years of experience with software development in Python or C++.1 year of experience with ML infrastructure (e.g., model deployment... ...statistics.Google's software engineers develop the next-generation...$170k - $210k
...experiences, and intelligent software come together at a... ...is already applying AI to challenging TV problems... .... This is a hands-on engineering role for someone who treats... ...lifecycle of agent development—from prototyping and architecture... ...engineering, AI/ML engineering, backend...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours- ...computing experiences—from AI and data centers, to... ...critical to AMD’s AI software roadmap.AMD GPUs are an... ...Triton/Gluon kernels for ML kernels powering the... ...architecture, and performance engineering. You are comfortable... ...in GPU kernel development, compiler backends, or...
$143k - $191k
...building the next generation of Agentic AI products that help millions of people and... ...better talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user... ...with product managers, designers, and AI/ML engineers to bring intelligent agents to...Work at officeRemote workFlexible hours$174k - $252k
Design and implement scalable AI solutions for Google's enterprise functions leveraging... ...building blocks.Collaborate with ML engineers and leads on developing reusable enterprise... ...Experience productionizing a service.Google's software engineers develop the next-generation...$152k - $241.5k
...recently, GPU deep learning ignited modern AI - the new era of computing, positioning... ...landscape.Local AI seeks a Senior Systems Software Engineer interested in solving client-side AI... ...inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch...Full timeLocal area$136.3k - $231.7k
...inspiration, research and development. KLA focuses more than... ...teams of physicists, engineers, data scientists and problem... ...research scientist, software engineers, application... ...by the current wave of AI — someone who actively explores modern AI/ML and generative-AI...Minimum wageFull timeFlexible hoursWeekend work- ...Why RoboForce RoboForce is an AI robotics company building Physical AI and Robo-Labor... .... We are looking for a Senior Software Engineer to build scalable AI infrastructure. As... ...Strong proficiency with C++, Python, and ML frameworks (e.g., PyTorch, JAX). Deep...Full timeWork at officeVisa sponsorship
$231.4k - $331.8k
...Cisco’s Platform & Identity Engineering Group, a foundational group... ...technical direction of Cisco’s software and technology solutions,... ...technical community.Ensure the development, execution, and enablement... ...observability, data platforms, or AI/ML-driven systems.Track record...Full timeTemporary workLocal areaFlexible hours$185.5k - $265k
...efficient, resilient, and secure. As an AI-forward enterprise, we are constantly... ....RoleWe are looking for a Principal Software Development Engineer to join our team. This is a hybrid (3... ...Qualifications)Foundational understanding of AI/ML technologies and experience...Full timeWork at officeLocal areaRemote work3 days per week$272k - $431.25k
We're looking for a Principal Engineer to join our CSP Engagements team as the... ...— identify configuration, software, or workload differences that... ...engineering, ideally in GPU/HPC/ML infrastructure. BS or MS in... ...existing vacancy. NVIDIA uses AI tools in its recruiting processes...Full timeRemote work$272k - $431.25k
...inference framework for serving generative AI and reasoning models across multi-node... ...-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap for... ...systems, high-performance storage, or ML systems infrastructure in C/C++ and Python...Full timeLocal areaRemote work- ...Identify and capitalize on emerging AI trends in automated shopping, voice... ...initiatives. Experience working with AI/ML models, personalization engines, and automation tools. Strong... ...considerations are embedded in product development. Build and manage partnerships with...Full time
- ...SummaryWe are seeking a visionary Senior Principal Software Engineer / Technical Staff Member to spearhead... ...architect, an Agile Product Owner, and an AI pioneer. You will lead the charge in... ...proficiency in Python, Bash, Perl, or TCL.AI/ML Practice: Practical experience...Temporary workFor contractorsWork at officeLocal areaWorldwideShift work
$190k - $300k
...potential of generative AI to power the... ...at the forefront of software and hardware innovation... ...US/Canada.The role: Principal Software Engineer, SDK & Lowering StackWhat... ...compiler teams.Create development tools to be used in kernel... ..., TPUs, or custom ML accelerators....Work experience placement$231.4k - $331.8k
...platforms central to the AI era, powering Cisco’s... .... Because full product development—from design to qualification... .... Develop and execute software test plans. Collaborate... ...s degree in Electrical Engineering, Computer Science, or... ...embedded systems. AI/ML experience and knowledge...Full timeTemporary workLocal areaFlexible hours$272k - $431.25k
...actionable insights for ML workloads. You will... ...delivery across system software, drivers, and CUDA to make... ...integrate with existing ML/AI workflows (e.g.,... ...technical direction for an engineering team; mentor engineers,... ...of system-level C/C++ development, including concurrency,...Full time$272k - $431.25k
...deep learning ignited modern AI—the next era of computing—with... ...personal assistants and engineering-productivity tools to data-driven... ...across the company. Now we need a principal-level, hands-on engineering... ...behave like mature software, not prototypes.Build reusable...Full timeLive in- ...computing experiences—from AI and data centers, to PCs,... ...generation of compiler and software infrastructure to... ...Language Models (LLMs) and ML workloads on emerging accelerator... ...PERSON:We are looking for a Principal Software Development Engineer to lead technical...
- ...generation computing experiences—from AI and data centers, to PCs,... ...looking for an influential software engineer who is passionate about... ...technologies, you will accelerate the development and performance enhancement... ...or the C++/HIP/CUDA core of ML frameworks like PyTorch,...
$200k - $322k
...Enterprise Product Group builds AI solutions that help... ...Senior Technical Marketing Engineer focused on Enterprise AI Software, and accelerating adoption... ...work together across model development, inference, RAG, agentic... ...Science, Engineering, AI/ML, Data Science, or another...Full time- ...generation computing experiences—from AI and data centers, to PCs,... ...'re looking for a senior software engineer who combines deep systems... ...tooling where it accelerates development and tuning of the ROCm ecosystem... ...CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as...Shift work
$189k - $301k
...posed by the growing demands of future AI/ML workloads. Our team is committed to... ...collaborate closely with both hardware and software engineers to identify and address the unique... ...we continuously conduct research and development in emerging technologies and trends across...Work at officeFlexible hours$165.2k - $223.6k
...(AWS) builds AWS Neuron, the software development kit used to accelerate deep learning... ...'s Inferentia and Trainium ML accelerators. This... ...hardware-software boundary, our engineers build systematic infrastructure... ...boundaries of what's possible in AI acceleration.As part of the...Work experience placementInternshipLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Development Engineer - AI/ML. Be the first to apply!
- principal software engineer San Jose, CA
- agile software developer San Jose, CA
- software developer internship no experience San Jose, CA
- software engineer staff San Jose, CA
- experienced software developer San Jose, CA
- work from home software developer San Jose, CA
- software developer fintech San Jose, CA
- software data engineer San Jose, CA
- financial software developer San Jose, CA
- software developer internship San Jose, CA

