Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Development Engineer- GPU, LLM, AI

Advanced Micro Devices Inc

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges – striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

THE ROLE

AMD is looking for an influential software engineer who is passionate about improving the performance of key applications and benchmarks. You will be a member of a core team of extremely talented industry specialists and will work with the latest hardware and software technology.

THE PERSON

As a Senior Staff Software Developer, you will be at the heart of AMD’s AI strategy, tackling challenges such as training and running AI to make AI itself more efficient on GPUs on the fly, which can dramatically alter the trajectory of AI progress. This high‑impact, hands‑on role will directly define the software that powers the future of AI.

KEY RESPONSIBILITIES

Architect and Drive the AI Software Stack: Establish best practices and optimize performance from GPU kernels to large-scale distributed systems, shaping foundational software for AMD hardware. By leveraging LLMs and agent-based technologies, accelerate development and performance enhancement of the ROCm ecosystem. Accelerate Foundational Models: Directly accelerate cutting‑edge applications like foundation models (LLMs) and autonomous AI agents, ensuring AMD is the platform of choice for demanding workloads. Innovate Across Hardware and Software: Contribute to the entire co‑design lifecycle, influencing future GPU architectures, developing groundbreaking software for new accelerators, and collaborating with the broader AI community.

QUALIFICATIONS & EXPERIENCE

Success in this role requires a deep passion for software engineering, strong technical ownership, and the ability to influence technical direction across teams. As a senior engineer, you will also mentor others and communicate ideas to shape the future of AI at AMD. To excel, we seek a candidate with exceptional technical expertise who can bridge deep proficiency in high‑performance C++ and low‑level GPU programming with a robust understanding of LLMs and AI systems. The ideal candidate can be deep in one and light on the other.

PREFERRED EXPERIENCE

Lengthy professional software development experience in performance‑critical environments. Extensive hands‑on experience in GPU programming (HIP/CUDA) and optimizing deep‑learning kernels and operators. Fundamental understanding of GPU architecture and memory hierarchy, used to diagnose and resolve complex performance bottlenecks. Expert‑level proficiency in modern C++ and object‑oriented design. Deep experience using GPU profiling and performance analysis tools (e.g., AMD ROCm Profiler, NVIDIA Nsight) to diagnose and resolve complex bottlenecks in distributed, multi‑GPU systems. Deep knowledge of transformer architectures, attention mechanisms, and modern AI systems (Generative AI, Agentic AI). Hands‑on experience optimizing the post‑training and inference pipelines of LLMs. Strong technical ownership, communication, and problem‑solving skills with a track record of delivering complex technical solutions. Plus: Experience or deep expertise with the AMD ROCm/HIP ecosystem.

ACADEMIC CREDENTIALS

Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent. Master’s degree preferred; PhD is a plus. Relevant publications in AI/ML, GPU computing, or system optimization are highly valued.

OTHER CONDITIONS

This role is not eligible for visa sponsorship. This posting is for an existing vacancy.

EEO & AI SCREENING STATEMENT

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. #J-18808-Ljbffr Advanced Micro Devices, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Development Engineer- GPU, LLM, AI in Santa Clara, CA vacancy
  • $207k - $300k

    Software Engineer, GDC LLM Serving and GPU Performance Google Sunnyvale, CA, USA Qualifications Bachelor’s degree...  ...8 years of experience in software development. 5 years of experience testing and...  ...Language Models? Join the GDC AI Models and Performance team and work... 
    Suggested
    Full time

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $207k - $300k

     ...years of experience in software development. 5 years of experience...  ...Experience with modern GPU architectures (NVIDIA, AMD, or other AI accelerators), memory hierarchies...  ...etc.) and performance engineering techniques. Preferred...  ...Identify and maintain LLM training and serving... 
    Suggested
    Full time
    Temporary work
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $196.5k - $219.3k

     ...functions to monitor and filter LLM requests/responses in real...  ...features. Mentor junior engineers on secure backend development and best practices in an...  ...delivery of high-quality software features while adhering to...  ...language models or other AI/ML systems (e.g. implementing... 
    Suggested
    Full time
    Worldwide

    Fortinet

    Sunnyvale, CA
    5 days ago
  • $170k - $220k

     ...Staff Software Engineer, GPU Algorithms We are looking for a full-time Staff Software Engineer,...  ...learning and artificial intelligence (AI) techniques to improve ultrasound image...  ..., beamforming, simulation, algorithm development, or tool development Strong... 
    Suggested
    Full time

    DeepSight Technology

    Santa Clara, CA
    3 days ago
  • Advanced Micro Devices, Inc. is seeking a Senior Staff Software Developer who will play a pivotal role in shaping the future of AI and improving performance in key applications....  ...in high-performance C++ programming and GPU technologies, with experience optimizing AI systems... 
    Suggested

    Advanced Micro Devices, Inc.

    Santa Clara, CA
    2 days ago
  •  ...computing experiences-from AI and data centers, to PCs...  ...a senior member of the LLM inference framework team...  ...of inference engines, distributed systems, and GPU runtime and kernel backends...  ...architectures and kernel development Software Engineering ~ Expertise... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    5 days ago
  •  ...NVIDIA’s TensorRT Edge‑LLM team and help...  ...generation of edge AI for automotive and...  .... We build the software stack that enables...  ...kernel and operator development for critical transformer...  .../Computer Engineering, or a closely related...  ...profiling, and GPU architecture fundamentals... 

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $188k - $275k

     ...Staff Software Engineer, Inference CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...routing, scheduling, GPU resource management,...  ...vLLM, Triton, TensorRT-LLM, Ray Serve, or...  ...collaboration and enables the development of innovative... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $130k - $170k

    NTT DATA is hiring a Platform Engineer in Santa Clara, California, to lead the design and operation of scalable infrastructure supporting AI/LLM-based solutions. The ideal candidate will have over 5 years of experience in Platform Engineering. Your role involves managing... 

    NTT DATA

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...framework for serving generative AI and reasoning models across multi-...  ...extensibility, Dynamo orchestrates GPU shards, routes requests, and manages...  ...deployment of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and roadmap for... 
    Local area
    Remote work

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  •  ...for a Senior Deep Learning Software Engineer, LLM Performance! NVIDIA is seeking...  ...on designing and optimizing GPU-accelerated software for...  ...functional teams in generative AI, automotive, image understanding...  ...years of relevant software development experience. Excellent Python... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $188k - $275k

     ...The Essential Cloud for AI™. Built for pioneers...  ...routing, scheduling, GPU resource management, and...  ...the role: As a Staff Software Engineer (IC5) on the Inference...  ...vLLM, Triton, TensorRT-LLM, Ray Serve, or TorchServe...  ...and enables the development of innovative solutions... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    6 days ago
  • $248.71k - $292.6k

    About Groq Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses...  ...is within reach, anything is possible. Build fast. Sr. Staff Software Engineer - High Performance GPU Inference Systems Mission Push the limits of heterogeneous... 

    I did my part and supported the Regular Toilet

    Palo Alto, CA
    2 days ago
  •  ...Platform Engineer (AI/LLM Infrastructure) Day to Day Job Duties:...  ...player-coach), contributing to development while guiding a team of engineers...  ...database management Lead GPU infrastructure provisioning...  ..., Sudheer Senior US IT Recruiter | United Software Group Inc.... 
    3 days per week

    United Software Group

    Santa Clara, CA
    3 days ago
  • NVIDIA Gruppe is seeking a Senior Staff Software Engineer to join our Software Infrastructure team in Santa Clara, CA. In this role, you will develop...  ...and high-performance database services that power NVIDIA’s AI workloads. The ideal candidate has 12+ years of experience... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  ...computing experiences—from AI and data centers, to PCs, gaming...  ...your career. SENIOR GPU FIRMWARE ENGINEER The Role Join AMD’s Datacenter...  ...OEM partners, internal development and validation teams, and...  ...intersection of hardware and software. You enjoy collaborating directly... 

    AMD

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...Overview NVIDIA’s invention of the GPU in 1999 sparked the growth of...  ...deep learning ignited modern AI — the next era of computing —...  .... Are you a motivated system software engineer with a deep understanding of...  ...Coordinate and drive development efforts across multiple teams... 

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...unlimited potential of AI to define the next era...  ...computing. An era in which our GPU acts as the brains of...  ...part in every stage of development of a GPU* Thrive at the interface between software drivers and the GPU...  ...Science or Computer Engineering or equivalent experience... 
    Work experience placement

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $60k - $120k

     ...are we? Mission Altimate AI, founded in 2022 in San...  ...of the AI-powered data engineering revolution. You can read...  ...? We\'re in search of a Staff Software Engineer who brings a passion...  ...Backend Integration of LLM Architectures : Lead the development and maintenance of the... 
    Remote work
    Worldwide

    Early Stage Partners LP

    Sunnyvale, CA
    14 days ago
  • $300 per month

     ...Software Engineer Crusoe is on a mission to accelerate the abundance of...  ...the only vertically integrated AI infrastructure company built...  ...infrastructure for Crusoe's fleet GPU's and data center. The team...  ...position is focused on the development of software for the management... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    1 day ago
  • $188k - $275k

     ...Staff Software Engineer, IAM New York, NY, Sunnyvale, CA, Bellevue, WA CoreWeave...  ...is The Essential Cloud for AI™. Built for pioneers by...  ...microservices AI-Augmented Development: Familiarity with leveraging...  ...Familiarity with AI/ML workloads, GPU-based infrastructure, and... 
    Temporary work
    Casual work
    Work at office
    Immediate start
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $188k - $275k

     ...Staff Software Engineer, Compute Architecture Manhattan, NY / Sunnyvale, CA / Bellevue, WA / Livingston...  ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...operate the backbone of our large-scale GPU data centers. The METALDEV team builds... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  •  ...maintains a close and long-term relationship with our direct client. In support of their needs, we are looking for a Python Developer - LLM / AI Applications. Job Description: Job Title: Python Developer - LLM / AI Applications Job Type: Contract... 
    Contract work

    Maxonic

    Sunnyvale, CA
    4 days ago
  • $2,000 per month

     ...About Etched Etched is building AI chips that are hard-coded for...  ...chain-of-thought reasoning. Software Engineer, LLM Infrastructure Transformer...  ...audio and video communication GPU kernel profiling and low-level...  ...expect all of our technical staff to contribute to both as needed... 
    Work at office
    Relocation package

    OpenReq

    Cupertino, CA
    3 days ago
  •  ...company is seeking a Senior Staff Software Developer in Santa Clara. This role emphasizes improving AI performance on GPUs and requires...  ...performance C++ programming, GPU architectures, and Large...  ...for groundbreaking software engineering. A Master's degree and significant... 

    AMD

    Santa Clara, CA
    4 days ago
  • $124k - $195.5k

    ## Software Engineer, GPU Performance ToolsApplylocations: US, CA, Santa Clara: US, OR, Hillsboro: US, Remotetime type: Full timeposted...  ...with the latest software engineering practices including AI-enabled development tooling****Ways to stand out from the crowd:*****... 

    NVIDIA Corporation

    Santa Clara, CA
    23 hours ago
  • $188k - $275k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...more at What You'll Do: As a Staff Software Engineer (IC5) on the AI Workload Orchestration...  ..., scheduled, and governed across large GPU clusters using frameworks such as Kueue... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    21 days ago
  • $300 per month

     ...intelligence . As the only vertically integrated AI infrastructure company built from the...  ...About This Role We are seeking a Staff Software Engineer to architect, design, and develop the...  ...layer that controls how every GPU node in Crusoe's fleet gets assigned, monetized... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    28 days ago
  • $165k - $198k

     ...Sr Staff Software Engineer – Agentic AI Security Build our AI Agent Security Capability on the cloud, working...  ...for the complete software development life cycle, including requirement analysis...  ...depth experience with exploiting OWASP LLM Top 10 vulnerabilities, OWASP Low... 
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $208.73k - $279.57k

     ...Staff Software Engineer For The Ai Model Lifecycle Team Crusoe is on a mission to accelerate the abundance...  ...platform for the entire application development lifecycle, with a specific focus on...  .... Performance optimizations on GPU systems and inference frameworks.... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Development Engineer- GPU, LLM, AI. Be the first to apply!