Senior Software Engineer - Efficient GenAI Models
AMD
ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.THE ROLE:The AI Models and Applications team at AMD is looking for a specialized Senior Staff Engineer who is passionate about enabling innovative and efficient Generative AI training and inference at scale. You will be part of a core team of incredibly talented specialists and work on scaling training and inference for the latest Generative AI models.THE PERSON:You have a deep technical understanding and hands-on experience with the latest Generative AI applications in at least one of the following areas: large language models (LLMs), 3D World and Action Models, or image/video generation models. You have experience training models at scale and are passionate about developing efficient approaches to enable distributed training and inference on AMD devices.Why Join Us?Exciting Opportunities: As a senior member of the team, you will be at the forefront of innovation, working with the latest Generative AI models and algorithms. You will have the opportunity to shape the future of AI model training and inference optimization across a variety of applications.Talented Team: Join a team of highly skilled industry specialists who are passionate about pushing the boundaries of AI. Collaborate with like-minded professionals and learn from the best in the field.Cutting-Edge Technology: Work with state-of-the-art Generative AI algorithms and software, enabling you to stay ahead of the curve and drive advancements in AI model training at scale and deployment.Impactful Work: Your contributions will directly influence how cutting-edge Generative AI models across the industry are efficiently trained at scale, as well as how inference solutions are deployed to serve millions of customers, making a significant difference across various industries and applications.KEY RESPONSIBILITIES:Propose and apply innovative techniques to support both training and inference, including innovative transformer architectures, parallelism strategies for training on large clusters, inference optimization techniques such as speculative decoding, and optimal KV-caching strategies.Implement novel, efficient architectures for Generative AI models for training and inference and showcase the benefits on AMD platforms.Work with open-source frameworks and communities (e.g., PyTorch, JAX, vLLM, SGLang) to integrate AMD-optimized models and libraries and publish training recipes.Collaborate with software and hardware teams to co-optimize end-to-end performance on current and future AMD solutions.Increase adoption of agentic workflows for optimizing and deploying Generative AI applications at scale on AMD platforms.Publish and promote your work at external venues, including major conferences.Collaborate with researchers within AMD and across industry and academia to promote innovation on AMD platforms.PREFERRED EXPERIENCE:Strong technical expertise in Generative AI model training and inference, with familiarity working with deep learning frameworks such as PyTorch, JAX, vLLM, SGLang, and MuJoCo.Strong technical expertise in algorithmic innovation for efficient Generative AI applications across both training and inference.Expertise and publications in one or more of the following preferred areas: efficient model architectures, optimized training, innovative parallelism strategies, or low-precision training.Additional plus if publications have been presented at conferences such as NeurIPS, CVPR, ECCV, ICCV, ICML, or ICLR.Experience productizing Generative AI models and training foundation models at scale.Excellent written, verbal, and presentation skills, with the ability to coordinate effectively both internally and externally.Several years of experience in AI, deep learning, and related software development.ACADEMIC CREDENTIALS:PhD or master’s degree in computer science, Electrical Engineering, Mathematics, or a related field.LOCATION:San Jose, CA. Alternative locations in Seattle, WA, or Austin, TX may be considered.#LI-MV1Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
$184.7k - $324.8k
...Number: 200684368Team: Software and ServicesLocation:... ...is seeking a Senior Software Engineer to help engineering teams understand, model, and optimize infrastructure... ..., and infrastructure efficiency.You will partner... ...planningExperience applying GenAI, LLMs, or other...SeniorRelocation$184k - $287.5k
...that power them. We are hiring a Senior Engineer to design and build robust software for accelerated computing systems... ...define clear interfaces and enable efficient development.Make hands-on... ...executive dashboards, or quantitative modeling for accelerated systems. Experience...SeniorFull time$174k - $252k
...accuracy, testability, and efficiency,)Contribute to... ....Design and implement GenAI solutions, leverage ML... ...maintaining, or launching software products, and 1 year... ...infrastructure (e.g., model deployment, model evaluation... ....Google's software engineers develop the next-...Senior$174k - $252k
...experience.5 years of experience with software development in one or more... ...-end Machine Learning (e.g., model deployment, model evaluation,... ...).1 year of experience with GenAI techniques (e.g., LLMs, Multi... ...C++.Experience with software engineering practices for infrastructure,...SeniorTemporary work$152k - $241.5k
...re building the perception-based world model stack that makes this possible. It takes... ...on.You will join a team of world-class software engineers improving these algorithms. This is a... ...geometry and graphics.Experience building efficient, reusable APIs and frameworks for...SeniorFull timeRemote work$193.3k - $261.5k
...builds AWS Neuron, the software development kit... ...deep learning and GenAI workloads on... ...running a wide range of models and supporting... ...software boundary, our engineers build systematic... ...and maximize the efficiency of them running on... ...and mentorship. Our senior members enjoy one-...SeniorWork experience placementInternshipLocal areaFlexible hours$174k - $252k
...testability, and efficiency).Contribute to existing... ...Intelligence (GenAI) solutions, leverage... ...of experience in software development with... ...., Large Language Models (LLMs), Retrieval-... ...talent. AI/ML software engineers in Cloud bridge... ...models. As a Senior Software/Machine Learning...Senior$184k - $287.5k
NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team within the Isaac Engineering org! You will join a group of... ...simulation, and at scale in data pipelines for training foundation models.Advance the state of the art in geometric computer vision,...SeniorFull time$174k - $252k
...utilization, batching, scheduling, and KV cache efficiency. Achieve these gains through expert... ...and compiler roadmaps.Implement model compression techniques—such as... ...Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related STEM field...SeniorWork experience placementInternship$174k - $252k
Senior Software Engineer, Machine Learning, Discover Interest Modeling Share Senior Software Engineer, Machine Learning, Discover Interest Modeling _corporate... ...a global company and, in order to facilitate efficient collaboration and communication globally,...Senior$184k - $287.5k
...searching for a creative and expert Systems Engineer to help us expand NVIDIA's autonomous... ...engineers, AI applied researchers and software engineers in building world-class perception... ...analysis (e.g. error budget creation, modeling of scenarios), data analysis, and...SeniorFull time$152k - $241.5k
...NVIDIA is dedicated towards a computing model focused on visual and AI computing. For... ...group is looking for Architects, Software Engineers, and AI application developers to join... ...architects on enabling state-of-the-art GenAI applications integrated with simulation...SeniorFull time$260.36k - $358k
...combines analog, digital, AI, and software technologies into solutions that... ...Role We are seeking a Principal AI Engineer in Time-Series & Sensor Foundation Models to advance AI engineering at the... ...for real-time, energy-efficient sensing applications. Work on design...SeniorPermanent employmentFull timeWork at officeDay shift$184.7k - $324.8k
Role Number: 200667876Team: Software and ServicesLocation: Austin; Cupertino... ...We are seeking an experienced engineers to drive data and insights on... ....Believes the rules of cloud efficiency are being rewritten — has experience with foundation models, agentic AI, and AI-native...SeniorRelocationShift work$184.7k - $324.8k
Role Number: 200671236Team: Software and ServicesLocation: CupertinoPosted... ...team with a specific thesis: GenAI-first development is ready to... ...from experiment to operating model. We proved this by building a... ...run, and now we need engineers who can make that approach repeatable...SeniorDaily paidRelocationShift work$262k - $364k
Develop and deploy GenAI technology to empower content... ...for holistic content modeling and supporting... ...years of experience with software development in one or... ...tools.Google's software engineers develop the next-generation... ...surfaces, with high efficiency and cohesion. Moreover...Senior$150.4k - $277.6k
Role Number: 200690010Team: Software and ServicesLocation: CupertinoWeekly... .... Our mission is to provide engineers and data scientists with an... ...deployment at scale. As a Senior GenAI Engineer on the Apple Cloud... ...harness, agent orchestration, model selection, building services...SeniorRelocationFlexible hours$184.7k - $324.8k
...enhance both the quality and efficiency of these comprehensive evaluations... ...develop cutting-edge AI/ML models for the automatic grading and... ...assessment of our internal GenAI products.DescriptionIn this... ...apply deep expertise in prompt engineering, foundation model adaptation,...SeniorRelocation$152k - $241.5k
...advancement.Are you a motivated system software engineer with a deep understanding of device drivers... ...modelExtend important CUDA programming models and functionality such as CUDA... ...AI/ML workloads on our GPUS to be more efficient and faster. Write effective, maintainable...SeniorFull time$152k - $253k
...autonomous driving hardware and software development team. We have... .... We're looking for a Senior Software Triage Engineer with strong technical... ...with Product, Engineering, Model/SW Devs, In-car testing, Fleet... ...and improve triage efficiency and quality by steps.Automate...SeniorFull time$184k - $287.5k
...biological discovery. We are looking for a Senior Software Engineer to join the cuEquivariance team — an... ...to train and deploy equivariant models at scale. This team builds and ships... ...tensor products — sufficient to work efficiently in the domain.BS/MS in Computer Science...SeniorFull time$200k - $250k
...generation of nuclear reactors! You'll leverage your software skills alongside nuclear engineers to model, simulate, design, and deploy advanced fission... ...developing novel techniques to reach new levels of safety, efficiency, and resiliency. Come be a part of powering the...SeniorRemote workFlexible hours$152k - $241.5k
...sensor data into an accurate, live 3D model. This model shows lanes, boundaries, crosswalks... ...driving stack depends on. This is a software engineering role is central to that system. The... ...-heavy mapping components fast and efficient. Implement and incorporate...SeniorFull time$160k - $200k
Join Fortinet as a Senior Software Developer and play a pivotal role in the entire software development... ...of our existing and forthcoming GenAI products and more. This position offers... ...of professional software engineering practices, including version control, coding...SeniorFull timeWorldwide$213k - $263k
...simulation across 15+ U.S. states. As a Software Engineer, you will solve ill-defined problems at... ...You will develop creative quantitative models to address eval challenges, while... ...proof of the correctness and statistical efficiency of your solutions. You will: Tackle...SeniorFull timeRemote work$127.1k - $185k
...builds the AWS Neuron SDK, the software development kit used to accelerate deep learning and GenAI workloads on AWS Trainium... ...performance for a wide range of ML models and model architectures on AWS... ...-software boundary, our engineers build systematic infrastructure...InternshipLocal areaFlexible hours- ...AMD is looking for a motivated engineer to join a core team of... ...cutting-edge machine learning model compiler targeting AMD AIE in... ...candidate should be passionate about software development. The candidate... ...research alternative, more efficient ways to accomplish the same workPREFERRED...Senior
$152k - $241.5k
NVIDIA is seeking talented engineers to join the TensorRT... .... Our team develops software that accelerates state... ...the-art generative AI models for local and... ...hardware configurations.As a Senior Software Engineer, you... ...of GPU execution into efficient code generation and measurable...SeniorFull timeLocal area$136k - $218.5k
...world.We are currently looking for a Software/CAD Tool Engineer to join our dynamic team in our Circuits... ...solutions to boost productivity and efficiency of our custom circuit designs. You... ...is requiredFamiliar with different AI models for code development and code reviewsFamiliar...SeniorFull time- ...technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will... ...performance for large-scale AI models.You enjoy collaborating with... ...opportunities for improvements in compute efficiency, memory utilization, and...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - Efficient GenAI Models. Be the first to apply!
- senior software design engineer San Jose, CA
- software web developer San Jose, CA
- senior software engineer San Jose, CA
- software developer fintech San Jose, CA
- security software engineer San Jose, CA
- scientific software engineer San Jose, CA
- new graduate software engineer San Jose, CA
- senior software engineer ruby on rails San Jose, CA
- intel software engineer San Jose, CA
- graduate software developer no experience San Jose, CA


