Software Engineer - AI Inference and Performance Optimization
Advanced Micro Devices Inc
ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.THE ROLE:Join AMD’s CG-AIM team to develop and optimize AI inference software for AMD platforms. Work with architecture and engineering teams to improve performance, efficiency, and scalability across AI workloads.THE PERSON:A collaborative engineer with strong software development, debugging, and problem-solving skills who can turn performance analysis into practical improvements.KEY RESPONSIBILITIES:Develop and optimize AI inference software, runtimes, and workloads.Identify bottlenecks and improve latency, throughput, and memory efficiency.Integrate and validate improvements with architecture and software teams.Build benchmarks and automated tests to track performance and correctness.PREFERRED EXPERIENCE:Strong C/C++ and Python development skills.Experience with AI frameworks, inference runtimes, and performance profiling.Familiarity with GPU programming, parallel computing, and memory optimization.Experience with PyTorch, ONNX Runtime, ROCm, HIP, or similar technologies.ACADEMIC CREDENTIALS:Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.LOCATION:Austin, TX, OR Markham Ontario CanadaTHIS ROLE IS NOT ELIGIBLE FOR VISA SPONSORSHIP#LI-AG1Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
- ...scientific discovery to powering AI and the technologies people... ...s CG-AIM team to develop and optimize AI inference software and runtimes for AMD platforms, improving performance, efficiency, and scalability.THE PERSON:A collaborative engineer with strong software...Performance
- ...discovery to powering AI and the... ...leader to join the AI Software group. You will be... ...-to-end software optimization strategy to... ...industry-leading performance for our top-tier... ...engagement, and software engineering, ensuring that... ...optimizing distributed inference and training at...Performance
$101k - $273k
...MongoDB Server Query Optimization team, and help us build... ...in the experience and performance of data processing. We... ...structures, algorithms, and software design/... ...toolsWork with other engineers to coordinate seamless... ...data platform for the AI era, enabling builders...PerformanceLocal areaRemote workWorldwideFlexible hours$136k - $218.5k
...of external EDA with highly optimized, internal EDA tools. Our team... ...seeking an innovative CAD Software Engineer with particular interest in... ...of graph-based algorithms, AI, and feedback from RTL designers... ...modifications.Explore high performance algorithms for clustering, min...PerformanceFull timeWork experience placement$152k - $241.5k
...learning ignited modern AI — the next era of... ...Learning Compiler Engineer. NVIDIA is hiring software engineers for its... ...backbone of NVIDIA’s inference engine, spanning... ...leading inference performance, fast build time, reduced... ...compiler optimization algorithms.Collaborating...PerformanceFull timeRemote work$150k - $270k
...with the world’s most advanced AI-native platform. We work on... ...is seeking a Senior Software Engineer to help design and build the... ...Continuously re-evaluate architecture, performance, and reliability as the... ...AWS/GCP/OCI) and FinOps/cost optimization experience Open source...PerformanceHourly payPermanent employmentFull timeWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week- ...industry on cutting-edge AI technology, revolutionizing performance expectations, ease... ...innovations in software models, compilers,... ...skilled Software Engineer with a passion for... ...development and optimization of the... ...closely with large inference and training model...PerformancePermanent employment
- ...discovery to powering AI and the technologies... ...ROLEAMD's Datacenter Performance Group is seeking a Senior... ...) GPU Performance Software Engineer to drive performance... ...features, and guide optimization efforts across the GPU... ...for next-generation AI inference systems, with...Performance
$224k - $356.5k
...the unlimited potential of AI to define the next era of... ...NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa... ...technologies and work on optimizing performance at an... ...distributed training and inference workloads throughout the entire...PerformanceFull time$152k - $241.5k
The DL Performance Modeling Team’s core mission... ...architecture, software, product, and research... ...Software Engineer to help develop simulation... ...assesses new AI-accelerating GPU... ...computational graph optimization using analysis... ...understanding of LLM inference workloads and...PerformanceFull time$184k - $287.5k
...unlimited potential of AI to define the... ...open-source software, developer tools,... ...Senior Software Engineer to help build the... ...evaluator, environment, inference, and model causes... ...turn recurring optimization needs into... ...benchmark methodology, performance investigations, regression...PerformanceFull timeRemote work- ...We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI... ...Evaluation Frameworks AI Infrastructure Architecture Performance Optimization Technical Leadership Required...PerformanceFull time
- ...DescriptionThe RoleThe AI Quality and... ...lifecycle. As a Senior Software Engineer, you will be responsible... ...focus on data quality, performance, and reliability.This... ...PostgreSQL).Build and optimize data pipelines and workflows... ...feature pipelines, inference integrations,...PerformanceFull timeLocal areaWork from homeRelocation package
$152k - $241.5k
...NVIDIA's high-performance computing platforms... ...are powering the AI revolution across... ...industries. Within our software stack, [CUTLASS](... ...learning models’ inference and training... ...and performance optimization loop to push the... ...Science, Computer Engineering, or related field...PerformanceFull time$170.6k - $261.3k
...design, intelligent software, and next-... ...scale.Our Embodied AI teams are redefining... ...‑edge robotics, optimization, and machine learning... ...Senior Software Engineer on the Secondary... ...integration, performance profiling, and observability... ...‑based ML inference, model deployment...PerformanceFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours$22.1 - $42.5 per hour
...for technologies like AI, data centers, automotive... ...) division is KLA's software powerhouse, responsible for developing high-performance software platforms... ...scientists, software engineers, apps engineers and process... ...model training and inference solutions for KLA products...PerformanceHourly payMinimum wageInternship- ...establishing the first distributed AI infrastructure dedicated... ...) is looking for an AI Software Engineer with deep expertise in high-performance computing and machine learning inference. The AI Engineer is the "... ..., and hardware-aware optimization.Key...PerformanceTemporary workLive outWork at officeLocal areaFlexible hours
$75.7k - $136.3k
...develop and produce high performance systems excite you?... ..., including hardware, software, and network infrastructure... ...best As a Software Engineer I, you'll work on high... ...existing features and optimizing existing functionality... ...without a glitch. AI : Enabling our...PerformanceWork experience placementWork at office$184k - $287.5k
...forefront of the generative AI revolution, building the software and systems that... ...a Senior Software Engineer to lead the bring-up... ..., analysis, and optimization of distributed training and inference workloads across NVIDIA... ...You will lead deep performance and reliability investigations...PerformanceFull timeRemote work$152k - $241.5k
...the hardest problems in AI: storage, access,... ...for exabyte-scale, high-performance GPU-based training and inference jobs. Our work gives NVIDIA... ...environments.Use modern software engineering practices, including AI... .../indexing.Experience optimizing storage performance for...PerformanceFull timeRemote work$150.8k - $241.2k
...Description:Infrastructure AI/ML Engineer for Memory Design, Characterization... ..., and yield optimization.In this role, you will collaborate... ...DFT, Silicon Yield Analysis, software architecture and AI systems... ...workflows optimized for performance, power, area, and yield Orchestrate...PerformanceFull timeLocal area$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means... ...developing tools for optimizing efficiency and... ...training, post-training, inference. Our objective is to... ...an AI infrastructure software engineer to join our team. You... ...Intelligence, High-Performance Computing, and Visualization...PerformanceFull timeRemote work$70 - $75 per hour
...currently seeking a Full Stack Software Engineer Location : Austin, TX (... ...innovation by integrating AI-driven tools into the daily... ...entire stack. Manage and optimize database interactions across... ...issues and optimize application performance. Minimum qualifications:...PerformanceHourly pay- ...bridge physical hardware and modern software. If you want your full-stack engineering skills to make a tangible,... ...peripherals. Write, test, and optimize high-performance C++ codebases as well as Python... .... ~ Experience with emerging AI toolsets for software coding...PerformanceFull timeFlexible hoursWeekend work
- ...combines responsible AI with clinical, payment... ...position. Full-Stack Engineers serve as a frontline... ...Responsibilities and Key Performance Outcomes 1.... ...maintainability. Create, optimize, and maintain data structures... ...full-stack software engineering experience...PerformanceFull timeRemote workVisa sponsorship
- Role Number: 200655905Team: Software and ServicesLocation:... ...stack developer to join its engineering organization where you will... ...systemsSolid knowledge of application performance optimization techniques and caching... ...testingFamiliarity with AI/ML algorithms and frameworks...PerformanceWork experience placementWorldwide
- ...discovery to powering AI and the... ...Collectives and Network Performance team, you will... ...important role in optimizing collective communication... ...and networking software for AMD GPUs. You... ...and training/inference performance... ...less experienced engineers.KEY RESPONSIBILITIES...Performance
- ...scientific discovery to powering AI and the technologies... ...: AMD, Inc., is hiring Software Development Engineer to Research, design, develop... ...debug, bring-up, and tune performance of new graphics hardware running... ..., Linux, or Unix; Code optimization using the GPU or software...PerformanceInternship
- ...scientific discovery to powering AI and the technologies people... ...are seeking an experienced software systems engineer to join AMD's Datacenter... ..., validation, and optimization of software solutions supporting... ...issues.Develop and execute performance characterization, benchmarking...Performance
$184k - $287.5k
...learning ignited modern AI — the next era of... ...tools used by design engineers for build and verification... ...designs. As a senior software engineer, you will craft... ..., scalable and high performance software that are easy... ...hardware and software teams.Optimize the daily workflows of...PerformanceFull timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - AI Inference and Performance Optimization. Be the first to apply!
- senior software design engineer Austin, TX
- software web developer Austin, TX
- senior software engineer Austin, TX
- software sales engineer Austin, TX
- software developer fintech Austin, TX
- software support engineer Austin, TX
- security software engineer Austin, TX
- software developer night shift Austin, TX
- scientific software engineer Austin, TX
- software engineer - web development Austin, TX







