Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Inference and Performance Optimization

Advanced Micro Devices Inc

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.THE ROLE:Join AMD’s CG-AIM team to develop and optimize AI inference software for AMD platforms. Work with architecture and engineering teams to improve performance, efficiency, and scalability across AI workloads.THE PERSON:A collaborative engineer with strong software development, debugging, and problem-solving skills who can turn performance analysis into practical improvements.KEY RESPONSIBILITIES:Develop and optimize AI inference software, runtimes, and workloads.Identify bottlenecks and improve latency, throughput, and memory efficiency.Integrate and validate improvements with architecture and software teams.Build benchmarks and automated tests to track performance and correctness.PREFERRED EXPERIENCE:Strong C/C++ and Python development skills.Experience with AI frameworks, inference runtimes, and performance profiling.Familiarity with GPU programming, parallel computing, and memory optimization.Experience with PyTorch, ONNX Runtime, ROCm, HIP, or similar technologies.ACADEMIC CREDENTIALS:Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.LOCATION:Austin, TX, OR Markham Ontario CanadaTHIS ROLE IS NOT ELIGIBLE FOR VISA SPONSORSHIP#LI-AG1Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Inference and Performance Optimization in Austin, TX vacancy
  •  ...scientific discovery to powering AI and the technologies people...  ...s CG-AIM team to develop and optimize AI inference software and runtimes for AMD platforms, improving performance, efficiency, and scalability.THE PERSON:A collaborative engineer with strong software... 
    Performance

    AMD

    Austin, TX
    2 days ago
  •  ...discovery to powering AI and the...  ...leader to join the AI Software group. You will be...  ...-to-end software optimization strategy to...  ...industry-leading performance for our top-tier...  ...engagement, and software engineering, ensuring that...  ...optimizing distributed inference and training at... 
    Performance

    AMD

    Austin, TX
    1 day ago
  • $101k - $273k

     ...MongoDB Server Query Optimization team, and help us build...  ...in the experience and performance of data processing. We...  ...structures, algorithms, and software design/...  ...toolsWork with other engineers to coordinate seamless...  ...data platform for the AI era, enabling builders... 
    Performance
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    Austin, TX
    4 days ago
  • $136k - $218.5k

     ...of external EDA with highly optimized, internal EDA tools. Our team...  ...seeking an innovative CAD Software Engineer with particular interest in...  ...of graph-based algorithms, AI, and feedback from RTL designers...  ...modifications.Explore high performance algorithms for clustering, min... 
    Performance
    Full time
    Work experience placement

    Nvidia

    Austin, TX
    2 days ago
  • $152k - $241.5k

     ...learning ignited modern AI — the next era of...  ...Learning Compiler Engineer. NVIDIA is hiring software engineers for its...  ...backbone of NVIDIA’s inference engine, spanning...  ...leading inference performance, fast build time, reduced...  ...compiler optimization algorithms.Collaborating... 
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    2 days ago
  • $150k - $270k

     ...with the world’s most advanced AI-native platform. We work on...  ...is seeking a Senior Software Engineer to help design and build the...  ...Continuously re-evaluate architecture, performance, and reliability as the...  ...AWS/GCP/OCI) and FinOps/cost optimization experience Open source... 
    Performance
    Hourly pay
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Austin, TX
    16 days ago
  •  ...industry on cutting-edge AI technology, revolutionizing performance expectations, ease...  ...innovations in software models, compilers,...  ...skilled Software Engineer with a passion for...  ...development and optimization of the...  ...closely with large inference and training model... 
    Performance
    Permanent employment

    Tenstorrent

    Austin, TX
    3 days ago
  •  ...discovery to powering AI and the technologies...  ...ROLEAMD's Datacenter Performance Group is seeking a Senior...  ...) GPU Performance Software Engineer to drive performance...  ...features, and guide optimization efforts across the GPU...  ...for next-generation AI inference systems, with... 
    Performance

    AMD

    Austin, TX
    2 days ago
  • $224k - $356.5k

     ...the unlimited potential of AI to define the next era of...  ...NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa...  ...technologies and work on optimizing performance at an...  ...distributed training and inference workloads throughout the entire... 
    Performance
    Full time

    Nvidia

    Austin, TX
    10 hours ago
  • $152k - $241.5k

    The DL Performance Modeling Team’s core mission...  ...architecture, software, product, and research...  ...Software Engineer to help develop simulation...  ...assesses new AI-accelerating GPU...  ...computational graph optimization using analysis...  ...understanding of LLM inference workloads and... 
    Performance
    Full time

    Nvidia

    Austin, TX
    3 days ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the...  ...open-source software, developer tools,...  ...Senior Software Engineer to help build the...  ...evaluator, environment, inference, and model causes...  ...turn recurring optimization needs into...  ...benchmark methodology, performance investigations, regression... 
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    3 days ago
  •  ...We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI...  ...Evaluation Frameworks AI Infrastructure Architecture Performance Optimization Technical Leadership Required... 
    Performance
    Full time

    Techvilla Solutions

    Austin, TX
    1 day ago
  •  ...DescriptionThe RoleThe AI Quality and...  ...lifecycle. As a Senior Software Engineer, you will be responsible...  ...focus on data quality, performance, and reliability.This...  ...PostgreSQL).Build and optimize data pipelines and workflows...  ...feature pipelines, inference integrations,... 
    Performance
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Austin, TX
    1 day ago
  • $152k - $241.5k

     ...NVIDIA's high-performance computing platforms...  ...are powering the AI revolution across...  ...industries. Within our software stack, [CUTLASS](...  ...learning models’ inference and training...  ...and performance optimization loop to push the...  ...Science, Computer Engineering, or related field... 
    Performance
    Full time

    Nvidia

    Austin, TX
    11 days ago
  • $170.6k - $261.3k

     ...design, intelligent software, and next-...  ...scale.Our Embodied AI teams are redefining...  ...‑edge robotics, optimization, and machine learning...  ...Senior Software Engineer on the Secondary...  ...integration, performance profiling, and observability...  ...‑based ML inference, model deployment... 
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    3 days ago
  • $22.1 - $42.5 per hour

     ...for technologies like AI, data centers, automotive...  ...) division is KLA's software powerhouse, responsible for developing high-performance software platforms...  ...scientists, software engineers, apps engineers and process...  ...model training and inference solutions for KLA products... 
    Performance
    Hourly pay
    Minimum wage
    Internship

    KLA

    Austin, TX
    1 day ago
  •  ...establishing the first distributed AI infrastructure dedicated...  ...) is looking for an AI Software Engineer with deep expertise in high-performance computing and machine learning inference. The AI Engineer is the "...  ..., and hardware-aware optimization.Key... 
    Performance
    Temporary work
    Live out
    Work at office
    Local area
    Flexible hours

    webAI

    Austin, TX
    4 days ago
  • $75.7k - $136.3k

     ...develop and produce high performance systems excite you?...  ..., including hardware, software, and network infrastructure...  ...best As a Software Engineer I, you'll work on high...  ...existing features and optimizing existing functionality...  ...without a glitch. AI : Enabling our... 
    Performance
    Work experience placement
    Work at office

    Akamai

    Austin, TX
    8 hours ago
  • $184k - $287.5k

     ...forefront of the generative AI revolution, building the software and systems that...  ...a Senior Software Engineer to lead the bring-up...  ..., analysis, and optimization of distributed training and inference workloads across NVIDIA...  ...You will lead deep performance and reliability investigations... 
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    2 days ago
  • $152k - $241.5k

     ...the hardest problems in AI: storage, access,...  ...for exabyte-scale, high-performance GPU-based training and inference jobs. Our work gives NVIDIA...  ...environments.Use modern software engineering practices, including AI...  .../indexing.Experience optimizing storage performance for... 
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    10 hours ago
  • $150.8k - $241.2k

     ...Description:Infrastructure AI/ML Engineer for Memory Design, Characterization...  ..., and yield optimization.In this role, you will collaborate...  ...DFT, Silicon Yield Analysis, software architecture and AI systems...  ...workflows optimized for performance, power, area, and yield Orchestrate... 
    Performance
    Full time
    Local area

    Broadcom

    Austin, TX
    10 hours ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means...  ...developing tools for optimizing efficiency and...  ...training, post-training, inference. Our objective is to...  ...an AI infrastructure software engineer to join our team. You...  ...Intelligence, High-Performance Computing, and Visualization... 
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    4 days ago
  • $70 - $75 per hour

     ...currently seeking a Full Stack Software Engineer Location : Austin, TX (...  ...innovation by integrating AI-driven tools into the daily...  ...entire stack. Manage and optimize database interactions across...  ...issues and optimize application performance. Minimum qualifications:... 
    Performance
    Hourly pay

    Judge Group, Inc.

    Austin, TX
    4 days ago
  •  ...bridge physical hardware and modern software. If you want your full-stack engineering skills to make a tangible,...  ...peripherals. Write, test, and optimize high-performance C++ codebases as well as Python...  .... ~ Experience with emerging AI toolsets for software coding... 
    Performance
    Full time
    Flexible hours
    Weekend work

    Signature Science

    Austin, TX
    5 days ago
  •  ...combines responsible AI with clinical, payment...  ...position. Full-Stack Engineers serve as a frontline...  ...Responsibilities and Key Performance Outcomes 1....  ...maintainability. Create, optimize, and maintain data structures...  ...full-stack software engineering experience... 
    Performance
    Full time
    Remote work
    Visa sponsorship

    Lyric

    Austin, TX
    14 hours ago
  • Role Number: 200655905Team: Software and ServicesLocation:...  ...stack developer to join its engineering organization where you will...  ...systemsSolid knowledge of application performance optimization techniques and caching...  ...testingFamiliarity with AI/ML algorithms and frameworks... 
    Performance
    Work experience placement
    Worldwide

    Apple

    Austin, TX
    10 hours ago
  •  ...discovery to powering AI and the...  ...Collectives and Network Performance team, you will...  ...important role in optimizing collective communication...  ...and networking software for AMD GPUs. You...  ...and training/inference performance...  ...less experienced engineers.KEY RESPONSIBILITIES... 
    Performance

    AMD

    Austin, TX
    1 day ago
  •  ...scientific discovery to powering AI and the technologies...  ...: AMD, Inc., is hiring Software Development Engineer to Research, design, develop...  ...debug, bring-up, and tune performance of new graphics hardware running...  ..., Linux, or Unix; Code optimization using the GPU or software... 
    Performance
    Internship

    Advanced Micro Devices , Inc.

    Austin, TX
    4 days ago
  •  ...scientific discovery to powering AI and the technologies people...  ...are seeking an experienced software systems engineer to join AMD's Datacenter...  ..., validation, and optimization of software solutions supporting...  ...issues.Develop and execute performance characterization, benchmarking... 
    Performance

    AMD

    Austin, TX
    3 days ago
  • $184k - $287.5k

     ...learning ignited modern AI — the next era of...  ...tools used by design engineers for build and verification...  ...designs. As a senior software engineer, you will craft...  ..., scalable and high performance software that are easy...  ...hardware and software teams.Optimize the daily workflows of... 
    Performance
    Full time
    Worldwide

    Nvidia

    Austin, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Inference and Performance Optimization. Be the first to apply!