Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Runtime Optimization Engineer

$159.05k - $199.3k

Decisive Point

About the role We are looking for a software engineer with deep experience in optimizing ML models and deploying them on production‑grade embedded runtime environments. You’ll work across the entire ML framework stack (e.g. PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, Triton). At Applied Intuition, you will: Drive ML performance optimization on multiple technologies for on‑road and off‑road ADAS / AD stacks targeting deployment on a variety of embedded compute platforms Develop compute usage strategies to optimize efficiency and latency of model inference for compute boards selected by our customers Work on model pruning and quantization, and support deployment on memory constrained platforms Collaborate closely with ML engineers and software developers on technical efforts to find and optimize efficient model architecture solutions Set up methodologies to profile the model performance on target embedded compute platforms and identify performance bottlenecks as part of stack integration We're looking for someone who has: Bachelors in Electrical Engineering or Computer Science, OR B.Sc. in Computer Science, Mathematics, Physics or a related field 3+ years of experience with ML accelerators, GPU, CPU, SoC architecture and micro‑architecture Strong software development skills with the focus on embedded programming Experience profiling and optimizing model performance on embedded compute platforms Experience in working with deep learning frameworks (e.g., PyTorch, JAX, ONNX, etc.) Nice to have: M.Sc or PhD in a ML related area Built an ML optimization framework from scratch before Deployed ML solutions to embedded chips for real time robotics applications Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment. Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position. For pay transparency purposes, the base salary range for this full‑time position in the location listed is: $159,053 - $199,295 USD annually. Applied Intuition is an equal opportunity employer and federal contractor or subcontractor. Consequently, the parties agree that, as applicable, they will abide by the requirements of 41 CFR 60‑1.4(a), 41 CFR 60‑300.5(a) and 41 CFR 60‑741.5(a) and that these regulations prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities, and prohibit discrimination against all individuals based on race, color, religion, sex, sexual orientation, gender identity or national origin. These regulations require that covered prime contractors and subcontractors take affirmative action to employ and advance in employment individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disability. The parties also agree that, as applicable, they will abide by the requirements of Executive Order 13496 (29 CFR Part 471, Appendix A to Subpart A), relating to the notice of employee rights under federal labor laws. #J-18808-Ljbffr

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the ML Runtime Optimization Engineer in Sunnyvale, CA vacancy
  • $166k - $244k

     ...the Role:We are looking for a Software Engineer, Edge Systems & Runtime to join our team, focusing on high-...  ...edge GPUs.Your primary focus will be optimizing our production C++ runtime infrastructure...  .../smart memory management.On-Device ML Deployment: 3+ years hands-on... 
    Suggested
    Full time

    X Company

    Mountain View, CA
    23 hours ago
  • $195.2k - $361.2k

     ...future of AI should belong to the people it servesRole SummaryMake models fast on the hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge environments — GPU/iGPUs, Vulkan backends — not datacenter H100 environment... 
    Suggested
    Full time
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    4 days ago
  • $204k - $259k

     ...autonomous driving technology company is looking for an experienced engineer to improve compute performance in machine learning systems. This hybrid role involves collaboration with a world-class ML team and requires strong expertise in ML software or systems. The ideal... 
    Suggested

    Waymo

    Mountain View, CA
    3 days ago
  • $120k - $275k

     ...and software to train and run the largest ML workloads for AGI. MatX is seeking silicon micro-architects and design engineers to join our team as we create best-in-class...  ...dynamic and static power reduction.Drive power optimization across compute, memory, interconnect, PCIe,... 
    Suggested
    Full time
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    1 day ago
  •  ...future of AI should belong to the people it serves Role Summary Make models fast on the hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge environments - GPU/iGPUs, Vulkan backends - not datacenter H100... 
    Suggested
    Local area
    Shift work

    PVH (Tommy Hilfiger/Calvin Klein)

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...We are seeking an AI Compiler Engineer with deep expertise in...  ...implement end-to-end compiler optimization workflows, from feature engineering...  ...software engineering and AI/ML experience, preferably in tools...  ...measurable outcomes such as runtime gains, compile-time... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance...  ...across kernel execution, compiler decisions, and runtime scheduling.Direct experience with LLM inference frameworks... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • Apple seeks a senior engineer to design the core auction system powering its ads platform at global scale. You will drive optimal outcomes for advertisers, users, and the platform, applying advanced auction theory and machine learning in production environments. You will... 

    Socket

    Cupertino, CA
    1 day ago
  • $166k - $244k

    Google is looking for a Senior Software Engineer in Sunnyvale, CA to lead GPU performance optimizations for cutting-edge AI and machine learning technologies. This role offers the opportunity to work on innovative projects that impact billions of users around the globe.... 

    Google

    Sunnyvale, CA
    23 hours ago
  • Lemurian Labs Inc. in Santa Clara, CA, is hiring a Runtime Engineer to design and build the multi-target runtime at the heart of our AI compiler...  ...boundaries. You’ll work with compiler and product teams to optimize execution across diverse targets. #J-18808-Ljbffr Lemurian... 

    Lemurian Labs Inc.

    Santa Clara, CA
    1 day ago
  • $120k - $200k

     ...to train and run the largest ML workloads for AGI. We primarily...  .../validation, compiler, and runtime teams Contribute to architectural...  ...and implement performance optimizations Requirements Bachelor of...  ...equivalent degree Excellent software engineering skills, with a focus on... 
    Full time
    Work at office
    3 days per week

    Acceler8 Talent

    Mountain View, CA
    3 days ago
  •  ...supercomputer — feel like one seamless engine. Developers can write once,...  ...the Role We're looking for a Runtime Engineer to design and build...  ...you'll take the output of our optimizing compiler and make it execute —...  ...the evolving needs of ML engineers and drive improvements... 

    Lemurian Labs Inc.

    Santa Clara, CA
    1 day ago
  • $136k - $218.5k

     ...closely collaborate with HW/ML experts and infrastructure teams...  ...power patterns, generate optimized code, and provide actionable...  ...structures, algorithms, and software engineering principles.Familiarity with...  ..., and comment on their runtime and memory complexities.Desire... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...Performance Senior Software Engineer to join our energetic team. You...  ...be doing:Play a key role in optimizing system software for Nvidia automotive...  ...teams to track key boot & runtime performance benchmarks.Ensure...  ...software efficiency.AI/ML experience is highly desirable... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $124k - $195.5k

     ...computing, and low-level hardware optimization has never been more critical....  ...exploratory tools and runtime systems to profile and accelerate...  ...Computer Science, Computer Engineering, Electrical Engineering, or related...  ...deep learning compilers and ML systems, including graph-... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $163k - $400k

     ...search ranking, two-sided marketplace matching, and dispatch optimization. This is the engine of a local marketplace: learning-to-rank and retrieval...  ...prove causal impact in a marketplace setting.Bring modern ML/LLM techniques into ranking and matching where they add real... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    23 hours ago
  • $100k

     ...and looking for contributors of all seniorities.As a Software Engineer on the Metal Runtime team at Tenstorrent, you’ll work on the low-level software that powers our AI accelerators. You’ll build and optimize high-performance runtime systems that execute directly on the... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago
  • $218.8k - $335.3k

     ...with cutting‑edge robotics, optimization, and machine learning to build...  ...looking for a Staff Software Engineer to provide technical leadership...  ...robustness, and predictable runtime behavior under tight latency...  ...mix of analytical models and ML‑based forecasting, including... 
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $120k - $250k

     ...compiler, and kernels so each layer benefits from the others. The runtime owns the host-side stack and the contracts that bind those...  ...and debuggers — perf counters, traces, and the Python surfaces ML engineers actually use — and hit measurable performance targets on... 
    Full time
    Contract work
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    3 days ago
  • $152k - $241.5k

     ...reinvented itself over two decades, inventing the GPU in 1999 to reshape PC gaming and modern computer graphics. As an engineer in our EDA Workflow Optimization team, you will partner closely with our engineering teams worldwide. You will understand workflows covering the... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $198k - $326k

     ...work is centered on trust and optimized for culture, connection,...  ...for a Senior Staff Software Engineer with deep expertise at the intersection...  ...how models interact with runtimes, compilers, and hardware, and...  ...closely with ML, infrastructure, and product... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $152k - $208.5k

     ...a global leader in materials engineering solutions used to produce virtually...  ..., distribution, and runtime loading across Java, Python,...  ...on experience integrating AI/ML models into developer workflows...  ...to on prem LLM deployment and optimization.Practical knowledge of RAG and... 
    Full time

    Applied Materials

    Santa Clara, CA
    1 day ago
  •  ...Clara, CA, headquarters 3 days per week.The role: Senior toStaff Runtime Systems EngineerWhat You Will Do:d-Matrix is developing an AI...  ...in datacenters.This position is for runtime software engineering, working on the architecture, development, and validation of the... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    23 hours ago
  • $286.2k - $326.7k

     ...Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital...  ..., our applications of AI & ML are bringing humanity and...  ...the high-scale developer and runtime environments required to build...  ...partners across Capital One to help optimize business outcomes while... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    San Jose, CA
    1 day ago
  • $163k - $236k

     ...architectural and microarchitectural power optimization techniques.Define best practices and...  ...qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science,...  ..., you’ll work to shape the future of AI/ML hardware acceleration. You will have an... 
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $266.05k - $396k

     .... Job Summary Distinguished Engineer - AI Infrastructure We are seeking...  ...Engineer with unrivaled depth in AI/ML inferencing at scale and the...  ...inference engines (TensorRT, vLLM, ONNX Runtime, Triton), model optimization (quantization, pruning, distillation... 
    Work at office
    Local area

    NetApp

    San Jose, CA
    2 days ago
  • $136k - $218.5k

    We’re looking for a Senior Power Architecture & Optimization Engineer to push the limits of energy efficiency using advanced analytics and AI, including...  ...and productionize power‑aware models and flows, including ML/RL‑based techniques for anomaly detection, dynamic power... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...currently seeking a Senior Developer Technology Engineer for High-Performance Databases!Would you...  ...hardware and system bottlenecks, and optimizing performance of data intensive...  ...becoming the bottleneck for Machine Learning (ML) and Deep Learning (DL) applications, as... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184.7k - $324.8k

    Senior Software Engineer, Middleware - Special Projects Cupertino,...  ...closely with hardware, robotics, ML, design, and platform teams...  ...understanding of their runtime systems, performance models,...  ...Commitment to measuring and optimizing performance; skilled at using... 
    Relocation

    Apple Inc.

    Cupertino, CA
    1 day ago
  • Build and deploy ML models for lead scoring, conversion prediction, and campaign performance optimization. Automate demand generation workflows spanning audience segmentation...  ...3-10 years of experience in ML engineering, data science, or growth analytics. Strong... 

    Jobtailor

    Mountain View, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Runtime Optimization Engineer. Be the first to apply!