Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Runtime Optimization Engineer

$159.05k - $199.3k

Decisive Point

About the role We are looking for a software engineer with deep experience in optimizing ML models and deploying them on production‑grade embedded runtime environments. You’ll work across the entire ML framework stack (e.g. PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, Triton). At Applied Intuition, you will: Drive ML performance optimization on multiple technologies for on‑road and off‑road ADAS / AD stacks targeting deployment on a variety of embedded compute platforms Develop compute usage strategies to optimize efficiency and latency of model inference for compute boards selected by our customers Work on model pruning and quantization, and support deployment on memory constrained platforms Collaborate closely with ML engineers and software developers on technical efforts to find and optimize efficient model architecture solutions Set up methodologies to profile the model performance on target embedded compute platforms and identify performance bottlenecks as part of stack integration We're looking for someone who has: Bachelors in Electrical Engineering or Computer Science, OR B.Sc. in Computer Science, Mathematics, Physics or a related field 3+ years of experience with ML accelerators, GPU, CPU, SoC architecture and micro‑architecture Strong software development skills with the focus on embedded programming Experience profiling and optimizing model performance on embedded compute platforms Experience in working with deep learning frameworks (e.g., PyTorch, JAX, ONNX, etc.) Nice to have: M.Sc or PhD in a ML related area Built an ML optimization framework from scratch before Deployed ML solutions to embedded chips for real time robotics applications Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment. Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position. For pay transparency purposes, the base salary range for this full‑time position in the location listed is: $159,053 - $199,295 USD annually. Applied Intuition is an equal opportunity employer and federal contractor or subcontractor. Consequently, the parties agree that, as applicable, they will abide by the requirements of 41 CFR 60‑1.4(a), 41 CFR 60‑300.5(a) and 41 CFR 60‑741.5(a) and that these regulations prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities, and prohibit discrimination against all individuals based on race, color, religion, sex, sexual orientation, gender identity or national origin. These regulations require that covered prime contractors and subcontractors take affirmative action to employ and advance in employment individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disability. The parties also agree that, as applicable, they will abide by the requirements of Executive Order 13496 (29 CFR Part 471, Appendix A to Subpart A), relating to the notice of employee rights under federal labor laws. #J-18808-Ljbffr Decisive Point

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Runtime Optimization Engineer in Sunnyvale, CA vacancy
  • $166k - $244k

     ...the Role:We are looking for a Software Engineer, Edge Systems & Runtime to join our team, focusing on high-...  ...edge GPUs.Your primary focus will be optimizing our production C++ runtime infrastructure...  .../smart memory management.On-Device ML Deployment: 3+ years hands-on... 
    Suggested
    Full time

    X Company

    Mountain View, CA
    3 days ago
  • $195.2k - $361.2k

     ...future of AI should belong to the people it servesRole SummaryMake models fast on the hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge environments — GPU/iGPUs, Vulkan backends — not datacenter H100 environment... 
    Suggested
    Full time
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    2 days ago
  • $204k - $259k

     ...autonomous driving technology company is looking for an experienced engineer to improve compute performance in machine learning systems. This hybrid role involves collaboration with a world-class ML team and requires strong expertise in ML software or systems. The ideal... 
    Suggested

    Waymo

    Mountain View, CA
    20 hours ago
  • $120k - $275k

     ...and software to train and run the largest ML workloads for AGI. MatX is seeking silicon micro-architects and design engineers to join our team as we create best-in-class...  ...dynamic and static power reduction.Drive power optimization across compute, memory, interconnect, PCIe,... 
    Suggested
    Full time
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    4 days ago
  • $184k - $287.5k

     ...We are seeking an AI Compiler Engineer with deep expertise in...  ...implement end-to-end compiler optimization workflows, from feature engineering...  ...software engineering and AI/ML experience, preferably in tools...  ...measurable outcomes such as runtime gains, compile-time... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance...  ...across kernel execution, compiler decisions, and runtime scheduling.Direct experience with LLM inference frameworks... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $130k - $200k

     ...programmable using standard high-level programming languages and AI/ML frameworks. This level of efficiency makes perpetual,...  ...computing revolution About the Role We are seeking Software Optimization Engineers to join our growing team. Efficient’s Optimization Engineers... 
    Immediate start

    Efficient Computer Service LLC

    San Jose, CA
    6 hours ago
  • $184.7k - $324.8k

    Staff Data Science Engineer, Siri Runtime Systems and Interaction Cupertino, California, United States Software and Services The Siri Attention...  ...monitoring. Drive technical decisions and architecture for ML/AI initiatives. Identify high‑impact opportunities where data... 
    Relocation package

    Apple Inc.

    Cupertino, CA
    3 days ago
  •  ...supercomputer — feel like one seamless engine. Developers can write once,...  ...the Role We're looking for a Runtime Engineer to design and build...  ...you'll take the output of our optimizing compiler and make it execute —...  ...the evolving needs of ML engineers and drive improvements... 

    Lemurian Labs Inc.

    Santa Clara, CA
    4 days ago
  • Lemurian Labs Inc. in Santa Clara, CA, is hiring a Runtime Engineer to design and build the multi-target runtime at the heart of our AI compiler...  ...boundaries. You’ll work with compiler and product teams to optimize execution across diverse targets. #J-18808-Ljbffr Lemurian... 

    Lemurian Labs Inc.

    Santa Clara, CA
    4 days ago
  • $166k - $244k

    Google is looking for a Senior Software Engineer in Sunnyvale, CA to lead GPU performance optimizations for cutting-edge AI and machine learning technologies. This role offers the opportunity to work on innovative projects that impact billions of users around the globe.... 

    Google

    Sunnyvale, CA
    3 days ago
  • $120k - $200k

     ...to train and run the largest ML workloads for AGI. We primarily...  .../validation, compiler, and runtime teams Contribute to architectural...  ...and implement performance optimizations Requirements Bachelor of...  ...equivalent degree Excellent software engineering skills, with a focus on... 
    Full time
    Work at office
    3 days per week

    Acceler8 Talent

    Mountain View, CA
    20 hours ago
  • $224k - $356.5k

     ...Performance Senior Software Engineer to join our energetic team. You...  ...be doing:Play a key role in optimizing system software for Nvidia automotive...  ...teams to track key boot & runtime performance benchmarks.Ensure...  ...software efficiency.AI/ML experience is highly desirable... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $124k - $195.5k

     ...computing, and low-level hardware optimization has never been more critical....  ...exploratory tools and runtime systems to profile and accelerate...  ...Computer Science, Computer Engineering, Electrical Engineering, or related...  ...deep learning compilers and ML systems, including graph-... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $218.8k - $335.3k

     ...with cutting‑edge robotics, optimization, and machine learning to build...  ...looking for a Staff Software Engineer to provide technical leadership...  ...robustness, and predictable runtime behavior under tight latency...  ...mix of analytical models and ML‑based forecasting, including... 
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    6 hours ago
  • $100k

     ...and looking for contributors of all seniorities.As a Software Engineer on the Metal Runtime team at Tenstorrent, you’ll work on the low-level software that powers our AI accelerators. You’ll build and optimize high-performance runtime systems that execute directly on the... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...best work. Come join the team and see how you can make a lasting impact on the worldWe are looking for an experienced Compiler Optimization Engineer for an exciting role in our Compute Compiler Team. We deliver features and improvements to CUDA and other compute compilers... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $124k - $195.5k

    NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks...  ...position provides an outstanding opportunity to employ your optimization knowledge in an autonomous optimization framework. AI agents use... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $163k - $400k

     ...search ranking, two-sided marketplace matching, and dispatch optimization. This is the engine of a local marketplace: learning-to-rank and retrieval...  ...prove causal impact in a marketplace setting.Bring modern ML/LLM techniques into ranking and matching where they add real... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    3 days ago
  • $152k - $241.5k

     ...reinvented itself over two decades, inventing the GPU in 1999 to reshape PC gaming and modern computer graphics. As an engineer in our EDA Workflow Optimization team, you will partner closely with our engineering teams worldwide. You will understand workflows covering the... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    2 days ago
  • $120k - $250k

     ...compiler, and kernels so each layer benefits from the others. The runtime owns the host-side stack and the contracts that bind those...  ...and debuggers — perf counters, traces, and the Python surfaces ML engineers actually use — and hit measurable performance targets on... 
    Full time
    Contract work
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    1 day ago
  •  ...View, CA is hiring a distributed systems engineer to build the runtime infrastructure powering Moveworks' AI...  ...responses. This is not an individual ML engineering role. You will own an...  ...implement lease-based session management, and optimize an event-driven pipeline using SQS,... 

    ServiceNow

    Mountain View, CA
    4 days ago
  • $152k - $208.5k

     ...a global leader in materials engineering solutions used to produce virtually...  ..., distribution, and runtime loading across Java, Python,...  ...on experience integrating AI/ML models into developer workflows...  ...to on prem LLM deployment and optimization.Practical knowledge of RAG and... 
    Full time

    Applied Materials

    Santa Clara, CA
    4 days ago
  • $198k - $326k

     ...work is centered on trust and optimized for culture, connection,...  ...for a Senior Staff Software Engineer with deep expertise at the intersection...  ...how models interact with runtimes, compilers, and hardware, and...  ...closely with ML, infrastructure, and product... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  • This is a distributed systems engineering role at ServiceNow, located...  ...position focuses on building the runtime infrastructure that powers...  ...responses. It is not an individual ML engineering role....  ...message pipeline: operate and optimize SQS FIFO queues for ordered delivery... 
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    4 days ago
  • $218.8k - $335.3k

     ...in Computer Science, Robotics, Electrical Engineering, Mechanical Engineering, or a closely related...  ...experience with GPU or accelerator-based ML inference, model deployment, and optimization tools such as TensorRT or ONNX Runtime. Bonus qualifications include... 
    Full time

    General Motors

    Sunnyvale, CA
    3 days ago
  • $136k - $218.5k

    We’re looking for a Senior Power Architecture & Optimization Engineer to push the limits of energy efficiency using advanced analytics and AI, including...  ...and productionize power‑aware models and flows, including ML/RL‑based techniques for anomaly detection, dynamic power... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...currently seeking a Senior Developer Technology Engineer for High-Performance Databases!Would you...  ...hardware and system bottlenecks, and optimizing performance of data intensive...  ...becoming the bottleneck for Machine Learning (ML) and Deep Learning (DL) applications, as... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...Clara, CA, headquarters 3 days per week.The role: Senior toStaff Runtime Systems EngineerWhat You Will Do:d-Matrix is developing an AI...  ...in datacenters.This position is for runtime software engineering, working on the architecture, development, and validation of the... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $266.05k - $396k

     ...function. Job Summary Distinguished Engineer - AI Infrastructure We are...  ...Engineer with unrivaled depth in AI/ML inferencing at scale and the distributed...  ...engines (TensorRT, vLLM, ONNX Runtime, Triton), model optimization (quantization, pruning, distillation... 
    Work at office
    Local area
    Immediate start

    NetApp

    San Jose, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Runtime Optimization Engineer. Be the first to apply!