Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Runtime Optimization Engineer

$159.05k - $199.3k
Full-time

Applied Intuition

About Applied Intuition

Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring intelligence to every moving machine on the planet. Applied Intuition services the automotive, defense, trucking, construction, mining and agriculture industries in three core areas: tools and infrastructure, operating systems, and autonomy. Eighteen of the top 20 global automakers, as well as the United States military and its allies, trust the company’s solutions to deliver physical intelligence. Applied Intuition is headquartered in Sunnyvale, California, with offices in Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Learn more at applied.co.

We are an in-office company, and our expectation is that employees primarily work from their Applied Intuition office 5 days a week. However, we also recognize the importance of flexibility and trust our employees to manage their schedules responsibly. This may include occasional remote work, starting the day with morning meetings from home before heading to the office, or leaving earlier when needed to accommodate family commitments.

About The Role

We are looking for a software engineer with deep experience in optimizing ML models and deploying them on production-grade embedded runtime environments. You’ll work across the entire ML framework stack (e.g. PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, Triton).

At Applied Intuition, You Will

  • Drive ML performance optimization on multiple technologies for on-road and off-road ADAS / AD stacks targeting deployment on a variety of embedded compute platforms
  • Develop compute usage strategies to optimize efficiency and latency of model inference for compute boards selected by our customers
  • Work on model pruning and quantization, and support deployment on memory constrained platforms
  • Collaborate closely with ML engineers and software developers on technical efforts to find and optimize efficient model architecture solutions
  • Set up methodologies to profile the model performance on target embedded compute platforms and identify performance bottlenecks as part of stack integration

We're Looking For Someone Who Has

  • Bachelors in Electrical Engineering or Computer Science, OR B.Sc. in Computer Science, Mathematics, Physics or a related field
  • 3+ years of experience with ML accelerators, GPU, CPU, SoC architecture and micro-architecture
  • Strong software development skills with the focus on embedded programming
  • Experience profiling and optimizing model performance on embedded compute platforms
  • Experience in working with deep learning frameworks (e.g., PyTorch, JAX, ONNX, etc.)

Nice To Have

  • M.Sc or PhD in a ML related area
  • Built an ML optimization framework from scratch before
  • Deployed ML solutions to embedded chips for real time robotics applications

Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment.

Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position.

Please reference the job posting’s subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the location listed is: $159,053 - $199,295 USD annually.

Don’t meet every single requirement? If you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.

Applied Intuition is an equal opportunity employer and federal contractor or subcontractor. Consequently, the parties agree that, as applicable, they will abide by the requirements of 41 CFR 60-1.4(a), 41 CFR 60-300.5(a) and 41 CFR 60-741.5(a) and that these laws are incorporated herein by reference. These regulations prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities, and prohibit discrimination against all individuals based on their race, color, religion, sex, sexual orientation, gender identity or national origin. These regulations require that covered prime contractors and subcontractors take affirmative action to employ and advance in employment individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disability. The parties also agree that, as applicable, they will abide by the requirements of Executive Order 13496 (29 CFR Part 471, Appendix A to Subpart A), relating to the notice of employee rights under federal labor laws.

Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the ML Runtime Optimization Engineer in California vacancy
  • $170.5k - $315.49k

    ## Inference Optimization Engineer (local / edge runtime)Applylocations: US, California, Santa Clara: US, Oregon, Hillsboro: US, California, Folsom: US, Arizona, Phoenixtime type: Full timeposted on: Posted Yesterdayjob requisition id: JR0284871# **Job Details:**## Job... 
    Suggested
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    5 days ago
  • Gravity Engineering Services Pvt Ltd. is seeking a systems-oriented Software Engineer in San Francisco to enhance the performance...  ...and reliability of Claude Code and the JavaScript runtime. You will work on optimizing low-level systems to ensure a fast and reliable... 
    Suggested
    Work experience placement

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • $204k - $259k

     ...autonomous driving technology company is looking for an experienced engineer to improve compute performance in machine learning systems. This hybrid role involves collaboration with a world-class ML team and requires strong expertise in ML software or systems. The ideal... 
    Suggested

    Waymo

    Mountain View, CA
    2 days ago
  •  ...AI platform, from chip to model, optimized for enterprise and government organizations...  ...assets. The Opportunity The Runtime team at Sambanova is a seasoned engineering team with a proven track record of...  ...data-flow applications such as ML training and inference and HPC applications... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    SambaNova

    Palo Alto, CA
    5 days ago
  •  ...Senior Software & Machine Learning Engineer to join our Energy Optimization team. This role focuses on building...  ...integration applications Build automated ML pipelines for model training,...  ...performance, memory utilization, and runtime efficiency. Develop monitoring, simulation... 
    Suggested

    Pentangle Tech Services | P5 Group

    Palo Alto, CA
    4 days ago
  • $122.5k - $183.7k

    Company Qualcomm Technologies, Inc. Job Area Engineering Group > Modem Software Engineering...  ...air interface performance analysis and optimization. Basic programming ability in Python or...  ...learn and collaborate. Exposure to AI/ML and Large Language Models (LLMs), with interest... 
    Work experience placement
    Work from home

    Qualcomm

    San Diego, CA
    4 days ago
  • A leading AI software company in California is seeking a Software Engineer to develop and enhance runtime stacks for scalable ML applications. The role involves working on system software and collaborating with various teams to support next-generation high-performance... 

    SambaNova

    Palo Alto, CA
    5 days ago
  •  ...Technologies in Mountain View, CA, seeks a Senior Machine Learning Engineer to join the Vector Bidding Science team. Define the technical...  ...real-time bidding systems powered by cutting‑edge AI and optimization frameworks. As a key member of the Vector AI org, you will develop... 

    Unity Technologies

    Mountain View, CA
    3 days ago
  • $181.1k - $318.4k

    Staff Data Science Engineer, Siri Runtime Systems and Interaction Cupertino, California, United States Software and Services Apple is where individual...  ...monitoring Drive technical decisions and architecture for ML/AI initiatives Identify high-impact opportunities where data... 
    Relocation

    Apple Inc.

    Cupertino, CA
    4 days ago
  •  ...unicorn founders and senior engineers with deep expertise in 3D, generative...  ...for a Founding Engineer, ML Inference with deep expertise...  ...novel inference frameworks, optimizing inference performance, and...  ...performance in-house inference runtime Implement optimizations... 
    Relocation
    Visa sponsorship
    Relocation package

    Reactor

    San Francisco, CA
    2 days ago
  • Inferact is seeking an inference runtime engineer to enhance the performance and capabilities of LLM and diffusion model serving. This role requires expertise in optimizing model execution on various hardware architectures and has significant implications for AI inference... 
    Remote work

    Inferact

    San Francisco, CA
    20 days ago
  •  ...will sit at the intersection of systems engineering and applied ML, building specialized infrastructure...  ...through better memory utilization, optimized parallelism, and kernel‑level innovations...  ...(compilers, kernels, inference runtimes) or open‑source infrastructure projects... 

    Goaly AI

    San Francisco, CA
    2 days ago
  • $139k - $242k

    CoreWeave is seeking a GPU & Runtime Systems Engineer in San Francisco. The role involves designing secure execution environments for GPU-accelerated workloads and optimizing performance across multi-tenant systems. Candidates should have over 3 years of relevant experience... 
    Flexible hours

    CoreWeave

    San Francisco, CA
    4 days ago
  • $166k - $244k

    Google is looking for a Senior Software Engineer in Sunnyvale, CA to lead GPU performance optimizations for cutting-edge AI and machine learning technologies. This role offers the opportunity to work on innovative projects that impact billions of users around the globe.... 

    Google

    Sunnyvale, CA
    5 days ago
  • Pentangle Tech Services | P5 Group is seeking a Senior Software & Machine Learning Engineer for their Energy Optimization team. You will build scalable software and machine learning solutions to optimize battery charging strategies for energy systems. The ideal candidate... 

    Pentangle Tech Services | P5 Group

    Palo Alto, CA
    4 days ago
  • $158.4k - $237.6k

     ...Qualcomm Technologies, Inc. Job Area Engineering Group, Engineering Group > Machine Learning...  ...We are seeking a Physical AI Model Optimization Engineer to help bring cutting‑edge robotic...  .... Validate accuracy, stability, and runtime behavior of quantized and optimized... 
    Work experience placement
    Immediate start
    Work from home

    Qualcomm

    San Diego, CA
    4 days ago
  • $156.74k - $261.23k

     ...prototyping, test, manufacturing, and optimization. Our ~15,000 employees create...  ...coordinate across complex engineering workflows. Built on LangGraph...  ...Keysight’s agentic runtime - the layer that ensures AI‑driven...  ...agentic logic. Partner with ML and validation engineers to... 
    Local area
    Flexible hours

    Keysight Technologies SAles Spain SL.

    Calabasas, CA
    1 day ago
  • $100k

    Tenstorrent, based in Santa Clara, CA, is seeking a Software Engineer for their Metal Runtime team. This hybrid role focuses on optimizing high-performance systems that execute on their AI accelerators. Candidates will work at the hardware/software boundary to enhance performance... 

    Tenstorrent

    Santa Clara, CA
    2 days ago
  • d-Matrix inc. is seeking a Staff Runtime Systems Engineer to join our team in Santa Clara, CA. This hybrid role involves working onsite three days...  ...firmware and software for multiprocessor systems, ensuring optimal runtime performance. Ideal candidates have a Bachelor's in... 
    3 days per week

    d-Matrix inc.

    Santa Clara, CA
    4 days ago
  •  ...physical world. We are a group of engineers, scientists, roboticists, and...  ...at real-time speeds. As a Runtime Software Engineer, you'll...  .... You won't be designing ML models - you'll be the person...  ...run flawlessly in production, optimizing every layer from OS to camera... 

    Physical Intelligence

    San Francisco, CA
    2 days ago
  •  ...Robotics Software Engineer At Mind Robotics, we're building generalized...  ...Engineer to build the runtime systems, middleware, and developer...  ...scenarios Implement and optimize robotics middleware for inter-...  ...robotics UIs Experience supporting ML-driven robotic systems... 

    Mind Robotics

    Palo Alto, CA
    5 days ago
  • $213k - $263k

    Waymo is seeking experienced engineers with ML software and systems expertise to develop the next generation of its onboard ML inference engine. The role involves architecting high-performance ML systems for autonomous vehicles, requiring over 5 years of software engineering... 
    Full time

    Waymo

    Mountain View, CA
    4 days ago
  • $10k

     ...previously sold an AI company & have built ML systems that scaled to millions of users...  ...full lifecycle of deployments, bridging engineering, product, and client success. Decisions at...  ...agent behaviors, build backend systems, optimize ML pipelines, and ship product features –... 
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Sphinx

    San Francisco, CA
    1 day ago
  • $350k

     ...Continuously learning from each interaction to optimize performance. Our team worked at a small...  ...(For now). Training a proprietary ML model that matches detailed patient profiles...  ...personalized across all channels. Reverse engineering legacy healthcare systems that don’t have... 
    Contract work
    Night shift

    Alleviate Health

    San Francisco, CA
    1 day ago
  •  ...Overview This role sits at the intersection of ML engineering and customer partnership. You will be the person who makes it real for our...  ...infrastructure, and own the deployment end to end Profile and optimize model performance to hit the latency and throughput targets that... 
    Visa sponsorship
    Relocation package

    Reactor.am

    San Francisco, CA
    2 days ago
  • $300k

     ...Job Description GPU Optimisation Engineer - Real-Time Inference Want to push GPU performance to its limits - not in theory, but...  ...infra, not model research. You'll operate across the kernel and runtime layers, profiling large-scale speech and multimodal models end-... 
    Relocation
    Visa sponsorship
    Free visa

    Techire Ai

    San Francisco, CA
    4 days ago
  • $139k - $183k

     ...seeking a highly skilled and motivated Senior Engineer, Machine Learning to join our dynamic...  ...Responsibilities Design, develop, and optimize deep learning models (CNNs, Vision Transformers...  ...scoring Develop and manage end-to-end ML pipelines — from data ingestion and... 
    Full time
    Flexible hours

    Element Biosciences Inc

    San Diego, CA
    2 days ago
  •  ...automation with Moveworks’ Reasoning Engine and natural language...  ...The Role We're building the runtime infrastructure that powers Moveworks...  ...in real time. This is not an ML role. This is a distributed...  .../per-bot scoping, batch read optimization, and hot‑reload configuration... 
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    4 days ago
  •  ...As an AI Research Scientist (Efficient ML Systems) at Goaly, you will research and...  ...stability). Scale agentic RL: Design and optimize large‑scale agentic RL pipelines, including...  ...systems tooling (compilers, kernels, inference runtimes) or open‑source infrastructure projects.... 
    Full time
    Work at office

    Goaly AI

    San Francisco, CA
    4 days ago
  • $224k - $356.5k

     ...Performance Senior Software Engineer to join our energetic team. You...  ...be doing: Play a key role in optimizing system software for Nvidia...  ...Test teams to track key boot & runtime performance benchmarks. Ensure...  ...software efficiency. AI/ML experience is highly desirable... 

    NVIDIA

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Runtime Optimization Engineer. Be the first to apply!