ML Runtime Optimization Engineer
$159.05k - $199.3kFull-time
Applied Intuition
About Applied Intuition Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring intelligence to every moving machine on the planet. Applied Intuition services the automotive, defense, trucking, construction, mining and agriculture industries in three core areas: tools and infrastructure, operating systems, and autonomy. Eighteen of the top 20 global automakers, as well as the United States military and its allies, trust the company’s solutions to deliver physical intelligence. Applied Intuition is headquartered in Sunnyvale, California, with offices in Washington, D.C.; San Diego; Ft. Walton Beach, Florida; Ann Arbor, Michigan; London; Stuttgart; Munich; Stockholm; Bangalore; Seoul; and Tokyo. Learn more at applied.co. We are an in-office company, and our expectation is that employees primarily work from their Applied Intuition office 5 days a week. However, we also recognize the importance of flexibility and trust our employees to manage their schedules responsibly. This may include occasional remote work, starting the day with morning meetings from home before heading to the office, or leaving earlier when needed to accommodate family commitments. About The Role We are looking for a software engineer with deep experience in optimizing ML models and deploying them on production-grade embedded runtime environments. You’ll work across the entire ML framework stack (e.g. PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, Triton). At Applied Intuition, You Will
- Drive ML performance optimization on multiple technologies for on-road and off-road ADAS / AD stacks targeting deployment on a variety of embedded compute platforms
- Develop compute usage strategies to optimize efficiency and latency of model inference for compute boards selected by our customers
- Work on model pruning and quantization, and support deployment on memory constrained platforms
- Collaborate closely with ML engineers and software developers on technical efforts to find and optimize efficient model architecture solutions
- Set up methodologies to profile the model performance on target embedded compute platforms and identify performance bottlenecks as part of stack integration
- Bachelors in Electrical Engineering or Computer Science, OR B.Sc. in Computer Science, Mathematics, Physics or a related field
- 3+ years of experience with ML accelerators, GPU, CPU, SoC architecture and micro-architecture
- Strong software development skills with the focus on embedded programming
- Experience profiling and optimizing model performance on embedded compute platforms
- Experience in working with deep learning frameworks (e.g., PyTorch, JAX, ONNX, etc.)
- M.Sc or PhD in a ML related area
- Built an ML optimization framework from scratch before
- Deployed ML solutions to embedded chips for real time robotics applications
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the ML Runtime Optimization Engineer in California vacancy
$170.5k - $315.49k
## Inference Optimization Engineer (local / edge runtime)Applylocations: US, California, Santa Clara: US, Oregon, Hillsboro: US, California, Folsom: US, Arizona, Phoenixtime type: Full timeposted on: Posted Yesterdayjob requisition id: JR0284871# **Job Details:**## Job...SuggestedInternshipLocal areaImmediate startShift work- Gravity Engineering Services Pvt Ltd. is seeking a systems-oriented Software Engineer in San Francisco to enhance the performance... ...and reliability of Claude Code and the JavaScript runtime. You will work on optimizing low-level systems to ensure a fast and reliable...SuggestedWork experience placement
$204k - $259k
...autonomous driving technology company is looking for an experienced engineer to improve compute performance in machine learning systems. This hybrid role involves collaboration with a world-class ML team and requires strong expertise in ML software or systems. The ideal...Suggested- ...AI platform, from chip to model, optimized for enterprise and government organizations... ...assets. The Opportunity The Runtime team at Sambanova is a seasoned engineering team with a proven track record of... ...data-flow applications such as ML training and inference and HPC applications...SuggestedFull timeTemporary workLocal areaFlexible hours
- ...Senior Software & Machine Learning Engineer to join our Energy Optimization team. This role focuses on building... ...integration applications Build automated ML pipelines for model training,... ...performance, memory utilization, and runtime efficiency. Develop monitoring, simulation...Suggested
$122.5k - $183.7k
Company Qualcomm Technologies, Inc. Job Area Engineering Group > Modem Software Engineering... ...air interface performance analysis and optimization. Basic programming ability in Python or... ...learn and collaborate. Exposure to AI/ML and Large Language Models (LLMs), with interest...Work experience placementWork from home- A leading AI software company in California is seeking a Software Engineer to develop and enhance runtime stacks for scalable ML applications. The role involves working on system software and collaborating with various teams to support next-generation high-performance...
- ...Technologies in Mountain View, CA, seeks a Senior Machine Learning Engineer to join the Vector Bidding Science team. Define the technical... ...real-time bidding systems powered by cutting‑edge AI and optimization frameworks. As a key member of the Vector AI org, you will develop...
$181.1k - $318.4k
Staff Data Science Engineer, Siri Runtime Systems and Interaction Cupertino, California, United States Software and Services Apple is where individual... ...monitoring Drive technical decisions and architecture for ML/AI initiatives Identify high-impact opportunities where data...Relocation- ...unicorn founders and senior engineers with deep expertise in 3D, generative... ...for a Founding Engineer, ML Inference with deep expertise... ...novel inference frameworks, optimizing inference performance, and... ...performance in-house inference runtime Implement optimizations...RelocationVisa sponsorshipRelocation package
- Inferact is seeking an inference runtime engineer to enhance the performance and capabilities of LLM and diffusion model serving. This role requires expertise in optimizing model execution on various hardware architectures and has significant implications for AI inference...Remote work
- ...will sit at the intersection of systems engineering and applied ML, building specialized infrastructure... ...through better memory utilization, optimized parallelism, and kernel‑level innovations... ...(compilers, kernels, inference runtimes) or open‑source infrastructure projects...
$139k - $242k
CoreWeave is seeking a GPU & Runtime Systems Engineer in San Francisco. The role involves designing secure execution environments for GPU-accelerated workloads and optimizing performance across multi-tenant systems. Candidates should have over 3 years of relevant experience...Flexible hours$166k - $244k
Google is looking for a Senior Software Engineer in Sunnyvale, CA to lead GPU performance optimizations for cutting-edge AI and machine learning technologies. This role offers the opportunity to work on innovative projects that impact billions of users around the globe....- Pentangle Tech Services | P5 Group is seeking a Senior Software & Machine Learning Engineer for their Energy Optimization team. You will build scalable software and machine learning solutions to optimize battery charging strategies for energy systems. The ideal candidate...
$158.4k - $237.6k
...Qualcomm Technologies, Inc. Job Area Engineering Group, Engineering Group > Machine Learning... ...We are seeking a Physical AI Model Optimization Engineer to help bring cutting‑edge robotic... .... Validate accuracy, stability, and runtime behavior of quantized and optimized...Work experience placementImmediate startWork from home$156.74k - $261.23k
...prototyping, test, manufacturing, and optimization. Our ~15,000 employees create... ...coordinate across complex engineering workflows. Built on LangGraph... ...Keysight’s agentic runtime - the layer that ensures AI‑driven... ...agentic logic. Partner with ML and validation engineers to...Local areaFlexible hours$100k
Tenstorrent, based in Santa Clara, CA, is seeking a Software Engineer for their Metal Runtime team. This hybrid role focuses on optimizing high-performance systems that execute on their AI accelerators. Candidates will work at the hardware/software boundary to enhance performance...- d-Matrix inc. is seeking a Staff Runtime Systems Engineer to join our team in Santa Clara, CA. This hybrid role involves working onsite three days... ...firmware and software for multiprocessor systems, ensuring optimal runtime performance. Ideal candidates have a Bachelor's in...3 days per week
- ...physical world. We are a group of engineers, scientists, roboticists, and... ...at real-time speeds. As a Runtime Software Engineer, you'll... .... You won't be designing ML models - you'll be the person... ...run flawlessly in production, optimizing every layer from OS to camera...
- ...Robotics Software Engineer At Mind Robotics, we're building generalized... ...Engineer to build the runtime systems, middleware, and developer... ...scenarios Implement and optimize robotics middleware for inter-... ...robotics UIs Experience supporting ML-driven robotic systems...
$213k - $263k
Waymo is seeking experienced engineers with ML software and systems expertise to develop the next generation of its onboard ML inference engine. The role involves architecting high-performance ML systems for autonomous vehicles, requiring over 5 years of software engineering...Full time$10k
...previously sold an AI company & have built ML systems that scaled to millions of users... ...full lifecycle of deployments, bridging engineering, product, and client success. Decisions at... ...agent behaviors, build backend systems, optimize ML pipelines, and ship product features –...Temporary workWork at officeRelocation packageFlexible hours$350k
...Continuously learning from each interaction to optimize performance. Our team worked at a small... ...(For now). Training a proprietary ML model that matches detailed patient profiles... ...personalized across all channels. Reverse engineering legacy healthcare systems that don’t have...Contract workNight shift- ...Overview This role sits at the intersection of ML engineering and customer partnership. You will be the person who makes it real for our... ...infrastructure, and own the deployment end to end Profile and optimize model performance to hit the latency and throughput targets that...Visa sponsorshipRelocation package
$300k
...Job Description GPU Optimisation Engineer - Real-Time Inference Want to push GPU performance to its limits - not in theory, but... ...infra, not model research. You'll operate across the kernel and runtime layers, profiling large-scale speech and multimodal models end-...RelocationVisa sponsorshipFree visa$139k - $183k
...seeking a highly skilled and motivated Senior Engineer, Machine Learning to join our dynamic... ...Responsibilities Design, develop, and optimize deep learning models (CNNs, Vision Transformers... ...scoring Develop and manage end-to-end ML pipelines — from data ingestion and...Full timeFlexible hours- ...automation with Moveworks’ Reasoning Engine and natural language... ...The Role We're building the runtime infrastructure that powers Moveworks... ...in real time. This is not an ML role. This is a distributed... .../per-bot scoping, batch read optimization, and hot‑reload configuration...Work at officeRemote workFlexible hours
- ...As an AI Research Scientist (Efficient ML Systems) at Goaly, you will research and... ...stability). Scale agentic RL: Design and optimize large‑scale agentic RL pipelines, including... ...systems tooling (compilers, kernels, inference runtimes) or open‑source infrastructure projects....Full timeWork at office
$224k - $356.5k
...Performance Senior Software Engineer to join our energetic team. You... ...be doing: Play a key role in optimizing system software for Nvidia... ...Test teams to track key boot & runtime performance benchmarks. Ensure... ...software efficiency. AI/ML experience is highly desirable...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Runtime Optimization Engineer. Be the first to apply!
Related searches
- machine learning engineer California
- computer vision machine learning engineer California
- data engineer machine learning California
- machine learning California
- machine learning intern California
- internship machine learning California
- artificial intelligence - machine learning intern California
- machine learning remote California
- machine learning scientist California
- machine learning research scientist California

