On-Device ML API & Inference Infra Engineer
Apple
Apple is looking for an ML Infrastructure Engineer in Cupertino, CA, to develop APIs that enhance the experience of machine learning on its platforms. This role involves utilizing Apple’s ML infrastructure for robust model conversion, optimization, and authoring. The position demands proficiency in Python, solid experience with ML frameworks like PyTorch, and a good understanding of ML fundamentals. You'll work closely with engineers to optimize machine learning performance across Apple devices. #J-18808-Ljbffr Apple
- GMI Cloud, based in Mountain View, California, is seeking talented Machine Learning Engineers to advance their leading inference optimization solutions and token platform. You will focus on cutting-edge research and production methodologies that set industry benchmarks...Suggested
- ...Sunnyvale, California is seeking a skilled engineer to work on on-device intelligence for the Android... ...platform. The role includes deploying ML systems, optimizing models under real... ...background in C++, experience in ML inference, and a degree in a relevant technical...SuggestedFlexible hours
- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...Suggested
$203.3k - $305.6k
A leading technology company in Santa Clara seeks a Senior Operations Engineer to drive efficiency and manage a fleet of devices. This role requires 8+ years in technical operations and strong problem-solving skills. You will lead cross-functional initiatives that enhance...Suggested$170k - $210k
...simplicity of a single device. This approach allows Cerebras... ...-leading training and inference speeds and empowers... ...run large-scale ML applications, without the... ...As a Test Development Engineer on our manufacturing team... ...development. Experience in API development. The base...SuggestedContract workFor contractorsFor subcontractorWork at office- Apple is seeking an experienced ML Infrastructure Engineer based in Cupertino, California. This senior position focuses on optimizing execution... ...various platforms. This role allows you to directly impact intelligent experiences on Apple devices. #J-18808-Ljbffr Apple
$207.4k - $311.7k
...environments. As a Worldwide Consulting Engineer focused on AI/ML within Apple's Enterprise, Education... ...across cloud, hybrid, and on-device/edge AI/ML solutions, demonstrating Apple... ...Apple Foundation Models (AFM), on-device inference, and Apple Intelligence features....Remote workWorldwideRelocationShift work- ...responsive applications—whether in edge devices like drones, robotics, and sensors, or in... ...CNNs to advanced signal processing, and is engineered to operate from -40 °C to +125 °C, making... ...closely with hardware engineers and ML developers, your work will expand interoperability...
$184k - $287.5k
NVIDIA is recruiting a Senior Inference Engineer to advance AIConfigurator ( a system that automatically... .... Build production-quality Python/Rust APIs, CLIs, SDK surfaces, and web workflows... ...GPU computing, distributed systems, ML infrastructure, or high-performance model...$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel... ...degree (PhD preferred) and over 6 years of experience in ML/DL systems development, with strong skills in Python and...- Summary The Metal API and Shader Instrumentation team is directly responsible for augmentation of system-level components to detect... ...implement Metal applications. They can apply their software engineering skills to instrument complex applications and deliver undefined...
- RadixArk is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize... ...models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance optimization to shape how state...Worldwide
$147k - $211k
Google is seeking software engineers to drive the development of next-generation technologies and solutions. You will design and maintain advanced software systems critical to Google's operations, focusing on areas like distributed computing and machine learning. This role...$190k - $230k
...programming simplicity of a single device. This approach allows Cerebras... ...industry‑leading training and inference speeds and empowers machine... ...effortlessly run large‑scale ML applications, without the... ...the Role As a Senior Mechanical Engineer at Cerebras, you will lead the...For contractors$150k - $260k
...programming simplicity of a single device. This approach allows... ...industry-leading training and inference speeds and empowers machine learning... ...effortlessly run large-scale ML applications, without the... ...operations & test engineering, supply chain, ASIC, mechanical...$175k - $275k
...programming simplicity of a single device. This approach allows Cerebras... ...industry‑leading training and inference speeds and empowers machine... ...effortlessly run large‑scale ML applications, without the... ...for a hands‑on Senior Quality Engineer to drive Manufacturing Quality...Contract work$153k - $222k
Applied Intuition in Sunnyvale, California, is seeking a skilled engineer to contribute to next-generation AI Research. This role will focus on building tools and infrastructure that support autonomy research and self-driving vehicle development. The ideal candidate will...- We're seeking an AI Data and Python Tools Engineer to develop and deploy intelligent tools that... ...data pipelines, train and validate ML models, and implement robust evaluation methods... ...modern frameworks (React, Vue, or Angular) API development and integration experience...Full timeRelocation packageMonday to Friday
$178.7k - $268.1k
...at scale. We’re hiring a Senior Backend Engineer to build and operate the infrastructure those... ..., reliability, and scalability of inference systems. What You’ll Be Doing Design, develop... ...serving infrastructure. Partner with ML engineers to ensure online serving infrastructure...Work at officeRelocation package- ...experiences requires new ways for engineers, designers, animators,... ...on AI-driven features across devices and platforms. Description Our... ...device middleware and distributed inference platforms to large-scale data... ...with hardware, robotics, ML, design, and platform teams...
- Unity in Mountain View is hiring a Senior Backend Engineer to design and operate distributed systems that power large-scale online model inference. You will work on performance, reliability, and scalability of these critical systems. The position requires expertise in...Worldwide
$140k - $224.25k
...ID: JR2011328 Job Category: Engineering Time Type: Full time Are you... ...AI technologies for NVIDIA's device driver software and SDKs on various... ...with testing RESTful APIs and the ability to conduct performance... ...experience with building ML and DL based applications would...Full time- Intel Corporation in Santa Clara seeks an Inference Optimization Engineer to optimize AI models for local and edge environments. Candidates should possess over 5 years of experience in software development, proficient in C++ and Python, and comfortable with performance...Local area
- NVIDIA Corporation is seeking a Senior Software Engineer for Deep Learning Inference in Santa Clara. In this role, you will craft and develop robust inferencing software for multiple platforms and contribute to TensorRT, NVIDIA’s high-performance deep learning inference...
$152k - $287.5k
NVIDIA is seeking a talented engineer to join its TensorRT Edge-LLM team in Santa Clara, CA. You'll develop state-of-the-art inference frameworks for edge AI in automotive and robotics using modern C++. Strong experience with transformer models and CUDA is essential. The...$224k - $356.5k
NVIDIA is seeking a Senior Deep Learning Software Engineer to design and build automated inference solutions. You will develop a scalable architecture while optimizing performance through GPU innovations. Main tasks include defining training and deployment workflows, profiling...$147.4k - $272.1k
Deep Learning Engineer - Perception Algorithms Sunnyvale, California, United States Machine... ...responsible for developing real‑time on‑device Computer Vision, Machine Perception, and... ...and optimizing network towards inference efficiency. Strong coding skills in ObjectiveC...Relocation- NVIDIA is looking for a Senior Software Engineer for Deep Learning Inference to develop robust inferencing software and contribute to TensorRT, their high-performance deep learning inference SDK. The ideal candidate will have at least 3 years of software development experience...
- Dreamztech in Sunnyvale, California is looking for an experienced API Documentation Specialist. Your role will involve writing clear documentation that enhances developers' understanding of APIs and providing sample codes. You will also collaborate closely with various...
$174k - $253k
...Speech (STT/TTS). Experience building or leveraging AI solutions, ML APIs, prompting, agent tooling, eval frameworks, and modern AI... ...customers. You liaise with the product marketing management and engineering teams to stay on top of industry trends and devise...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to On-Device ML API & Inference Infra Engineer. Be the first to apply!
- machine learning engineer Cupertino, CA
- machine learning software engineer Cupertino, CA
- senior ml engineer Cupertino, CA
- data engineer machine learning Cupertino, CA
- machine learning Cupertino, CA
- artificial intelligence - machine learning intern Cupertino, CA
- machine learning scientist Cupertino, CA
- machine learning research scientist Cupertino, CA
- entry level machine learning engineer
- lead machine learning engineer

