On-device AI Frameworks Engineer (Staff)
Argmax
We are looking for a Staff Engineer to join our growing On‑device AI Frameworks team at Argmax! In this role, you will design, implement and optimize software frameworks that expose developer‑friendly APIs to run state‑of‑the‑art inference workloads natively on Apple and Android devices. You will collaborate closely with industry‑leader engineer and researcher colleagues, advancing the frontiers of on‑device inference technology and accelerating its market adoption. AI Frameworks are at the core of Argmax SDK, our flagship developer toolkit trusted by Enterprises and developers in high‑stakes industries such as healthcare. Argmax is a customer‑obsessed team and we work very closely with them, sometimes in forward‑deployed capacity. Responsibilities Productionize research prototypes: The Applied Research team will come to you with a Python prototype that provides the blueprints for a new feature (example ) for one of our AI Frameworks. You will collaborate with them in turning this standalone prototype into a production‑ready implementation in a test‑driven development fashion. This collaboration may include experimentation and benchmarking that leads to top‑tier AI research conference submissions (example ). Contribute to SDK and Frameworks design: As the number of supported models and workloads grow, you will see around corners and recommend scalable design patterns to absorb the code growth while minimizing technical debt. Support Enterprise customers: You will directly work with the engineering teams of Enterprise customers during their onboarding journey. This could range from a Q&A session to customizing an Argmax feature to fit a particular customer requirement. Qualifications 3+ years of hands‑on experience in SDK or Frameworks development for iOS or macOS Fluency in Swift Fluency in profiling and optimizing native applications Familiarity with at least one of Core ML, MLX Swift, LiteRT, ONNX, WebGPU or ExecuTorch Preferred Qualifications 5+ years of hands‑on experience in SDK or Frameworks development for iOS or Android Track record of significant open‑source contributions Fluency in Swift, Kotlin and Python Direct experience with Core ML, MLX Swift and LiteRT Top‑of‑market equity at a fast‑growing early‑stage startup with a unique mission Performance‑based equity refreshers twice a year 3 days a week in the office from Palo Alto, CA or Manhattan, NY Palo Alto office offers comprehensive on‑site amenities, including chef‑catered meals Remote possible by exception for industry leader exceptional candidates Platinum‑tier healthcare with 90% employer contribution, including dependents 401(k) match Quarterly in‑person team‑building weeks in Palo Alto, CA About Argmax AI applications are scaling in user adoption at unprecedented rates. The infrastructure is crumbling. Spinner wheels are back in fashion The most sensitive types of user data are uploaded to the cloud and occasionally leaked Spiky demand leads to infrastructure capacity crunch and underutilization at the same time Argmax is building the critical infrastructure required to bring real‑time AI workloads to the edge. Autoscaling instantly and infinitely Private and compliant by design Reliable beyond even the multi‑cloud platforms The hardest part: We are directly migrating cloud workloads to the edge, without compromising accuracy that our customers work so hard to achieve. This is a hard core technology problem and we built the mission‑driven team with a long‑term vision to make on‑device the default way to build AI applications. Join us if this sounds like you and you have 3+ years to stake! #J-18808-Ljbffr Argmax
- We are looking for a Staff Engineer to join our growing On-device AI Frameworks team at Argmax! In this role, you will design, implement and optimize software frameworks that expose developer-friendly APIs to run state-of-the-art inference workloads natively on Apple and...SuggestedWork at officeRemote work3 days per week
- Overview We are looking for an intern to join our On-device AI Frameworks team at Argmax! In this role, you will design, implement and optimize software frameworks that expose developer-friendly APIs to run state‑of‑the‑art inference workloads natively on Apple and Android...SuggestedInternshipWork at office3 days per week
- Argmax, Inc. in Palo Alto, CA is looking for a Staff Engineer for its On-device AI Frameworks team. This role focuses on designing and optimizing software frameworks for native inference workloads on both Apple and Android devices. You will work closely with research teams...SuggestedWork at office
- Argmax seeks a Staff Engineer for its On-device AI Frameworks team in Palo Alto, CA. In this role, you will design, implement, and optimize software frameworks for native AI workloads on Apple and Android devices. Collaborate closely with research teams, turning prototypes...SuggestedFlexible hours
$265k - $331.3k
...scale our Enterprise Applied AI solutions driving impact across internal teams. As a Staff AI Engineer (Staff or Senior Staff), you... ...augmented generation, evaluation frameworks, and scalable serving.... ...social media/website, network/device, recruiting system usage/interaction...SuggestedFull timeContract workLocal area$206.5k - $258.1k
...contributor to build and scale our AI solutions driving impact... ...Technology teams. As a Staff AI Engineer, you will design, build, and... ...augmented generation, evaluation frameworks, and scalable serving. Build... ...media/website, network/device, recruiting system usage/interaction...Full timeContract workTemporary workPart timeLocal areaShift work- Google Inc. is seeking a Senior Software Engineer for the AI Core Solutions team in Mountain View, CA. This role involves developing mobile AI innovations and optimizing on-device GenAI capabilities. Ideal candidates have a Bachelor's degree and substantial experience...
- Majestic Labs is looking for an Embedded Systems Software Engineer to design and optimize AI-based embedded systems. The ideal candidate will work with cross-functional teams to enhance smart devices, involving development and integration of AI solutions. Successful candidates...
$174k - $253k
Google Inc. is seeking a Senior Software Engineer for its Sensor AI/ML/Watch Software team in Mountain View, CA. This role involves designing AI... ...for sensor fusion, managing model optimization for edge devices, and developing high-performance sensor pipelines in C/C++...- Mythic is building the future of AI computing with breakthrough... ...applications—whether in edge devices like drones, robotics, and... ...advanced signal processing, and is engineered to operate from -40 °C to +12... ...research and neural network frameworks. Here’s the background you...
- Junior AI Engineer, Agentic Orchestration Join to apply for the Junior AI Engineer, Agentic... ...to prototypes using modern agentic frameworks (LangChain, ReAct, AutoGPT) Collaborate... ...teams to ship intelligent features to HP’s devices Design and run experiments to fine-tune...Full time
- Senior AI Engineer, Time-Series Signal Processing Senior AI Engineer, Time-Series Signal Processing... ...-world events—captured through edge devices, mobile sensors, and large-scale cloud... ...in Python and fluency with ML/DL frameworks (e.g., PyTorch, TensorFlow, Keras). Experience...Immediate start
- AMD is seeking a senior C++/Linux expert to optimize and develop deep learning frameworks for AMD GPUs. You will work on GPU kernels, model performance, and multi-GPU/multi-node scales while collaborating with internal teams and open‑source maintainers. The ideal candidate...
$279.5k - $419.5k
...to CPU design focused on high-performance, energy efficient AI compute. Description As a pioneer in the new frontier of energy... ...About The Role As an AI Accelerator Software Distinguished Engineer - Framework Integration, you will lead end-to-end technical strategy and...Local area- We’re building AI systems that handle real-world healthcare conversations at scale. This... ...quality through evaluation and testing frameworks Debug production issues and improve... ...capabilities and bring them to production Mentor engineers and drive technical excellence What We’re...
$251k - $310k
...looking for experienced data-minded software engineers and data scientists to help us improve... ..., and deploy production-grade agentic AI systems to solve complex, open-ended evaluation... .... Develop robust, automated evaluation frameworks and objective metrics to continuously...Full timeRemote work- ...processes, applications, and experiences. Its AI‑powered platform enables teams to... ...are looking for an exceptional Search/AI Engineer with experience in Search Relevance to join... ...neural methods. Own the design of evaluation frameworks for offline/online relevance testing, A/B...Flexible hours
- Responsibilities Develop and deploy AI-powered full-stack applications using Python, React, and modern machine learning frameworks Design and streamline data pipelines, train... ...development lifecycle Software Engineering & AI/ML Data, Tools Development 3+ years...Full timeRelocation packageMonday to Friday
$206.5k - $258.1k
...individual contributor to build and scale Applied AI Solutions for an automotive customer in the electric vehicle space. As a Staff AI Engineer, you will design, build, and operate... ...‑augmented generation, evaluation frameworks, and scalable serving. Define long‑term...- ...building autonomous proactive security for the AI era. We seek a researcher who can extend post... ...the forefront. You will collaborate across engineering, research, and product teams, push efficiency and evaluation frameworks, stay at the frontier of RLHF/RLAIF, and ship...
$198k - $326k
...Role Overview The Responsible AI team at LinkedIn serves as the... ...and manage rigorous evaluation frameworks to quantify the fidelity,... ...of data scientists, software engineers, product managers, and governance... ...2+ years as a Technical Lead, Staff Engineer, Principal Engineer,...For contractorsWork at officeFlexible hours$182k - $273k
...to CPU design focused on high‑performance, energy efficient AI compute. Description Ampere is a semiconductor design company... ...apply! About The Role As an AI Accelerator Software Principal Engineer - Framework Integration, you will lead the design and delivery of high‑...Local area$190k - $250k
...Employment Type Full time Location Type Hybrid Department AI We are looking for an AI Inference engineer to join our growing team. Our current stack is Python... ...Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX) Familiarity with common...Full time$190k - $260k
...an artificial intelligence (AI) powered technology stack purpose... .... We are looking for engineers who make model training fast:... ...models that don't fit on a single device Maximize utilization of modern... ...with distributed training frameworks and techniques (PyTorch DDP/FSDP...Work at officeFlexible hours$180k
...About xAI xAI’s mission is to create AI systems that can accurately understand the... ...small, highly motivated, and focused on engineering excellence. This organization is for... ...at xAI builds an end to end RL training framework to enable pretrain scale RL. About the...Work at officeWork from homeRelocation- Applied Intuition in Sunnyvale, California is seeking a skilled engineer to work on on-device intelligence for the Android Automotive platform. The role includes deploying ML systems, optimizing models under real-world constraints, and interfacing with vehicle signals....Flexible hours
- ...Unconventional Since 2022, AI has entered the mainstream... ...networks directly to the device physics rather than relying... ...As a Member of Technical Staff, Silicon Validation Engineer, you will be a foundational... ...Python-based automation frameworks to accelerate characterization...Work at office
$170.5k - $315.49k
Intel in Santa Clara is seeking a candidate to design and implement an agent framework supporting hybrid local and cloud AI models. The role involves building the agent loop, managing context, tool invocation, and ensuring security and observability within the harness....Local area- ...firm in Mountain View, CA is seeking a highly skilled Device-Side Test Automation Engineer to join their hardware validation team. The successful... ...responsible for developing and maintaining automation frameworks for critical device subsystems like Bluetooth and Wi-Fi...
$103.75k - $174.75k
...AI Engineer III New York, NY, United States Palo Alto, CA, United States (Hybrid) Job Description At American Express, our... ...Exposure to LLM tooling, prompt engineering, RAG, or agent frameworks through work, coursework, or personal projects. Internship...Full timeInternshipShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to On-device AI Frameworks Engineer (Staff). Be the first to apply!
- ai engineer Palo Alto, CA
- ai ml engineer Palo Alto, CA
- ai research engineer Palo Alto, CA
- senior ai engineer Palo Alto, CA
- machine learning ai engineer Palo Alto, CA
- ai developer Palo Alto, CA
- ai prompt engineer Palo Alto, CA
- ai engineer remote Palo Alto, CA
- technology administrator Palo Alto, CA
- engineering aide Palo Alto, CA

