On-Device AI OS Engineer: Inference & Performance
OpenAI
OpenAI Consumer Devices seeks an Operating Systems Engineer focused on on-device inference to design, develop, and ship the OS stack enabling reliable, responsive, and energy-efficient AI on consumer devices. You will collaborate across OS services, inference runtimes, and research to adapt models to device constraints and production-ready solutions. The role involves shaping scheduling, memory management, and power strategies, with opportunities to bring capabilities to production through #J-18808-Ljbffr OpenAI
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the On-Device AI OS Engineer: Inference & Performance in San Francisco, CA vacancy
$184.7k - $324.8k
...States Machine Learning and AI Do you want to build... ...lets every app on the device do its best work for... ...with them. We are engineers, scientists, and problem... ...Intelligence throughout the OS. We bring app... ...approaches that work in a performant manner both on-device and...PerformanceRelocationApple Inc.
San Francisco, CA1 day ago$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...superior infrastructure performance with deep technical expertise... ...Description Of The Team The Inference team is responsible for delivering... ...looking for an Applied AI Engineer to help us understand,...PerformancePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
San Francisco, CA1 day ago$215k - $260k
...the only vertically integrated AI infrastructure company built... ..., and be part of a high-performing team that believes in each other... ...production. That means owning the inference stack end to end: profiling... ...work directly with customer engineering teams to tailor deployments...PerformanceTemporary workCrusoe
San Francisco, CA5 days ago- DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine... ...kernel levels, and guide the technical roadmap for high-performance inference fleets. Bring 5+ years of HPC or AI infra...PerformanceRemote job
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded... ...new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of our model...PerformancePermanent employmentFull timeTogether Computer Inc
San Francisco, CA11 hours ago- Sail builds the world’s most efficient software for inference and agent hosting. In this role, you’ll own token processing down to the lowest layers of the stack, optimize kernel performance, develop new request scheduling and parallelism strategies, and help us use a...Performance
- CoreWeave is hiring an Applied AI Engineer to understand, measure, and improve the real-world performance of our inference platform. In the near term, you will build and run rigorous benchmarks, profile model and system behavior, identify bottlenecks, and drive targeted...Performance
- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference... ...Rust experience, proficiency in network protocols, and a track record of optimizing performance #J-18808-Ljbffr CloudFlarePerformance
$149k - $240k
...AreHP IQ is HP’s new AI innovation lab. Combining... ..., world-class team—engineers, designers, researchers... ...of AI directly to edge devices while seamlessly... ...design and develop high-performance, scalable services to... ...solutions for real-time AI inference and processing....PerformanceFull timeTemporary workLocal areaFlexible hoursHP IQ
San Francisco, CA5 days ago$127k - $175k
AI Software Engineer - HP IQDescription -Who We AreHP IQ is HP’s new AI innovation... ...of AI directly to edge devices while seamlessly... ...to design and develop high-performance, scalable services to support... ...solutions for real-time AI inference and processing.Work closely...PerformanceFull timeTemporary workLocal areaRelocationFlexible hoursShift workJuniper Networks
San Francisco, CA2 days ago$175k - $215k
...are experimenting with AI in their GTM motion.... ...across a billion consented devices. The Revenue team... ...architecture, prompt engineering standards, and enablementWrite... ..., drift monitoring, inference cost managementPrior... ..., experience, and performance.Base is one component....PerformanceFull timeSamba TV
San Francisco, CA1 day ago$175k - $215k
...Samba TV AI Revenue Architect Samba is a media... ...a billion consented devices. The Revenue team should... ...architecture, prompt engineering standards, and... ...scale, drift monitoring, inference cost management Prior... ...location, experience, and performance. Base is one component...PerformanceSamba TV
San Francisco, CA1 day ago- ...the first multi-silicon neocloud designed for fast, efficient AI inference. You will shape compiler infrastructure, optimize how workloads... ...latency and high throughput by partitioning workloads across devices and by enabling new accelerator architectures #J-18808-Ljbffr...
- ...Team OpenAI Consumer Devices is building the... ...that bring powerful AI into people's... ...class researchers, engineers, designers, and operators... ...on on-device inference, you will design,... ...develop, and ship the OS stack that makes... ..., scheduling, and performance and power...Performance
- ...Robotic AI Engineer/Applied Scientist - Foundation Models LOCATION: Role Description... ...robust and scalable models that perform effectively in real-world scenarios.... ...with deployment of models to edge devices for real-time inference. Experience with large-scale distributed...Performance
Maven Robotics, Inc.
San Francisco, CA11 hours ago $122k - $240.5k
...our clients’ success. We are hiring an AI Engineer to build and operate the data, features... ...that support model training, real-time inference, and LLM applications using Claude-, GPT... ...governance, observability, and cost/performance discipline. Recruiting for this role ends...PerformanceLocal areaVisa sponsorshipDeloitte
San Francisco, CA1 day ago$91.1k - $179.5k
...our clients’ success. We are hiring an AI Engineer to build and operate the data, features... ...that support model training, real-time inference, and LLM applications using Claude-, GPT... ...governance, observability, and cost/performance discipline. Recruiting for this role ends...PerformanceLocal areaDeloitte
San Francisco, CA6 days ago- Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms. You should...
- ...· Full-time We are looking for an AI System Engineer who builds the core AI systems that generate... ...that write RTL, understand power-performance-area tradeoffs, and learn from verification... ...functionality. Optimize Inference : Ensure our models run fast enough for...PerformanceFull timeShift work
TenX Semi
San Francisco, CA1 day ago $270k - $325k
...organization specializing in advanced AI solutions that help businesses... ..., it is investing in the engineering foundations required to support reliable, high-performance AI applications at scale The... ...with different foundation models, inference platforms, AI service providers...PerformanceGoliath Partners Inc.
San Francisco, CA11 hours ago$168.1k - $312.3k
...an imaging-focused machine learning engineer within the AI Enablement team, you will be working... ...tools to evaluate AI/ML and vision model performance, establish benchmark datasets, and... ...GPU memory footprint, batching, and inference throughput for large image pipelines...PerformanceLocal areaRelocation package3 days per weekGenentech
San Francisco, CA1 day ago$197.3k - $225.1k
...AI Engineer 4 At Capital One, we are creating responsible and reliable AI systems, changing... ...product experiences and scalable, high-performance AI infrastructure. At Capital One, you... ...foundation model training, large language model inference, agents and multi-agent workflows,...PerformanceFull timePart timeLocal areaCapital One
San Francisco, CA1 day ago$211k - $235k
...distributed data systems that deliver 10-100x performance for Fortune 500 clients including... ..., Graph Neural Networks, and causal inference to deliver real-time analytics that... ...RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend...PerformanceWork at officeAlembic
San Francisco, CA2 days ago- ...financial world.The role:SoFi’s SeniorStaff AI Engineer is a hands-on AI engineering role in... ...techniques to maximize model performance and minimize operational costs across the... ...to ensure high-throughput, low-latency inference across diverse hardware footprints.Operational...PerformanceRemote work
SoFi
San Francisco, CA4 days ago - ...Senior AI/Data Engineer - Autonomous Agentic Systems MaxIQ is building the industry's first revenue AI platform that transforms... ...in revenue-critical operations Scalable Inference : Optimize LLM performance for high-throughput environments using quantization,...Performance
MaxIQ
San Francisco, CA4 days ago $158k - $215k
...About Collate Collate is an AI document generation platform... ..., diagnostic, and medical device development-from concept to market... ...Lever. Our AI researchers, engineers, and designers have worked at... ...sciences - a space where performance, safety, and trust matter as...PerformanceCollate
San Francisco, CA1 day ago- ...~ We're looking for an AI Engineer who possesses a deep understanding of large-scale information... ...techniques, to improve retrieval performance and relevance ranking. Vector Database... ...with cloud-based platforms, edge devices, or embedded systems. Strong understanding...Performance
Renaissance Academy
San Francisco, CA4 days ago $204k - $216k
...Description About Sapience AI Sapience AI is the collective... ...scale. You build and run the inference infrastructure that turns the... ...applied AI, research, and platform engineering, and you make the difference... ...and change. 2. Latency and performance Drive down latency so...Performance$230k - $390k
...platform for customer-facing AI agents, working with many of... ...reason and act in real time. The Inference team builds the systems that... ...at scale.As a Software Engineer on Inference, you’ll help define... ...and quota that keep inference performant and available across large-scale...PerformanceFull timeFlexible hoursSierra
San Francisco, CA4 days ago$220k - $250k
...brand in the space. Leveraging cutting-edge AI, sensor technology, and nonlethal... ...perception system for the home.The Role - Senior Device Software EngineerThe device platform is... ...contributing to or growing high-performance software teams.We are focused on building...PerformanceLocal areaRemote workAtomic
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to On-Device AI OS Engineer: Inference & Performance. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- senior performance engineer San Francisco, CA
- performance improvement specialist San Francisco, CA