ML Framework Engineer (MetalLM) for GPU Inference
Apple Inc.
Apple Inc. in Cupertino, California, is seeking an experienced ML Framework Engineer to join their Server ML Frameworks team. This role focuses on enabling Apple Intelligence through high-performance ML applications and involves working on custom-built server hardware for distributed inference. The ideal candidate will have a strong programming background and expertise in GPU compute, with responsibilities including optimizing ML frameworks and collaborating on GPU architecture design. Competitive benefits and pay are offered. #J-18808-Ljbffr Apple Inc.
$147.4k - $272.1k
...ML Framework (MetalLM) Engineer, Graphics, Game and ML Cupertino, California, United States Apple’s Server ML Frameworks team in GPU, Graphics and Machine Learning works on enabling Apple Intelligence... ...high-performance, distributed inference of GenAI applications (such as...SuggestedRelocation package- ...Machine Learning team in Cupertino seeks a senior engineer to influence and lead new features in Metal and Metal compute frameworks through our next‑generation GPU hardware roadmap. You will design APIs, implement compute and ML use cases, and partner with cross‑functional...Suggested
- JPMorgan Chase’s Software Engineer III role sits within... ...deploy secure, scalable ML-powered software... ...emphasis on production-grade inference and fast, low-latency web... ...strong Python, ML framework experience, and hands-on... ...Kubernetes expertise, including GPU workloads and modern...Suggested
$184.7k - $324.8k
...and Services Apple’s Server ML Frameworks team in Intelligent System... ...high-performance, distributed inference of GenAI applications (such as... ...tailored for high-throughput GPU execution and to partner with... ...grow and mentor a team of engineers, establish engineering best practices...SuggestedRelocation$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware... ...developments in AI/ML technologies, frameworks, and successful strategies, and... ...data processing, model training, and inference pipelines.Proficiency in programming...SuggestedFull time$150k
...knowledge-driven economy. The Role The GPU Kernel Engineer will play a role at the forefront of... ...stacks, especially at training and inference, and support the team to develop new... ...kernels with PyTorch or an equivalent framework, including numerical and gradient validation...- ...career. THE ROLE: We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation... ...Python and experience with ML frameworks such as PyTorch, JAX, TensorFlow... ...management. Familiarity with GPU systems, ROCm/HIP, CUDA, profiling...
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ...team works closely with compiler, kernel, hardware, and framework organizations across NVIDIA to surface bottlenecks and...Full time- ...advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-... ...firmware, drivers, networking stacks, runtimes, and AI frameworks.PREFERRED EXPERIENCE:Background in GPU performance engineering...
- ...a mapless, hardware-agnostic approach. This role focuses on performance engineering across ML systems, GPU compute and distributed platforms, shaping optimisations for training and cloud inference. You will profile workloads, implement cross-target improvements, collaborate...
- NVIDIA is seeking a CUDA Engineer to optimize deep learning frameworks for GPU acceleration, focusing on kernel optimization, memory management, and performance tuning for training and inference workloads on our latest GPU architectures in Santa Clara. You will collaborate...
$250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly... ...at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment, and video generation...Work at office3 days per week- ...Software Engineer Applied Intuition, Inc. is powering... ...in optimizing ML models and deploying them... ...work across the entire ML framework stack (e.g. PyTorch, JAX... ...efficiency and latency of model inference for compute boards... ...with ML accelerators, GPU, CPU, SoC architecture...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
- ....THE ROLE: We are looking for a talented engineer to join our team: developing heterogeneous... ...: Design, develop, and optimize GPU/CPU software for computer vision, image and... ...knowledge of software testing methodologies, frameworks, and tools for automated testing. PREFERRED...
$193.3k - $261.5k
...performance for AWS's custom ML accelerators. Working... ...software boundary, our engineers craft high-performance... ..., and application framework that seamlessly integrates... ...unparalleled ML inference and training performance... ...architectures- Experience with GPU kernel optimization and...InternshipLocal areaWork from homeFlexible hours- ...Apple Watch. The Pre-silicon Compute Frameworks team is seeking a senior engineer to influence and lead new features... ...frameworks through our next-generation GPU hardware roadmap. Description The... ...you will develop critical compute and ML use cases to showcase new features....
$180k
...motivated, and focused on engineering excellence. This... ...ABOUT THE ROLE: As an ML Infrastructure Engineer,... ..., building, and scaling GPU compute infrastructure, training frameworks, and experimentation tools... ...scale data, training, and inference systems Collaborating...Temporary workWork experience placement- ...seeking a full-time Machine Learning Engineer - AI Foundation to build state-of-the-art ML infrastructure for training very... ...models and speeding training/inference. You will join a team of... ...including data pipelines, training frameworks, and cloud inference for simulation...Full time
- ...to take your software engineering career to the next level... ...experience, with emphasis on ML systems. Hands-on... ...including experience with ML frameworks (e.g., TensorFlow,... ...deploying or operating GPU workloads in Kubernetes... ...Serving, Triton Inference Server) Familiarity with...
$193.3k - $261.5k
...Senior Software Development Engineer to own the design and implementation of our inference data plane. We build... ...kernels for a custom ML accelerator architecture... ...open-source ML serving frameworks (vLLM, PyTorch),... ...validation across CPU, GPU, simulator, and hardware...Local areaFlexible hours$195.2k - $262.2k
...complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems... ..., GPU performance, model training frameworks, RL pipelines, and production engineering...Temporary workImmediate startRemote work- Apple Inc. in Cupertino, CA, is seeking extraordinary machine learning and GPU programming engineers to deliver robust compute solutions on Apple Silicon. You will contributes to optimized kernels, ML workflows, and high-performance GPU architectures across iOS, macOS and...
- NVIDIA AI in Santa Clara, CA is seeking an experienced software engineer to design and implement optimized GPU algorithms for large-scale vector search and ML workloads. You will drive performance analysis and contribute to open-source libraries. The role requires a CS...
- Cerebras Systems is hiring a Software Engineer to build and evolve the ML API layer for a new generation of disaggregated AI inference systems. You will work across inference APIs, model integration, request routing, and Cerebras runtime components to deliver a consistent...
- XPENG, a leading smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade Python code, build end-to-end pipelines, and work with research, systems, and in-vehicle...
- Apple Inc. is seeking a senior engineer to advance the Visual Generation Framework across mobile and desktop platforms. You will translate research into production frameworks, design interoperable architecture, and fix performance bottlenecks while collaborating with product...
- Cerebras Systems is seeking a Software Engineer to productionize and optimize the GPU serving stack, spanning custom inference APIs, the vLLM runtime, ROCm, and rack-scale AMD GPU infrastructure. You will write production code, establish deployment and health-checking practices...
$184.7k - $324.8k
...Description As a Senior/Staff Engineer on the Foundation Model... ..., evaluation, and inference. You will develop model... ...with distributed ML training or inference systems... ...such as TPU, GPU ~ Experience with Kubernetes... ...Familiarity with frameworks such as JAX, PyTorch, TensorFlow...Relocation- ...delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role...
- ...industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud... ....About The RoleThe Core ML team develops novel... ...the Cerebras Wafer-Scale Engine. Our work spans efficient... ...You will work across ML frameworks, compilers, runtimes, and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Framework Engineer (MetalLM) for GPU Inference. Be the first to apply!
- senior ml engineer Cupertino, CA
- data scientist machine learning engineer Cupertino, CA
- machine learning software engineer Cupertino, CA
- machine learning engineer Cupertino, CA
- computer vision machine learning engineer Cupertino, CA
- machine learning research scientist Cupertino, CA
- machine learning Cupertino, CA
- data engineer machine learning Cupertino, CA
- internship machine learning Cupertino, CA
- machine learning intern Cupertino, CA



