Senior ML Engineer: LLM Inference & Quantization
XPENG
XPENG, a leading smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade Python code, build end-to-end pipelines, and work with research, systems, and in-vehicle teams. The role focuses on PTQ and QAT workflows, performance benchmarking, and validating models in real-world simulations. Strong PyTorch experience, quantization know-how, and collaboration skills are essential for #J-18808-Ljbffr XPENG
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Engineer: LLM Inference & Quantization in Santa Clara, CA vacancy
$174.72k - $295.68k
...build strong foundation for LLM deployment and quality sign-... ...tuning, PTQ, QAT, on-vehicle inference and related fields.Key... ...models, and productionize LLM quantization methods, including PTQ, QAT,... ...Python programming and software engineering skills.Ability to work...SeniorFull timeXPENG Motors
Santa Clara, CA5 days ago$195.2k - $262.2k
...large in-house AI/ML infrastructure. Built by engineers, for engineers. From... ...GPU orchestration to inference optimization, we... ...production engineering. A Senior MLE owns... ...rollouts. Optimize LLM and VLM endpoints for... ...workflows, including quantization, quantization‑aware...SeniorTemporary workImmediate startRemote work- CrowdStrike is seeking a Sr. Machine Learning Engineer for the AIDR Engineering Team in Sunnyvale... ...will work on high-throughput, low-latency LLM inferencing, post-training tasks, and data... ...build scalable pipelines, apply advanced ML methods, and mentor engineers while...SeniorRemote job
- ...what’s possible with LLM inference on heterogeneous hardware... ...applied research and engineering team that moves fast,... ...minimize latency.Drive quantization, sparsity, and... ...open-source inference or ML systems projects.Experience... ...real hardware.Small, senior team with high autonomy...Senior
d-Matrix
Santa Clara, CA3 days ago - Cerebras Systems is hiring a Software Engineer to build and evolve the ML API layer for a new generation of disaggregated AI inference systems. You will work across inference APIs, model integration, request routing, and Cerebras runtime components to deliver a consistent...Senior
- ...a mapless, hardware-agnostic approach. This role focuses on performance engineering across ML systems, GPU compute and distributed platforms, shaping optimisations for training and cloud inference. You will profile workloads, implement cross-target improvements, collaborate...Senior
$150.4k - $277.6k
...AI/ML - Machine Learning Engineer, Text Language Identification Cupertino, California, United States... ...model optimization techniques such as quantization, pruning, or knowledge distillation,... ...and a general interest in efficient inference. Experience with low-resource...SeniorWorldwideRelocationApple Inc.
Cupertino, CA1 day ago- Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed systems, and cloud-native infrastructure...Senior
- Lead the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated systems. Develop performance-... ...kernels and contribute improvements to open-source inference engines to reduce latency and increase throughput. Requires over 6 years...Senior
$173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar Group is a leading global provider... ...analyze model performance, optimize inference speed and resource utilization, and... ...model optimization techniques such as quantization, pruning, distillation, and neural architecture...SeniorFull timeWork at officeWork from homeMatterport
Sunnyvale, CA4 days ago- ...Santa Clara, CA is seeking a Sr. Staff ML Researcher to advance LLM algorithmic optimization on our DNN... ...You will design and implement efficient inference algorithms, collaborating with mathematicians, ML researchers and engineers on high-impact research at the math-ML...Senior3 days per week
$184.7k - $324.8k
...Apple Services Engineering (ASE) builds experiences... .... The ASE AI/ML organization sits... ...We are seeking a Senior Machine Learning Engineer... ...in Generative AI, LLM architectures, and... ..., behavioral inference, discovery, and growth... ...techniques (quantization, distillation, model...SeniorRelocationApple Inc.
Cupertino, CA1 day ago$124.5k - $272k
...platform, its Zero Trust Engine, and the powerful... ...are available at Senior Staff and above.... ..., you own the inference and optimization layer... ...live here: quantization, KV-cache and memory... ...years hands-on in ML/AI (model development... .../SGLang, TensorRT-LLM, ONNX Runtime,...SeniorNetskope
Santa Clara, CA1 day ago$227k - $300k
...looking for a great Senior Staff Machine Learning Engineer to join our seasoned... ...own the end-to-end ML pipeline—from data ingestion... ...cloud-based LLM APIs (Gemini, OpenAI... ...embedded NPUs.Apply quantization, pruning, distillation... ...C++ (C++14/17 for inference).Deep proficiency with...SeniorWork at officeWorldwideFlexible hoursShift work3 days per weekSonatus
Sunnyvale, CA5 days ago- Nebius in Palo Alto is seeking a Senior MLE to own end-to-end model and endpoint optimization... ..., GPU performance, and production ML engineering, debugging serving problems and delivering... .... You will deploy and optimize LLM/VLM backends, quantify latency and cost,...Senior
$162k - $243k
...Qualcomm Technologies, Inc. Job Area: Engineering Group, Engineering Group Machine... ...the software ecosystem for large-scale LLM inference on Qualcomm platforms. In this role,... ...Cloud-native/Kubernetes infrastructure ML compiler or runtime systems Experience...SeniorWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA1 day ago$193.3k - $261.5k
...DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the... ...compute kernels for a custom ML accelerator architecture,... ...inference.- Implement and validate LLM architectures end-to-end -...SeniorLocal areaFlexible hoursAmazon
Cupertino, CA4 days ago- ...the role We're looking for an ML engineer who works across the full... ...comfortable optimizing training and inference performance on GPU/AI-... ...ML models (deep learning, LLM, CV, or recommendation systems... ...adapting model architecture/quantization to chip constraints Deep,...Senior
- ...low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role is in the...Senior
- ...Member of Technical Staff, ML Inference Engineering Sanas is pioneering the... ...looking for a deeply hands-on, senior engineer to help lead that... ...for mixed precision, quantization, and model graph optimization... ...and CUDA ~ Fluency in the LLM serving stack, from kernels...
Sanas
Palo Alto, CA1 day ago $182k - $242k
...a large fraction of the total inference market, which is worth tens of... ...qualifications, we’re looking for strong engineers with great taste. The most... ...kernels to high-performance LLM tracing dashboards, and you... ...on experience with modern ML frameworks such as PyTorch or...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- Apple Inc. is seeking a Senior Machine Learning Engineer to shape the Siri platform's next... .... You will design scalable LLM reasoning and simulation... ...You will collaborate with ML researchers and product engineers... ...systems, build training/inference pipelines, and integrate...Senior
$184k - $287.5k
...that wants to change how the AI inference industry works. With agent... ...level executives, distinguished engineers and datacenter developers how... ...pipelines using TensorRT-LLM, vLLM, SGLang, and other backends... ..., speculative decoding, quantization and custom inference kernels....SeniorFull timeNvidia
Santa Clara, CA1 day ago- Nace AI in Palo Alto, CA is seeking a Senior MLOps Engineer to own the production-grade ML infrastructure that turns research into reliable... ...cloud and on-prem environments. You'll lead LLM/SLM serving, scale low-latency inference with vLLM and related tooling, manage multi...Senior
$250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical... ...techniques, including attention optimization and quantization for efficient model serving.Maximize GPU Parallelism:...Work at office3 days per weekPika
Palo Alto, CA1 day ago- ...SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: ML Engineer with LLMLocation: Sunnyvale, CA(onsite)Job Description:6-8 years of experience in machine learning and LLM, with a proven track record in image processing and analysis.Development...
SRI Tech
Sunnyvale, CA5 days ago $170.6k - $261.3k
...looking for a mathematically rigorous engineer to own model numerics: how we measure,... ...Map low-level numerical differences from quantization, compilation, and precision reduction to... ...quantization, compiler toolchains, or inference-time numerical parity. Experience...SeniorLocal areaWork from homeFlexible hoursGeneral Motors
Sunnyvale, CA1 day ago$174.72k - $295.68k
...a full-time Machine Learning Engineer - AI Foundation, with deep knowledge... ...establishing a state-of-art ML infrastructure for training... ...and accelerating model training/inference.Our mission is to solve the... ...reinforcement learning, and enterprise LLM/VLM applications.Minimum Skill...SeniorFull timeXPENG Motors
Santa Clara, CA1 day ago- Nebius is seeking a Senior Applied Scientist to turn frontier inference bottlenecks into production-ready solutions. You... ...PyTorch, and collaborate with ML engineers to ship research into production.... ...throughput, and cost per token across LLM/VLM inference workloads. #J-1880...Senior
- Apple Inc. is seeking a Full Stack ML Engineer to innovate and enhance machine learning solutions for its applications. The role involves designing and implementing solutions to optimize performance metrics such as runtime latency and decoding speed. Candidates should possess...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Engineer: LLM Inference & Quantization. Be the first to apply!
Related searches
- senior ml engineer Santa Clara, CA
- machine learning ai engineer Santa Clara, CA
- machine learning software engineer Santa Clara, CA
- ai ml engineer Santa Clara, CA
- machine learning engineer Santa Clara, CA
- computer vision machine learning engineer Santa Clara, CA
- senior living Santa Clara, CA
- senior associate vice president Santa Clara, CA
- senior app developer Santa Clara, CA
- senior manufacturing engineer Santa Clara, CA