Staff Machine Learning Engineer - LLM Quantization & Deployment

$215.28k - $364.32k

Full-time

XPENG

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.
Our mission is to build strong foundation for LLM deployment and quality sign-off for next-gen XPENG Turing AI chip. This includes and is not limited to: LLM model fine tuning, PTQ, QAT, on-vehicle inference and related fields.
Key Responsibilities
Develop VLA inference models, ensure numerical consistency with training models, and productionize LLM quantization methods, including PTQ, QAT, mixed-precision inference, INT8, FP4, and lower-bit techniques.
Develop production-quality Python code with strong testing, observability, reproducibility, and failure handling.
Build robust model export, calibration, benchmarking, validation, and deployment pipelines.
Engage early with the VLA model research team to establish performance estimates and prove model feasibility.
Curate evaluation datasets and establish a comprehensive metric suite to systematically benchmark VLA performance.
Analyze numerical errors, accuracy regressions, and performance trade-offs.
Develop PTQ and QAT orchestration workflows.
Serve as the primary interface with field-testing and simulation teams for issue triage and autonomous driving performance sign-off.
Collaborate with the in-vehicle software team on latency analysis and issue triage.
Collaborate with the training infrastructure team to develop QAT and model distillation.
Basic Qualifications
Master in CS/CE/EE, or equivalent, with 3-5 years of industry experience.
Strong understanding of Transformer architectures and LLM inference.
Hands-on experience quantizing or deploying deep learning models in production.
Proficiency with PyTorch and at least one inference or compilation stack.
Strong Python programming and software engineering skills.
Ability to work effectively across research, systems, infrastructure, and product teams.
Excellent communication and problem-solving skills, with the ability to thrive in a fast-paced and collaborative environment.
Preferred Qualifications
Experience with weight-only, activation, KV-cache, dynamic, static, or mixed-precision quantization.
Experience with AWQ, GPTQ, SmoothQuant, or related methods.
Strong numerical analysis and systems engineering skills.
Experience with one or more LLM runtimes, such as TensorRT-LLM, vLLM, SGLang, llama.cpp, ONNX Runtime, TVM, MLIR, or custom runtimes.
Experience deploying LLMs on resource-constrained or heterogeneous hardware.
Contributions to model optimization, inference, compiler, or serving projects.
Publications at NeurIPS, ICML, ICLR, ACL, or related conferences.
What We Provide
A fun, supportive and engaging environment.
Infrastructures and computational resources to support your work.
Opportunity to work on cutting edge technologies with the top talents in the field.
Opportunity to make a significant impact on the transportation revolution by the means of advancing autonomous driving.
Competitive compensation package.
Snacks, lunches, dinners, and fun activities.
The base salary range for this full-time position is $215,280 - $364,320, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Staff Machine Learning Engineer - LLM Quantization & Deployment in California vacancy

Senior Machine Learning Engineer - LLM Quantization & Deployment
$174.72k - $295.68k
...through cutting-edge R&D in AI, machine learning, and smart connectivity.... ...strong foundation for LLM deployment and quality sign-off for next... ..., and productionize LLM quantization methods, including PTQ,... ...programming and software engineering skills.Ability to work effectively...
Suggested
Full time
XPENG Motors
Santa Clara, CA
2 days ago
Staff/Senior Machine Learning Research Engineer, Intelligent Systems
$250k - $350k
...rigorous evaluation with full-stack deployment so our customers can build AI they... ...agentic AI looks like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the full... ...patents in agent training methods, LLM alignment, or applied MLExperience...
Suggested
Full time
Scale AI
San Francisco, CA
2 days ago
Senior Machine Learning Engineer
$188.5k - $282.7k
...Semantic AI Governance Engine, which is the first... ...At its core, SAGE is "LLM-as-judge" applied to... ...training choices (LoRA, quantization-aware training,... ...fleets.Optimizing live deployments through shared GPU pools... ...in Computer Science, Machine Learning, Computer Engineering...
Suggested
Permanent employment
Rubrik
Palo Alto, CA
1 day ago
Principal Machine Learning Engineer
$296.3k - $374.8k
....Your ImpactAs a Principal Machine Learning Engineer on Cisco’s CX AI Incubation... ...through production and customer deployment. You will serve as the... ...techniques such as PEFT or LoRA, quantization, and distillation.... ...architecting and deploying production LLM and/or SLM inference...
Suggested
Full time
Temporary work
Local area
Flexible hours
3 days per week
CISCO Systems
San Jose, CA
23 hours ago
Staff Machine Learning Engineer
$197.5k - $272k
...funding and proven by global deployment, we’re solving some of the... ...are looking for a great Staff Machine Learning Engineer to join our seasoned AI... ...flows, including cloud-based LLM APIs (Gemini, OpenAI,... ...targets or embedded NPUs.Apply quantization, pruning, distillation,...
Suggested
Work at office
Worldwide
Flexible hours
Shift work
3 days per week
Sonatus
Sunnyvale, CA
2 days ago
Senior Machine Learning Engineer - Foundation Model
$174.72k - $295.68k
...cutting-edge R&D in AI, machine learning, and smart... ...time Machine Learning Engineer / Research Scientist to... ...to design, train, and deploy large-scale multi-modal... ...optimization, including quantization, export, and latency-accuracy... ...driving models, or LLM/VLM architectures (e.g...
Full time
XPENG Motors
Santa Clara, CA
2 days ago
Machine Learning System Engineer
...Responsibilities As a ML System Engineer on the AI & ML... ...(GPU kernels, quantization, speculative decoding)... ...infrastructure for seamless model deployment and inference engine... ..., Triton, TensorRT-LLM, etc.).It would be... ...and so much more. To learn more, visit go.atlassian...
Work at office
Local area
Atlassian
San Francisco, CA
3 days ago
Sr Machine Learning Engineer, Proactive
...At Apple machine learning powers experiences that anticipate... ...Senior Machine Learning Engineer to help build the next... ...-tune optimize and deploy large language models... ...researching new approaches to LLM fine-tuning knowledge... ...model compression quantization and low-latency inference...
Full time
Apple
Cupertino, CA
7 days ago
Principal Machine Learning Engineer, Artificial Intelligence (AI) Required, Work From Home
...Description Principal Machine Learning Engineer, Artificial Intelligence (AI... ...evaluation, inference, and deployment. - Design reproducible,... ...including memory efficiency, quantization, and mixed precision. -... ...iteration. - Experience with LLM inference frameworks such...
Remote work
Work from home
Ginas Tech Jobs
San Francisco, CA
28 days ago
Senior Staff Machine Learning Engineer
...role We're looking for an ML engineer who works across the full... ...and evaluate ML models (deep learning, LLM, CV, or recommendation... ...end, from training through deployment and monitoring Requirements... ...adapting model architecture/quantization to chip constraints Deep,...
ValueBase Consulting LLC
San Jose, CA
2 days ago
Senior machine learning engineer
...entity. Responsibilities Senior Machine Learning Engineer — Agentic Search Atlassian is seeking... ...technical design through experimentation, deployment, and ongoing measurement, building... ...systems.Experience in one or more of LLM applications, AI agents, information retrieval...
Work at office
Local area
Atlassian
Mountain View, CA
3 days ago
Machine Learning Engineer
...are unavailable or unreliable. As a Machine Learning Engineer, you will own and scale the training... ...between infrastructure, modeling, and deployment.Key ResponsibilitiesOwn and evolve... ...inference on Jetson-class hardware (quantization/pruning, TensorRT/ONNX Runtime); profile...
Permanent employment
Work experience placement
Work at office
Local area
Shift work
Mach Industries
Huntington Beach, CA
2 days ago
Senior Machine Learning Engineer, Recommendations
$162.8k - $203.5k
...byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and... ...and lead the design, development, and deployment of state-of-the-art machine learning and... ..., technologies (such as LLMs and LLM-based applications), and frameworks —...
Hourly pay
Work at office
Local area
3 days per week
Lyft
San Francisco, CA
2 days ago
Machine Learning Engineer, LLM Post-Training
$150k - $230k
...information, visit About the RoleWe are looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models,... ...techniques into working, production-ready code.RequirementsHands-on LLM post-training experience. You have personally run CPT, SFT,...
Full time
Local area
Work from home
News Break
Mountain View, CA
2 days ago
Sr. Machine Learning Engineer
...worldwide.We’re a team of engineers, clinicians, and innovators... ...advanced computer vision and machine learning algorithms tailored for... ...Architect and execute model deployment pipelines, seamlessly integrating... ...utilizing techniques like quantization, pruning, and hardware...
Local area
Worldwide
Flexible hours
Intuitive Surgical
Sunnyvale, CA
3 days ago
Distinguished Machine Learning Engineer, AISWP (Hybrid)
$342.7k
...defines how the internet is managed. As a Distinguished Machine Learning Engineer, you will have a seat at the table where the future of autonomous... ...in the design, development, and production-level deployment of LLM-based systems serving at least 10,000+ daily active...
Full time
Temporary work
Work at office
Local area
Flexible hours
Shift work
CISCO Systems
San Jose, CA
3 days ago
Staff Computer Vision & Machine Learning Engineer
$203k - $270k
...two former U.S. Navy electrical engineers with deep experience in robotics... ...modern battlefield. Bullfrog is deployed with U.S. forces, and ACS works with... ...The Role: We are looking for a Staff Level Computer Vision and Machine Learning Engineer to help lead the...
Local area
Allen Control Systems
Mountain View, CA
20 days ago
Machine Learning Engineer, Local Search & Marketplace
$190k - $300k
...visit About the RoleWe are looking for a Machine Learning Engineer to build intelligent systems that... ...and experimentation through production deployment and iteration. We welcome candidates across... ...efficiency.Explore new ML and LLM techniques and bring them into production...
Full time
Internship
Local area
Work from home
News Break
Mountain View, CA
4 days ago
Senior Machine Learning Engineer, Trust
$200k - $227k
..., data scientists, software engineers, fraud intelligence, and operations... ...You Will Make:As a Senior Machine Learning Engineer on the Trust... ...model training, evaluation, and deployment — for both batch and real-... ...evaluation methodology for ML or LLM systems — benchmarks, ground...
Work experience placement
Casual work
Live in
Work at office
Remote work
Airbnb
San Francisco, CA
1 day ago
Senior Machine Learning Engineer, Accelerated Apache Spark
$224k - $356.5k
NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache... ...with key partners and customers on the deployment of complex machine learning solutions... ...sophisticated ML methodologies, including LLM/GenAI, reinforcement learning, and...
Full time
Nvidia
Santa Clara, CA
3 days ago
Senior Applied Machine Learning Developer, Asset Intelligence
$131.4k - $236k
...it, then feed what you learn running it back into... ...motivated Senior Applied Machine Learning Developer to... ...detection, and LLM-powered intelligence across... ...development to model training, deployment, and monitoring.Mentor... ...techniques like quantization, distillation, and...
MaintainX
San Francisco, CA
4 days ago
Senior Machine Learning Engineer
$230k - $265k
...want to lead projects to build and deploy cutting-edge AI technology to help people... ...industry-veteran scientists and engineers. As a Senior Machine Learning Engineer, you’ll bring your strong software... ...large-scale SID / ASR / NLP / LLM systems that power mission-critical...
Permanent employment
Otter.ai
Mountain View, CA
2 days ago
Senior Machine Learning Engineer, AI-Native Evaluation & Search
...Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization... ...through experimentation, evaluation, deployment, and continuous improvement.A key part... ...testing, human evaluation, or LLM-as-a-judge.Experience evaluating agent...
Work at office
Local area
Atlassian
San Francisco, CA
6 hours ago
Senior Machine Learning Engineer - Content and Contributor Intelligence (Hybrid - United States)
$112k - $269k
SummaryYelp engineering culture is driven by our values:... ...problems. All new engineers deploy working code their... ...use of cutting-edge Machine Learning (ML) and Artificial Intelligence... ...locations. As a Staff-level ML Engineer on... ...with LLMs, utilizing LLM APIs (OpenAI, Bedrock,...
Work experience placement
Local area
Yelp
San Francisco, CA
6 hours ago
Sr. Machine Learning Engineer
$200.35k - $260.91k
...1 2026.The OpportunityWe’re hiring a Senior Machine Learning Engineer to join our AI team, reporting directly to the... ...from data exploration and modeling through deployment, monitoring, and iteration in production.Build NLP, LLM, and agentic systems at enterprise scale,...
Full time
6sense
San Francisco, CA
6 hours ago
Staff Machine Learning Engineer - Game Tech Group, ML Platform
Riot engineers bring deep knowledge of specific technical areas... ...many broader domains. As a Staff Machine Learning Engineer at Riot, you’ll also... ..., feature management, and deployment workflows. Our goal is to help... ...frameworks for LLM-based systemsPassion for player...
Local area
Flexible hours
Riot Games
Los Angeles, CA
1 day ago
Staff Machine Learning Engineer
...models that power these experiences must be deployed and accelerated entirely within that runtime. As a Senior Machine Learning Engineer for On-Device & Mobile AI, you will take... ...leaving research, through export, quantization, and kernel-level tuning, to a shipped feature...
Full time
Work at office
Remote work
Worldwide
Unity Technologies
San Francisco, CA
3 days ago
Senior Staff Machine Learning Engineer - DevOps
$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ....We are seeking a Senior Staff Machine Learning Engineer (DevOps) to lead the... ...onboarding cutting-edge models to deploying optimized inference engines... ...expertise in GPU compute, LLM APIs, inference frameworks,...
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
2 days per week
ServiceNow
Santa Clara, CA
3 days ago
Senior Staff Machine Learning Engineer
$201.3k - $352.3k
...entrepriseIt all started when engineer Fred Luddy wrote code that automated... ...autonomous systems safe to deploy at scale. Retrieval and... ...systems or retrieval. Exposure to LLM fine-tuning or inference optimization... ...their assigned work location. Learn more here. To determine...
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
Santa Clara, CA
3 days ago
Principal Machine Learning Engineer
$264k - $363k
...Looking ForWe're seeking a Principal Machine Learning Engineer to help define and lead the next generation... ...Intelligent AI Agents: Design and deploy advanced AI Agentic systems that combine... ...-tune, and RL-optimize open source LLM and SLM for the RPM domain — optimizing...
Full time
Flexible hours
AppFolio
Santa Barbara, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Machine Learning Engineer - LLM Quantization & Deployment. Be the first to apply!