Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Machine Learning Engineer - Model Optimization & Quantization

$160.5k - $240.7k

Socket.dev

Company:

Qualcomm Technologies, Inc.

Job Area:

Engineering Group, Engineering Group > Machine Learning Engineering

General Summary:

About the Role

Join the Qualcomm AI Hub team and help developers integrate machine learning into their products and experiences:

Inthisroleyou willdevelop tools tohelp developersoptimizeand deploy machine learning models on edge and mobile hardware. AIMETis Qualcomm'sopen-source library forstate-of-the-artmodel quantization, and compression techniques. You will develop and supportcutting-edgemodel optimization workflows — pushing the boundary ofwhat'spossible on resource-constrained hardware. Applications range from quantizing large language models (LLMs) and generative AI models to compressing latency-critical vision, audio, and multimodal networks for deployment on Qualcomm Snapdragon and other edge SoCs.

For this role we areseekinga talented and motivated Staff Software Engineer withexpertiseintheoptimizingand deployingML models– especially for edge devices.

What You'll Do

  • Design, develop, and maintain quantization algorithms and compression pipelines within the AIMET framework (PTQ, QAT, mixed-precision, AdaScaleetc.)

  • Implement advanced quantization techniques including weight-only quantization, activation quantization, KV-cache quantization, and sub-4-bit quantization for LLMs and generative AI models

  • Build tooling to analyze, profile, and debug model accuracy degradation caused by quantization

  • Integrate AIMET workflows with popular ML frameworks —PyTorchand ONNX

  • Develop APIs and developer-facing tooling to make AIMET accessible and easy to use for external customers and design partners

  • Integrate AIMET in AI Hub Workbench Quantize job to enable Quantization at large scale.

  • Own end-to-end quantization and optimization of models published on Qualcomm AI Hub, ensuring they meet accuracy, latency, and power targets on Qualcomm hardware

  • Quantize and validate a broad range of model families — vision transformers, LLMs, diffusion models, speech, and multimodal architectures — for deployment via AI Hub

  • Develop and maintain automated quantization pipelines and evaluation harnesses to scale model onboarding across AI Hub's growing model catalog

Minimum Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • Master's degree in Computer Science, Engineering, Information Systems, or related field and 3+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
  • PhD in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.

Preferred Qualifications:

  • 3+ years of industry experience in machine learning, deep learning, or AI infrastructure

  • Strongproficiencyin Python, with hands-on experience inPyTorch, ONNX and/or TensorFlow

  • Solid understanding of neural network architectures — CNNs, Transformers, LLMs, diffusion models, multimodal models

  • Experience with model quantization techniques — PTQ, QAT, weight-only quantization, mixed-precision, sub-4-bit methods

  • Hands-on experience quantizing LLMs (GPT,LLaMA, Mistral, Falcon, or similar families) for inference optimization

  • Familiarity with AIMET, GPTQ, AWQ,SmoothQuant, or similar quantization frameworks is a strong plus

  • Experience working with ONNX,TFLite/LiteRT, or other model interchange formats

  • Understanding of hardware constraints: memory bandwidth, compute precision (INT4/INT8/FP16/BF16), and NPU/DSP execution

  • Experience collaborating across teams or BUs to drive technical alignment and model delivery

  • Proficiencywith git and software development best practices

  • Strong written and verbal communication skills — ability to write clean APIs, documentation, and engage directly with external developers

  • Experience with C++ for performance-critical components is a bonus

  • Familiarity with ARM processors and mobile SoC architecture (Snapdragon) is a plus

  • Experience with automated evaluation pipelines and model benchmarking at scale is a plus

Level of Responsibility

  • Works independently with minimal supervision

  • Provides technical guidance and mentorship to other team members

  • Decision-making is significant and affects work beyond the immediate team

  • Requiresstrong communicationskills to convey complex quantization concepts to varied audiences — from hardware engineers and BU partners to external researchers and application developers

  • Has meaningful influence on the AIMET product roadmap, AI Hub model catalog, and cross-BU quantization strategy

  • Tasks are open-ended; planning, prioritization, and problem-solving are core to the role

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail View email address on click.appcast.io or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

Pay range and Other Compensation & Benefits

$160,500.00 - $240,700.00

The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer – and you can review more details about our US benefits at this link.

If you would like more information about this role, please contact Qualcomm Careers.

#J-18808-Ljbffr
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Staff Machine Learning Engineer - Model Optimization & Quantization in Santa Clara, CA vacancy
  • $160.5k - $240.7k

     .... Job Area Engineering Group, Engineering Group Machine Learning Engineering About...  ...to help developers optimize and deploy machine learning models on edge and mobile...  ...state-of-the-art model quantization, and compression...  ...and motivated Staff Software Engineer with... 
    Suggested
    Work experience placement
    Immediate start
    Work from home

    Qualcomm

    Santa Clara, CA
    16 hours ago
  • $174.72k - $295.68k

     ...through cutting-edge R&D in AI, machine learning, and smart connectivity.We...  ...full-time Machine Learning Engineer / Research Scientist to drive the modeling and algorithmic development...  ...to model deployment optimization, including quantization, export, and latency-accuracy... 
    Suggested
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $174.72k - $295.68k

     ...cutting-edge R&D in AI, machine learning, and smart...  ...not limited to: LLM model fine tuning, PTQ, QAT...  ...and productionize LLM quantization methods, including PTQ...  ...programming and software engineering skills.Ability to...  ...to model optimization, inference, compiler... 
    Suggested
    Full time

    XPENG Motors

    Santa Clara, CA
    1 day ago
  •  ...Apple is seeking an ML Infrastructure Engineer focused on ML user experience APIs and integration...  ...for on-device AI. You will develop new model authoring and conversion APIs that serve...  ...and external model repositories, optimize pipelines from authoring to runtime, and... 
    Suggested

    Socket.dev

    Cupertino, CA
    16 hours ago
  • $174.72k - $295.68k

     ...through cutting-edge R&D in AI, machine learning, and smart connectivity. We are seeking Machine Learning Engineers with strong expertise in generative modeling and large-scale deep learning...  ...data structures, algorithms, code optimization and large-scale data processing... 
    Suggested
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $195.2k - $262.2k

     ...enterprises from data and model training through to...  .... Built by engineers, for engineers. From...  ...orchestration to inference optimization, we own the hard...  ...workflows, including quantization, quantization-aware training...  ...Career growth and learning opportunities... 
    Full time
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    1 day ago
  •  ...Institute of Foundation Models  We are a dedicated...  ...data scientists, and engineers, tackling the most fundamental...  ...computing in deep learning, driving impactful...  ...foundation models to unlock machine intelligence beyond...  ...~ Knowledge of cost optimization, security, and... 
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    more than 2 months ago
  • $159.05k - $199.3k

     ...intelligence to every moving machine on the planet. Applied...  ...; Seoul; and Tokyo. Learn more at applied.co. We...  ...looking for a software engineer with deep experience in optimizing ML models and deploying them on...  ...Work on model pruning and quantization, and support deployment... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied PC

    Sunnyvale, CA
    4 days ago
  • $195.2k - $262.2k

     ...enterprises from data and model training through to...  .... Built by engineers, for engineers. From...  ...orchestration to inference optimization, we own the hard...  ...productionize methods for quantization, QAT, distillation,...  ...in computer science, machine learning, ML systems, computer... 
    Full time
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    1 day ago
  •  ...your career. THE ROLE:The AI Models and Applications team at...  ...for a specialized Sr. Staff or Principal level engineer who is passionate about enabling...  ...training and inference optimizations across a variety of applications...  ...-minded professionals and learn from the best in the field... 

    AMD

    San Jose, CA
    2 days ago
  •  ...Qualcomm Technologies, Inc. is seeking a Staff Software Engineer to join the AI Hub team and advance quantization and deployment of ML models for edge devices. You will design and optimize quantization pipelines within AIMET, supporting PTQ, QAT, and mixed-precision... 

    Socket.dev

    Santa Clara, CA
    16 hours ago
  •  ...Qualcomm Technologies, Inc. is seeking a Staff Software Engineer to lead quantization and optimization of ML models for edge devices within the AI Hub ecosystem. You will design and implement quantization pipelines (PTQ, QAT, mixed-precision) and develop tooling to... 

    Qualcomm

    Santa Clara, CA
    16 hours ago
  • $250k - $350k

     ...are seeking Senior/Staff level Inference Engineers to accelerate the performance...  ..., advanced model deployment, and video...  ...You will design and optimize inference pipelines,...  ...attention optimization and quantization for efficient model...  ..., and deep learning compiler stacks.GPU... 
    Work at office
    3 days per week

    Pika

    Palo Alto, CA
    3 days ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...medical imaging and machine learning algorithms tailored for...  ...), DINO, Diffusion models, and Vision Language...  ...utilizing techniques like quantization, pruning, and...  ...ITK, VTK, and model optimization tools such as TensorRT... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    1 day ago
  • $174.72k - $295.68k

     ...cutting-edge R&D in AI, machine learning, and smart...  ...time Machine Learning Engineer - AI Foundation, with...  ...very large foundation model and accelerating model...  ...Job Responsibilities:Optimize transformer-based LLMs...  ...Implement and benchmark (Quantization, Knowledge distillation... 
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $151.8k - $265.35k

     ...tuned image, video, and 3D models built on each customer’s...  ...verticals. We are hiring a Senior Machine Learning Engineer to build the pipelines and...  ...self-serve fine-tuning, optimized VLM deployments for media...  ...for latency and cost — quantization, batching, and serving... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    1 day ago
  • $119.25k - $150.85k

     ...scale. Within GM AV, the Model Deployment &...  ...Solutions team deploys machine learning models from training...  ...predictable, and to optimize models so they meet the...  ...IQ, and we’re hiring engineers to help deliver the next...  ...optimization experiments (e.g., quantization, pruning,... 
    Full time
    Internship
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $204k - $259k

     ...support and automate the lifecycle of the machine learning workflow, including feature and experiment management, model development, optimization and monitoring. These efforts have...  ...and Simulation. We are looking for engineers with ML software or ML systems expertise... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $240k - $280k

     ...environments in the industry to learn just how fast you can grow,...  ...every part of the journey. Machine learning lies at the core of...  ...streams. As a machine learning model engineer of the Samsung Ads Platform Intelligence...  ...machine learning pipelines Optimize and scale up existing machine... 
    Worldwide

    National Black MBA Association

    Mountain View, CA
    1 day ago
  • $206.4k - $379.1k

     ...tuned image, video, and 3D models built on each customer's...  ...We are hiring a Principal Machine Learning Engineer to serve as the technical...  ...generative models are architected, optimized, and served at enterprise...  ...— serving runtimes, quantization, GPU scheduling — to improve... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    2 days ago
  • $179.4k - $303.6k

     ...through cutting-edge R&D in AI, machine learning, and smart connectivity....  ...a strong Machine Learning Engineer / Computer Vision Engineer...  ...the full lifecycle of TSR model development, including...  ...model training, evaluation, optimization, quantization, and deployment. You will... 
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  •  ...your career. THE ROLE:We are looking for a Principal Machine Learning Engineer to join our Models and Applications team. If you are excited by the challenge...  ....Improve the end-to-end training pipeline performance.Optimize the distributed training pipeline and algorithm to... 

    AMD

    San Jose, CA
    4 days ago
  •  ...TikTok is hiring a Machine Learning Engineer for the Ads Core team focused on User Experience in San...  ...You will work on ranking, bidding, and optimization to balance ad revenue with user...  ...participate in end-to-end development, model improvements, and cross-team collaboration... 

    TikTok

    San Jose, CA
    16 hours ago
  • $124k - $195.5k

     ...Deep Learning Software Engineer, TensorRT PerformanceNVIDIA is seeking...  ...the performance optimization, deployment and serving...  ...and serve these models.Collaborate with the...  ...limited to areas like quantization, scheduling, memory...  ...the foundation for machines to learn, perceive,... 

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $117.7k - $221.4k

     ...sits at the intersection of machine learning, data infrastructure, and developer...  ...not only on stronger models, but also on better infrastructure...  ...model reflects how Cola engineers think: build durable...  ...speed, and cost instead of optimizing any one of them in isolation... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $170.6k - $261.3k

     ...on a global scale.As a Senior Machine Learning Engineer on the State Estimation and Mapping...  ...and improve the ML perception model that powers the secondary (...  ...pipelines, including model optimization techniques (e.g., pruning, quantization, distillation) to meet on‑vehicle... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • Applied Intuition Inc. is seeking a software engineer with deep expertise in optimizing ML models for production-grade embedded runtime environments. You will...  ...profiling model performance, implementing pruning/quantization, and driving efficient architectures for memory-... 

    Applied Intuition Inc.

    Sunnyvale, CA
    3 days ago
  •  ...to every moving machine on the planet. Applied...  ...; and Tokyo. Learn more at applied.co...  ...a performance engineer who specializes in...  ...evaluation. The optimization target here is...  ...scheduling strategies, quantization and low‑precision...  ...and performance models for our workloads... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    16 hours ago
  • $122.57k - $187.2k

     ...art techniques to enhance model performance, including Instruction...  ..., and Contextual Prompt Engineering. Optimize model serving for production environments using quantization, distillation, and...  ...of the following fields: Machine Learning, Natural Language Processing... 
    Temporary work
    Local area
    Shift work

    TikTok USDS Joint Venture

    San Jose, CA
    16 hours ago
  • $184.7k - $324.8k

     ...is seeking an experienced Machine Learning Engineer to build, operate, and scale...  ...will bring deep expertise in model serving, deployment...  ...processing libraries and profile/optimize ML workloads. Build scalable...  ...techniques such as quantization, batching, caching, and model... 
    Work experience placement
    Relocation

    Apple Inc.

    Cupertino, CA
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Machine Learning Engineer - Model Optimization & Quantization. Be the first to apply!