LLM Algorithmic Optimization Engineer

Job Description

Job Description

About NIO

NIO Inc. is a pioneer and a leading company in the global smart electric vehicle market. Founded in November 2014, NIO aspires to shape a sustainable and brighter future with the mission of “Blue Sky Coming”.

NIO envisions itself as a user enterprise where innovative technology meets experience excellence. NIO designs, develops, manufactures and sells smart electric vehicles, driving innovations in next-generation core technologies. NIO distinguishes itself through continuous technological breakthroughs and innovations, exceptional products and services, and a community for shared growth.

NIO provides premium smart electric vehicles under the NIO brand, premium smart electric vehicles for families through the ONVO brand, and small smart high-end electric cars with the FIREFLY brand.

Roles and Responsibilities

• Conduct research and apply cutting-edge technologies to optimize Large Language Models (LLMs) and multimodal models, exploration and implementation of the core algorithmic optimization on heterogeneous architectures, for highly efficient LLM inference as well as deployment across distributed and heterogeneous hardware environments.
• Focus on model optimization from a systems perspective, ensuring efficient deployment in the vehicle’s digital cockpit and advanced driving (AD) domain.
• Collaborate with cross-functional teams to ensure the integration of optimized models into real-world automotive applications.
• Contribute to the entire pipeline from research, development, and testing, through to deployment on hardware, including GPUs and other distributed systems.

Qualifications

• Currently pursuing or completed a PhD or Master’s degree in Computer Science, Computer Engineering, Applied Mathematics, Communications, Electronics, or a related field with relevant research projects and publications.
• Strong understanding of GPU/NPU architecture and optimization techniques to identify and address bottlenecks.
• Proficient in LLM and VLM architectures and algorithms, familiar with transformer based NLP / Audio / CV algorithms and technologies.
• Proficiency in Python and experience with AI-related training and inference tools such as PyTorch.
• Proficiency in C/C++ programming, familiar with at least one commonly used LLM inference engines.
• Hands-on experience with model-serving frameworks such as Open Neural Network Exchange (ONNX).
• Familiarity with debugging code in distributed computing  environments.Experience in LLM inference optimization on resource constrained edge devices is a plus.

Preferred Qualification

• Ph.D. in computer science, artificial intelligence, or related fields; or Masters degree + 3 years of relevant industry experience

• Experience in inference optimization techniques of deep learning models or libraries on hardware architectures;

• Familiar with microkernel architecture, Linux kernel, hypervisor, middleware, and application framework

• Those who have good publication records and have published high impact, innovative papers are preferred

Compensation

• Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
• Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.

Benefits:

Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:

• Anthem Blue Cross, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.  
• Dental (including orthodontic coverage) and vision plan.  Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
• Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible Anthem Blue Cross medical plan
• Healthcare and Dependent Care Flexible Spending Accounts (FSA)
• 401(k) with Brokerage Link option
• Company paid Basic Life, AD&D, short-term and long-term disability insurance
• Employee Assistance Program
• Sick and Vacation time
• 13 Paid Holidays a year
• Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
• Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
• Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
• Commuter benefits
• Mobile Cell Phone Credit
• Free lunch and snacks
• Onsite gym
• Employee discounts and perks program

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.