Machine Learning Engineer - AI Compiler Optimization
$162k - $387.6kByteDance
Responsibilitie The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company. We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer in AI Compiler Optimization to join our team to support and advance that mission. Responsibilities: - Responsible for building and implementing the compilation optimization system for the recommendation machine learning engine. Design and implement full-stack optimization solutions at the graph, operator, and memory levels specifically for recommendation model scenarios, including but not limited to graph-operator fusion and automatic operator generation, to maximize hardware computing limits. - Collaborate closely with hardware and algorithm teams to carry out hardware-software co-design. Optimize compilation strategies based on hardware characteristics to improve the efficiency of hardware-software synergy. - Responsible for the compilation adaptation of recommendation models from the PyTorch framework to the engine. Optimize the entire process of model import, conversion, and code generation to simplify the model deployment process and enhance development efficiency. Qualification Minimum Qualifications: - Proficient in one of the mainstream AI compiler frameworks (e.g., Triton, MLIR, TVM), with practical project experience in customized compilation optimization and Pass development based on the framework. - Experience in GPU/NPU compilation optimization, mastering core techniques such as loop optimization, memory optimization, and operator optimization, with the ability to independently perform performance bottleneck analysis and technical optimization. - Familiar with common model structures and compilation adaptation logic of deep learning frameworks such as PyTorch and TensorFlow, capable of designing targeted optimization solutions. Preferred Qualifications: - Familiar with the architecture design of recommendation machine learning engines. Solid implementation experience in compilation optimization and low-latency inference optimization for large-scale recommendation systems, with the ability to handle compilation optimization needs in high-concurrency scenarios. - Experience contributing to open-source AI compiler projects (e.g., TVM, MLIR), or possess technical expertise in the compilation adaptation of large models for recommendation scenarios and the automatic generation of sparse operators. Job Information [For Pay Transparency]Compensation Description (Annually) The base salary range for this position in the selected city is $162000 - $387600 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
- Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
- Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
- Exercising sound judgment.
$193.3k - $261.5k
Do you want to be part of AI revolution? At AWS our vision is to make deep learning pervasive for everyday developers... .... AWS Neuron is the SDK that optimizes the performance of complex ML... ...is for a senior software engineer in the Compiler team for AWS Neuron. As part...SuggestedLocal areaFlexible hours$165.2k - $223.6k
Do you want to be part of AI revolution? At AWS our vision is to make deep learning pervasive for everyday developers... .... AWS Neuron is the SDK that optimizes the performance of complex ML... ....This role is for a software engineer in the Compiler team for AWS Neuron. As part...SuggestedInternshipLocal areaFlexible hours$193.3k - $261.5k
The Product: AWS Machine Learning accelerators are at the forefront... ...building Generative AI on AWS. The Inferentia... ...which includes an ML compiler, runtime and natively... ...including silicon engineering, hardware design and verification... ...Neuron team works to optimize the performance of...SuggestedInternshipLocal areaWork from homeRelocationFlexible hours$152k - $241.5k
We are now looking for a Senior Machine Learning Applications and Compiler Engineer!NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack... ...similar.Experience with large-scale AI distributed inference or training systems...SuggestedFull time$165.2k - $223.6k
The AWS Neuron Compiler team is actively seeking... ...skilled compiler engineers to join our... ...state-of-the-art deep learning compiler stack. This... ...is designed to optimize application models... ...our custom-built Machine Learning accelerators... ...solutions like Generative AI. In this role as a...SuggestedInternshipLocal areaFlexible hours$165.2k - $223.6k
Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large language OSS models like Qwen, Gemma, gptoss, improving inference performance by development on inference stacks like vLLM, SGLAng, performance tuning...InternshipLocal areaWork from homeFlexible hours- ...discovery to powering AI and the technologies people... ...AMD's proprietary AI-engine architecture.THE... ...sophisticated issues in a complex compiler tool stack. This role... ...platforms, to compile Machine Learning networks in a broad... ...for analysis and optimization effortsContribute to...
$184.7k - $324.8k
Role Number: 200649539Team: Machine Learning and AI, Software and ServicesLocation: CupertinoWeekly Hours: 40Posted: 2026-08-12SummaryAt Apple... ...developing and implementing machine learning or optimization algorithms, ideally within the ads space, recommendations,...Relocation$184.7k - $324.8k
...intersection of Generative AI, Information Retrieval, and... ...We're looking for a senior machine learning engineer to own the conversational intelligence... ...LLM inference-optimization experience: distillation, quantization... ...schemas, building graph compilation and ingestion pipelines,...Relocation- ...At Rhoda AI, we’re building the next generation of generalist intelligent robots... ...accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast,... ...dataflow accelerators (their SDKs and compilers), and consumer Blackwell GPUs such as the...Full time
- Machine Learning Engineer 5 - Decisioning & Optimization New York, New York, United States of America • Seattle, Washington, United States of America At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of...Hourly payFull timeImmediate startFlexible hoursShift work
$218.4k
Senior Machine Learning Engineer, Developer AI Location: San Jose Team: Technology Employment Type: Regular... ...reinforcement learning, preference optimization, prompt engineering, context engineering... ...such as program analysis, compilers, static analysis, code search, repository...Temporary workLocal area$213k - $263k
Senior ML Compiler Engineer, Compute Waymo is an autonomous driving technology... ...to ensure we design and optimize hardware and software for... ...You will: Leverage agentic AI to accelerate analysis,... ...principles behind popular machine learning and neural network algorithms...Full timeRemote work$220k - $300k
...leader in next-generation AI infrastructure, delivering... ...team The ML team builds and optimizes the models that run on SambaNova... ...work directly with the compiler, systems, and hardware... ...role As a Senior Principal Machine Learning Engineer, you will be responsible for...Full timeTemporary workLocal areaWorldwideFlexible hours- ...regular in-person events. Learn more about our flexible approach... ...About the Role: As a Machine Learning Engineer, you will have the... ...crucial areas such as routing optimization, pricing, dispatch, and mapping... ...the Team: The Logistics AI group is responsible for the...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
$2,000 per month
Machine Learning Research Engineer Cupertino, CA Etched is building AI chips that are hard-coded for individual model architectures... ...real-time image generation Optimize model instructions and scheduling... ...with GPU kernels, the CUDA compilation stack and related tools, or...Work at officeRelocation package$110k - $200k
Machine Learning Engineer Responsibilities: Develop, optimize, and deploy lightweight machine learning models for edge AI applications, particularly for audio processing. Implement and optimize... ...strong plus: Understanding of ML compiler and runtime design. Experience...Local area$150.8k - $241.2k
...please Sign-In before you apply.Job Description:Infrastructure AI/ML Engineer for Memory Design, Characterization,and Yield... ...development workflow for memory design, characterization, and yield optimization.In this role, you will collaborate with memory designers and...Full timeLocal area$123.75k - $185k
...EightfoldEightfold is a global leader in AI-native enterprise talent... ..., and high standards. Our engineers, product leaders, and go-to-... ...environments and optimize system performance.Contribute... ...Qualifications:Knowledge and passion in machine learning algorithms, Gen AI, LLMs,...Work experience placementWork at office3 days per week$342.7k
...San Jose office.Meet the teamCisco’s AI Software & Platform team (AISWP) is the... ...is managed. As a Distinguished Machine Learning Engineer, you will have a seat at the table where... ....Deep knowledge of inference serving optimizations, such as KV/prefix caching, continuous...Full timeTemporary workWork at officeLocal areaFlexible hoursShift work$129.3k - $225.3k
...experience where customers can shop, buy and learn everything Apple, wherever they are.... ...motivated, and hands-on applied Machine Learning Engineer. You will lead the way on our Online... ..., messaging, marketing), Generative AI and optimizing Apple-wide systems & infrastructure....Relocation$150k - $200k
...Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...teams.We are seeking a highly skilled Machine Learning Engineer with deep expertise in developing Bird... ...Design, implement, and optimize BEV-based perception models that fuse...Full time$150.4k - $277.6k
...for extraordinary algorithm engineers to work on the image capture... ...will work on core camera/ISP/machine learning technologies based on Apple-... ...should be able to balance optimization and performance in resource-... ...experience in Computer Science, AI, Machine Learning, or a...Relocation$150.4k - $277.6k
Role Number: 200683571Team: Machine Learning and AILocation: Santa ClaraWeekly... ...learning and generative AI to meaningful, large-scale... ...machine learning inference optimization to deliver fast, power-efficient... ...will bridge research and engineering excellence to drive scalable...Relocation$150.4k - $277.6k
Role Number: 200661302Team: Machine Learning and AI, Software and ServicesLocation: Cupertino; SeattleWeekly... ...specific adapters to on-device optimizations, you will have the unique opportunity... ...seeking a machine learning research engineer with experience building modern...Relocation$184.7k - $324.8k
...Number: 200670239Team: Hardware, Machine Learning and AILocation:... ...products, and as a research engineer on our team, you will build... ...infrastructure, performance optimization, data, and production deployment... ...architecture principlesProficiency in AI tooling such as Claude and...Relocation$159.5k - $236.5k
...design, develop, and implement machine learning models and algorithms to... ...with data scientists, software engineers, and product teams to... ...services through innovative AI/ML solutions. Your role will... ...Responsibilities: Develop and optimize machine learning models for...Full timeWork at officeLocal areaImmediate startFlexible hours$165.2k - $223.6k
...to accelerate deep learning and GenAI... ...on Amazon’s custom machine learning accelerators... ...software boundary, our engineers craft high-... ...counts in delivering optimal performance for our... ...what's possible in AI acceleration.The AWS... ...includes an ML compiler, runtime, and application...InternshipLocal areaWork from homeFlexible hours$202k
...Posted: 2026-10-14About the RoleThe Maps Optimization team builds and maintains the... ...routing. Our technology leverages advanced machine learning models and high-throughput scalable infrastructure... ..., entrepreneurial machine learning engineer to join the Maps Optimization team. As...Full timeWork at officeRemote workWorldwide$150.4k - $225.3k
...2026-09-24SummaryAre you a passionate Machine Learning Engineer with a deep love for photography? Join... ...detectionExperience in applying generative AI and reinforcement learning techniques... ...with using advanced ML methods to optimize system architectures and improve image...WorldwideRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer - AI Compiler Optimization. Be the first to apply!
- machine learning ai engineer San Jose, CA
- graduate machine learning engineer San Jose, CA
- senior ml engineer San Jose, CA
- machine learning software engineer San Jose, CA
- computer vision machine learning engineer San Jose, CA
- ai ml engineer San Jose, CA
- machine learning engineer San Jose, CA
- machine learning San Jose, CA
- machine learning research scientist San Jose, CA
- machine learning researcher San Jose, CA



