Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer - AI Compiler Optimization

$162k - $387.6k

ByteDance

Responsibilitie The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company. We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer in AI Compiler Optimization to join our team to support and advance that mission. Responsibilities: - Responsible for building and implementing the compilation optimization system for the recommendation machine learning engine. Design and implement full-stack optimization solutions at the graph, operator, and memory levels specifically for recommendation model scenarios, including but not limited to graph-operator fusion and automatic operator generation, to maximize hardware computing limits. - Collaborate closely with hardware and algorithm teams to carry out hardware-software co-design. Optimize compilation strategies based on hardware characteristics to improve the efficiency of hardware-software synergy. - Responsible for the compilation adaptation of recommendation models from the PyTorch framework to the engine. Optimize the entire process of model import, conversion, and code generation to simplify the model deployment process and enhance development efficiency. Qualification Minimum Qualifications: - Proficient in one of the mainstream AI compiler frameworks (e.g., Triton, MLIR, TVM), with practical project experience in customized compilation optimization and Pass development based on the framework. - Experience in GPU/NPU compilation optimization, mastering core techniques such as loop optimization, memory optimization, and operator optimization, with the ability to independently perform performance bottleneck analysis and technical optimization. - Familiar with common model structures and compilation adaptation logic of deep learning frameworks such as PyTorch and TensorFlow, capable of designing targeted optimization solutions. Preferred Qualifications: - Familiar with the architecture design of recommendation machine learning engines. Solid implementation experience in compilation optimization and low-latency inference optimization for large-scale recommendation systems, with the ability to handle compilation optimization needs in high-concurrency scenarios. - Experience contributing to open-source AI compiler projects (e.g., TVM, MLIR), or possess technical expertise in the compilation adaptation of large models for recommendation scenarios and the automatic generation of sparse operators. Job Information [For Pay Transparency]Compensation Description (Annually) The base salary range for this position in the selected city is $162000 - $387600 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

  1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
  2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
  3. Exercising sound judgment.
About U Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join ByteDance Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us. Diversity & Inclusion ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. Reasonable Accommodation ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at ByteDance

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer - AI Compiler Optimization in San Jose, CA vacancy
  • $193.3k - $261.5k

    Do you want to be part of AI revolution? At AWS our vision is to make deep learning pervasive for everyday developers...  .... AWS Neuron is the SDK that optimizes the performance of complex ML...  ...is for a senior software engineer in the Compiler team for AWS Neuron. As part... 
    Suggested
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $165.2k - $223.6k

    Do you want to be part of AI revolution? At AWS our vision is to make deep learning pervasive for everyday developers...  .... AWS Neuron is the SDK that optimizes the performance of complex ML...  ....This role is for a software engineer in the Compiler team for AWS Neuron. As part... 
    Suggested
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $193.3k - $261.5k

    The Product: AWS Machine Learning accelerators are at the forefront...  ...building Generative AI on AWS. The Inferentia...  ...which includes an ML compiler, runtime and natively...  ...including silicon engineering, hardware design and verification...  ...Neuron team works to optimize the performance of... 
    Suggested
    Internship
    Local area
    Work from home
    Relocation
    Flexible hours

    Amazon

    Cupertino, CA
    7 hours ago
  • $152k - $241.5k

    We are now looking for a Senior Machine Learning Applications and Compiler Engineer!NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack...  ...similar.Experience with large-scale AI distributed inference or training systems... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $165.2k - $223.6k

    The AWS Neuron Compiler team is actively seeking...  ...skilled compiler engineers to join our...  ...state-of-the-art deep learning compiler stack. This...  ...is designed to optimize application models...  ...our custom-built Machine Learning accelerators...  ...solutions like Generative AI. In this role as a... 
    Suggested
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $165.2k - $223.6k

    Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large language OSS models like Qwen, Gemma, gptoss, improving inference performance by development on inference stacks like vLLM, SGLAng, performance tuning... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Santa Clara, CA
    4 days ago
  •  ...discovery to powering AI and the technologies people...  ...AMD's proprietary AI-engine architecture.THE...  ...sophisticated issues in a complex compiler tool stack. This role...  ...platforms, to compile Machine Learning networks in a broad...  ...for analysis and optimization effortsContribute to... 

    AMD

    San Jose, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200649539Team: Machine Learning and AI, Software and ServicesLocation: CupertinoWeekly Hours: 40Posted: 2026-08-12SummaryAt Apple...  ...developing and implementing machine learning or optimization algorithms, ideally within the ads space, recommendations,... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

     ...intersection of Generative AI, Information Retrieval, and...  ...We're looking for a senior machine learning engineer to own the conversational intelligence...  ...LLM inference-optimization experience: distillation, quantization...  ...schemas, building graph compilation and ingestion pipelines,... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  •  ...At Rhoda AI, we’re building the next generation of generalist intelligent robots...  ...accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast,...  ...dataflow accelerators (their SDKs and compilers), and consumer Blackwell GPUs such as the... 
    Full time

    rhoda-ai

    Mountain View, CA
    7 days ago
  • Machine Learning Engineer 5 - Decisioning & Optimization New York, New York, United States of America • Seattle, Washington, United States of America At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours
    Shift work

    Netflix

    Los Gatos, CA
    1 day ago
  • $218.4k

    Senior Machine Learning Engineer, Developer AI Location: San Jose Team: Technology Employment Type: Regular...  ...reinforcement learning, preference optimization, prompt engineering, context engineering...  ...such as program analysis, compilers, static analysis, code search, repository... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    1 day ago
  • $213k - $263k

    Senior ML Compiler Engineer, Compute Waymo is an autonomous driving technology...  ...to ensure we design and optimize hardware and software for...  ...You will: Leverage agentic AI to accelerate analysis,...  ...principles behind popular machine learning and neural network algorithms... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $220k - $300k

     ...leader in next-generation AI infrastructure, delivering...  ...team The ML team builds and optimizes the models that run on SambaNova...  ...work directly with the compiler, systems, and hardware...  ...role As a Senior Principal Machine Learning Engineer, you will be responsible for... 
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    SambaNova

    San Jose, CA
    1 day ago
  •  ...regular in-person events. Learn more about our flexible approach...  ...About the Role: As a Machine Learning Engineer, you will have the...  ...crucial areas such as routing optimization, pricing, dispatch, and mapping...  ...the Team: The Logistics AI group is responsible for the... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    San Jose, CA
    4 days ago
  • $2,000 per month

    Machine Learning Research Engineer Cupertino, CA Etched is building AI chips that are hard-coded for individual model architectures...  ...real-time image generation Optimize model instructions and scheduling...  ...with GPU kernels, the CUDA compilation stack and related tools, or... 
    Work at office
    Relocation package

    ETCHED LLC

    Cupertino, CA
    1 day ago
  • $110k - $200k

    Machine Learning Engineer Responsibilities: Develop, optimize, and deploy lightweight machine learning models for edge AI applications, particularly for audio processing. Implement and optimize...  ...strong plus: Understanding of ML compiler and runtime design. Experience... 
    Local area

    TETRAMEM INC

    San Jose, CA
    1 day ago
  • $150.8k - $241.2k

     ...please Sign-In before you apply.Job Description:Infrastructure AI/ML Engineer for Memory Design, Characterization,and Yield...  ...development workflow for memory design, characterization, and yield optimization.In this role, you will collaborate with memory designers and... 
    Full time
    Local area

    Broadcom

    San Jose, CA
    1 day ago
  • $123.75k - $185k

     ...EightfoldEightfold is a global leader in AI-native enterprise talent...  ..., and high standards. Our engineers, product leaders, and go-to-...  ...environments and optimize system performance.Contribute...  ...Qualifications:Knowledge and passion in machine learning algorithms, Gen AI, LLMs,... 
    Work experience placement
    Work at office
    3 days per week

    Eightfold

    Santa Clara, CA
    2 days ago
  • $342.7k

     ...San Jose office.Meet the teamCisco’s AI Software & Platform team (AISWP) is the...  ...is managed. As a Distinguished Machine Learning Engineer, you will have a seat at the table where...  ....Deep knowledge of inference serving optimizations, such as KV/prefix caching, continuous... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work

    CISCO Systems

    San Jose, CA
    4 days ago
  • $129.3k - $225.3k

     ...experience where customers can shop, buy and learn everything Apple, wherever they are....  ...motivated, and hands-on applied Machine Learning Engineer. You will lead the way on our Online...  ..., messaging, marketing), Generative AI and optimizing Apple-wide systems & infrastructure.... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $150k - $200k

     ...Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver...  ...teams.We are seeking a highly skilled Machine Learning Engineer with deep expertise in developing Bird...  ...Design, implement, and optimize BEV-based perception models that fuse... 
    Full time

    Plus.ai

    Santa Clara, CA
    1 day ago
  • $150.4k - $277.6k

     ...for extraordinary algorithm engineers to work on the image capture...  ...will work on core camera/ISP/machine learning technologies based on Apple-...  ...should be able to balance optimization and performance in resource-...  ...experience in Computer Science, AI, Machine Learning, or a... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $150.4k - $277.6k

    Role Number: 200683571Team: Machine Learning and AILocation: Santa ClaraWeekly...  ...learning and generative AI to meaningful, large-scale...  ...machine learning inference optimization to deliver fast, power-efficient...  ...will bridge research and engineering excellence to drive scalable... 
    Relocation

    Apple

    Santa Clara, CA
    1 day ago
  • $150.4k - $277.6k

    Role Number: 200661302Team: Machine Learning and AI, Software and ServicesLocation: Cupertino; SeattleWeekly...  ...specific adapters to on-device optimizations, you will have the unique opportunity...  ...seeking a machine learning research engineer with experience building modern... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

     ...Number: 200670239Team: Hardware, Machine Learning and AILocation:...  ...products, and as a research engineer on our team, you will build...  ...infrastructure, performance optimization, data, and production deployment...  ...architecture principlesProficiency in AI tooling such as Claude and... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $159.5k - $236.5k

     ...design, develop, and implement machine learning models and algorithms to...  ...with data scientists, software engineers, and product teams to...  ...services through innovative AI/ML solutions. Your role will...  ...Responsibilities: Develop and optimize machine learning models for... 
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    San Jose, CA
    1 day ago
  • $165.2k - $223.6k

     ...to accelerate deep learning and GenAI...  ...on Amazon’s custom machine learning accelerators...  ...software boundary, our engineers craft high-...  ...counts in delivering optimal performance for our...  ...what's possible in AI acceleration.The AWS...  ...includes an ML compiler, runtime, and application... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $202k

     ...Posted: 2026-10-14About the RoleThe Maps Optimization team builds and maintains the...  ...routing. Our technology leverages advanced machine learning models and high-throughput scalable infrastructure...  ..., entrepreneurial machine learning engineer to join the Maps Optimization team. As... 
    Full time
    Work at office
    Remote work
    Worldwide

    Uber

    Sunnyvale, CA
    2 days ago
  • $150.4k - $225.3k

     ...2026-09-24SummaryAre you a passionate Machine Learning Engineer with a deep love for photography? Join...  ...detectionExperience in applying generative AI and reinforcement learning techniques...  ...with using advanced ML methods to optimize system architectures and improve image... 
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer - AI Compiler Optimization. Be the first to apply!