Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Compiler Engineer

Oho Group

Join a stealth-stage AI hardware startup building a custom SoC and the full compiler and inference stack alongside it. What You’ll Do You’ll own the full stack from PyTorch and Triton down to efficient machine IR on leading-edge GPUs and novel accelerator targets You’ll build and optimise ML compiler infrastructure across every layer, not just one slice You’ll drive GPU optimisation across CUDA and ROCm with real, measurable performance outcomes You’ll collaborate directly with hardware engineers on ISA and microarchitecture tradeoffs that shape the silicon itself You’ll tackle compiler problems on XPU and novel accelerator targets where no established playbook exists What We’re Looking For 3+ years in compilers, ML systems, or equivalent depth Strong compiler fundamentals with a track record of delivered performance improvements Hands‑on experience with PyTorch, Triton, and low‑level code generation GPU optimisation depth in CUDA and/or ROCm HW‑SW co‑design experience or strong evidence of meaningful hardware collaboration #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML Compiler Engineer in San Jose, CA vacancy
  • A leading technology company in Cupertino seeks an On-Device ML Infrastructure Engineer focused on developing advanced ML models for Apple's hardware. The role involves building graph compilers and runtimes, optimizing model execution, and contributing to the AI ecosystem... 
    Suggested

    Apple

    Cupertino, CA
    2 days ago
  • $128.7k - $261.3k

     ...accessible mobility. For theAIKernels & Compilers team, that mission shows up in the...  ...export,kernel development, and performance engineering so that every cycle on our accelerators...  ...makesthat path fast, reliable, andeffortlessfor ML engineers across the AV organizationto... 
    Suggested
    Local area
    Work from home
    Flexible hours

    Dormont Manufacturing Co

    Sunnyvale, CA
    4 days ago
  • $152k - $287.5k

    NVIDIA Gruppe is seeking a Senior Machine Learning Applications and Compiler Engineer in Santa Clara, California. This role involves developing algorithms for their LPX inference and compiler stack, optimizing the performance of neural network workloads on NVIDIA platforms... 
    Suggested

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • Qualcomm is seeking an experienced compiler engineer to join the Qualcomm AI Hub Compiler team in Santa Clara, CA. You will design and maintain...  ...proficiency in Python and C++, as well as experience in ML infrastructure or compiler engineering. This position offers a... 
    Suggested

    Qualcomm

    Santa Clara, CA
    2 days ago
  • $165.2k - $223.6k

     ...of innovation, delivering best‑in‑class ML inference and training performance through...  ...Amazon, covering disciplines such as silicon engineering, hardware design, and software operations...  ...Amazon hardware through a deep learning compiler stack. Role As a Machine Learning... 
    Suggested
    Internship

    Amazon

    Cupertino, CA
    3 days ago
  • $160.5k - $240.7k

    Company Qualcomm Technologies, Inc. Job Area Engineering Group, Engineering Group > Machine Learning...  ...developers to easily integrate, optimize, and deploy ML models on Qualcomm devices. Qualcomm AI Hub Workbench lets developers compile trained PyTorch or ONNX models into... 

    Qualcomm

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop algorithms and...  ...approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues. What we need to... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  ...learning users to effortlessly run large‑scale ML applications, without the hassle of...  ...are seeking a versatile and experienced engineer to join our SOTA Training Platform team....  ...architecture translation, graph lowering, compiler optimizations, runtime integration, and performance... 
    Internship

    Cerebras

    Sunnyvale, CA
    4 days ago
  •  ...accessible mobility. For the AI Kernels & Compilers team, that mission shows up in the...  ...export, kernel development, and performance engineering so that every cycle on our accelerators...  ...that sit at the heart of our on‑vehicle ML inference for ADAS and autonomous driving... 
    Local area
    Relocation package
    Flexible hours

    Dormont Manufacturing Co

    Sunnyvale, CA
    4 days ago
  •  ...a supercomputer — feel like one seamless engine. Developers can write once, run anywhere,...  ...About the Role We're looking for a Senior ML Performance Engineer to architect and...  ...DeepSeek, and others — before and after compiler optimization on modern GPU architectures.... 

    Lemurian Labs

    Santa Clara, CA
    24 days ago
  • $147.4k - $272.1k

     ...devices. We are seeking exceptional software engineers with a strong machine learning background...  ...programming Proficiency in at least one compiled language like C, C++, Objective-C, Swift,...  ...Qualifications Experience working with ML pipelines and large datasets in... 
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • $147.4k - $272.1k

    Apple Inc. is seeking passionate software engineers with a strong machine learning background to join the Proactive Intelligence team...  ...production machine learning systems, proficiency in Python, and one compiled language. The base pay range is $147,400 to $272,100 and... 
    Worldwide

    Apple Inc.

    Cupertino, CA
    1 day ago
  • $128.7k - $261.3k

     ...developers, deployment, and infrastructure engineers to ship numerically robust, low‑latency...  ...performance; partnering with deployment, compiler, and kernel teams to deploy quantized models...  ..., Physics, Mathematics, Data Science/ML, or a closely related quantitative field... 
    Local area
    Remote work
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $250k - $310k

     ...HiringCafe is building a 100x better job search engine: fast, comprehensive, honest, and...  ...placement. We are looking for a founding ML engineer who can help us turn powerful AI...  ...techniques such as quantization, pruning, compilation, batching, caching, and memory optimization... 
    Relocation package

    Dormont Manufacturing Co

    Cupertino, CA
    3 days ago
  •  ...Labs, located in Santa Clara, California, is seeking a Senior ML Performance Engineer to lead the development of a performance testing platform...  ...large language models. This role is pivotal in validating compiler performance on advanced GPU architectures. The ideal candidate... 

    Lemurian Labs

    Santa Clara, CA
    4 days ago
  •  ...Title: ML Ops Engineer Location: Sunnyvale, CA Job Description: Strong Software Engineering fundamentals Experience deploying machine learning models into production environment Strong DevOps, Data Engineering and ML background with... 

    Fisec Global

    Sunnyvale, CA
    3 days ago
  •  ...& Responsibilities Design, build, and deploy production‑grade ML systems with end‑to‑end ownership of the model lifecycle from conception...  ...or a related field. 1-6 years of professional experience in ML engineering. Strong programming skills in Python (TypeScript experience is... 
    Full time

    Catalyst Labs, LLC

    Sunnyvale, CA
    3 days ago
  •  ...Machine Learning Engineer The position is for a Machine Learning Engineer, with a high priority for hiring in San Jose, CA. Hybrid onsite...  ...adoption of a product or platform. Proficiency in Java, Python, ML Platforms, LLMs, and Machine Learning is required. Experience in... 
    Remote work

    Argyle Infotech

    San Jose, CA
    1 day ago
  • $160k - $220k

     ...at scale. This is a hands-on role where you'll see direct impact on business metrics daily. What You'll Do Build and deploy ML models serving 100M+ predictions daily Develop ranking algorithms that balance relevance, diversity, and revenue Implement real... 
    Remote work

    Launch Potato

    San Jose, CA
    29 days ago
  • $147.4k - $272.1k

    ML Framework (MetalLM) Engineer, Graphics, Game and ML Cupertino, California, United States Apple’s Server ML Frameworks team in GPU, Graphics and...  ..., pipeline and expert parallelism. Develop kernel and compiler level optimizations and perform in‑depth analysis to ensure... 
    Relocation package

    Apple

    Cupertino, CA
    2 days ago
  •  ...speed inference. About the Role We are looking for a Software Engineer to join the ML Integration and Quality team at Cerebras. This team sits at...  .... You will work closely with engineers across runtime, compiler, kernel, and hardware teams to debug complex issues, improve... 
    Work at office
    Remote work

    Cerebras Systems, Inc.

    Sunnyvale, CA
    5 days ago
  • $178.42k - $230.5k

     ...responsible for delivering and maintaining the tools and services engineers here at GM use every day to do their best work and drive our...  ...of engineers at GM — how/where code is checked out, modified, compiled, tested, merged, and eventually deployed. Our goal is to... 
    Work experience placement
    Local area
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $147.4k - $272.1k

     ...equivalent Experience programming in modern C++ Excellent debugging, critical thinking, and communication skills Experience with compilers, parsers, and interpreters Experience with assembly-level programming Experience with performance analysis Experience with... 
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • Apple Inc. in Cupertino, California, is seeking a full-stack ML Engineer to enhance its advertising systems. The ideal candidate will design intuitive user interfaces, partner with cross-functional teams, and build production-ready RAG Machine Learning models. Required... 

    Apple

    Cupertino, CA
    1 day ago
  • $125k - $222k

    Decisive Point in Sunnyvale, California is seeking a skilled Software Engineer to develop ML-first behavior prediction modules. The role requires expertise in algorithms and collaboration with engineering teams. Ideal candidates should hold a Bachelor's degree and possess... 

    Decisive Point

    Sunnyvale, CA
    5 days ago
  • $147.4k - $272.1k

    Apple Inc. is seeking a Computer Vision & Machine Learning Engineer in Sunnyvale, California. This role involves developing cutting-edge computer vision and machine learning algorithms for human interaction and real-time systems. You will work on core perception technologies... 

    Apple

    Sunnyvale, CA
    3 days ago
  • $147.4k - $272.1k

    A leading technology company is seeking an algorithm developer to join its Camera Algorithm team. The role involves working on image capture and processing algorithms to improve the quality of still images and videos. Ideal candidates have an MS degree in relevant fields...

    Apple Inc.

    Cupertino, CA
    3 days ago
  • $184.7k - $324.8k

     ...something! We are a team of computer vision and machine learning engineers building real-time 3D perception and spatial understanding...  ...production deployment Proficiency in C++ or experience integrating ML models into performance-critical systems Strong communication skills... 
    Relocation

    Apple

    Sunnyvale, CA
    4 days ago
  • Apple Inc. in Cupertino, California, is seeking an experienced ML Framework Engineer to join their Server ML Frameworks team. This role focuses on enabling Apple Intelligence through high-performance ML applications and involves working on custom-built server hardware for... 

    Apple Inc.

    Cupertino, CA
    2 days ago
  • Applied Intuition in Sunnyvale, California, seeks a Software Engineer with expertise in perception for autonomous vehicles. You will contribute to building key capabilities within the autonomy stack, focusing on computer vision and machine learning techniques. The role... 

    Decisive Point

    Sunnyvale, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Compiler Engineer. Be the first to apply!