Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Compiler Engineer

Full-time

Jane Street

About the position

We’re looking for compiler engineers to join a new ML Compilers Team at Jane Street. 

Machine learning is a critical pillar of our global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.

ML compilers let us quickly turn research ideas and novel architectures into high-throughput training jobs and low-latency inference. To get the most out of our hardware resources and enable rapid model development and deployment, we are working to understand and improve the current ML compiler technologies and explore where it makes sense to build our own solutions. In this role, you would shape the development of our compiler stack.

If you’ve never thought about a career in finance, you’re in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you’ll fit right in.

About you

The ideal candidate has worked on an ML compiler in the past, but non-ML compiler experience is also valuable. Experience with any part of the stack is fine, be it high-level ML frameworks (PyTorch, Jax, TensorFlow), graph compilers (Inductor, XLA, TVM), or kernel DSLs (Triton, Helion, cuTile). You should understand how all those pieces fit together even if you are unfamiliar with specific parts. 

Some other things you might be excited about are:

  • Optimizations in ML compilers: algebraic rewriting, materialize vs recompute tradeoffs and fusion, equality saturation, scheduling languages, loop-level optimization, autotuning
  • ML compiler frontends: graph capture, symbolic and dynamic shapes, control flow, automatic differentiation
  • GPU kernel programming and architecture: Triton, cuTile, CuTeDSL, CUDA, compute and memory hierarchies, programming with tensor cores
  • Compiler concepts: static analysis, intermediate representations like SSA and CFGs, instruction selection
  • ML inference: CUDA Graphs, KV caching, batching
  • ML training: Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing
  • GPU debugging and optimization: CUDA-GDB, Nsight Systems, Nsight Compute
  • Formal methods: proof assistants, automated theorem provers, agentic proof systems
  • Programming languages and DSL design: embedded DSLs, staging and metaprogramming, type systems, functional programming

 

If you're a recruiting agency and want to partner with us, please reach out to View email address on janestreet.com

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning Compiler Engineer in New York, NY vacancy
  • $213k - $263k

     ...schedule and you will report to a Software Engineering Manager. You Will Leverage...  ...code generated by our production grade compiler, and design and implement...  ...Knowledge of the principles behind popular machine learning and neural network algorithms and applications... 
    Suggested
    Full time
    Remote work

    Waymo

    New York, NY
    5 days ago
  • $175k - $250k

     ...Machine Learning Engineers at IMC play a pivotal role in building the systems that drive training and deployment of large-scale ML models across...  ...device level, and optimising performance across kernels, compilers and hardware (e.g. CUDA, Triton or equivalent).... 
    Suggested
    Permanent employment
    Full time

    IMC

    New York, NY
    44 minutes ago
  •  ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’...  ...Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy...  ...level Python and strong proficiency in a compiled or high-performance language (e.g., C++... 
    Suggested
    Full time
    Local area
    Remote work
    Worldwide

    Fusemachines

    New York, NY
    5 days ago
  •  ...Senior Machine Learning Engineer ESPN is investing in next-generation sports personalization and recommendation experiences across its digital...  ...such as distillation, quantization, pruning, batching, compilation, and efficient architecture design where appropriate. Own... 
    Suggested
    Shift work

    The Walt Disney Studios

    New York, NY
    3 days ago
  • $144.1k - $202.4k

     ...Disney Entertainment & Sports LLC is hiring a Sr Machine Learning Engineer for ESPN, focused on building and productionizing deep learning models...  ...such as distillation, quantization, pruning, batching, compilation, and efficient architecture design where appropriate.... 
    Suggested
    Shift work

    Disney Entertainment & Sports LLC

    New York, NY
    4 days ago
  • $150.9k - $202.4k

     ...Technology is a global organization of engineers, product developers, designers,...  ...digital products. We are seeking a Senior Machine Learning Engineer who will focus on the design,...  ...distillation, quantization, pruning, batching, compilation, and efficient architecture design... 
    Work experience placement
    Shift work

    The Walt Disney Company

    New York, NY
    2 days ago
  • $107.66k - $161.7k

     ...topics and providing a unique platform to learn and connect with others. Poe : a...  ...About the Team and Role: Our small engineering team works on challenging problems every...  ...product and our company. At Poe, we use Machine Learning in various parts of the product... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    New York, NY
    2 days ago
  •  ...while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    Machine Learning Engineer 5 Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you‘ll be part of a big group of... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $135k - $175k

     ...AI/ML Engineer Location: New York, NY Compensation: $135,000 – $175,000 base + bonus + full benefits, (401(k), and more) Industry...  ...Qualifications: Internship or project experience in machine learning, AI engineering, or related roles—especially in insurance or... 
    Internship

    James Search Group

    New York, NY
    1 day ago
  •  ...Combinator (P25) and part of the NVIDIA inception program. Role Description This is a full-time role for a Founding Machine Learning Engineer, located in Manhattan, NYC. The Founding ML Engineer will develop the core of Photonium’s agentic and deep learning... 
    Full time

    Photonium

    New York, NY
    3 days ago
  • $200k - $225k

     ...Machine Learning Engineer New York | Hybrid (4 days in office) $200k - $225k base + 20% bonus A well-funded real estate business is investing heavily in AI and data to transform how strategic decisions are made across its portfolio. They're hiring a Machine Learning... 
    Full time
    Work at office

    Harnham

    New York, NY
    5 days ago
  • $200k - $265k

     ...Role Description You will be responsible for building the machine learning systems that power our core platform. Your work will focus...  ...who wants to work across applied ML research and production engineering, developing new models and building the systems required to... 
    Full time

    Triangle Analytics

    New York, NY
    3 days ago
  • $200k - $300k

     ...Build the Evaluation Engine Behind Production AI Voice Agents | $200k-$300k This Jobot...  ...balance is important at Aircall Fast-learning environment, entrepreneurial and strong team...  ...Bachelor's degree in Computer Science, Machine Learning, Statistics, or a related field.... 
    Local area
    Worldwide

    Jobot

    New York, NY
    3 days ago
  • $143.7k - $194.4k

    Join the AI Studios Engineering org within Prime Video and Amazon MGM Studios as a Machine Learning Engineer on CreativeFlux, the ML platform powering Nara, our AI-native...  ...fleet through batching, quantization, model compilation, serving framework tuning, and Kubernetes-... 
    Internship
    Local area
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  •  ...groundbreaking AI research projects at InAI Lab. Drive innovation in machine learning and artificial intelligence, publish in top-tier conferences...  ...Work closely with research scientists, data engineers, and product teams to deliver end-to-end ML solutions that meet... 
    Full time
    Immediate start
    Flexible hours

    InAI Lab

    New York, NY
    14 hours ago
  • $120k - $180k

     ...Founding ML Engineer Opportunity We are looking for a founding ML engineer to join our technical team, where your work will have the...  ...of hands-on experience in applied ML. ~ Strong skills in deep learning and related frameworks (PyTorch, TF) backed by a portfolio of... 
    Permanent employment
    Full time
    Work experience placement
    Work at office

    YRIKKA

    New York, NY
    5 days ago
  •  ...tooling, partnering closely with Conversation Design, CX, and engineering teams to deliver secure, compliant, and scalable AI-powered...  ...to resolve cases more effectively. We are hiring an IC4 Machine Learning Engineer to help evolve our conversational ecosystem by building... 

    Coinbase

    New York, NY
    5 days ago
  •  ...monitoring, automated retrainingWork with data scientists, engineers and business stakeholders to turn goals into ML solutionsDefine...  ...and scalability What we're looking for 5+ years in Machine Learning Engineering, Data Science or Applied MLProven experience deploying... 
    Full time
    Immediate start
    Remote work

    emagine Polska

    New York, NY
    14 hours ago
  • $143.7k - $213.8k

     ...As a Machine Learning Engineer on Amazon Ads’ Sponsored Products and Brands team, you will help power advertising experiences that connect shoppers with highly relevant sponsored products. The work sits at the intersection of machine learning, natural language processing... 
    Internship
    Flexible hours

    Amazon

    New York, NY
    13 hours ago
  •  ...Machine Learning Engineer (AI Data Trainer) About the Role What if your machine learning expertise could directly influence how the world's most advanced AI systems reason, plan, and solve problems? We're looking for Machine Learning Engineers to help train cutting... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    13 hours ago
  •  ...hub for AI innovation and transformation. With expertise in machine learning, natural language processing, and data discovery, we develop...  ...time and resources to explore new ideas, but always rooted in engineering best practices. As a result, we can innovate rapidly to... 
    Work at office
    Worldwide

    S&P Global

    New York, NY
    2 days ago
  •  ...Education UG: B.Sc in Artificial Intelligence and Machine Learning, Computer Science and Technology Key Skills Naukri.com does not promise a job or an interview in exchange of money. Fraudsters may ask you to pay in the pretext of registration fee, Refundable Fee… Employment... 
    Temporary work
    Part time
    For contractors
    Remote work
    Flexible hours

    Anika Technologies

    New York, NY
    2 days ago
  •  ...OON Systems is building AI-first infrastructure for complex healthcare workflows. As a Machine Learning Engineer, you will design, train, and deploy production models that improve decision quality, automate operational processes, and support real-world optimization across... 

    OON Systems LLC

    New York, NY
    14 hours ago
  •  ...Founding ML Engineer About Our Client Our client is an early-stage AI research company building models with real creative ability...  .... This matters: ML alone won't produce a model with real creative ability, so you'll keep learning the creative domains as you go... 

    PRIMIS , Inc. Defunct

    New York, NY
    2 days ago
  • $80k - $110k

     ...experience — talk with your recruiter to learn more. Base Pay Range $80,000.00/yr - $110...  ...provide innovative solutions in the field of machine learning and AI, fostering a culture of...  ...a motivated Entry‑Level Machine Learning Engineer to join our growing team. This role is... 
    Full time
    Internship
    Remote work

    Mayzax Solutions

    New York, NY
    5 days ago
  • $10k

     ...the Role We’re seeking someone to lead the future of fraud machine learning at Ramp. In this role, you will help build core machine learning...  ...legitimate users. You will partner closely with product and engineering counterparts across model design, implementation, execution,... 
    Full time
    Work at office
    Remote work
    Relocation
    Home office
    Flexible hours

    RAMP

    New York, NY
    14 hours ago
  • $205k - $235k

     ...something that should “just come naturally,” but as a skill to learn and practice. Founded by Dr. Becky Kennedy and Dr. Erica...  ...of change. The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team. This is not a research or data... 

    Good Inside

    New York, NY
    5 days ago
  • $84.58k - $126k

     ...Position Summary We have an exciting opportunity to join our team as an Engineer II – Applied AI. As an ML Engineer, you will support the implementation of diverse Generative AI and Machine Learning initiatives across the health system. You will drive specific projects... 
    Work at office

    NYU Langone Hospitals

    New York, NY
    13 hours ago
  • $140k - $250k

     ...them. About the role Design, develop, and optimize machine learning and generative AI systems used to evaluate pharmaceutical marketing...  .... Develop large language model applications using prompt engineering, retrieval-augmented generation (RAG), multi-agent... 
    Work experience placement

    Solstice

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Compiler Engineer. Be the first to apply!