Machine Learning Compiler Engineer
Jane Street
About the position
We’re looking for compiler engineers to join a new ML Compilers Team at Jane Street.
Machine learning is a critical pillar of our global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.
ML compilers let us quickly turn research ideas and novel architectures into high-throughput training jobs and low-latency inference. To get the most out of our hardware resources and enable rapid model development and deployment, we are working to understand and improve the current ML compiler technologies and explore where it makes sense to build our own solutions. In this role, you would shape the development of our compiler stack.
If you’ve never thought about a career in finance, you’re in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you’ll fit right in.
About you
The ideal candidate has worked on an ML compiler in the past, but non-ML compiler experience is also valuable. Experience with any part of the stack is fine, be it high-level ML frameworks (PyTorch, Jax, TensorFlow), graph compilers (Inductor, XLA, TVM), or kernel DSLs (Triton, Helion, cuTile). You should understand how all those pieces fit together even if you are unfamiliar with specific parts.
Some other things you might be excited about are:
- Optimizations in ML compilers: algebraic rewriting, materialize vs recompute tradeoffs and fusion, equality saturation, scheduling languages, loop-level optimization, autotuning
- ML compiler frontends: graph capture, symbolic and dynamic shapes, control flow, automatic differentiation
- GPU kernel programming and architecture: Triton, cuTile, CuTeDSL, CUDA, compute and memory hierarchies, programming with tensor cores
- Compiler concepts: static analysis, intermediate representations like SSA and CFGs, instruction selection
- ML inference: CUDA Graphs, KV caching, batching
- ML training: Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing
- GPU debugging and optimization: CUDA-GDB, Nsight Systems, Nsight Compute
- Formal methods: proof assistants, automated theorem provers, agentic proof systems
- Programming languages and DSL design: embedded DSLs, staging and metaprogramming, type systems, functional programming
If you're a recruiting agency and want to partner with us, please reach out to View email address on janestreet.com
$213k - $263k
...schedule and you will report to a Software Engineering Manager. You Will Leverage... ...code generated by our production grade compiler, and design and implement... ...Knowledge of the principles behind popular machine learning and neural network algorithms and applications...SuggestedFull timeRemote work$175k - $250k
...Machine Learning Engineers at IMC play a pivotal role in building the systems that drive training and deployment of large-scale ML models across... ...device level, and optimising performance across kernels, compilers and hardware (e.g. CUDA, Triton or equivalent)....SuggestedPermanent employmentFull time- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’... ...Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy... ...level Python and strong proficiency in a compiled or high-performance language (e.g., C++...SuggestedFull timeLocal areaRemote workWorldwide
- ...Senior Machine Learning Engineer ESPN is investing in next-generation sports personalization and recommendation experiences across its digital... ...such as distillation, quantization, pruning, batching, compilation, and efficient architecture design where appropriate. Own...SuggestedShift work
$144.1k - $202.4k
...Disney Entertainment & Sports LLC is hiring a Sr Machine Learning Engineer for ESPN, focused on building and productionizing deep learning models... ...such as distillation, quantization, pruning, batching, compilation, and efficient architecture design where appropriate....SuggestedShift work$150.9k - $202.4k
...Technology is a global organization of engineers, product developers, designers,... ...digital products. We are seeking a Senior Machine Learning Engineer who will focus on the design,... ...distillation, quantization, pruning, batching, compilation, and efficient architecture design...Work experience placementShift work$107.66k - $161.7k
...topics and providing a unique platform to learn and connect with others. Poe : a... ...About the Team and Role: Our small engineering team works on challenging problems every... ...product and our company. At Poe, we use Machine Learning in various parts of the product...Remote jobFull timeWork experience placementInternship- ...while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
$229.9k - $262.4k
Machine Learning Engineer 5 Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you‘ll be part of a big group of...Full timePart timeLocal area$135k - $175k
...AI/ML Engineer Location: New York, NY Compensation: $135,000 – $175,000 base + bonus + full benefits, (401(k), and more) Industry... ...Qualifications: Internship or project experience in machine learning, AI engineering, or related roles—especially in insurance or...Internship- ...Combinator (P25) and part of the NVIDIA inception program. Role Description This is a full-time role for a Founding Machine Learning Engineer, located in Manhattan, NYC. The Founding ML Engineer will develop the core of Photonium’s agentic and deep learning...Full time
$200k - $225k
...Machine Learning Engineer New York | Hybrid (4 days in office) $200k - $225k base + 20% bonus A well-funded real estate business is investing heavily in AI and data to transform how strategic decisions are made across its portfolio. They're hiring a Machine Learning...Full timeWork at office$200k - $265k
...Role Description You will be responsible for building the machine learning systems that power our core platform. Your work will focus... ...who wants to work across applied ML research and production engineering, developing new models and building the systems required to...Full time$200k - $300k
...Build the Evaluation Engine Behind Production AI Voice Agents | $200k-$300k This Jobot... ...balance is important at Aircall Fast-learning environment, entrepreneurial and strong team... ...Bachelor's degree in Computer Science, Machine Learning, Statistics, or a related field....Local areaWorldwide$143.7k - $194.4k
Join the AI Studios Engineering org within Prime Video and Amazon MGM Studios as a Machine Learning Engineer on CreativeFlux, the ML platform powering Nara, our AI-native... ...fleet through batching, quantization, model compilation, serving framework tuning, and Kubernetes-...InternshipLocal areaFlexible hours- ...groundbreaking AI research projects at InAI Lab. Drive innovation in machine learning and artificial intelligence, publish in top-tier conferences... ...Work closely with research scientists, data engineers, and product teams to deliver end-to-end ML solutions that meet...Full timeImmediate startFlexible hours
$120k - $180k
...Founding ML Engineer Opportunity We are looking for a founding ML engineer to join our technical team, where your work will have the... ...of hands-on experience in applied ML. ~ Strong skills in deep learning and related frameworks (PyTorch, TF) backed by a portfolio of...Permanent employmentFull timeWork experience placementWork at office- ...tooling, partnering closely with Conversation Design, CX, and engineering teams to deliver secure, compliant, and scalable AI-powered... ...to resolve cases more effectively. We are hiring an IC4 Machine Learning Engineer to help evolve our conversational ecosystem by building...
- ...monitoring, automated retrainingWork with data scientists, engineers and business stakeholders to turn goals into ML solutionsDefine... ...and scalability What we're looking for 5+ years in Machine Learning Engineering, Data Science or Applied MLProven experience deploying...Full timeImmediate startRemote work
$143.7k - $213.8k
...As a Machine Learning Engineer on Amazon Ads’ Sponsored Products and Brands team, you will help power advertising experiences that connect shoppers with highly relevant sponsored products. The work sits at the intersection of machine learning, natural language processing...InternshipFlexible hours- ...Machine Learning Engineer (AI Data Trainer) About the Role What if your machine learning expertise could directly influence how the world's most advanced AI systems reason, plan, and solve problems? We're looking for Machine Learning Engineers to help train cutting...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
- ...hub for AI innovation and transformation. With expertise in machine learning, natural language processing, and data discovery, we develop... ...time and resources to explore new ideas, but always rooted in engineering best practices. As a result, we can innovate rapidly to...Work at officeWorldwide
- ...Education UG: B.Sc in Artificial Intelligence and Machine Learning, Computer Science and Technology Key Skills Naukri.com does not promise a job or an interview in exchange of money. Fraudsters may ask you to pay in the pretext of registration fee, Refundable Fee… Employment...Temporary workPart timeFor contractorsRemote workFlexible hours
- ...OON Systems is building AI-first infrastructure for complex healthcare workflows. As a Machine Learning Engineer, you will design, train, and deploy production models that improve decision quality, automate operational processes, and support real-world optimization across...
- ...Founding ML Engineer About Our Client Our client is an early-stage AI research company building models with real creative ability... .... This matters: ML alone won't produce a model with real creative ability, so you'll keep learning the creative domains as you go...
$80k - $110k
...experience — talk with your recruiter to learn more. Base Pay Range $80,000.00/yr - $110... ...provide innovative solutions in the field of machine learning and AI, fostering a culture of... ...a motivated Entry‑Level Machine Learning Engineer to join our growing team. This role is...Full timeInternshipRemote work$10k
...the Role We’re seeking someone to lead the future of fraud machine learning at Ramp. In this role, you will help build core machine learning... ...legitimate users. You will partner closely with product and engineering counterparts across model design, implementation, execution,...Full timeWork at officeRemote workRelocationHome officeFlexible hours$205k - $235k
...something that should “just come naturally,” but as a skill to learn and practice. Founded by Dr. Becky Kennedy and Dr. Erica... ...of change. The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team. This is not a research or data...$84.58k - $126k
...Position Summary We have an exciting opportunity to join our team as an Engineer II – Applied AI. As an ML Engineer, you will support the implementation of diverse Generative AI and Machine Learning initiatives across the health system. You will drive specific projects...Work at office$140k - $250k
...them. About the role Design, develop, and optimize machine learning and generative AI systems used to evaluate pharmaceutical marketing... .... Develop large language model applications using prompt engineering, retrieval-augmented generation (RAG), multi-agent...Work experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Compiler Engineer. Be the first to apply!
- junior machine learning research engineer New York, NY
- machine learning ai engineer New York, NY
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- computer vision machine learning engineer New York, NY
- ai ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning New York, NY







