Compiler Engineer (Mid and/or Backend)
Persimmons
Who we are: Persimmons is building the infrastructure that will power the next decade of AI. Founded in 2023 by veteran technologists from the worlds of semiconductors, AI systems, and software innovation, We're on a mission to enable smarter devices, more sustainable data centers, and entirely new applications the world hasn't imagined yet. Why join us: We're growing fast and looking for bold thinkers, builders, and curious problem-solvers who want to push the limits of AI hardware and software. If you're ready to join a world-class team and play a critical role in making a global impact - we want to talk to you. Summary of Role: This role focuses on transforming higher-level MLIR-based large language models by applying sophisticated mid- and backend compiler techniques to target Persimmons.ai's custom accelerator hardware. You will help design and optimize the Persimmons Compiler mid- and backend, integrate it with custom operations and kernels, as well as implement compiler passes that convert higher-level intermediate representations into runtime-oriented code and libraries. This position offers the opportunity to directly shape Persimmons.ai's innovative AI hardware and software stack through close collaboration with teams across hardware, systems, and software. What you'll do:
- Develop and enhance MLIR-based compiler pipelines targeting Persimmons' custom spatial accelerator hardware.
- Design and optimize the Persimmons Compiler mid- and backend techniques for efficient lowering, graph-to-resources mapping, and code generation.
- Implement transformations to convert Python, PyTorch, and similar kernel representations to LLVM IR and runtime-ready libraries.
- Architect and implement efficient support for SPMD-based, distributed collective operations and lower them through specialized MLIR compiler dialects (e.g., MESH, SHARDY).
- Drive advanced loop optimizations leveraging polyhedral analysis: loop tiling, fusion, interchange, skewing, and related techniques.
- Apply and optimize techniques such as bufferization, padding, inlining, and integration of custom operations and kernels within the compilation workflow.
- Work on register allocation and instruction scheduling for Persimmons' spatial hardware, ensuring high resource utilization, throughput, and low latency.
- Contribute to graph and tensor partitioning logic for optimal hardware-targeted execution.
- Collaborate across teams to deliver performant compilation flows from high-level ML representations to low-level executable artifacts.
- We do not expect candidates to meet all of the requirements listed below; strong candidates will demonstrate expertise in several key areas.
- Solid understanding and experience with underlying principles and methods of the MLIR framework (SSA representation, interfaces, rewriting, dialect hierarchy, etc.).
- Hands-on experience with developing MLIR-based compiler infrastructure, algorithms, and techniques for non-GPU/custom spatial hardware architectures.
- Working experience with lowering SIMD operations from PyTorch, Triton, xDSL, pyDSL, or similar Python-based frontends toward LLVM IR and, further, to SIMD kernel library.
- Extensive experience and understanding of loop optimization based on polyhedral principles.
- Experience and understanding of SPMD-based, distributed collective operations, specialized MLIR compiler dialects (e.g., MESH, SHARDY), and collective operation lowering in compilers for spatial hardware.
- Experience with techniques such as padding, bufferization, inlining, and other lowering techniques.
- Knowledge of register allocation and instruction scheduling in spatial architectures.
- Experience in lowering and integration of custom operations and kernels at the compiler mid- and backend.
- Familiarity with graph and tensor partitioning and mapping optimization algorithms and their integration in the compiler workflow.
- High level of understanding and 5+ years of experience with C++ and appreciation for writing clean and maintainable code. Good knowledge of Python is a big plus.
- Demonstrated fluency with modern AI tools and workflows (e.g., leveraging AI assistants for research, analysis, or productivity).
- Competitive salary and benefits package.
- Flexible PTO
- 401k
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Compiler Engineer (Mid and/or Backend) in San Jose, CA vacancy
$152k - $241.5k
We are searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler team is responsible for constructing and emitting the highest performance GPU machine instructions for Graphics (OpenGL, Vulkan, DX) and Compute...BackendFull timeRemote workWorldwide- ...a supercomputer — feel like one seamless engine. Developers can write once, run anywhere,... ...We're looking for a Graph Optimization Compiler Engineer to own the middle tier of our AI... ...our compiler front end and code generation backend. You'll work on graph-level transformations...Backend
$128.88k - $181.94k
...Job Details:Job Description:As a Compiler Engineer, you will be at the forefront of advancing Intel's industry-leading compiler technologies... ...LLVM framework components, including IR generation, passes, and backend development.Experience with vectorization techniques,...BackendFull timeInternshipLocal areaImmediate startWorldwideShift work$150.4k - $277.6k
...Apple is looking for system programmers with compiler (especially just-in-time) and virtual... ...WebKit is responsible for the JavaScriptCore engine, and our mission is to make JavaScript... ..., and multiple optimizing compiler backend that turn JS and Wasm programs into efficient...BackendWorldwideRelocation$184k - $287.5k
...lasting impact on the world. We are looking for a Raytracing Compiler Engineer to join as a member of our international engineering team. What... ...: Guide the design and implementation of a new LLVM-based backend JIT compiler targeting NVIDIA GPUs. Design and develop new...BackendFull time- ...breakthrough technology takes more than great engineering—it takes a team of exceptional people who... ..., DV, FPGA, DFT, SoC integration, and backend teams throughout various stages of ASIC... ...Full-timeFunction: EngineeringExperience level: Mid-Senior LevelIndustry: SemiconductorsBackend
$184.7k - $324.8k
...product!As a Physical Electrical Analysis Engineer on our SoC team, you will be driving the... ...with industrial EDA backend tools including Redhawk, PrimeRail, Voltus... ...design.Experience with Innovus, Design Compiler, PrimeTime and Tempus.Familiar with voltage...BackendRelocation$106k - $205k
Title: Staff System Engineers Engineer, AI/MLAbout GlobalFoundries:GlobalFoundries is a leading... ..., interconnect) and software teams (compilers, runtimes, ML frameworks), serving as... ...compiler infrastructure in a performance or backend capacity, contributions to internal or...BackendFull timeWork at officeLocal area$184.7k - $324.8k
...infrastructure and tools to help other engineers be more productive and make software easier... ...a set of innovative distributed backend services and tools to deliver a high volume... ...ScalaExpertise in at least 2 of: caching, compilers, networking, or operating systemsAbility...BackendRelocationFlexible hours$150.4k - $277.6k
...Information Systems and Technology group!We are looking for mid-career senior-level Java Software Engineers, who will work closely with other Software Engineers,... ...implementing testable, maintainable, and extensible backend code.Preferred QualificationsTrack record of leading...BackendWork experience placementRelocation- ...have the opportunity of working on optimizing our Persimmons Compiler. Design and build the compiler that converts AI models from... ...Provide technical leadership across the compiler team, mentoring engineers in advanced compiler techniques, and help scale the team as...Flexible hours
$152k - $241.5k
...perceive and understand the world. Today, we are increasingly known as “the AI computing company”.We are searching for a Senior Backend Compiler Engineer with experience in LLVM code generation for an exciting and fun role in our GPU Software organization. Our Compiler team...BackendFull timeRemote workWorldwide$140.3k - $178.1k
...foundational supercomputing platforms that empower engineering, research, security, and product teams.... ...optimize high-throughput, low-latency backend fabrics (RDMA, RoCEv2, 400G/800G).... ...operating procedures (SOPs); mentor and coach mid-level and senior engineers to foster a...BackendFull timeTemporary workLocal areaFlexible hours$152k - $241.5k
...do their best work. Come join the team and see how you can make a lasting impact on the world. We are searching for a Senior Compiler Engineer in our GPU Software organization. We deliver features and improvements that help NVIDIA hardware reach its full potential across...Full time- ...are looking for a dynamic, energetic candidate to join the P4 Language Compiler team in the AMD Network Technology Solutions Group.THE PERSON: We are seeking a candidate who possesses strong engineering skills to tackle complex challenges in P4 compiler and language works...
$152k - $241.5k
...make a lasting impact on the world.NVIDIA is hiring a Senior Compiler Engineer to join our team driving the next generation of GPU systems... ...Pipelines: Design, implement, and maintain custom compiler backends (such as rustc codegen backends and proc-macros) and Rust-native...Full timeRemote work$149.6k - $211.2k
Job Details:Job Description: The Role and ImpactIntel is seeking a talented and motivated GPU Compiler Engineer to help advance the software technologies powering the next generation of Artificial Intelligence (AI), High-Performance Computing (HPC), and accelerated computing...Full timeLocal areaImmediate startShift work$152k - $241.5k
...their best work. Come join the team and see how you can make a lasting impact on the worldWe are looking for a Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and commercial groups around the world...Full timeRemote work$184k - $287.5k
...and understand the world. Today, we are increasingly known as “the AI computing company”.We're looking for a Senior Performance Compiler Engineer to join our team and work on the open-source Triton compiler project. This opportunity involves working with new technologies...Full timeRemote work$184k - $287.5k
...best work. Come join the team and see how you can make a lasting impact on the worldWe are looking for an experienced Compiler Optimization Engineer for an exciting role in our Compute Compiler Team. We deliver features and improvements to CUDA and other compute compilers...Full time$149.6k - $284.58k
Job Details:Job Description: The Role and ImpactIn this position as a Compiler Engineer, you will focus on enhancing and maintaining cutting-edge compiler software tools optimized for Intel processors. Your day-to-day responsibilities will revolve around feature development...Full timeLocal areaImmediate startWorldwideShift work$184k - $287.5k
...inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our team. The ideal candidate brings broad experience across machine...Full timeRemote work$184k - $287.5k
We are seeking for an expert Senior Compiler Engineer to join our Compute Compiler Team, with a focus on upstream engagement with the LLVM ecosystem and advancing NVIDIA’s compiler technology through trusted, sustained participation in open‑source communities. In this role...Full timeRemote work$150.4k - $277.6k
...responsibilities encompass design new language constructions, compiler transformation, and developer tools to the GPU on Apple’s hardware... ...Silicon.Join the compiler team, and you’ll collaborate with engineers across Apple to develop tools and languages to enable...Relocation- ...Experience in AI-First Engineering: Proficiency in AI-first development principles, LLM integration, AI-assisted coding, and AI-powered... ...full-stack product development, including front-end (React JS), backend (Python/Java), APIs, and application architecture....Backend
- ...system — from a laptop to a supercomputer — feel like one seamless engine. Developers can write once, run anywhere, and get state-of-the-... ...the process, join us. About the Role We're looking for a Compiler Code Generation Engineer to design and build the core code...Relocation
$186.9k - $267.7k
...pipelines, lakehouse architectures, and backend services end-to-end—powering real-time CX... ...streaming, and observability while mentoring engineering pods and aligning technical execution... ...code and design reviews, mentor senior and mid-level data engineers, and coordinate...BackendFull timeTemporary workLocal areaFlexible hours- ...Jade Global is hiring a Forward Deployed Engineer for our Native AI Services business within the AI Engineering service line. You will... ...systems, and application design; ability to contribute across backend and user‑facing components. ~ Deep understanding of LLM application...Backend
- ...business.If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!Staff Backend and Test Engineering P60:We are looking for a self-motivated, data-oriented Backend and Test Engineering based in San Jose, Rose Orchard Fab....BackendFull timeContract work
- We are looking for an outstanding Senior Compiler Engineer to help build the next generation of intelligent compiler technologies for NVIDIA's accelerated computing stack. Our team works at the intersection of compilers, agentic systems, numerical correctness, and verification...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Compiler Engineer (Mid and/or Backend). Be the first to apply!




