Senior ML Compiler Engineer

Job Description
You will design and build core components of our ML compiler, owning critical parts of the transformation and optimization pipeline.

Your work will directly determine whether models fit within hardware constraints and achieve real-time performance.

What You'll Do

• Design and implement compiler architecture across:
• IR design and transformation pipelines
• Optimization strategies for scheduling, tiling, and memory reuse
• Lead development of complex compiler passes such as:
• Global memory allocation and liveness-driven reuse
• Cross-operator fusion and graph partitioning
• Hardware-aware scheduling strategies
• Develop cost models and optimization heuristics
• Explore advanced techniques:
• Constraint-based optimization (e.g., ILP/MILP/CP)
• Scheduling optimization
• Drive debugging of system-level issues (correctness, performance, HW mismatches)
• Collaborate with hardware teams on co-design of abstractions and execution models

Requirements

Required qualifications and experience:

• 4+ years of experience in compilers, systems, or performance engineering
• Masters or PhD in Computer Science, Electrical Engineering, Math, or a related field
• Deep experience with at least one:
• ML compiler frameworks (MLIR, TVM, XLA, etc.)
• Low-level optimization (scheduling, memory, tiling)
• Proven ability to design non-trivial compiler systems or passes
• Strong intuition for performance across compute, memory, and data movement
• Comfort working with hardware constraints

Nice to have:

• Experience with constraint solvers (MILP, ILP, CP)
• Background in accelerator architectures or embedded systems
• Experience optimizing ML workloads for latency/power
• Familiarity with DSP or real-time signal processing

Benefits

• 401(k)
• Medical insurance
• Vision insurance
• Dental insurance
• Commuter benefits
• Disability insurance
• Paid maternity leave
• Paid paternity leave
• Child care support

femtoAI is an equal opportunity employer committed to a diverse workforce which strives to create an inclusive working environment empowering everyone to do their best work. We do not discriminate on the basis of race, ethnicity, religion, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status.