Engineering Manager, Compiler & Runtime
$200k - $400kNormal Computing Corporation
Normal Computing | Build with Us
Normal is an applied AI company solving the hardest problems in AI and silicon. We build foundational hardware and software for the semiconductor industry, critical AI infrastructure, and the broader systems that power our world, in partnership with the world's most advanced institutions. We work as one team across New York City, Silicon Valley (Mountain View), London, Copenhagen, and Seoul.
The Role
Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. As Engineering Manager, Compiler & Runtime, you will build and lead the team that writes the core of it: the compiler that takes PyTorch models to our hardware, the runtime that executes them, and the kernels in between.
This is a people-leadership role on a technical team. You will hire the team, plan its work against the hardware program, and partner with our senior compiler architect, who sets the team's technical direction. Our chip is pre-silicon, so the team builds against simulators and FPGA prototypes first.
What You Will Own
Team Building : Grow the compiler and runtime team from its first engineers, set the hiring bar, and develop each engineer's growth and career.
Delivery : Turn the Systems Software roadmap into plans, milestones, and staffing for the compiler, runtime, and kernels, and deliver against them. Success means LLMs run end to end on our hardware through PyTorch.
Technical Partnership : Work with our compiler architect so that technical decisions get made, staffed, and finished. Stay close enough to the work to review designs and weigh trade-offs.
Cross-Team Coordination : Coordinate with the hardware team, which owns drivers and firmware, and with the serving and simulation work that depends on the compiler and runtime.
Simulation-to-Silicon Continuity : Keep the compiler and runtime working against simulators, FPGA prototypes, and silicon as the hardware matures, so software development never waits on tapeout.
Engineering Practices : Set up the testing, release, and review practices that make the stack reliable enough to ship to customers.
What Makes You a Great Fit
Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware
Track record of hiring and mentoring strong systems engineers
Enough depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers
Experience delivering software against a hardware schedule, from simulation through bring-up
Familiarity with state of the art ML compiler stacks and with LLM inference workloads
Bonus Points
Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative
Experience with in-memory compute, processing-in-memory, or analog hardware interfaces
Experience shipping an SDK or software product to external customers
Equal Employment Opportunity Statement
Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.
Accessibility Accommodations
Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at View email address on aiapply.co.
Privacy Notice
By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice .
$200k - $350k
...next-generation AI compute platforms. In this role, you'll work on compiler technologies, AI runtimes, graph optimization, and hardware-aware execution in close collaboration with inference engineers, ML scientists, and hardware specialists. You'll leverage modern AI...Suggested$168k - $270.25k
...performance data centers.NVIDIA's compiler technologies are key enablers... ..., and large-scale systems engineering. To address these complex... ...we are seeking an Engineering Manager to spearhead our strategy for... ...CUDA software, ML framework, runtime, product, and AI software teams...SuggestedFull time- ...but to help redefine the future of how work gets done. Engineering Manager – Spark Runtime Engineering Location: Bellevue, WA or Menlo Park, CA... ...Spark APIs and semantics they rely on. We build the compiler and runtime integration that translate Spark workloads into...Suggested
- ...Corporation in Santa Clara, CA, is seeking an Engineering Manager to lead a technical team focused on verifying AI compilers for next-generation deep learning workloads.... ...partnering with CUDA software, ML framework, runtime, and product teams to scale verification infrastructure...Suggested
$217k - $271.5k
...Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration... ...entire product ecosystem — and we need a hands-on engineering leader to run it. The Agent Runtime team is a platform team at the heart of Box's AI-...SuggestedLive inWork at officeImmediate startShift work3 days per week$160k - $250k
...across ISA, RTL, simulator, compiler, and kernels so each layer benefits from the others. The runtime owns the host-side stack and... ...interface library — device memory management, DMA, streams and events,... ..., and the Python surfaces ML engineers actually use — and hit measurable...Daily paidFull timeContract workWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours- ...yet in any standard form. The runtime is the layer the rest of that... ...runs through: it is how compiled programs get loaded, scheduled... ...design of the runtime: device management, memory allocation and host-device... ...with compiler and serving engineers so the interface serves them....
$224k - $356.5k
...climatology, fluid dynamics and defense. We support real science and scientists throughout the world.We are now looking for a Compiler Engineering Manager! NVIDIA’s HPC Compiler team is looking to hire a Compiler Engineering Manager to join the team building one of the world...Full timeImmediate startRemote work- The Siri team is looking for an Engineering Program Manager, with a focus on Siri's runtime platform and the next revolution of Siri interaction across the Apple ecosystem.As part of our organization, you will help shape one of the world's most widely used AI assistants...
- ...Mountain View is seeking a senior systems engineer to own the runtime that loads, schedules, and executes... ...arrives, and collaborate with compiler and serving teams to ensure end-to-end... ...lead architecture choices for device management, memory allocation, and host-device transfer...
$272k - $431.25k
The NVIDIA Kubernetes Engine (NKE) team is looking for a technical leader to lead the Runtime Engineering team responsible for the full configuration lifecycle of NKE... ...work across networking, storage, GPU resource management, and cluster security to deliver a production-...Full timeTemporary work$207k - $300k
...and evolve the platform’s APIs and core runtime capabilities to support AI usage flows for... ..., grow, and mentor a team of software engineers, fostering a collaborative and high-velocity... ...role.2 years of experience in a people management or team leadership role.Experience...$182k - $273k
...AI Accelerator Software Principal Engineer - Runtime Library Ampere is a semiconductor design... ...execution, scheduling, and lifecycle management of deep learning workloads across... ...Inference serving and integration layers Compiler/runtime interfaces and graph/IR...Local area$207k - $300k
...Share Engineering Manager, Google AI Compute corporate_fare Google place Mountain View, CA, USA X In most instances, this position requires... .... Architect and evolve the platform’s APIs and core runtime capabilities to support AI usage flows for products like Gemini...$195k - $292k
...deep learning accelerator. You'll work across the full SW/HW stack — from inference serving and framework integration down to compiler, runtime, and compute kernels. What You’ll Achieve Optimize deep learning computational graphs for performance, throughput, and latency...Local area$100k
...to unify innovations in software models, compilers, platforms, networking, and... ...seniorities.We are seeking a GCC Compiler Engineer to design, develop, and optimize compilers... ...compilers with leading ML frameworks and runtime environments.The end-to-end toolchain flow...Permanent employment$184k - $287.5k
...impact on the world.We are seeking an AI Compiler Engineer with deep expertise in compiler... ...Demonstrated measurable outcomes such as runtime gains, compile-time improvements, or efficiency... ...'re a creative and autonomous program manager with a real passion for technology, we...Full timeRemote work$201k - $250k
.../infor about the role. We are looking for an experienced Engineering Manager to lead and scale our skilled team of Backend Software Engineers... ...Docker on top of K8s (pronounced Kubernetes). Language / Runtime: Backend services - Kotlin (on top of the JVM - Java VM). ML...Remote workRelocation package$100k
...unify innovations in software models, compilers, platforms, networking, and... ...it to life. As a Technical Program Manager within our Platform Gen organization... ...ll drive complex, cross-functional engineering initiatives spanning runtime systems, device drivers, deployment...Permanent employment$278.1k - $417.1k
...inside a modern, browser-native runtime (built on technologies such... ...runtime. As our Principal Engineer for On-Device AI Inference &... ...render path, and frame-budget management alongside the renderer.* Architect... ...runtime.* Familiarity with compiler stacks (MLIR, TVM, IREE, XLA)...Work at officeWorldwideRelocation package$152k - $241.5k
We are looking for an outstanding Senior Compiler Engineer to help build the next generation of intelligent compiler technologies for NVIDIA... ...verification infrastructure, and co-designing with NVIDIA's compiler, runtime, library, and hardware teams to bring new capabilities into...Full timeRemote work- NVIDIA Corporation's Deep Learning Engineering team within the Tegra Solutions Engineering organization seeks a Manager to lead a high‑performing group delivering inference... ...at scale, and collaborate with compiler, runtime, and hardware teams to align workloads with...
$207k - $300k
...experience.7 years of experience working in a privacy related field (e.g., security engineering, data engineering, data scientist, compliance engineering etc.).2 years of experience managing, mentoring, and developing a team to drive initiatives and solutions for...$208k - $260k
Palo Alto, CA / San Francisco, CA / New York City, NY / Seattle, WAEngineering - Engineering - Manager /Full-time /HybridJoin us in building a better financial system. Wealthfront is continuing to grow and needs managers who are excited to lead talented teams of engineers...Full time- ...National Security Advisor, and Senior Foreign-Policy Advisor to four US presidents. Key Responsibilities Lead and manage a team of engineers through weekly sprint cycles and delivery milestones Drive sprint planning and execution— from backlog grooming to sprint...Shift work
$202.13k - $269.51k
...Engineering Manager - Water, Gas, and Wastewater Click here for the position brochure The salary range for this position is $202,134.40 - $269,505.60 annually. Become part of this prestigious utility company dedicated to delivering a wide array of City-owned and...Price workFull timeContract workFor contractorsLocal areaImmediate startFlexible hours$236k - $339.25k
...experience can be. The Snowflake Postgres team is building a fully managed, cloud-native Postgres service that delivers the reliability,... ...data experience that seamlessly ties into Snowflake. As an Engineer Manager, you'll help define the architecture, push the...Immediate startFlexible hours$230.1k - $311.2k
At Amazon, Principal Engineers are both technical leaders and hands-... ...chip to server to network to compiler to cloud — so you see your work... ...software stack — compiler, runtime, and ML frameworks — that powers... ...sound judgment, effectively manage stress and work safely and...InternshipLocal areaFlexible hours$184k - $287.5k
NVIDIA is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of AI model deployment. You will shape... ..., focusing on Client AI.Partner with internal compiler, libraries, and research teams to deliver end-...Full timeRemote workWorldwide$262k - $364k
...code to solve ambiguous problems. Review code developed by other engineers and provide feedback to ensure best practices (e.g., style... ...experience with software development.5 years of experience in a people management or team leadership role.2 years of experience with GenAI...Worldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Compiler & Runtime. Be the first to apply!



