Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Compiler & Runtime

Normal Computing Corporation

Normal Computing | Build with Us

Normal is an applied AI company solving the hardest problems in AI and silicon. We build foundational hardware and software for the semiconductor industry, critical AI infrastructure, and the broader systems that power our world, in partnership with the world's most advanced institutions. We work as one team across New York City, Silicon Valley (Mountain View), London, Copenhagen, and Seoul.

The Role

Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. As Engineering Manager, Compiler & Runtime, you will build and lead the team that writes the core of it: the compiler that takes PyTorch models to our hardware, the runtime that executes them, and the kernels in between.

This is a people-leadership role on a technical team. You will hire the team, plan its work against the hardware program, and partner with our senior compiler architect, who sets the team's technical direction. Our chip is pre-silicon, so the team builds against simulators and FPGA prototypes first.

What You Will Own

  • Team Building : Grow the compiler and runtime team from its first engineers, set the hiring bar, and develop each engineer's growth and career.

  • Delivery : Turn the Systems Software roadmap into plans, milestones, and staffing for the compiler, runtime, and kernels, and deliver against them. Success means LLMs run end to end on our hardware through PyTorch.

  • Technical Partnership : Work with our compiler architect so that technical decisions get made, staffed, and finished. Stay close enough to the work to review designs and weigh trade-offs.

  • Cross-Team Coordination : Coordinate with the hardware team, which owns drivers and firmware, and with the serving and simulation work that depends on the compiler and runtime.

  • Simulation-to-Silicon Continuity : Keep the compiler and runtime working against simulators, FPGA prototypes, and silicon as the hardware matures, so software development never waits on tapeout.

  • Engineering Practices : Set up the testing, release, and review practices that make the stack reliable enough to ship to customers.

What Makes You a Great Fit

  • Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware

  • Track record of hiring and mentoring strong systems engineers

  • Enough depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers

  • Experience delivering software against a hardware schedule, from simulation through bring-up

  • Familiarity with state of the art ML compiler stacks and with LLM inference workloads

Bonus Points

  • Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative

  • Experience with in-memory compute, processing-in-memory, or analog hardware interfaces

  • Experience shipping an SDK or software product to external customers

Equal Employment Opportunity Statement

Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.

Accessibility Accommodations

Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at View email address on click.appcast.io.

Privacy Notice

By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice.

#J-18808-Ljbffr

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Compiler & Runtime in New York, NY vacancy
  • $230k - $340k

     ...reliability. We are looking for an Engineering Team Lead to help build and...  ...be an engineer first and a manager second. You will contribute...  ..., routing, build systems, runtime behavior, and developer tooling...  .... Experience with compilers, bundlers, caching, rendering... 
    Suggested
    Work from home
    Worldwide
    Flexible hours

    Vercel Inc.

    New York, NY
    1 day ago
  •  ...with high ownership and trust. The Role We are hiring an Engineering Manager (Embedded) to lead the team that builds the software running...  ...Linux platform, the interfaces to our hardware, the runtime that executes our models on the smallest chips we can, and the... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Work at office
    Flexible hours

    Distributed Spectrum Inc.

    New York, NY
    2 days ago
  •  ...This is a high-impact people leadership role managing engineers focused on a mission-critical domain: building the future of our mobile app...  ...Native, Flutter), ensuring robust SDK integration, optimal runtime performance, and scalable application architecture Release Engineering... 
    Suggested
    Contract work
    Temporary work
    Work from home

    Human Interest

    New York, NY
    3 days ago
  • $160k - $190k

     ...paying for. About the RoleThe New York Times is looking for an Engineering Manager to lead the Compute and Storage team in the Data Platform...  ...Preferred QualificationsExperience with data processing engines and runtimes such as Spark, Trino, Flink, Kafka, Airflow.Experience... 
    Suggested
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    The New York Times

    New York, NY
    3 days ago
  • $165k - $242k

     ...more at .What You'll DoCoreWeave's Fleet Engineering organization owns the lifecycle of every...  ...the RoleWe're seeking an Engineering Manager to lead a full-stack team building Go backend...  ...) and backend services (Go, or another compiled service language).Demonstrated track... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $184k - $287.5k

    NVIDIA is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of AI model deployment. You will shape...  ..., focusing on Client AI.Partner with internal compiler, libraries, and research teams to deliver end-... 
    Full time
    Remote work
    Worldwide

    Nvidia

    New York, NY
    2 days ago
  • $191k - $265k

     ...that makes those guarantees real. We are hiring a Senior Engineering Manager to manage the largely New York-based Storage Execution team....  ...work East Coast hours ~ Strong proficiency in at least one compiled, statically‑typed language such as C++, Rust, or Go; prior... 
    Temporary work
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    New York, NY
    2 hours ago
  • $100k - $220k

     ...Job Description Principal Engineer, AI Platform & Fabrics BMO is building the...  ...Identity Fabric, AI Registry, Guardrails Runtime, and AI Observability. This is a build...  ...code infrastructure (Cedar/OPA), a policy compilation pipeline, GitOps‑based domain‑scoped... 
    Contract work
    Local area

    BMO U.S.

    New York, NY
    1 day ago
  • $194k - $349k

     ...including threading, file I/O, hashing, work queues, and memory management. Every engineering team that builds sensor capabilities depends on this layer...  ...shared platform for on-sensor machine learning inference runtime: a stable C API, backed by an isolated out-of-process... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    New York, NY
    14 hours ago
  • $230k - $285k

     ...Wpromote is seeking a Vice President of Engineering to lead the engineering organization...  ...Polaris supports client and integration management, normalized marketing data, reporting,...  ...coding agents, model providers, agent runtimes, and automation opportunities based on... 
    Contract work
    Temporary work
    Work at office
    Local area
    Remote work

    Wpromote,-LLC-

    New York, NY
    3 days ago
  • $300k

     ...We are looking for an experienced software engineer to work on code generation in the OxCaml compiler, which is open source. OxCaml is Jane Street’s variant of...  ...interested in candidates who have proven experience managing a team of developers, and who would enjoy doing... 
    Worldwide

    Jane Street Group

    New York, NY
    2 hours ago
  •  ...VP Engineering, AI Agents - Legal Tech - North America, UK or EU (Eastern Time Zone for US Based Candidates) Vice President, Engineering...  ...foundation behind production AI agents, including agent development, runtime infrastructure, integrations, reliability, scalability,... 
    Full time

    kadence

    New York, NY
    3 days ago
  • $240k - $270k

     ...Capital. Join us and help build the platform engineers turn to ship AI products. About Baseten...  ...We're looking for an Engineering Manager to lead part of our Inference Performance...  ...working across the inference engine and runtime: kernels, scheduling, batching, KV-cache... 
    Flexible hours

    Baseten

    New York, NY
    1 day ago
  •  ...Engineering ManagerZerohash is looking for an experienced Engineering Manager to lead the team architecting and building our open banking data aggregation platform. This...  ...team of engineers building the core automation runtime, guiding architecture for resilient UI interactions... 
    Work experience placement

    Zero Hash

    New York, NY
    1 day ago
  • $181.22k - $217.46k

     ...close early due to the volume of applicants. Sr Software Engineer, VCL Compiler We are looking for a Compiler Engineer to join our Core...  ...require travel as required by your role or requested by your manager. SF / LA Fair Chance Ordinance Statement Pursuant to... 
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    Webhosting.net

    New York, NY
    1 day ago
  • $170k - $235k

     ...Sigma Computing in New York is looking for an experienced engineer to join the Compiler Team, focusing on optimizing user-driven data analysis into SQL queries. You'll need over 5 years of software engineering experience and a strong understanding of compilers and algorithms... 
    Flexible hours

    Sigma

    New York, NY
    4 days ago
  •  ...Manager of Software Engineering - FDE Forward Deployed Engineering Manager Location: New York City, Dallas, Toronto (Hybrid) The Client: Manager of Software Engineering – Forward Deployed Engineering (AI) I’m partnering with a global technology leader... 
    Full time

    kadence

    New York, NY
    4 days ago
  • $200k - $240k

     ...Engineering Manager, AI Tax Platform NYC · Toronto (hybrid) Our client is building the next generation of AI-powered software for tax and accounting professionals. The company was acquired by a global leader in professional information and software, so you get a startup... 
    Full time

    Primis

    New York, NY
    4 days ago
  • $182k - $242k

     ...in March 2025. Learn more at .What You’ll Do:The Observability Engineering organization at CoreWeave is responsible for the platforms and...  ...cloud environment.About the role:CoreWeave is seeking a Manager, Observability Engineering to lead a team responsible for building... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $120k - $150k

     ...YorkCompany: Guardian GlassCareer Field: Operations & ManufacturingJob Number: 193566Apply: JobGuardian Glass is seeking an Engineering Manager to join our Operations team in Geneva, NY. In this role, you will help shape the future of a high-performing manufacturing operation... 
    For contractors
    Local area
    Home office
    Flexible hours

    Guardian Industries

    New York, NY
    2 days ago
  • $207k - $300k

    Manage, coach, and develop a team of engineers, setting clear expectations, fostering a collaborative and fast-moving engineering culture, and aligning project ownership with individual career growth.Design the long-term technical vision of the team, develop a roadmap... 
    Temporary work

    Google

    New York, NY
    3 days ago
  • $131k - $169k

     ...like you, you’ll fit right in.Who You AreYou are a systems thinker who owns and drives cross-functional engineering initiatives to completion You're comfortable managing ambiguity, removing blockers, and keeping distributed teams aligned on shared outcomes. You build... 
    Casual work
    Work at office
    Local area
    Shift work
    3 days per week

    Justworks

    New York, NY
    1 day ago
  • $212k - $274k

     .... Being able to see the bigger picture, you bring people together to effectively prioritize, craft, and achieve plans. As an Engineering Manager at Justworks, you will help build and oversee a team of software engineers as a player-coach. You are responsible for coordinating... 
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    5 days ago
  • $175k - $185k

     ...industry, join our team as we help shape a brighter way forward. *Onsite five days a week at JFK Airport*What this job involvesThe Engineering Manager leads programmatic oversight of all mechanical and electrical (M&E) systems, focusing on commissioning new installations,... 
    Full time
    Local area

    Jones Lang LaSalle

    New York, NY
    2 days ago
  • $220k - $300k

     ...Kleiner Perkins, Accomplice, Gradient Ventures (Google’s AI Fund), BoxGroup, Village Global, and many more.About the DepartmentThe Engineering Manager role at Secureframe is a key position spearheading the development and refinement of the workforce product set, focusing... 
    Work experience placement
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Secureframe

    New York, NY
    5 days ago
  • $194k - $215k

     ...platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.Engineering ManagerAs an Engineering Manager at Compass, you'll lead high-performing teams building the tools that power daily workflows for hundreds of... 
    Minimum wage
    Full time
    For contractors
    Flexible hours

    Compass

    New York, NY
    3 days ago
  • $240k - $285k

     ...combining global corporate cards and banking with intuitive spend management, bill pay, and travel software, Brex enables founders and...  ...tools, resources, and support you need to grow your career.Engineering at BrexEngineering at Brex is about building systems that scale... 
    Work at office
    Remote work
    Work from home

    Brex

    New York, NY
    1 day ago
  • $193.8k - $285k

    About the TeamDoorDash is looking for an Engineering Manager with strong product sense to oversee building out transportation and logistics strategies for long-distance deliveries across the US. This team is in charge of making big bets to enable DoorDash to think outside... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Long distance
    Flexible hours

    Doordash

    New York, NY
    4 days ago
  • $190k - $225k

    New York, New YorkEngineering (NYC) - Software Engineering /Full Time /HybridABOUT US: Founded in 2020, Regal is the AI Agent Platform....  ...experience in a relevant engineering role1-3 years of experience managing a teamHands-on experience with Python and Typescript, you can... 
    Full time
    Work at office

    Regal Voice

    New York, NY
    4 days ago
  • $165k - $242k

     ...publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at .What You’ll DoYou’ll join CoreWeave’s IaaS organization as the Engineering Manager for the Launch & Sandboxes team. The team owns two connected areas: Sandboxes, cloud execution environments that let... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Compiler & Runtime. Be the first to apply!