Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Systems Engineer - AI Infrastructure

$150k - $230k

Clockwork.io

Job Description

Job Description

About Clockwork Systems

Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization

Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.

To learn more, visit About the Role

We're building infrastructure for fault-tolerant, high-performance distributed GPU training. You'll work at the intersection of GPU systems, high-speed networking, and distributed coordination—designing and implementing systems that run at scale.

This is a systems building role. You'll dig into internals, understand why things break under pressure, and design solutions that handle the messy reality of distributed systems.

What You'll Do
  • Design and implement low-level systems software for GPU clusters
  • Work with internals of frameworks like PyTorch, NCCL, CUDA runtime—not as a user, but modifying and extending them
  • Build components that make large-scale GPU training more reliable and efficient
  • Debug complex distributed/concurrent systems where failures are subtle and non-deterministic
  • Own systems end-to-end: from design through production
What We're Looking For

Required: Systems building experience

You've designed and built complex systems—not just deployed or operated them. Examples:

  • Kernel subsystems, device drivers, or OS-level components
  • Distributed storage, databases, or coordination systems
  • Runtimes, profilers, or performance tooling
  • Network stacks, protocols, or high-performance I/O systems
  • Large-scale infrastructure at the systems layer

Core technical skills:

  • Strong C/C++ in systems contexts (not just application code)
  • Deep understanding of concurrency, memory models, and failure modes
  • Experience reasoning about distributed system behavior: consistency, ordering, partial failures
  • Comfortable reading and modifying large, unfamiliar codebases

Nice to have:

  • GPU programming (CUDA) or GPU systems experience
  • High-performance networking (RDMA, InfiniBand)
  • ML framework or runtime internals
  • Cluster scheduling or orchestration systems

We believe strong systems engineers pick up domain-specific tools quickly. We value your ability to reason about complex systems over checkbox familiarity with our specific stack.

Senior Expectations
  • Lead design of significant system components
  • Navigate ambiguity and define technical direction
  • Mentor engineers and raise team capabilities
  • 8+ years building systems software

Enjoy

  • Challenging projects.
  • A friendly and inclusive workplace culture.
  • Competitive compensation.
  • A great benefits package.
  • Catered lunch.

Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $230,000. In addition to cash compensation, this role is eligible to participate in the company's equity program , which may include stock options granted in accordance with the company's equity plan and subject to approval and applicable vesting schedules.

Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Systems Engineer - AI Infrastructure in Palo Alto, CA vacancy
  • $131k - $175k

     ...awards, such as Best Engineering Team, Best Company for...  ...You’ll Work With As a Senior Rack Solution Engineer...  ...for the world’s largest AI and cloud deployments....  ...of AI and cloud infrastructure—translating cluster architectures...  ...layouts and cabling systems, including fiber/... 
    Senior
    Remote work
    Flexible hours

    Arista Networks

    Santa Clara, CA
    1 day ago
  • $174k - $252k

    Write and test product or system development code in...  ...large-scale infrastructure, distributed systems or...  ...accessible technologies or engineering highly reliable, planet...  ...developing Generative AI applications or LLM-based...  ...globally. As a Senior Software Engineer on the... 
    Senior

    Google

    Mountain View, CA
    1 day ago
  • $144k - $236k

     ...world-class software engineering team, you will help build...  ...the next-generation infrastructure and platforms that power...  ..., business, and AI-first future. This includes...  ..., storage systems, streaming platforms,...  ...EngineeringExperience level: Mid-Senior LevelIndustry: Internet
    Senior
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    1 day ago
  • $184k - $287.5k

     ...is looking for a top-tier Software Test Engineer to join the NVIDIA-Cumulus Linux Verification...  ...qualification of the Network Operating System software that powers data centers that...  ...-defined to meet the exploding growth in AI and high-performance computing.What you'll... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    3 days ago
  • $193.93k - $291.15k

     ...scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses...  ...protocols. About the Work Engineered Connectivity: Architect a network bonding...  ...Tools:  Wireshark  About You Systems Thinker: You have a deep understanding of... 
    Senior
    Full time
    Remote work

    Nuro

    Mountain View, CA
    1 day ago
  • $198k - $326k

     ...world-class software engineering team, you will take the...  ...building the next-generation infrastructure and platforms for...  ..., best-in-class AI/ML infrastructure, Kubernetes...  ..., API design and systems design, and your passion...  ...EngineeringExperience level: Mid-Senior LevelIndustry:... 
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA is hiring experienced software engineers to help scale up its AI Infrastructure. We expect you to have significant software engineering experience with...  ...part of an DGX Cloud team responsible for production systems that enable large scalable GPU clusters to be used... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...entity.We're building the observability layer for AI-assisted software development, measuring how much of an engineering org's code is actually written by AI coding...  ...Responsibilities What You'll DoBuild the core systems that detect and attribute AI-generated code at... 
    Senior
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    3 days ago
  • $196k - $236k

     ...TeamThe End-to-End (E2E) Feature and Homologation team brings systems engineering focus and discipline to Zoox mobility-as-a-service deployment...  ..., and life insurance.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Relocation package

    Zoox

    Foster, CA
    8 hours ago
  • $173.9k - $235.2k

     ...like to build massively scalable systems that are used by the world's largest cloud infrastructures?Would you enjoy broad yet...  ...in this role?Deeply technical engineers, who stay close to the customer...  ...powers EC2, every rack that runs AI/ML workloads, every piece of capacity... 
    Senior
    Contract work
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $152k - $253k

    Join NVIDIA as a Senior System Mechanical Engineer and help build the systems powering the future of AI and accelerated computing!In this role, you’ll work alongside a collaborative...  ...systems for GPU and LPU-based AI infrastructure—from early concept through production—... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $175k - $239k

     ...Assurance - SDMA /Full-time /HybridZoox’s System Design and Mission Assurance (SDMA) team...  ...trustworthy, innovative, and pragmatic safety engineering. As a Platform System Vehicle Test...  ...skills.We may use artificial intelligence (AI) tools to support parts of the hiring process... 
    Senior
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    4 days ago
  • $184k - $287.5k

     ...the boundaries of innovation and engineering? At NVIDIA, we lead the world...  ...computing—driving progress in AI, graphics, and high‑performance systems.As a Senior Hardware Systems Engineer, you...  ...Familiarity with hyperscale data center infrastructure, including cooling methods,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $180k - $215k

     ...company has developed an artificial intelligence (AI) powered technology stack purpose-built for...  ...U.S. Department of Defense.We are looking for a Senior Software Engineer to build infrastructure, tools, and systems that support our Planning team to develop, debug,... 
    Senior
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    4 days ago
  • $193.93k - $291.15k

     ...immediate and profound opportunity for AI to drive positive change in the...  ...RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data...  ...Platform Engineering, or Distributed Systems.Resource Provisioning: Deep... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $174k - $252k

    Help run a highly reliable infrastructure that's responsible for billions...  ...designs as we build the next-gen AI/LLM-powered Ads serving...  ...resource savings.Build automation systems and related tools to operate...  ...Automation.Google's software engineers develop the next-generation... 
    Senior

    Google

    Mountain View, CA
    3 days ago
  • $184k - $287.5k

    We are looking for a Network/Storage Test Engineer to join our End-to-End Cloud solution...  ...defining of Networking industry-leading systems and will bring with him an ability of the...  ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $183k - $275k

     ...profound opportunity for AI to drive positive...  ...many different bench-top systems to evaluate and...  ...road. You will own the infrastructure that makes this possible...  ...tools, and much much more.Engineers across the company...  ...deliver, and you've briefed senior engineering leadership... 
    Senior
    Temporary work
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $150k - $250k

     ...looking for a talented, driven Senior Software Engineer to build the critical infrastructure that powers trading on Aptos.This...  ...significant impact and visibility - the systems you build will directly enable...  ...(a plus)Comfortable leveraging AI tools to enhance productivity... 
    Senior
    Full time
    Work experience placement
    Work at office
    Local area

    Aptos Labs

    Palo Alto, CA
    3 days ago
  • $193.93k - $352.29k

     ...immediate and profound opportunity for AI to drive positive change in the physical...  ...investors.About the RoleThe Autonomy ML Infrastructure team is responsible for building & improving...  ...model compression. Work with autonomy engineers to optimize, validate, and deploy large... 
    Senior
    Work experience placement
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $188.5k - $282.7k

     ...innovation and solving complex engineering problems for our customers....  ...technical solutions ensuring system scalability and meeting high...  ...businesses with their data when infrastructure is attacked.Rubrik provides...  ...and Accelerating the World's AI TransformationRubrik (RBRK),... 
    Senior
    Local area

    Rubrik

    Palo Alto, CA
    4 days ago
  •  ...MetAntz, a fast-moving AI startup in Palo Alto, seeks experienced software engineers who thrive in ambiguity and want to own end-to-end services from design to production...  ...frontends, backends, and cloud-native distributed systems, delivering reliable APIs and scalable... 
    Senior

    MetAntz

    Palo Alto, CA
    3 days ago
  • $193.93k - $352.29k

     ...and profound opportunity for AI to drive positive change in the...  ...we are looking for talented engineers to join us and be...  ...the following areas: Onboard Systems, Performance, and Devices Platform...  ...profiling and tracing tools and infrastructure (perf, eBPF, Perfetto, pprof,... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $193.93k - $352.29k

     ...and profound opportunity for AI to drive positive change in the...  ...we are looking for talented engineers to join us and be...  ...Platform, Simulation, and Technical Infrastructure.Data Platform: The Data Platform...  ...as a comprehensive management system for Nuro AI Driver's data, labels... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • An innovative AI solutions company is seeking a Senior DevOps Engineer to architect and maintain the core infrastructure supporting cutting-edge AI applications. The role involves designing...  ..., and championing best practices in system reliability. Ideal candidates should... 
    Senior
    Full time
    Remote work
    Flexible hours

    New Code Inc

    Palo Alto, CA
    3 days ago
  • $185k - $230k

     ...looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data Platform team...  ...and develop the foundational systems that power the flow of data...  .../ lineage systemsAbout Otter.ai We are in the business of... 
    Senior
    Permanent employment

    Otter.ai

    Mountain View, CA
    8 hours ago
  • $193.93k - $352.29k

     ...immediate and profound opportunity for AI to drive positive change in the...  .... What is not fungible is the infrastructure that decides whether an autonomous system's output can be trusted —...  ...operate autonomously inside Nuro's own engineering organization, under the same standard... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $193.93k - $291.15k

     ...immediate and profound opportunity for AI to drive positive change in the...  ...high-output generalists where ML and systems engineering converge to push autonomy performance forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical bridge... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...impact on the world.We are looking for a senior systems software engineer to advance the Continuous Integration and Delivery (CI/CD) infrastructure that powers many accelerated open-source... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    8 hours ago
  • $224k - $356.5k

     ...into the unlimited potential of AI to define the next era of computing...  ...one? Do you look at a build system, a release pipeline, or a testing...  ...unnecessary? We're looking for a senior engineer to invent, set, and construct the infrastructure and AI direction that enables us... 
    Senior
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Systems Engineer - AI Infrastructure. Be the first to apply!