Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Cluster Operations Software Engineer

Cerebras Systems

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.The RoleWe are seeking a highly skilled and experienced AI Cluster Operations Engineer to manage and operate our cutting-edge machine learning compute clusters. These clusters would provide the candidate with an opportunity to work with the world's largest computer chip, the Wafer-Scale Engine (WSE), and the systems that harness its unparalleled power.You will play a critical role in ensuring the health, performance, and availability of our infrastructure, maximizing compute capacity, and supporting our growing AI initiatives. This role requires a deep understanding of Linux-based systems, containerization technologies, and experience with monitoring and troubleshooting complex distributed systems. The ideal candidate is a proactive problem-solver with expertise in large-scale compute infrastructure, dependable and an advocate for customer success.ResponsibilitiesDeploy, configure, and debug container-based services using Docker.Build and own software solutions that power cluster operations, including monitoring platforms, workflow automation systems, operational dashboards, and reliability tooling.Collaborate with cross-functional teams to translate operational requirements into scalable O&M products and platform capabilities.Develop APIs, automation services, and integrations that improve operational visibility, incident response, and fleet management across global AI infrastructure.Manage and operate multiple advanced AI compute infrastructure clusters.Monitor and oversee cluster health, proactively identifying and resolving potential issues.Maximize compute capacity through optimization and efficient resource allocation.Provide 24/7 monitoring and support, leveraging automated tools and performing hands-on troubleshooting as needed.Handle engineering escalations and collaborate with other teams to resolve complex technical challenges.Stay up-to-date with the latest advancements in AI compute infrastructure and related technologies.Skills And Requirements6-8 years of relevant experience in managing and operating complex compute infrastructure, preferably in the context of machine learning or high-performance computing.Proficient in Python and Go, with experience building operational platforms, workflow automation systems, and reliability tooling for large-scale infrastructure environments.Experience and Expertise in distributed systems is a must.Deep understanding of Linux-based compute systems and command-line tools.Extensive knowledge of Docker containers and container orchestration platforms like k8s.Proven ability to troubleshoot and resolve complex technical issues in a timely and efficient manner.Experience with monitoring and alerting systems.Should have a proven track record to own and drive challenges to completion.Excellent communication and collaboration skills.Ability to work effectively in a fast-paced environment.Willingness to participate in a 24/7 on-call rotation.Preferred Skills And RequirementsOperating and Managing large scale AI clusters.Knowledge of technologies like Ethernet, RoCE, TCP/IP, etc. is desired.Knowledge of cloud computing platforms (e.g., AWS, GCP, Azure).LocationSF Bay Area.Toronto, Canada.Bangalore, India.Why Join CerebrasPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Find out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking advancements in AI!Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.LocationSunnyvale, CA; Bengaluru, IND; Toronto, CANEmployment TypeFull timeLocation TypeHybridDepartmentSoftware Engineering

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Cluster Operations Software Engineer in Sunnyvale, CA vacancy
  •  ...-speed inference.About the RoleWe build and operate the software systems that deploy, validate, and manage AI compute clusters across data centers worldwide for the world’...  ...validation, and operational handoff.As a Software Engineer on the Cluster Deployment Automation team,... 
    Suggested
    Worldwide

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  •  ...and deployment of large-scale AI/ML clustered infrastructure. You will be working with...  ...a growing team of multi-disciplined engineers that operates across industry verticals as subject...  ...user of AI agents and toolsProfessional software development experience, including... 
    Suggested
    Flexible hours

    AMD

    Santa Clara, CA
    3 days ago
  • $139k - $204k

     ...accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers...  .... About The Role As part of the Cluster Orchestration team, you will play a key...  ...possible with AI. What You’ll Do As a Senior Software Engineer I (IC3), you will own multiple services... 
    Suggested
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $140k - $240k

     ...czar for the Cerebras’s AI cluster product. Such AI clusters have...  ..., security-first based engineering. Cerebras cluster involves complex...  ...cluster management software stack - all the way from a bare...  ...deployment that brings up an operational cluster to a suite of cluster... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $160k - $275k

     ...availability. MatX is seeking System Software Engineer to join our team as we create best-in-...  ...Linux kernel drivers up through node and cluster management. The team also co-owns the...  ..., inventory, telemetry, and control operations through endpoints (e.g., Redfish-style... 
    Suggested
    Daily paid
    Full time
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    2 hours ago
  • $184k - $287.5k

    NVIDIA DGX Cloud is building and operating large-scale GPU infrastructure for AI research...  ...workloads. We are looking for Senior Software Engineers to help build the automation, tooling,...  ...and operational systems that make GPU clusters reliable, scalable, and safe to run.... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $176k - $276k

     ...looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. we...  ...most exciting computing hardware and software to contribute to the latest...  ...infrastructure environments, to automate operational monitoring and alerting, and to... 
    Full time

    Nvidia

    Santa Clara, CA
    8 hours ago
  •  ...programming experience for a contract role in Sunnyvale, California. The ideal candidate will have expertise in setting up VMs, maintaining cluster high availability, and configuring OVA installers. While VCP certification is not required, strong knowledge in these areas is... 
    Contract work

    cognizant technologies

    Sunnyvale, CA
    3 days ago
  • $174k - $252k

     ...inputs and physical synthesis tool runs.Engineer modular carve-outs of our flow to run seamlessly...  ...experience. 5 years of experience with software development in C++.3 years of experience...  ...in multiple areas of machine learning, operation research, compiler construction,... 

    Google

    Mountain View, CA
    3 days ago
  • $136k - $218.5k

     ...their best work. Come join the team and see how you can make a lasting impact on the world.We are currently looking for a Software/CAD Automation Engineer to join our team! In this role you'll be building solutions to boost productivity and efficiency of our custom circuit... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $165.2k - $223.6k

     ...stack of hardware, firmware, and software to deliver unparalleled...  ...for an experienced software engineer to drive development for new...  ...knowledge of ML frameworks and cluster management is highly preferred...  ...build processes, testing, and operations experience- Bachelor's degree... 
    Internship
    Local area
    Flexible hours

    Amazon

    Santa Clara, CA
    8 hours ago
  • $187.74k - $234k

     ...What you'll do... Position: Senior Software Engineer Location : 1375 Crossman Avenue, Sunnyvale, CA, 94089 Duties: Assess gaps/updates...  ...-scale data processing and transformation on distributed clusters. Experience writing code using object-oriented programming... 
    Full time
    Temporary work

    Walmart

    Sunnyvale, CA
    4 days ago
  • $144.7k - $221.4k

     ...results into clear feedback for engineering and leadership, and help...  ...introspect autonomous driving software performance at interfaces...  ...that summarize, aggregate, and cluster metrics produced by...  ...behavior across diverse scenes and operational domains. Develop and apply methods... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...possible? We're a collaborative group of engineers, architects, and SREs who are passionate...  ...schedulers. We are looking for Senior Software Engineer who will be directly involved in...  ...scheduler output.Familiarity with networking, cluster topology, cloud infrastructure, or large... 
    Full time

    Nvidia

    Santa Clara, CA
    8 hours ago
  • $152k - $241.5k

     ...looking for a highly motivated senior software engineer for an exciting role in our communication...  ...(e.g. UCX for MPI/OpenSHMEM) on GPU clusters.Participating in and contributing to...  ...understanding of computer system architecture and operating systems.Experience with parallel... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

    We are now looking for a Senior Software Engineer for AI Resiliency!At NVIDIA, we are pushing the...  ...will be crucial in driving down cluster downtime towards zero, ensuring that our...  ...and HPC environments, ensuring seamless operation of AI training and inference workloads.... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $193.3k - $261.5k

     ...at scale.We are looking for a Senior Software Development Engineer to join the ENA Express team. You...  ...best from their network, including HPC clusters, large-scale ML training, financial...  ...best practices across the team• Drive operational excellence: build observability,... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $320k

     ...and a fully optimized NVIDIA AI and HPC software stack. NVIDIA NVLink Fusion will enable...  ...Software, Architecture, Networking and Systems engineering teams in defining the architecture for...  ...from the crowd:Knowledge of cloud and cluster level deployment and management systems.... 
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $165.2k - $223.6k

    We are seeking an experienced engineer to work on distributed AI/ML...  ...involves working on collective operations - the fundamental operations...  ...on features for the largest clusters, with the largest customers,...  ...AWS and develops hardware and software components that are critical... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $152k - $241.5k

     ...are looking for highly motivated Senior Software Engineers to join our Fabric Networking team...  ...including provisioning, monitoring, and operational readiness.Create automation, dashboards...  ..., CUDA, and large-scale AI/HPC clusters such as NVIDIA GB200 NVL72.Strong understanding... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team within the Isaac Engineering org! You will join a group...  ...products).Experience with large-scale model training on GPU clusters, including VLMs or other foundation models.Publications at top... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...looking for a motivated Deep Learning engineer to bring advanced CUDA features...  ...performance benchmarking on AI clusters. Familiarity with at least one...  ...architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)Adaptability and... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:...  ...responsible for building and operating large-scale, highly reliable,...  ...the company.As a Software Engineer on the AI infrastructure team...  ...on large-scale Kubernetes clusters to support inference, pre-... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    1 day ago
  • $100k

     ...solutions must evolve to unify innovations in software models, compilers, platforms, networking...  ...’s fastest, most efficient AI compute clusters. TT-Fabric is the high-performance...  ...in this posting.Who We AreStrong systems engineer with deep C or C++ experience and comfort... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    1 day ago
  •  ...compiler technologies and advanced engineering principles to drive...  ...performance for specific AI operations. Develop & Optimize Models:...  ...integrating graph compilers. Software Engineering Best Practices:...  ...resource utilization across clusters. Compiler Optimization: Thorough... 

    AMD

    Santa Clara, CA
    3 days ago
  • $193.3k - $261.5k

     ...stack of hardware, firmware, and software to deliver unparalleled...  ...for an experienced software engineer to drive development for new...  ...knowledge of ML frameworks and cluster management is highly preferred...  ...build processes, testing, and operations experience- Bachelor's degree... 
    Internship
    Local area
    Flexible hours

    Amazon

    Santa Clara, CA
    8 hours ago
  • $125.7k - $194.8k

     ...started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast...  ...network issuesExperience with deploying and managing Kubernetes clusters, Istio, etc.Working knowledge of disaster recovery process and... 
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    1 day ago
  • $150.08k - $234k

     ...What you'll do... Position: Software Engineer III Job Location: 1375 Crossman Avenue, Sunnyvale, CA 94089 Duties: Demonstrates up...  ...data structures and algorithms. Experience administering Kafka clusters and managing Kafka topics and partitions. Experience with... 
    Full time
    Temporary work

    Walmart

    Sunnyvale, CA
    4 days ago
  • $152k - $241.5k

     ...datacenter workloads on GPU-accelerated clusters. You will turn telemetry and workload data...  ...with OS, container, GPU, and systems engineers. When useful, you will apply machine learning...  .../prediction) inside existing software workflows.What we need to see:5+ years analyzing... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    8 hours ago
  • $124.92k - $171.77k

     ...SiTime is changing the timing industry. For more information, visit: .Job SummaryWe are seeking a Production Software Engineer to support our manufacturing operations through software development, optimization, and real-time troubleshooting. In this role, you will work... 

    SiTime

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Cluster Operations Software Engineer. Be the first to apply!