Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer- AI Workload Orchestration

$188k - $275k

CoreWeave

Job Description

Job Description

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at 

What You'll Do:

As a Staff Software Engineer (IC5) on the AI Workload Orchestration Platform team, you will act as a technical leader for CoreWeave's Kubernetes-native orchestration strategy for AI workloads.

You will define and evolve the architecture for how AI workloads are admitted, scheduled, and governed across large GPU clusters using frameworks such as Kueue, Volcano, and Ray . This platform serves as a strategic complement to SUNK (Slurm on Kubernetes) and underpins both training and inference workloads across the CoreWeave cloud.

This role requires strong systems thinking, cross-team influence, and a long-term view of platform scalability, reliability, and developer experience.

About the role:
  • Own the technical vision and architecture for major portions of the AI Workload Orchestration Platform
  • Design scalable, reliable orchestration primitives for AI workloads across multiple schedulers and runtimes
  • Lead cross-team architecture reviews and drive alignment across infrastructure, CKS, and managed inference teams
  • Define platform standards for reliability, observability, capacity management, and operational excellence
  • Identify and resolve systemic performance, scalability, and fairness issues across large GPU clusters
  • Mentor senior engineers and grow technical leadership within the organization
  • Represent the platform in technical reviews and influence broader CoreWeave platform strategy
Who You Are:
  • 8+ years of professional software engineering experience, with deep expertise in distributed systems or cloud platforms
  • Strong proficiency in Go and experience designing large-scale, long-lived production systems
  • Deep knowledge of Kubernetes internals , scheduling mechanisms, and controller-based architectures
  • Demonstrated experience designing or evolving orchestration, scheduling, or resource-management platforms
  • Proven ability to lead technical initiatives across teams without direct authority
  • Strong operational mindset with experience owning mission-critical systems at scale

Preferred qualifications:

  • Hands-on experience with Kueue, Volcano, Ray , or similar Kubernetes-native orchestration frameworks
  • Background in AI infrastructure, ML platforms, HPC, or large-scale batch and streaming systems
  • Deep understanding of scheduling concepts including fairness, pre-emption, quota management, and multi-tenant isolation
  • Experience defining and operating SLOs , capacity models, and large-scale reliability improvements
  • Contributions to open-source infrastructure or orchestration projects

Wondering if you're a good fit? We believe in investing in our people and value candidates who can bring their diverse experiences to our teams – even if you aren't a 100% skill or experience match.

Why CoreWeave?

At CoreWeave, we work hard, have fun, and move fast!  We're in an exciting stage of hyper-growth that you will not want to miss out on. We're not afraid of a little chaos, and we're constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values: 

  • Be Curious at Your Core
  • Act Like an Owner
  • Empower Employees
  • Deliver Best-in-Class Client Experiences
  • Achieve More Together

We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for takeoff, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us!  

The base salary range for this role is $188,000 to $275,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility). 

What We Offer

The range we've posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance 
  • Voluntary supplemental life insurance 
  • Short and long-term disability insurance 
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement 
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health 
  • Family-Forming support provided by Carrot
  • Paid Parental Leave 
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

California Applicants

California Consumer Privacy Act 

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA) , CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: View email address on ziprecruiter.com.

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency.  CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.

Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer- AI Workload Orchestration in Sunnyvale, CA vacancy
  • $152k

     ...The Resource Fabric Engineering team builds and operates...  ...tools that power the AI lifecycle across...  ...deploy, and manage AI workloads. We develop core services...  ...management, workflow orchestration, model lifecycle...  ...We are looking for a Staff Software Engineer to lead the... 
    Suggested
    Temporary work
    Flexible hours

    Coupang

    Mountain View, CA
    2 days ago
  • $190.9k - $334.1k

     ...all started when engineer Fred Luddy wrote code...  ...ServiceNow is the AI control tower for...  ...seeking a Senior Staff Reliability Engineer...  ..., including workload migration strategies...  ...node management, pod orchestration, resource quotas,...  ...industry.12+ years in software engineering or... 
    Suggested
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $182k - $242k

     ...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers...  ...25. Learn more at  About the Role As a Senior Software Engineer II (IC4) on the AI Workload Orchestration Platform team, you will help build and operate CoreWeave... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  • $185k - $275k

     ...Essential Cloud for AI™. Built for pioneers...  ...part of the Cluster Orchestration team, you will play a...  ...the AI cloud: ensuring workloads run seamlessly, reliably...  ...What You'll Do As a Staff Engineer, you will be a...  ...You Are ~8+ years of software engineering experience... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  •  ...areMoveworks is the Agentic AI Assistant platform that...  ...Moveworks’ Reasoning Engine and natural language...  ...DescriptionThe RoleAre you a software engineer who has honed...  ...the role for you.As a staff software engineer on...  ...following areas: agent orchestration, sandboxed file systems... 
    Suggested
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    2 days ago
  • CoreWeave is seeking a Senior Software Engineer II (IC4) for the AI Workload Orchestration Platform in Sunnyvale to build and operate a Kubernetes-native AI workload platform. You will own components end-to-end, drive reliability and performance, and scale the system as... 

    Neura Market

    Sunnyvale, CA
    4 days ago
  • $192k - $260k

    Staff Software Engineer - Distributed Data Systems P-186 Get AI-powered advice on this job and more exclusive features. At...  ...Databricks with their mission‑critical workloads, making us one of the fastest...  ...pipelines, enabling orchestration and operation of thousands of... 
    Work at office
    Local area

    Databricks

    Mountain View, CA
    4 days ago
  • $220k - $250k

     ...only vertically integrated AI infrastructure company built...  ...world's most ambitious AI workloads. When you join Crusoe, you...  ...actively seeking an exceptional Staff Software Engineer for our cloud software team...  .... Your expertise in orchestration and optimization will be instrumental... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    3 days ago
  • $300 per month

     ...the only vertically integrated AI infrastructure company built...  ...world's most ambitious AI workloads. When you join Crusoe, you join...  ...s Data Center Infrastructure Engineering (DCIE) team is fundamental to...  ...highly skilled and motivated Software Engineer to join Crusoe’s Data... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    26 days ago
  • $174k - $252k

     ...architectural direction for token orchestration and distribution across...  ...years of experience with software development in one or...  ...Experience in Generative AI.Google's software engineers develop the next-...  ...deterministic AI agents and workloads. Our team bridges the gap... 

    Google

    Sunnyvale, CA
    4 days ago
  • $160k - $200k

     ...leading the revolution in AI data center...  ...3D-stacked photonics engine, Passage™, capable of...  ...most advanced AI and HPC workloads. Lightmatter raised...  ...Operating Life (HTOL) Test Software system. Your work will...  ...HTOL testing system. Orchestration: Develop containerized... 
    Full time
    Temporary work
    Flexible hours

    Lightmatter

    Mountain View, CA
    1 day ago
  • $193.93k - $352.29k

     ...profound opportunity for AI to drive positive...  ...inside Nuro's own engineering organization,...  ...real systems: orchestration, sandboxing and isolation...  ...where an internal workload justifies it, and...  ...~5+ years of software engineering experience...  ...experience. Staff-level candidates should... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    8 days ago
  • $207k - $300k

    Analyze and optimize AI inference workloads across the application, model, and distributed fleet...  ...degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics...  ...experience.8 years of experience in software development.Experience in Python and... 

    Google

    Mountain View, CA
    2 days ago
  • $207k - $300k

     ...models and APIs, while mentoring engineers and upholding architectural...  ...degree in Computer Science, AI/ML, Data Systems, Information...  ....8 years of experience in software development.5 years of experience...  ..., and optimize their workloads and infrastructure across Google... 

    Google

    Sunnyvale, CA
    4 days ago
  • $214k - $261.5k

     ...devices.OverviewWe’re seeking a Senior Staff Software Engineer to lead the evolution of Dolby Vision...  ...video processing and GPU‑intensive workloads.Architect scalable, future‑proof Dolby...  ..., SIMD, and CPU/GPU workload orchestration for real‑time performance.Excellent debugging... 
    Full time
    Local area
    Worldwide
    Flexible hours

    Dolby

    Sunnyvale, CA
    4 days ago
  • $207k - $300k

     ..., controlling and tuning I/O workloads to mitigate performance bottlenecks...  ....8 years of experience in software development.5 years of...  ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a...  ...combine the best of Google AI, software, and hardware. Teams... 

    Google

    Mountain View, CA
    2 days ago
  • $207k - $300k

     ...experience. 8 years of experience in software development.5 years of...  ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related...  ...’s production and research workloads, like Gemini and other open-source models.The AI and Infrastructure team is... 
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  •  ...builds the world's largest AI chip, 56 times larger than...  ...scale, transforming key workloads with ultra high-speed inference...  ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize...  ...Kubernetes or comparable orchestration systems, observability, CI... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $190k - $300k

     ...the potential of generative AI to power the transformation...  ...We are at the forefront of software and hardware innovation, pushing...  ...consider remote.The Role: Staff Software Engineer, SIMD KernelsWhat you will do...  ...commonly used in ML workloads—GEMMs, Convolutions, softmax... 
    Work experience placement
    Remote work

    d-Matrix

    Santa Clara, CA
    4 days ago
  • $190.9k - $334.1k

     ...DescriptionIt all started when engineer Fred Luddy wrote code that...  .... Today, ServiceNow is the AI control tower for business reinvention...  ...most sensitive data and workloads to the cloud, accelerating...  ...We are looking for a Senior Staff IAM Software Engineer to bring full stack... 
    Permanent employment
    Work at office
    Immediate start
    Remote work
    Worldwide
    Relocation
    Flexible hours

    ServiceNow

    Santa Clara, CA
    1 day ago
  • $100k

     ...the industry on cutting-edge AI technology, revolutionizing...  ...evolve to unify innovations in software models, compilers, platforms...  ...a highly technical Senior Staff/Principal Engineer to lead the porting and enablement of critical AI workloads. You will be a primary... 
    Permanent employment
    Remote work

    Tenstorrent

    Santa Clara, CA
    3 days ago
  •  ...computing and Confidential AI for hybrid and multicloud environments...  ...and manage confidential workloads and AI, reduce data...  ...and security. The Role Staff Software Engineer (Rust) - Confidential...  ...and confidential workload orchestration Architect and evolve our... 
    Full time
    H1b

    Fortanix

    Santa Clara, CA
    1 day ago
  •  ...builds the world's largest AI chip, 56 times larger...  ..., transforming key workloads with ultra high-speed...  ...developer velocity and engineering productivity.Identify...  ...professional experience in software engineering,...  ...containerization and container orchestration, with Kubernetes... 

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $175k - $287k

     ...outside the public cloud providers. As a Staff Software Engineer on the Compute Infrastructure team,...  ...processing petabytes daily, and the AI/ML infrastructure driving...  ...work on problems that span large-scale workload orchestration, multi-cluster operations, platform... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    1 day ago
  • $90k - $180k

     ...WorkflowsBuild agentic AI services (planning,...  ...systems and APIs. Implement orchestration, memory, tooling,...  ...to design reviews and engineering best practices. Mentor...  ...Tech. We’re a team of software engineers, data scientists...  ...data science workloads with RAPIDS, and delivering... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    4 days ago
  • $179.5k - $260k

     ...company building a next-generation AI-driven operations platform,...  ...re looking for an Applied AI Engineer with strong backend and AI...  ..., real-time operational workloads. Integrate LLMs and GenAI...  ...including fine-tuning, prompt orchestration, retrieval pipelines, and evaluation... 
    Full time
    Flexible hours
    Night shift

    Fortinet

    Sunnyvale, CA
    5 days ago
  • $145k - $235.5k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything...  ...an AI-Native Cloud FinOps Engineer , you will build intelligent...  ...efficiency as a continuous software feature, you will leverage AI...  ...and optimize high-cost AI/ML workloads. Programmatically manage... 
    Full time
    Work at office
    Local area
    Visa sponsorship
    Work visa
    Shift work

    Palo Alto Networks

    Santa Clara, CA
    2 days ago
  • $209.7k - $283.8k

     ...experimentation, attribution, and AI-driven decision-making...  ...sound. We are seeking a staff ML engineer to design and evolve the large...  ...training datasets, orchestrating ML workflows, and enabling efficient...  ...increasingly complex training workloads. You will play a key role... 
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    5 days ago
  •  ...the world's largest AI chip, 56 times larger...  ...scale, transforming key workloads with ultra high-speed...  ...We're hiring a Staff Engineer to own major areas of...  ...years of experience in software engineering, with substantial...  ...networking, compute orchestration, container platforms,... 
    Full time

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $139k - $204k

     ...is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...As part of the Cluster Orchestration team, you will play a key role...  ...layers of the AI cloud: ensuring workloads run seamlessly, reliably,...  ...What You'll Do As a Senior Software Engineer I (IC3), you will own... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer- AI Workload Orchestration. Be the first to apply!