Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer II, AI Workload Orchestration

CoreWeave

What You’ll Do

As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and operating AI workloads at scale. This platform integrates multiple orchestration and scheduling frameworks such as Kueue, Volcano, and Ray to support modern AI training and inference workflows. It complements SUNK (Slurm on Kubernetes) by providing a Kubernetes-first, cloud‑native orchestration layer with deep platform integration. You will own meaningful components of the platform, drive reliability and performance improvements, and help scale the system as customer demand and workload complexity continue to grow.

About The Role

  • Design, build, and operate Kubernetes-native services for AI workload orchestration and scheduling
  • Own one or more platform components end-to-end, including design, implementation, testing, and on-call support
  • Improve scheduling latency, cluster utilization, and workload reliability through metrics-driven engineering
  • Contribute to architectural discussions across services and influence design decisions within the platform
  • Work closely with adjacent teams (CKS, infrastructure, managed inference) to ensure clean interfaces and integrations
  • Mentor junior engineers and raise the quality bar for code, design, and operations

Who You Are

  • 5–8 years of professional software engineering experience in distributed systems, cloud infrastructure, or platform engineering
  • Strong experience building production systems in Go (Python or C++ a plus)
  • Solid understanding of Kubernetes fundamentals, APIs, controllers, and operating services in production
  • Experience working with scheduling, resource management, or quota-based systems
  • Proven ability to improve system reliability and performance using data and operational metrics
  • Comfortable owning services in production and participating in on-call rotations

Preferred

  • Experience with Kubernetes-native orchestration frameworks such as Kueue, Volcano, Ray, Kubeflow, or Argo Workflows
  • Familiarity with GPU-based workloads, ML training, or inference pipelines
  • Knowledge of scheduling concepts such as quota enforcement, pre-emption, and backfilling
  • Experience with reliability practices including SLOs, alerting, and incident response
  • Exposure to AI infrastructure, HPC, or large-scale distributed compute environments

What We Offer

  • Medical, dental, and vision insurance – 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Employee Stock Purchase Program (ESPP) participation
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

Our Workplace

While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration.

California Consumer Privacy Act – California applicants only

California applicants are required to comply with the California Consumer Privacy Act.

Equal Opportunity Employer

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: View email address on click.appcast.io.

Export Control Compliance

This position requires access to export controlled information. To comply with U.S. Government export regulations applicable to that information, the applicant must either be:

  • 1157, or (iv) asylee under 8 U.S.C. 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency.
  • Eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency.
#J-18808-Ljbffr
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer II, AI Workload Orchestration in Sunnyvale, CA vacancy
  • $165k - $242k

     ...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...March 2025. Learn more at What You'll Do: As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave'... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  •  ...CoreWeave is looking for a Senior Software Engineer II to enhance our Kubernetes-native platform for AI workloads. You will design and manage Kubernetes services while mentoring junior engineers. Ideal candidates will have 5-8 years of experience in software engineering... 
    Senior
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    16 hours ago
  • $182k - $242k

     ...Senior Software Engineer IICoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...images, wiring up job orchestration. They came to train models...  ...actually unlocks new workloads and what's just nice...  ...citizen or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Full time
    Casual work
    Work at office

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $139k - $204k

     ...Essential Cloud for AI™. Built for pioneers...  ...part of the Cluster Orchestration team, you will play a...  ...the AI cloud: ensuring workloads run seamlessly, reliably...  ...What You'll Do As a Senior Software Engineer I (IC3), you will own...  ...or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  • $165k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...AI training and inference workloads run on. As a Senior Software Engineer II you will build and operate high-performance...  ...(e.g. CockroachDB), workflow orchestration (e.g. Temporal) and gRPC/Protobuf... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    9 hours ago
  • $165k - $220k

     ...CoreWeave, the AI Hyperscaler™, acquired...  ...intersection of software, hardware, and AI...  ...Reporting to the Senior Engineering Manager for ML...  ...customer ML and agent workloads. You will own...  ...infrastructure, orchestration. Frontend and...  ...or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    Sunnyvale, CA
    9 hours ago
  • $212.5k - $250k

     ...the connected platform and AI-native ecosystem for private...  ...Carta brings together the software, services, and legal infrastructure...  ...lifecycle so Carta's engineers can do the best work of...  ...Problems You’ll SolveAs a Senior Software Engineer II on DevEx, you will:Build the... 
    Senior
    Full time

    Carta

    Santa Clara, CA
    3 days ago
  • $174k - $252k

    Design and deliver an orchestration layer for Google's AI workloads.Partner with executive technical leadership...  ...concrete technical priorities and engineering roadmaps.Navigate open-ended architectural...  ....5 years of experience with software development in one or more... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    19 hours ago
  • $153k - $220k

     ...powering the future of physical AI. Founded in 2017 and now valued at...  ...commitments. About the role As a senior software engineer on the Simulation Orchestration team, you will own the compute...  ...Applied: one platform, any workload, any environment. Key responsibilities... 
    Senior
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Worldwide
    Day shift

    applied

    Sunnyvale, CA
    9 hours ago
  • $180k - $210k

     ...only vertically integrated AI infrastructure company built...  ...world's most ambitious AI workloads. When you join Crusoe, you...  ...actively seeking an exceptional Senior Software Engineer for our cloud software team...  .... Your expertise in orchestration and optimization will be instrumental... 
    Senior
    Temporary work

    Crusoe

    Sunnyvale, CA
    9 hours ago
  • $153k - $220k

     ...powering the future of physical AI. Founded in 2017 and now valued at...  ...commitments. About the role As a senior software engineer on the Simulation Orchestration team, you will own the compute platform...  ...Applied: one platform, any workload, any environment. At Applied Intuition... 
    Senior
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Decisive Point

    Sunnyvale, CA
    9 hours ago
  • $221.35k - $253k

     ...specialized audio logic within the orchestration framework;Guarantee the...  ...and maintain best practices in software development; andDrive the...  ...degree in Computer Science, Engineering, Computer Information Systems...  ...DeepMind, we are a pioneering AI lab with exceptional interdisciplinary... 
    Senior
    Full time
    Temporary work
    Work at office

    Google

    Mountain View, CA
    5 days ago
  •  ...areMoveworks: the Agentic AI Assistant platform that...  ...Moveworks’ Reasoning Engine and natural language...  ...DescriptionThe Role Are you a software engineer who has honed...  ...the role for you.As a senior software engineer on...  ...following areas: agent orchestration, sandboxed file systems... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    4 days ago
  • $109k - $204k

     ...Software Engineer II, Developer ExperienceCoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and...  ...with Kubernetes basics, such as how workloads are defined, scheduled, and operated at the... 
    Permanent employment
    Full time
    Casual work
    Work at office

    CoreWeave

    Sunnyvale, CA
    3 days ago
  •  ...Senior Software Engineer In TestWe are hiring a hands-on Senior Software Engineer in Test to design...  ...quality framework across our software and AI-driven systems. This role owns test...  ...and performance testing · Develop test orchestration, reporting dashboards, and failure triage... 
    Senior
    Shift work

    Covalent

    Sunnyvale, CA
    3 days ago
  • $165k - $242k

     ...Senior Software Engineer, Developer ExperienceLivingston, NJ / New...  ...Essential Cloud for AI™. Built for pioneers...  .... You understand how workloads are packaged, scheduled...  ...multi-stage pipeline orchestration, and custom Kubernetes...  ...citizen or national, (ii) U.S. lawful... 
    Senior
    Permanent employment
    Full time
    Casual work
    Work at office

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $160k - $250k

     ...security with the world’s most advanced AI-native platform. We work on large...  ...the Role:Crowdstrike is looking for a Senior Cloud Engineer II to join our growing Sensor Foundations...  ...experience with containerization and container orchestration technology such as docker and... 
    Senior
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area
    2 days per week

    CrowdStrike

    Sunnyvale, CA
    5 days ago
  • $174k - $252k

     ...development, and optimization of software components critical for Large Language...  ...core LLM frameworks, container orchestration (Kubernetes, Google Kubernetes Engine (GKE)), networking infrastructure,...  ...for software development, including AI/ML applications.Preferred... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • $184k - $287.5k

    We are looking for a Senior Software Engineer to join our DGX Cloud team and build the foundational systems...  ...Be Doing:Design and develop APIs to orchestrate and integrate operational workflows....  ...the operational aspects of the NVIDIA AI/ML software stack (e.g., CUDA, cuDNN,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $213k - $263k

     ...logic, physical dynamics, and advanced AI to create a realistic training ground...  ...across any environment. The Simulator Orchestration team is at the heart of tackling this...  ...requirements. We are looking for a Senior Software Engineer who is passionate about solving complex... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago
  • $174.72k - $295.68k

     ...innovation, integrating advanced AI and autonomous driving...  ...connectivity.You will be a senior engineer on the team building our internal...  ...engineers build and ship software. A core mission is connecting...  ...trouble-shooting, task orchestration, auto-research loop) is an important... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    4 days ago
  •  ...transforms how enterprise AI agents operate at...  ...pathways in agentic runtime orchestration, context retrieval,...  ...of data-centric AI workloads. Your work will ensure...  ...scale the orchestration engines that execute complex...  ...algorithms, systems, and software design. Experience:... 
    Senior
    Full time

    CV in

    Menlo Park, CA
    9 hours ago
  • $153k - $242k

     ...is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...at About the Role As a Senior Software Engineer within our Compute...  ...Kubernetes and containerized workloads in production environments....  ...U.S. citizen or national, (ii) U.S. lawful permanent resident... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  • $182k - $242k

     ...The Essential Cloud for AI™. Built for pioneers...  ...We're looking for a Senior Engineer for CoreWeave's Benchmarking...  ...partner with product, orchestration, and hardware teams to...  ...runs, including workload setup, cluster...  ...citizen or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  • $180k - $240k

     ...Senior Cloud Infrastructure EngineerSanta...  ...Cloud Infrastructure Engineer to architect and...  ...the backbone of our AI platform, ensuring...  ...ll DoCloud-Native Orchestration & Kubernetes...  ...for heavy GPU/TPU workloads.GPU Scheduling: Implement...  ...an integration of software and hardware - to... 
    Senior
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    3 days ago
  • $176k - $276k

     ...passionate about visual and AI computing. For...  ...applications for a Senior DevOps Platform Engineer skilled in Platform...  ...Learning video analytics workloads at scale using...  ...Runners for Metropolis software products.Develop and...  ...Helm, and container orchestration in production... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for...  .... Our stack is engineered for speed,...  ...looking for a Senior Engineer for CoreWeave...  ...with product, orchestration, and hardware...  ...runs, including workload setup, cluster...  ...GPU/accelerator software, or performance...  ...or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  • $165k - $242k

     ...The Essential Cloud for AI™. Built for pioneers...  ...Role We are seeking senior engineers to lead our...  ...for guided debugging, workload optimization, and incident...  ...years of experience in software or infrastructure engineering...  ...citizen or national, (ii) U.S. lawful permanent... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    9 hours ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...and Inference runs, including workload setup, cluster configuration,...  ...within the team. Break down engineering tasks into clear milestones and...  ...i) U.S. citizen or national, (ii) U.S. lawful permanent resident... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    9 hours ago
  • $153k - $224k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...largest AI training and inference workloads run on. As a Senior Software Engineer you will build features across our...  ...as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer II, AI Workload Orchestration. Be the first to apply!