Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer - Observability

$206k - $303k

CoreWeave

Principal Engineer - Observability

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025.

What You'll Do:

We are looking for a highly experienced and strategic Principal Engineer, Observability to lead the architecture, development, and operations of our Observability platform. In this role, you will define how customers monitor, troubleshoot, and operate their AI workloads at scale on CoreWeave.

You will work directly with customers and partner closely with engineering leaders across multiple teams to drive a unified Observability experience across CoreWeave products—spanning metrics, logs, traces, and customer-facing insights.

About the Role:

  • Lead the Observability strategy and roadmap, ensuring clear alignment with business goals, product direction, and performance/SLA objectives
  • Design and implement low-latency, high-scale telemetry pipelines and data stores solutions that power observability across all CoreWeave products
  • Build customer-facing experiences—dashboards, alerts, and workflows—that enable rapid troubleshooting and deep insight into AI workloads and platform health
  • Drive reliability, durability, and self-healing across the Observability stack, owning key services in production and setting a high bar for operational excellence
  • Shape customer experience for visibility by defining standards for metrics, SLOs, and dashboards that expose system performance and reliability in a clear, actionable way
  • Analyze production telemetry to identify and prioritize improvements in performance, reliability, and efficiency across the platform
  • Act as a trusted advisor to senior leadership, bringing perspective on observability trends and advocating for the right long-term technology investments
  • Partner with engineering, infrastructure, and product teams to ensure Observability is deeply integrated into evolving architectures, APIs, and customer features
  • Mentor and uplevel engineers across teams, promoting best practices in observability, distributed systems, and customer-focused product engineering

Who You Are:

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience
  • 15+ years of experience building and operating distributed systems at scale, with a strong track record of reliability-focused engineering
  • Proven experience leading Observability platform engineering initiatives and delivering products that directly address customer needs
  • Strong proficiency in one or more programming languages such as Go, Python, or Rust, and comfort working in large-scale production environments
  • Deep understanding of distributed observability systems and telemetry pipelines (e.g., ClickHouse or similar technologies for telemetry at scale)
  • Strong understanding of cloud-native infrastructure—Kubernetes, scalable architectures, automation, and modern CI/CD and deployment practices
  • Excellent analytical and problem-solving skills, including the ability to synthesize ambiguous customer and system signals into clear problem statements and designs
  • Exceptional communication and collaboration skills, able to articulate observability strategies, trade-offs, and best practices to both technical and non-technical stakeholders
  • Prior experience building end-to-end Observability solutions (metrics, logs, traces, dashboards, alerting) in production environments

Preferred:

  • Experience with modern AI platforms and workloads (e.g., large-scale training/inference, GPU-based infrastructure, MLOps tooling) is a plus

Why CoreWeave?

At CoreWeave, we work hard, have fun, and move fast! We're in an exciting stage of hyper-growth that you will not want to miss out on. We're not afraid of a little chaos, and we're constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values:

  • Be Curious at Your Core
  • Act Like an Owner
  • Empower Employees
  • Deliver Best-in-Class Client Experiences
  • Achieve More Together

We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and enables the development of innovative solutions to complex problems. As we get set for takeoff, the organization's growth opportunities are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us!

The base salary range for this role is $206,000 to $303,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

What We Offer:

The range we've posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs, including:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

Our Workplace:

While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration.

California Consumer Privacy Act - California applicants only

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: View email address on click.appcast.io.

Export Control Compliance:

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer - Observability in Sunnyvale, CA vacancy
  • $248k - $396.75k

    ## Principal Site Reliability Engineer - Observability and Telemetry PlatformApplylocations: US, CA, Santa Clara: US, Remotetime type: Full timeposted on: Posted Yesterdayjob requisition id: JR2018098Site Reliability Engineering (SRE) at NVIDIA is an engineering discipline... 
    Suggested

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...experience in implementing left shift strategy to de-risk program execution. ~ BS or MS degree in Computer Science, Electrical Engineering or related field (or equivalent experience). ~15+ years in the area of System architecture and design. Ways to stand out from... 
    Suggested
    Shift work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $206k - $303k

     ...drives innovation.  About this Role: We are seeking a highly experienced and strategic Principal Engineer to lead the architecture, development, and operations of our Observability product. In this role, you will help shape the vision and direction on how customers... 
    Suggested
    Remote job
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    more than 2 months ago
  • $206k - $333k

     ...25. Learn more at About this role We're looking for a Principal Engineer to be the technical lead of CoreWeave's Benchmarking & Performance...  ...operators to schedule benchmarks at scale; integrate with observability stacks (Prometheus, Grafana, OpenTelemetry) and results... 
    Suggested
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    8 days ago
  •  ...deep AI research expertise with the scale and operational excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking, security, observability, and customer experience — designing and deploying foundation models that enhance reliability,... 
    Suggested
    Flexible hours

    Webex Events (formerly Socio)

    Mountain View, CA
    1 day ago
  •  ...authority for enterprise BI and analytics engineering solutions, providing guidance and...  ...governance, metadata management, reliability, observability, and operational excellence....  ...Summary: We are seeking an experienced Principal Business Intelligence Engineer to provide... 
    Work at office

    Coherent

    Santa Clara, CA
    4 days ago
  • $147k - $237.5k

     ...output validation, and hallucination detection. Collaborate with engineers, and product teams to define test strategies. Monitor model...  ...cloud platforms (AWS, GCP, and Azure) Understanding of observability tools and monitoring systems Exposure to synthetic data generation... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    5 days ago
  • $248k - $396.75k

     ...this exciting endeavor! We are seeking a highly skilled Principal AI/ML Engineer to join our dynamic team to build the next generation of...  ...(Arista, Cumulus, Cisco, Palo Alto, load balancers) plus observability integration (Prometheus/Grafana) tied into automation/validation... 

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $300 per month

     ...cloud platform that frontier AI runs on. We are looking for a Principal Engineer on our Production Engineering team. Someone who will own...  ...autonomy position where you will set technical direction, drive observability and reliability standards across the organization, and be... 
    Full time
    Temporary work
    Immediate start

    Crusoe

    Sunnyvale, CA
    7 days ago
  • $143k - $286k

     ...Position Summary... What you'll do... Principal Data Engineer – Agentic Data Platforms The Mission As a Principal Data Engineer...  ...for Trust, Reliability, and Scale Define standards for observability, telemetry, lineage, governance, and AI auditability across... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    5 days ago
  • $147k - $237.5k

     ...protecting our digital way of life. We are looking for an Engineering Manager to lead the Explicit Proxy team, one of the most technically...  ...cloud-native microservices. Ensure efficient deployment, observability, and runtime stability in production environments.... 
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    16 hours ago
  • $206k - $303k

     ...how reliably systems perform under constant pressure. As a Principal Engineer in AI Infrastructure, you will lead the design and...  ...RELIABILITY AND OPERATIONS * Set standards for reliability, observability, and operational readiness across orchestration services.... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $190.9k - $253.75k

    A leading data and AI company is seeking a Software Engineer for their Observability team in Mountain View, California. The role focuses on developing observability solutions to enhance product monitoring and performance. Candidates should have at least 7 years of experience... 

    Menlo Ventures

    Mountain View, CA
    3 days ago
  • $220.2k - $330.4k

     ...Qualcomm Technologies, Inc. Job Area: Engineering Group, Engineering Group > Systems Engineering...  ...prem, and hybrid cloud scenarios. As a Principal Systems Solutions Architect, you will...  ...; design for offline/online modes, observability, and device management. Agentic AI: Architect... 
    Work experience placement
    Work at office

    Qualcomm

    Santa Clara, CA
    4 days ago
  • $2,000 per month

     ...complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI. What...  ...strategy, insights, and revenue. We are looking for a Principal Analytics Engineer to lead the design and build of this foundation. This role... 
    Local area
    Flexible hours

    Elastic

    Mountain View, CA
    3 days ago
  • $143.63k - $299.38k

     ...matter how big or small. We are excited to speak with principal / staff level engineers for this role. A Lot About You You are a backend engineer...  ...supporting backend services in production. Production observability: implement logging, metrics, tracing, and alerts to... 
    Work at office
    Flexible hours

    Yahoo Holdings Inc.

    Mountain View, CA
    4 days ago
  • Intuitive in Sunnyvale, California is seeking a Senior Software Engineer to design and develop robust software observability applications for its da Vinci™ Surgical System. The role involves collaboration with cross-functional teams to enhance system introspection and... 

    Intuitive

    Sunnyvale, CA
    2 days ago
  • $175.8k - $293k

     ...can seize a competitive advantage. We are looking for a Principal AI Engineer to build our next-generation Agentic AI platform from 0-1....  ...agent frameworks that balance autonomy with determinism, observability, and safety. Make pragmatic architectural trade-offs across... 

    BMC Software

    Santa Clara, CA
    4 days ago
  •  ...scalable workflows, and modern go-to-market execution. As a Principal Engineer in Marketing Technology, you will be a lead-level...  ...strong engineering practices, including code quality, testing, observability, and system reliability Mentor senior and mid-level engineers... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    4 days ago
  • $194.67k - $282.74k

     ...that will transform mobility. Join us as we shape the future of the car and everyone around it. Role Summary: The Principal Systems Engineer, Infotainment ECU leads system-level execution, integration, and validation of infotainment ECUs across hardware, SoC,... 
    Permanent employment
    Contract work
    Temporary work

    Cariad, Inc.

    Mountain View, CA
    1 day ago
  • $147k - $237.5k

     ...stronger relationships, and the kind of precision that drives great outcomes. Job Summary We are looking for a Principal Vulnerability Management Engineer to join the Cortex DevSecOps group and bolster our vulnerability management practices. This role focuses on... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    1 day ago
  • $147k - $237.5k

     ...the talent we hire. We’re looking for a Principal SRE to join our InfoSec SRE team that...  ...automate robust deployments and end‑to‑end observability across production environments....  ...US Citizen. BS/MS in Computer Science/Engineering or equivalent training, education, and... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks, Inc.

    Santa Clara, CA
    2 days ago
  • $103.6k - $236.5k

     ...patient care to improve, prolong and save lives. The Roche Sequencing team is seeking a passionate Systems Integration Engineer/Principal Systems Engineer to join our Systems Integration Group to support the Next Generation Sequencing (NGS) products. This is a... 
    Local area
    Relocation package

    F. Hoffmann-La Roche Ltd

    Santa Clara, CA
    6 days ago
  • $272k - $431.25k

     ...brain of computers, robots, and self-driving cars that can perceive and understand the world.We are seeking an exceptional Principal Perception Engineer to lead the design and productization of NVIDIA’s next-generation autonomous driving perception stack. This is a senior... 

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $150k - $220k

     ...DeepSight Technology Inc. in Santa Clara, CA is seeking a full-time Principal Imaging Systems Engineer to help build breakthrough imaging platforms that empower clinicians and enhance patient care. If you're motivated by innovation and energized by meaningful work,... 
    Full time
    Immediate start

    DeepSight Technology

    Santa Clara, CA
    16 hours ago
  • $195k - $243.75k

     ...Description: Zscaler is seeking a passionate Healthcare Industry Principal Sales Engineer (PSE) to serve as a top-level technical authority and...  ..., identify enablement improvements based on field observations and new Healthcare market technology trends. Deep Organizational... 
    Full time
    Work at office
    Local area
    Remote work

    Zscaler

    San Jose, CA
    4 days ago
  • $272k - $431.25k

     ...hundreds of automakers, truck makers, tier-1 suppliers, and robotaxi companies globally. We are looking for a world-class Principal Deep Learning Engineer to join our Autonomous Driving Perception team. In this highly impactful role, you will lead the development of... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $151.6k - $245.3k

     ...infrastructure and is one of the largest GCP customers. As a Principal Site Reliability Engineer for the ADEM (Autonomous Digital Experience Management)...  .... This includes automation, architecture, performance, observability, troubleshooting, security, and reliability. Our... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks, Inc.

    Santa Clara, CA
    4 days ago
  • $202k - $247k

    Job Category Site Reliability Engineering Posting Date 11/18/2025, 12:24 AM Locations Santa...  .../connectivity, workload management, observability, and storage services. We build tooling...  ...infrastructure. About this role: As a Principal Site Reliability Engineer at FortiCNAPP... 
    Full time
    Worldwide

    Fortinet, Inc.

    Santa Clara, CA
    3 days ago
  • $272k - $431.25k

     ...At NVIDIA, we are seeking exceptional engineers to join our autonomous driving team to design, implement, and deploy cutting-edge end-to-end autonomous driving systems, running on NVIDIA chips in mass-production vehicles. Our strategy has evolved from AI 1.0 — building... 
    Work experience placement

    NVIDIA

    Santa Clara, CA
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer - Observability. Be the first to apply!