Staff Software Engineer, Observability/Site Reliability
$235.6k - $276.8kPsiQuantum
PsiQuantum’s mission is to build the first useful quantum computers—machines capable of delivering the breakthroughs the field has long promised. Since our founding in 2016, our singular focus has been to build and deploy million-qubit, fault-tolerant quantum systems.
Quantum computers harness the laws of quantum mechanics to solve problems that even the most advanced supercomputers or AI systems will never reach. Their impact will span energy, pharmaceuticals, finance, agriculture, transportation, materials, and other foundational industries.
Our architecture and approach is based on silicon photonics. By leveraging the advanced semiconductor manufacturing industry—including partners like GlobalFoundries—we use the same high-volume processes that already produce billions of chips for telecom and consumer electronics. Photonics offers natural advantages for scale: photons don’t feel heat, are immune to electromagnetic interference, and integrate with existing cryogenic cooling and standard fiber-optic infrastructure.
In 2024, PsiQuantum announced government-funded projects to support the build-out of our first utility-scale quantum computers in Brisbane, Australia, and Chicago, Illinois. These initiatives reflect a growing recognition that quantum computing will be strategically and economically defining—and that now is the time to scale.
PsiQuantum also develops the algorithms and software needed to make these systems commercially valuable. Our application, software, and industry teams work directly with leading Fortune 500 companies—including Lockheed Martin, Mercedes-Benz, Boehringer Ingelheim, and Mitsubishi Chemical—to prepare quantum solutions for real-world impact.
Quantum computing is not an extension of classical computing. It represents a fundamental shift—and a path to mastering challenges that cannot be solved any other way. The potential is enormous, and we have a clear path to make it real.
Come join us.
Job Summary
The Observability team builds and runs the telemetry platform that lets PsiQuantum see how its quantum computing systems, and the infrastructure behind them, are behaving. We collect metrics, logs, and traces from on-premises Kubernetes clusters, cloud infrastructure, and the custom hardware that makes up a photonic quantum computer, including control electronics and cryostats. Engineering, operations, hardware, and research teams rely on this data to run the machine, catch problems early, and work out what went wrong when something fails. We are looking for a Staff Software Engineer to join the Observability team. You will wire up OpenTelemetry instrumentation and collection, run and scale Prometheus and Grafana, and turn raw signals into dashboards and alerts that people trust. A large part of the job is working with hardware teams: deciding what their devices should report, and getting that data off the device and into the platform reliably. This is a hands-on role with Staff-level scope. You will own major parts of the observability stack from design through operation, share the team's on-call rotation, and set the conventions other teams follow when they instrument their own systems. You will combine hands-on delivery with technical leadership, sound judgment under ambiguity, and a strong bias toward simple, maintainable systems. Responsibilities- Design, deploy, and operate the observability platform across on-premises Kubernetes and cloud, covering collection, storage, querying, visualization, and alerting for metrics, logs, and traces.
- Roll out OpenTelemetry across the fleet: deploy and configure Collectors, design telemetry pipelines, and help service teams adopt OTel SDKs and instrumentation in Python, Rust, and other languages.
- Run Prometheus in production, including service discovery, scrape configuration, recording and alerting rules, Alertmanager routing, retention, high availability, and long-term storage.
- Manage Grafana dashboards, alerts, and data sources as code so they are versioned, reviewed, and reproducible across environments.
- Work with hardware teams to instrument custom devices, control electronics, cryostats, and other lab equipment; build the exporters and collectors that bring device telemetry into the platform, including from equipment that was never designed to be monitored.
- Define and publish telemetry standards - metric and label naming, cardinality budgets, structured logging, trace context propagation, and resource attributes - so data from different teams and systems can be correlated.
- Partner with service owners and operations teams to define SLOs and alerts that reflect real impact, reduce alert noise, and make every page actionable.
- Take part in the team's on-call rotation: respond to incidents affecting the observability platform, help other teams diagnose production issues with telemetry, and lead blameless post-incident reviews through to completed fixes.
- Run the platform as a production service in its own right, with capacity planning, cost management, upgrades, backup and recovery, and monitoring of the monitoring stack itself, delivered through GitLab CI/CD and infrastructure as code.
- Use AI and LLM tooling to accelerate engineering and operational work responsibly - including coding assistants, query and dashboard generation, and incident analysis - while applying rigorous review, security, and validation practices.
- Work with the team's technical lead on architecture and roadmap; lead design reviews, mentor engineers, document consequential decisions, and coordinate with software, hardware, research, infrastructure, and operations teams to turn their observability needs into a shared plan.
Daily Functions
- Instrument and collect: Configure OTel Collectors and Prometheus scrape targets, write exporters, and help teams instrument new services and devices.
- Build and review: Write code and configuration, review merge requests for platform and dashboard changes, and simplify pipelines that are hard to understand or operate.
- Work with hardware teams: Learn how a new device or cryostat behaves, agree on what to measure and alert on, and get its data flowing.
- Watch and respond: Check platform health and alert quality, handle on-call pages, and help other teams debug with metrics, logs, and traces.
- Shape the platform: Work through storage, retention, cost, and tooling tradeoffs with the technical lead; unblock other engineers; keep near-term work aligned with the roadmap.
- Apply AI with judgment: Use LLM-assisted tools for queries, configuration, code, and documentation, then verify outputs to the standard expected for production infrastructure.
Experience
- 8+ years of professional software, infrastructure, or site reliability engineering experience, including significant time building and operating observability systems in production.
- A Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, Mathematics, Physics, or a closely related technical discipline is required.
- Deep hands-on experience with Prometheus and Grafana, including PromQL, recording and alerting rules, Alertmanager, exporters, dashboard design, and running both reliably at scale.
- Production experience with OpenTelemetry, including the Collector, OTLP, SDK and automatic instrumentation, and semantic conventions.
- Hands-on experience running workloads on self-managed, on-premises Kubernetes and in the cloud, with containers, Helm, and infrastructure as code such as Terraform; practical experience with GitLab and GitLab CI is strongly preferred.
- Strong programming skills in Python and at least one of Go or Rust, with the ability to write production-quality exporters, Collector components, and automation rather than only configuring off-the-shelf tools.
- Solid knowledge of Linux and networking fundamentals, including processes, filesystems, resource limits, DNS, TCP/IP, and TLS, and experience debugging distributed systems from the host up.
- Experience carrying a pager for production systems, leading incident response, running post-incident reviews, and designing alerts people act on.
- Staff-level technical leadership: leading design work, setting standards other teams adopt, mentoring engineers, influencing across teams, and communicating tradeoffs to technical and non-technical stakeholders.
- Proficiency with modern AI/LLM engineering tools, such as coding copilots and agents, model APIs, and retrieval workflows; a disciplined approach to privacy, security, hallucination risk, and generated-code review.
- Ability to work closely with hardware, electronics, and research teams across sites and time zones, in a fast-moving environment where requirements evolve as the quantum computer itself evolves
Nice to Haves
- Experience with scalable metrics, log, and trace backends such as Thanos, Mimir, VictoriaMetrics, Loki, Tempo, OpenSearch, or ClickHouse.
- Experience collecting telemetry from laboratory or industrial equipment over protocols such as Modbus, OPC UA, SNMP, SCPI, or serial interfaces, or through vendor SDKs.
- Familiarity with cryogenic, vacuum, laser, or other lab systems, or with software used in laboratories, data centers, or advanced manufacturing.
- Experience with high-frequency or high-cardinality time-series data, including downsampling, aggregation, and data lifecycle management.
- Experience running observability across multiple sites and hybrid on-premises and cloud environments, including sites with constrained network connectivity.
- Experience with eBPF-based observability, continuous profiling, or Kubernetes operators.
- Experience with SLO tooling, synthetic monitoring, or incident management platforms such as PagerDuty.
- Familiarity with VAST Data, Kafka, and AWS.
- Contributions to OpenTelemetry, Prometheus, Grafana, or related open-source projects.
- A background in physics or quantum computing is helpful but not required; curiosity, systems thinking, and motivation to learn the domain are essential.
Note: PsiQuantum will only reach out to you using an official PsiQuantum email address and will never ask you for bank account information as part of the interview process. Please report any suspicious activity to View email address on us.fitly.work .
We are not accepting unsolicited resumes from employment agencies.
Base pay is one part of the total compensation package. Full-time roles are eligible for equity and benefits. Our compensation ranges reflect the cost of labor across multiple U.S. geographic markets, and we pay based on defined geographic zones. This position may be filled within one of the following U.S. geographic zones, each with its own salary range.
Actual compensation may vary outside of these ranges and is dependent on various factors including, but not limited to, a candidate's qualifications, relevant education and training, competencies, experience, geographic location, business needs, and internal equity. Your recruiter can share more details about the salary range applicable to your location during the hiring process.
- Zone 1 - Bay Area and NYC
- Zone 2 - Examples include Los Angeles and Washington DC
- Zone 3 - Examples include Austin, Chicago, and Sacramento
- Zone 4 - Examples include Nashville and Phoenix/Tempe and many remote locations
This position includes the following benefits: competitive health coverage for you and your dependents, 401(k) with company match, equity grants, access to financial wellness tools and planning resources, wellness benefits, family support programs, life and disability insurance, paid leave programs, company-designated paid holidays, discretionary time off (DTO), and an end-of-year company shutdown. Some of these benefits have eligibility requirements and may vary based on location, role, or employment status. Many of these benefits are subsidized or fully paid for by the company.
The e s timated annual base salary range for this role is:
Zone 1
$235,600—$276,800 USD
Zone 2
$212,000—$249,100 USD
Zone 3
$188,400—$221,400 USD
Zone 4
$164,900—$193,800 USD
$218.3k - $327.5k
About Team & About RoleThe Site Reliability Engineering (SRE) team at Rubrik... ...operate at the intersection of software development and systems engineering... ...resiliency. As a Staff Site Reliability Engineer,... ...Modeling: Architect cost-observability tools and attribution frameworks...WebsiteShift work- ...how work gets done. Observe by Snowflake is an AI... ...Snowflake AI Data Cloud and engineered for scale. We ingest... ...while maintaining reliability at enterprise scale.... .... We are hiring a Staff Frontend Software Engineer on the AI Products... ...Snowflake Careers Site for salary and...WebsiteFull timeImmediate start
$262k - $364k
...system design consulting, developing software platforms and frameworks, capacity planning... ...by pushing for changes that improve reliability and velocity.Practice sustainable... ...Master's degree in Computer Science or Engineering.Site Reliability Engineering (SRE) combines...Website- ...operating our cloud platform—and driving the reliability, performance, and security that empower our engineering organization. As a Site Reliability Engineer at DrumWave, you... ...for compliance. ● Monitoring & Observability: Instrument services with metrics, logs...Website
- ...Job Description Job Description Site Reliability Engineer Onsite- Bay Area, CA Skills Relevant Skills and Experience What You... ...system health and performance using Grafana and other observability tools. Ensure high availability, reliability, and uptime...Website
$160k - $205k
...everyday essentials, safely and reliably. We're looking for a Site Reliability Engineer to join the platform team that... ...infrastructure, Kubernetes, Terraform, our observability stack, and the messaging and... ...with cloud, onboard software, operations, and safety teams on...WebsiteFlexible hours$86.33k - $191.9k
...constantly striving to make the most reliable and scalable systems possible to... ...and we’re looking for a passionate Site Reliability Engineer to join our team in the Palo Alto, CA... ...operations, reduce toil, and improve system observability. Contributing to the definition...WebsiteWork at office$140k - $165k
...Site Reliability EngineerInstrumental builds the manufacturing acceleration... ...digital exhaust and engineering context from assembly lines... ...on reliability, automation, observability, and operational excellence... ...: You partner closely with software engineers to make services...Website- ...architecture and roadmap for the observability platform across all pillars... ...Drive adoption across the engineering organization through RFCs,... ...approaches.Drive Reliability Across the Organization: Partner... ...failures.Bridge Hardware and Software Observability: Work with...Website
$170k - $230k
...Site Reliability Engineer (SRE)Palo Alto / San Francisco Bay AreaAbout MithrilMithril is an AI infrastructure platform built to make GPU compute... ...the lights on' role — you will build the automation, observability, and tooling that allows Mithril to coordinate advanced compute...WebsiteWork at officeLocal area1 day per week- ...Description Job Description Job Title: Staff Site Reliability Engineer Location: Santa Clara, CA -... ...digital health and medical software platforms. You will ensure reliability... ...incident response, deployment automation, observability, and capacity planning leveraging...Website3 days per week
- ...Description Primary Skills: Site Reliability Engineering & Production... ...W2 Job Summary: The Staff Site Reliability Engineer... ...digital health and medical software platforms. The role focuses... ...as Code, CI/CD automation, observability, incident response, and reliability...WebsiteContract work
$150k - $180k
...Role Verrus is looking for candidates to serve as software-focused Senior Site Reliability Engineer at Verrus. This is a full‑time position based out... ...resource allocation for workloads. Reliability & Observability : design and implement comprehensive monitoring,...WebsiteFull timeWork at officeLocal areaFlexible hours$251k - $310k
...billions in simulation across 15+ U.S. states. The Planner/Perception Reliability team’s goal is to build out architectures, tools, and workflows to prevent, identify, and guide fixes of reliability and software integrity issues. We focus the organization on reliability and...Full timeRemote work$228.6k - $314.25k
...RDQ126R35 At Databricks, observability and governance are what turn... ...help customers run workloads reliably at scale. Beyond query observability... ...these surfaces, raising the engineering bar of the combined team,... ...reliable, high-quality software and the operational practices...Worldwide$192k - $278k
Lead, mentor, and allocate a team of Technical Program Managers supporting vital Search reliability, testing architectures, and observability initiatives.Partner directly with Engineering Directors across an organization to drive strategic portfolio roadmaps and resolve...$262k - $364k
...infrastructure from SRE side, ensuring it is reliable, scalable, cost effective and... ...experience.8 years of experience with software development in one or more programming... ...Master's degree in Computer Science or Engineering.Site Reliability Engineering (SRE) combines...Website$206k - $258k
...generations. Role Summary As a Staff Software Engineer specializing in safety-critical self-... ...implementation of robust and reliable self-driving solutions. Responsibilities... ...to support development, building, observability, debugging, and testing Create...WebsiteFull timeContract workLocal area$206.5k - $258.1k
...AI team builds AI products that help engineers across the company design, build and support our vehicles. As a Staff AI Software Engineer specializing in agentic... ...evaluation practices needed to deliver reliable, scalable and observable AI applications, with measurable impact...WebsiteFull timeContract workTemporary workPart timeLocal areaShift work$206.5k - $258.1k
...Autonomy organization is looking for a Staff Software Engineer, ML Applications on the Data & Cloud... ..., cross-functional problems (scale, reliability, cost, developer velocity) and align... ...organization move faster by building reliable, observable software on top of petabyte-scale...WebsiteFull timeContract workTemporary workPart timeLocal areaShift work- ...Description This is a full-time on-site role for a Senior or Staff Software Engineer (Technical Lead) located in the... ...’ll be responsible for building reliable backend infrastructure and... ...system reliability, scalability, and observability Help shape the technical...WebsiteFull timeFlexible hours
- ...a talented and passionate Staff Software Engineer for our Snowpark Container... ..., Coding, Reviews, Testing, Observability, Tooling and On-Call support. Build highly reliable and fault-tolerant software... ...desirable ~ Ability to work on-site in our downtown Bellevue...WebsiteRemote jobFull timeWork at office
- ...of how work gets done. Staff Software Engineer – Compiler & Spark Runtime... ..., efficiency, and reliability to Spark workloads. Our mission... ...integration, and end-to-end observability to deliver faster, more cost... ...on the Snowflake Careers Site for salary and benefits...WebsiteRemote jobFull time
- ...future of how work gets done. Staff Software Engineer - Snowhouse Foundation... ...-team concerns such as reliability and efficiency. Responsibilities... ...co-own the reliability, observability, SLOs, capacity, and... ...on the Snowflake Careers Site for salary and benefits information...WebsiteFull time
$198.5k - $248k
...WHY BOX NEEDS YOU The Reliability Engineering team at Box ensures our platform... ...services. As a Senior Software Engineer on the... ...Contribute to the evolution of observability standards (SLIs, SLOs, latency... ...performance engineering, or site reliability engineering,...WebsiteFull timeWorldwideShift work$174k - $229k
...otherwise, all roles are on-site five days per week at... ...Overview This Staff Engineer role sits at the... ...ensure comprehensive, reliable coverage org-wide.... ...with 5+ years) as a software engineer in modern web... ...Docker, Kubernetes; observability and chaos engineering...WebsiteFull timeContract workTemporary workWork at officeRemote workFlexible hours$207k
...investment in the people, software, and systems that... ...software engineers who bring technical... ...are looking for a Staff Software Engineer... ...testing, deployment, observability, and continuous... ...monitoring systems, where reliable software connects... ...products, sites, or business units...WebsiteFull timeLocal areaWork from home$194k - $253k
...otherwise, all roles are on-site five days per week at one... ...Overview IDMe is seeking a Staff Software Engineer to join the Wallet -... ...identity requirements into reliable, low-friction authentication... ...exposure: raise the bar for observability, incident response, and post...WebsiteFull timeTemporary workWork at officeRemote workFlexible hours$172k - $300k
...Job Description As a Staff/Senior Software Engineer - Networking in the AV (Autonomous... ...skills to enable reliable, high-performance movement... ...distributed systems, and Site Reliability Engineering (SRE... ...modes. Build telemetry and observability capabilities that provide...WebsiteFull timeWork at officeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...Site Reliability EngineerRequired Skills & Experience7+ years of experience in Site Reliability Engineering, DevOps, Systems Engineering, or a similar infrastructure/application operations... ...with application monitoring and observability, including application health,...Website
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Observability/Site Reliability. Be the first to apply!
- software engineer - cloud services Palo Alto, CA
- software technical support engineer Palo Alto, CA
- remote software sales Palo Alto, CA
- entry level software sales Palo Alto, CA
- software sales Palo Alto, CA
- government software Palo Alto, CA
- id software Palo Alto, CA
- software intern Palo Alto, CA
- bank software Palo Alto, CA
- software implementation project manager Palo Alto, CA





