Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Observability

Temporal Technologies

Role Summary

We have an opening for a Senior Software Engineer on our Infrastructure Team, with specific focus on Observability - both internal and customer-facing . This is an opportunity to join a mission-critical engineering team that is driving the productivity and reliability of Temporal's developers andcore platforms, respectively. We are a passionate team of talented developers who truly care about our mission and enjoy working deeply across the entire Temporal ecosystem to be a force multiplier across the organization.

Team Highlights
  • Core observability tech stack: Clickhouse, Prometheus, Grafana, Loki, Thanos, Kubernetes, Temporal.
  • Our recent observability project had the biggest impact to Temporal margins of any engineering effort in company history while also unlocking unprecedented operator capabilities.
  • "Observability is the beating heart of our ability to deliver a mission critical service" - Preeti Somal, Senior VP of Engineering.
What You'll Do

Build
  • Lead the end-to-end Software Development Lifecycle: goals & requirements solicitation, design & review, implementation, operationalization & deployment, support & maintenance.
  • Formulate feature designs, review with stakeholders, iterate to incorporate feedback and drive consensus.
  • Clearly document design choices and operational knowledge to successfully deploy and manage the software you develop.
  • Provide appropriate test and production readiness coverage for unit, integration, and performance of your feature ownership area.
Own
  • Set a high bar for technical excellence and take pride in the software you develop.
  • Design and build multi-component, distributed systems that operate at scale.
  • Investigate issues with a methodical approach to identify a root cause.
  • Understand performance and reliability implications of design options at scale. Make related tradeoffs.
  • Able to participate in the team's on-call rotation.
Learn
  • Expert-level knowledge of architecture and services of assigned domain. Strong command over all aspects of the Temporal ecosystem. This role provides a strong opportunity for diverse technical exposure!
  • Investigate and understand ways to best leverage Temporal's own software to power our mission.
  • Deeply understand the needs of Temporal internal developers and external customers, and leverage that knowledge for product development and feature design.
Collaborate
  • Participate in design reviews and contribute to design of other features.
  • Share design principles for building reliable systems at scale.
What You'll Bring
  • User-first mindset. You're excited by the opportunity to empower others through tooling, and enjoy deeply internalizing user goals and use cases to build effective solutions.
  • Motivated by impact. You are driven by a desire to make positive things happen.
  • Strong opinions about tools and technology that are equally balanced by a pragmatic drive for impact.
  • Ability to work in a self-directed manner in a fast-paced environment.
  • Excellent collaboration and communication skills.
Skills & Technologies
  • Demonstrated ability to develop horizontally scalable, resilient, and high performance distributed systems in a production environment.
  • Experience designing, implementing, deploying, and supporting large scale, geographically distributed observability and/or high throughput data streaming/processing pipelines, or similar.
  • Expert in one or more high-level programming languages, preferably Go.
  • Expert-level Kubernetes skills.
  • Expert-level query development skills, preferably SQL.
  • Hands-on experience with one or more cloud providers, preferably AWS, or GCP.
  • Thorough understanding of computer architecture, operating systems, and networking.
  • Familiarity with best practices regarding monitoring, instrumenting, and configuring infrastructure.

Temporal Technologies is an Equal Opportunity Employer. Temporal Technologies does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need. We embrace and celebrate differences and diversity.

Temporal is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. If you need to request a reasonable accommodation, please let your Recruiter know so we can assist.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Observability in San Francisco, CA vacancy
  • $170k - $240k

     ...Senior Software Engineer - Observability and Reliability About the Role We are growing the engineering team and looking for engineers who have the chops to build and deliver world-class technology. You will be part of a talented team of engineers with... 
    Senior
    Full time
    Work at office
    Flexible hours

    Sigma Computing

    San Francisco, CA
    15 hours ago
  • Apple Inc. is seeking a Senior Software Engineer for Apple Services Engineering in San Francisco. You will design and build fault-tolerant distributed systems powering observability across CloudKit and iCloud services, operating within Kubernetes and across large-scale... 
    Senior

    Apple

    San Francisco, CA
    4 days ago
  • $200k - $280k

     ...generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. The AI Infrastructure...  ...that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining... 
    Senior
    Full time
    Remote work

    Together AI

    San Francisco, CA
    3 days ago
  • Snowflake is seeking a Senior Software Engineer to design and implement OTel Collector components and instrumentation libraries. You will collaborate...  ...contribute to upstream specifications, while owning the Observe Agent architecture and release strategy. You will shape... 
    Senior

    Snowflake

    San Francisco, CA
    4 days ago
  • $139k - $257.55k

     ...experiences using Adobe Express.We are seeking an experienced Software Development Engineer to help build the infrastructure and tooling that powers...  ...is built and operated, you will help shape intelligent observability capabilities that enable engineering teams to... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    7 days ago
  • Apple is seeking engineers to help build observability infrastructure for CloudKit and iCloud services. You will design, develop, and operate distributed backend services that ingest vast volumes of operational data and run on Kubernetes at scale. You will collaborate across... 
    Senior

    Apple

    San Francisco, CA
    3 days ago
  •  ...to improve their business. Founded by engineers — and customer obsessed — we leap at every...  ...And we're only getting started. As a Senior Software Engineer on the Customer Foresight...  ...providing a reliable and timely interface for observability Make it easy for frameworks teams... 
    Senior
    Worldwide

    Uncover

    San Francisco, CA
    3 days ago
  • $175k - $240k

     ...build the foundation for agent engineering in the real world, helping...  ...We're looking for a Senior Fullstack Engineer for our commercial...  ...product LangSmith, an observability and evals platform. In this...  ...~5+ years of experience in software engineering working on complex... 
    Senior
    Full time
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    15 hours ago
  •  ...The Opportunity Gradient is looking for a Founding Software Engineer to own how the robots move data from AI models to actuators....  ...instrumentation that make real-time behavior across controls and vision observable and debuggable   You Should Have •5+ years of... 
    Senior
    Full time

    Rethink recruit

    San Francisco, CA
    15 hours ago
  • $170k - $210k

     ...and others. About the role The engineering team owns the delivery and stability of...  ...’ ability to capture revenue. The Sr. Software Engineer role centers around...  ...implementing secure APIs, highly available and observable services Led and mentored more junior... 
    Senior
    Full time

    Finix

    San Francisco, CA
    15 hours ago
  •  ...The Compute team's mission: any engineer, using AI, should be able to stand...  ...make this possible. Reliable, observable, and self-service by design. This is a software engineering role. You'll spend real...  ...design failure to fix. A Senior engineer will help define the platform... 
    Senior
    Full time
    For contractors
    Internship

    Persona

    San Francisco, CA
    15 hours ago
  • $213k - $263k

     ...Waymo Driver. We focus on transforming the Software Development Life Cycle (SDLC) through...  ...and multi-agent frameworks, enabling our engineering teams to build, test, and deploy...  ...troubleshooting of complex driving behaviors observed in the real world and simulation Productionize... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    15 hours ago
  •  ...layer for consistent product access. We are looking for a Senior Software Engineer who is passionate about tackling complex, foundational...  ...lifecycle logic migrated out of legacy systems into resilient, observable, and Identity Platform-first services. Implement the... 
    Senior
    Full time
    Local area

    Ripple

    San Francisco, CA
    15 hours ago
  • $202k - $237k

     ...distributed computing and make it accessible to software developers of all skill levels. We’re...  ...We are seeking a Backend Software Engineer to join our team focused on building...  ...About the team The Workspace & Observability Team is dedicated to empowering clients... 
    Full time
    Work at office
    Flexible hours

    Anyscale

    San Francisco, CA
    15 hours ago
  •  ...About the role We are looking for a senior Python engineer who has built security-critical...  ...brings strong security judgment to the software they build: someone who can move between...  ...periods, staged rollouts, observability, recovery, and rollback. What we’re... 
    Senior
    Full time

    StackAI

    San Francisco, CA
    15 hours ago
  • $166.6k - $250.9k

     ...The location: Stuttgart, West Germany. Engineers are pacing with strained expressions. They...  ...remedy them. We champion and improve observability. We've helped define incident response....  ..., make critical decisions, and deliver software that works today and is sustainable for... 
    Senior
    Full time
    Immediate start

    Mercury

    San Francisco, CA
    15 hours ago
  •  ...them. We are a small team of engineers, designers, product managers,...  ...production. The role As a Senior Engineer, you own meaningful...  ...high-quality, well-tested, observable code, and help others do the...  ...requirements into working software Mentor earlier-career engineers... 
    Senior
    Full time

    Nuna

    San Francisco, CA
    15 hours ago
  • $190k - $280k

     ...About Sentry Bad software is everywhere, and we’re tired of it. Sentry is on a mission...  ...across our ecosystem. As a Senior Software Engineer on the CTRL team, you’ll design and operate...  ...the reliability, scalability, and observability of mission-critical control plane... 
    Senior
    Hourly pay
    Full time
    Work at office

    Sentry

    San Francisco, CA
    15 hours ago
  •  ...once-in-a-generation transformation. Engineering at Chestnut We’re building the...  ...agents working in parallel. As a Software Engineer at Chestnut, you’ll join a high...  ...evolve core infrastructure, including observability , permissions , and developer experience... 
    Senior
    Full time
    Contract work
    Remote work
    Flexible hours
    Shift work

    Chestnut

    San Francisco, CA
    15 hours ago
  •  ...from home day is currently Tuesday. Engineering at Lambda is responsible for building...  .... We are looking for an experienced Software Engineer to help design and build the next...  ...available network services through observability, failover, and redundancy features Deliver... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    15 hours ago
  • $200k - $400k

     ...their AI agents. We transform complex engineering work into intuitive self-serve products...  .... About the Role As a Senior Software Engineer on the Enterprise Product team...  ...building scalable systems Experience with observability, data visualization, or analytics... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    15 hours ago
  •  ...possible. The Lambda Infrastructure Engineering organization forges the foundation of...  ...We're looking for an experienced Senior Software Engineer to join our storage team. You...  ...performance regression detection, and the observability pipeline that makes a petabyte fleet... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    15 hours ago
  • $148k - $185k

     ...customers put their trust in us for safety and reliability. As a Software Engineer for Autonomous Vehicles, you’ll be responsible for executing...  ...match to help save for your future ~ In addition to 12 observed holidays, salaried team members have discretionary paid time... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    15 hours ago
  • $210.8k - $272.8k

     ...team at Thumbtack is focused on making engineering fast, reliable, and delightful. We tackle...  ...and complex challenges in modern software development. We’re introducing GenAI tooling...  ...– build systems, CI/CD, test infra, observability and dev/test environments. Optimize... 
    Senior
    Full time
    Part time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    15 hours ago
  •  ...end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. The storage and observability team is responsible for designing, implementing, and maintaining robust distributed storage... 
    Senior

    Together AI

    San Francisco, CA
    3 days ago
  • Crusoe is seeking a Senior Streaming Software Engineer to join the Observability team in our Cloud Infrastructure group. You will design, build, and operate high‑throughput streaming systems that power real‑time telemetry across our GPU cloud and global data centers. You... 
    Senior

    Crusoe

    San Francisco, CA
    4 days ago
  •  ...workersResponsibilitiesWe're looking for an exceptional Senior Software Engineer to help build the distributed backend that powers our AI...  ...end — from ideation and architecture through deployment, observability, and iteration.Raise the engineering bar through clean, well... 
    Senior
    Remote work
    Flexible hours

    Workato

    San Francisco, CA
    3 days ago
  • $300 per month

     ...performing team that believes in each other, come build with us at Crusoe.About This RoleWe’re looking for a Senior Streaming Software Engineer to join the Observability team within our Cloud Infrastructure organization. This team builds and operates the real-time data... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  • $166k - $201k

     ...other, come build with us at Crusoe.About This Role:As a Senior Software Engineer on our storage team, you'll be joining our core engineering...  ...for our most demanding customer workloadsBuilding observability, metrics and tooling for our services and fleetHigh Velocity... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $148k - $249k

     ...the architecture and development of Waabi’s monitoring and observability stack, used to monitor the health and performance of cloud...  ...and leadership.   Qualifications: - 5+ years software engineering or systems/performance engineering experience (BS in CS/... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Observability. Be the first to apply!