Senior Software Engineer, Data Infrastructure
Full-time
Decagon
Responsibilities
- Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
- Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
- Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
- Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
- Optimize data paths, caching, partitioning, pipeline latency, and query latency to meet tight p95/p99 targets.
- Lead Terraform infrastructure-as-code and GitOps practices, including reusable modules and policy-as-code.
- Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.
Requirements
- 5+ years of experience building and operating production data infrastructure at scale.
- Hands-on experience with Tier 1 data technologies including ClickHouse, Kafka or MSK/Pub-Sub/RabbitMQ, and Flink or dbt.
- Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
- Strong experience with OpenTelemetry, Prometheus/Grafana, or Datadog and disciplined incident response.
- Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs.
- Preferred: experience with Debezium and orchestration frameworks such as Airflow, Dagster, or Prefect.
- Preferred: familiarity with Spark or Dask for large-scale data processing.
- Preferred: experience with Snowflake, BigQuery, Redshift, or Databricks.
- Preferred: experience as an early data, platform, or infrastructure engineer.
- Preferred: strong Kubernetes experience with GKE, EKS, or AKS and exposure to GCP, AWS, and Azure.
- Preferred: experience with customer-managed deployments.
Benefits
- Medical, dental, vision, life insurance, disability, retirement, parental leave, and fertility and family-building benefits are offered to full-time employees.
- Monthly wellness and lifestyle stipend, daily office lunches and snacks, and a take-what-you-need vacation policy are provided.
- The role is in-office; benefits vary by location, and UK employees receive 25 days of statutory leave.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Data Infrastructure in San Francisco, CA vacancy
- Handshake is hiring a Senior Software Engineer for the Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, building large-scale datasets, evaluation frameworks, and execution environments. You...Senior
- ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of our next-generation Data Platform. This role is critical to ensuring... ...services for small businesses.As a Senior Software Engineer, you’ll be...SeniorFlexible hours
$192k - $240k
...management, bill pay, and travel software, Brex enables founders and finance... ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and... ...numbers. The Data team at Brex develops infrastructure, statistical models, and products...SeniorWork at office3 days per week$196k - $245k
...every Quest completed, there's data, petabytes of it, telling... ...excited about building data infrastructure at massive scale and cares deeply... ...Discord users and Discord engineers. We’re building the next... ...world.If you're the kind of Software Engineer who lights up when...SeniorFull timeWorldwideRelocationRelocation package$158k - $260k
...our unique combination of proprietary infrastructure and software, we empower over 250,000 businesses... ...team is at the heart of our company's data and AI strategy. We are building the... ...at a global scale. As a champion of engineering rigor, you will advocate for elite software...SeniorTemporary workLocal areaWorldwide- ...com addresses.About the Data Cloud TeamRippling... ...Data Cloud is the data infrastructure layer that powers Rippling... ...first "context-aware, senior analyst" for HR and... ...Access - Owns the query engine (RQL, Rippling Query... ...databasesDevelop high-quality software with attention to...SeniorWork at office3 days per week
- ...looking for passionate engineers who are excited to build the data foundation for the identity... ...of the internet. As a senior engineer on the Data Platform... ..., data science, and infrastructure to make the platform... ...years of experience in software engineering, with deep expertise...SeniorFull timeFor contractorsInternshipImmediate start
Persona
San Francisco, CA1 day ago $186.07k - $218.9k
...mission of the Platform Product Group engineers is to build a trusted, scalable and... ...Machine Learning, Customer Experience, and Infrastructure. The Data Platform team builds and operates... ...at least 5 years of experience in software engineering. You have Strong Python,...SeniorLocal areaCoinbase
San Francisco, CA2 days ago- Diamond Foundry is looking for a detail-oriented Software Engineer to strengthen data collection, interfaces, and infrastructure for real-time manufacturing metrics. You will work with scientists and engineers to improve software experiences, automate tasks, and ensure...Senior
$170k - $240k
...hybrid or in-office by design. For example, our engineering team in India works primarily from our Gurugram office. Role As a Senior Software Engineer on the Data Platform team at SentiLink, you will own the data infrastructure components that support the SentiLink suite...SeniorLive inWork at officeRemote workHome officeFlexible hoursSentiLink
San Francisco, CA3 days ago$192k - $240k
United States Digital Space LLC is seeking a Data Infrastructure Engineer to build and improve its data platform. You will work closely with product and data teams, enhancing the company’s data capabilities and driving impactful products. This role requires a strong background...SeniorWork at office3 days per week- A data intelligence platform is seeking a Senior Software Engineer in San Francisco to drive projects from ideation to production while working with cutting-edge technology in a high-autonomy environment. The ideal candidate has over 6 years of full-stack experience, particularly...SeniorRemote job
$192k - $240k
What you’ll do This position is on our Data Enablement Platform team. The company product... ...you will help build the company’s Data Infrastructure and also work across the entire data... ...like Kafka Experience in backend engineering or full‑stack development Strong communication...SeniorWork at officeMonday to Friday3 days per week$193.4k - $290k
...OverviewHarvey is generating far more data than we currently know how... ...paved paths that product engineers, data engineers, and... ...Engineering, product teams, and Infrastructure. Today this work is... ...treating data infrastructure as a software product built from reusable...SeniorNight shiftHarvey
San Francisco, CA3 days ago$192k - $240k
...payments, plus intuitive software for travel and... ...to grow your career. Engineering at Brex Engineering at... ...teams span Software, Data, Security, and IT, and... ...data, query, and search infrastructure that powers critical Brex... ...backend systems. As a Senior Software Engineer, you...SeniorWork at officeRemote workWork from home- ...join our growing team. About the role We are hiring a Senior Software Engineer to own the data platform that powers Plenful’s automation engine. You... ...engineering experience building backend or data infrastructure in production Deep expertise in relational databases...SeniorWork at officeFlexible hours2 days per week
$192k - $240k
...model, it starts with the data. We’re on a mission... ...empower scientists, engineers, financial experts, product... ...newest Snorkeler! Senior Full Stack Engineer... ...standards to codebases, infrastructure, and processes. Work... ...and shipping enterprise software products ,...SeniorWork at officeLocal area3 days per week- ...into a horizontal automation engine adopted by HR, Finance, Legal... ...employee onboarding/offboarding, software access management, and the... .... As a Software Engineer, Infrastructure, you'll build and scale the foundational... ...workflow orchestration, and data pipelines. Write and...SeniorFull time
Serval
San Francisco, CA16 hours ago $141.1k - $190.91k
...Come help us bring modern software to modern science. ROLE OVERVIEW... ...rich and variety of science data. To keep up our innovation,... ...Benchling’s Data Platform engineers, you’ll join a rapidly growing... ...warehouse. The Big Data Infrastructure team is responsible for enabling...Full timeTemporary workWork at officeLocal areaRemote workHome officeFlexible hours3 days per weekBenchling
San Francisco, CA16 hours ago$160k - $225k
...agentic platform synthesizes complex employee data, pinpoints risky behaviors, and deploys... ...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize...Full timeWork experience placementRelocation packageFlexible hoursFable Security
San Francisco, CA16 hours ago$140k - $200k
...include frontend and backend engineers, AI research scientists, and... ...'re looking to hire for our Data side of our AI team at... ...through a tight integration of infrastructure, engineering, and research work... ...are looking for a skilled Software Engineer to join us. What You...Remote jobFull timeWork at officeShift workSpeechify
San Francisco, CA16 hours ago$350k
...work for their unique needs and goals. We are scientists, engineers, and builders who’ve created some of the most widely used AI... ...We’re looking for an engineer to join us and contribute to data infrastructure. You'll join a small, high-impact team responsible for architecting...Full timeImmediate startVisa sponsorshipWork visaRelocation packageThinking Machines Lab
San Francisco, CA16 hours ago- ...Role As a Data Infrastructure Software Engineer working at OpenEvidence, you will build end-to-end systems powering critical product and research workflows. Your work will focus on performance, scalability, and accuracy, granting you full autonomy over the infrastructure...Full time
Open Evidence
San Francisco, CA16 hours ago $230k - $265k
...About the Position We're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing... ...spanning across cloud infrastructure, developer experience, data infrastructure and security. In this role, you'll...SeniorFull timeWork from homeFlexible hoursParafin
San Francisco, CA16 hours ago$170k - $220k
...operated. Our platform gives engineers real-time observability over... ...reliability demanded new infrastructure. Founded by a team from SpaceX... ...customer base. Collaborate with software engineers to optimize... ...React, Redux, and TypeScript Data : Arrow, DataFusion, Flink,...SeniorFull timeRelocationSift Stack
San Francisco, CA16 hours ago$130k - $175k
...robust teacher and leader data insights to drive the... ...and empower Kiddom’s engineering by building a... ...services. Practicing Infrastructure as Code (IaC) wherever... ...+ years professional software engineering... ...geography, past experience, seniority, and demonstrated role...SeniorPermanent employmentFull timeWork at officeLocal areaRemote workKiddom
San Francisco, CA16 hours ago$140k - $225k
...We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused... ...their best work. About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in shaping the developer...SeniorFull timeTemporary workLocal areaFlexible hoursHP IQ
San Francisco, CA16 hours ago$153k - $376k
...of design and collaboration, join us!The Data Platform team at Figma builds and... ...including AI researchers, machine learning engineers, data scientists, product engineers, and... ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing...Minimum wageFull timeLocal areaRemote workFlexible hours- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Software Engineer - API & Data ConnectorsThis role sits in Data Products, which leverages the company's go-to-market, operations, and SRE functions and adheres to the company's engineering standards and tooling,...SeniorLocal areaShift work
$155k - $216k
...anytime.About the Team & OpportunityThe Infrastructure team handles platform engineering at Clever. For example, it builds... ...Skills & Experience (Must-Haves)Senior Engineering Foundation: 4+ years... ...as a DevOps, Platform or Software Engineer with a strong background...SeniorWork at officeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Data Infrastructure. Be the first to apply!
Related searches
- cybersecurity software engineer San Francisco, CA
- graduate software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- new graduate software engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA
- software engineer visa sponsorship San Francisco, CA
- network software engineer San Francisco, CA
- software engineer remote San Francisco, CA
- part time software developer San Francisco, CA
- part time software developer remote San Francisco, CA