Senior Software Engineer, Data Infrastructure
Full-time
Decagon
Responsibilities
- Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
- Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
- Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
- Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
- Optimize data paths, caching, partitioning, pipeline latency, and query latency to meet tight p95/p99 targets.
- Lead Terraform infrastructure-as-code and GitOps practices, including reusable modules and policy-as-code.
- Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.
Requirements
- 5+ years of experience building and operating production data infrastructure at scale.
- Hands-on experience with Tier 1 data technologies including ClickHouse, Kafka or MSK/Pub-Sub/RabbitMQ, and Flink or dbt.
- Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
- Strong experience with OpenTelemetry, Prometheus/Grafana, or Datadog and disciplined incident response.
- Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs.
- Preferred: experience with Debezium and orchestration frameworks such as Airflow, Dagster, or Prefect.
- Preferred: familiarity with Spark or Dask for large-scale data processing.
- Preferred: experience with Snowflake, BigQuery, Redshift, or Databricks.
- Preferred: experience as an early data, platform, or infrastructure engineer.
- Preferred: strong Kubernetes experience with GKE, EKS, or AKS and exposure to GCP, AWS, and Azure.
- Preferred: experience with customer-managed deployments.
Benefits
- Medical, dental, vision, life insurance, disability, retirement, parental leave, and fertility and family-building benefits are offered to full-time employees.
- Monthly wellness and lifestyle stipend, daily office lunches and snacks, and a take-what-you-need vacation policy are provided.
- The role is in-office; benefits vary by location, and UK employees receive 25 days of statutory leave.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Data Infrastructure in San Francisco, CA vacancy
- Handshake is hiring a Senior Software Engineer for the Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, building large-scale datasets, evaluation frameworks, and execution environments. You...Senior
- ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of our next-generation Data Platform. This role is critical to ensuring... ...services for small businesses.As a Senior Software Engineer, you’ll be...SeniorFlexible hours
$192k - $240k
...management, bill pay, and travel software, Brex enables founders and finance... ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and... ...numbers. The Data team at Brex develops infrastructure, statistical models, and products...SeniorWork at office3 days per week$196k - $245k
...every Quest completed, there's data, petabytes of it, telling... ...excited about building data infrastructure at massive scale and cares deeply... ...Discord users and Discord engineers. We’re building the next... ...world.If you're the kind of Software Engineer who lights up when...SeniorFull timeWorldwideRelocationRelocation package$158k - $260k
...our unique combination of proprietary infrastructure and software, we empower over 250,000 businesses... ...team is at the heart of our company's data and AI strategy. We are building the... ...at a global scale. As a champion of engineering rigor, you will advocate for elite software...SeniorTemporary workLocal areaWorldwide- ...com addresses.About the Data Cloud TeamRippling... ...Data Cloud is the data infrastructure layer that powers Rippling... ...first "context-aware, senior analyst" for HR and... ...Access - Owns the query engine (RQL, Rippling Query... ...databasesDevelop high-quality software with attention to...SeniorWork at office3 days per week
- ...looking for passionate engineers who are excited to build the data foundation for the identity... ...of the internet. As a senior engineer on the Data Platform... ..., data science, and infrastructure to make the platform... ...years of experience in software engineering, with deep expertise...SeniorFull timeFor contractorsInternshipImmediate start
Persona
San Francisco, CA2 days ago $186.07k - $218.9k
...mission of the Platform Product Group engineers is to build a trusted, scalable and... ...Machine Learning, Customer Experience, and Infrastructure. The Data Platform team builds and operates... ...at least 5 years of experience in software engineering. You have Strong Python,...SeniorLocal areaCoinbase
San Francisco, CA3 days ago- Diamond Foundry is looking for a detail-oriented Software Engineer to strengthen data collection, interfaces, and infrastructure for real-time manufacturing metrics. You will work with scientists and engineers to improve software experiences, automate tasks, and ensure...Senior
$170k - $240k
...hybrid or in-office by design. For example, our engineering team in India works primarily from our Gurugram office. Role As a Senior Software Engineer on the Data Platform team at SentiLink, you will own the data infrastructure components that support the SentiLink suite...SeniorLive inWork at officeRemote workHome officeFlexible hoursSentiLink
San Francisco, CA4 days ago$192k - $240k
United States Digital Space LLC is seeking a Data Infrastructure Engineer to build and improve its data platform. You will work closely with product and data teams, enhancing the company’s data capabilities and driving impactful products. This role requires a strong background...SeniorWork at office3 days per week- A data intelligence platform is seeking a Senior Software Engineer in San Francisco to drive projects from ideation to production while working with cutting-edge technology in a high-autonomy environment. The ideal candidate has over 6 years of full-stack experience, particularly...SeniorRemote job
$193.4k - $290k
...OverviewHarvey is generating far more data than we currently know how... ...paved paths that product engineers, data engineers, and... ...Engineering, product teams, and Infrastructure. Today this work is... ...treating data infrastructure as a software product built from reusable...SeniorNight shiftHarvey
San Francisco, CA4 days ago$192k - $240k
What you’ll do This position is on our Data Enablement Platform team. The company product... ...you will help build the company’s Data Infrastructure and also work across the entire data... ...like Kafka Experience in backend engineering or full‑stack development Strong communication...SeniorWork at officeMonday to Friday3 days per week- As a Senior Data Engineer at fal, you will build the data infrastructure that turns our internal systems and external vendor relationships into a clear picture of cost... ...-time. This role sits at the intersection of software engineering and data engineering. You'll partner...SeniorCurrently hiringRelocation package
- ...Capital, In-Q-Tel, NeoTribe, Acrew, and more. The Role Build the data backbone that makes autonomous networks possible. You'll... ...directly with ML researchers tuning models on your data, wireless engineers defining what matters, and product teams shipping analytics to...SeniorNight shift
$192k - $240k
...payments, plus intuitive software for travel and... ...to grow your career. Engineering at Brex Engineering at... ...teams span Software, Data, Security, and IT, and... ...data, query, and search infrastructure that powers critical Brex... ...backend systems. As a Senior Software Engineer, you...SeniorWork at officeRemote workWork from home- ...join our growing team. About the role We are hiring a Senior Software Engineer to own the data platform that powers Plenful’s automation engine. You... ...engineering experience building backend or data infrastructure in production Deep expertise in relational databases...SeniorWork at officeFlexible hours2 days per week
$192k - $240k
...model, it starts with the data. We’re on a mission... ...empower scientists, engineers, financial experts, product... ...newest Snorkeler! Senior Full Stack Engineer... ...standards to codebases, infrastructure, and processes. Work... ...and shipping enterprise software products ,...SeniorWork at officeLocal area3 days per week$153k - $376k
...of design and collaboration, join us!The Data Platform team at Figma builds and... ...including AI researchers, machine learning engineers, data scientists, product engineers, and... ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing...Minimum wageFull timeLocal areaRemote workFlexible hours- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Software Engineer - API & Data ConnectorsThis role sits in Data Products, which leverages the company's go-to-market, operations, and SRE functions and adheres to the company's engineering standards and tooling,...SeniorLocal areaShift work
$140k - $225k
...collaborates.We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—... ...can do their best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in shaping the...SeniorFull timeTemporary workLocal areaFlexible hours$155k - $216k
...anytime.About the Team & OpportunityThe Infrastructure team handles platform engineering at Clever. For example, it builds... ...Skills & Experience (Must-Haves)Senior Engineering Foundation: 4+ years... ...as a DevOps, Platform or Software Engineer with a strong background...SeniorWork at officeWorldwide- ...and builds the shared infrastructure that helps DoorDash, Wolt... ...serving and inference engines, fine-tuning and... ...This role is ideal for a senior engineer who enjoys owning... ..., product engineers, data scientists, and... ...industry experience in software engineeringDeep backend...SeniorHourly payWork at officeLocal areaRemote workFlexible hours
$166k - $225k
...are passionate about enabling data teams to solve the world's... ...the world's best data and AI infrastructure platform so our customers... ...their business. Founded by engineers — and customer obsessed — we... ...re only getting started.As a Senior Software Engineer on the Infrastructure...SeniorLocal areaWorldwide$2,000 per month
...class solution for product, data, and marketing teams. Learn... ...a query. Our in-house OLAP engine, Nova, processes trillions of... ...That makes Nova the critical infrastructure in the loop, and as non-stop... ...dramatically.We're looking for a Senior Software Engineer who wants to go...SeniorWorldwideHome office$164k
About the RoleThe Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of Chime. The mission of this group is to build scalable data artifacts and insights that enable accurate, governed, data-driven decision...SeniorFull timeWork at officeLocal areaRemote work$160k
About the RoleThe Data Governance function is pivotal in ensuring the integrity, trustworthiness... ...the company. As a Data Governance Engineer, you will develop and implement policies... ...role, you can expect toBuild Data Trust Infrastructure: Design and implement trust scorecards,...SeniorFull timeWork at officeLocal areaRemote work- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Software Engineer - Backend, Data ProductsAs a Senior Software Engineer on Backend, Data Products, you build the product itself — the composable, self-correcting pipeline capabilities customers actually use. You...Senior
$172k - $215k
...opportunities, join us, and build real world value.As a Senior Software Engineer on the Data Engineering team, you are a core builder of the... ...grow into more complex ownership.Contribute to platform infrastructure through Terraform, and work with Unity Catalog to establish...SeniorFull timeWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Data Infrastructure. Be the first to apply!
Related searches
- cybersecurity software engineer San Francisco, CA
- graduate software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- new graduate software engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA
- software engineer visa sponsorship San Francisco, CA
- software qa engineer San Francisco, CA
- network software engineer San Francisco, CA
- software engineer remote San Francisco, CA
- part time software developer San Francisco, CA