Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Data Infrastructure

$200k - $275k

Peregrine Technologies

Backed by leading Silicon Valley investors, Peregrine helps public safety organizations, state and local and governments, federal agencies, and private-sector institutions address society's challenges with unprecedented speed and accuracy. Our AI-enabled platform turns siloed and disconnected data into operational intelligence - instantly surfacing mission-critical information to empower better, faster decisions that improve outcomes at every touchpoint. Today Peregrine supports hundreds of customers across 30+ states and two countries, serving more than 125 million people - and we're amplifying our impact as we expand into the enterprise and internationally.


Team

As an engineering team, we believe strongly that empathy improves our solutions. Seeing how people use the product is a priority and the way we get to the right answer. Engineers will have the opportunity to work closely with our team onsite to understand the variety of use cases that Peregrine serves.

We value both ownership and collaboration-you will take full responsibility for major features and work closely with other engineers to drive them to completion. We believe that humility and empathy are essential for building the right solutions-you will collaborate directly with our deployment team and users as we iterate to solve their problems. Perseverance and creativity are crucial to executing our vision.
Role

We are looking for a Staff Data Infrastructure Engineer to join our growing team, where you will have deep ownership over the data layer that underpins everything Peregrine does. You will architect and build the systems that ingest, store, and serve massive volumes of real-time operational data - enabling our customers to make critical decisions with speed and confidence.

This is a senior individual contributor role for someone who thrives on hard technical problems and brings the experience and judgment to shape foundational infrastructure decisions. You will tackle a wide range of complex challenges, including:
  • Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
  • Architecting a scalable open table format layer for reliable data storage at petabyte scale
  • Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
  • Driving performance, reliability, and cost efficiency across the full data infrastructure stack
  • Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
  • Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization
Our stack is constantly evolving but is built on AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, Kubernetes, and more.
About You
  • Deep passion for data infrastructure - you care about building systems that are correct, fast, and resilient at scale
  • Thrive on ambiguity and are energized by defining the right solution to hard, open-ended problems
  • Strong technical vision with the ability to translate complex data requirements into clean, durable infrastructure designs
  • Desire to own significant portions of the data stack end-to-end, from ingestion to serving
  • Committed to operational excellence - you build things you're proud to operate
What We Look For
  • 8+ years of experience architecting and operating large-scale data infrastructure systems in production environments
  • Deep expertise with open table formats, particularly Apache Iceberg - including schema evolution, partitioning strategies, compaction, and time travel
  • Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
  • Strong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
  • Solid experience with data pipeline orchestration using Airflow or similar tools
  • Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
  • Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures
  • Experience with Kubernetes and containerized deployment of data workloads
  • Degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Located in San Francisco, New York, or Washington DC and open to working in office

Salary Range: $200,000 - $275,000 Annually + Benefits + Equity (if applicable) + Bonus (if applicable)

Peregrine Technologies is committed to creating an inclusive environment for all employees. We celebrate diversity and are a proud equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Data Infrastructure in San Francisco, CA vacancy
  • $197.3k - $313.7k

     ...are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce...  ...future of Salesforce. Slack is looking for a Staff Software Engineer to join the Data Infrastructure team within the broader Data Engineering... 
    Suggested
    Permanent employment

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...our unique combination of proprietary infrastructure and software, we empower over 200,000 businesses...  ...team is at the heart of our company's data and AI strategy. We are building the...  ...You Are? As a high level architect (staff engineer), you will oversee the strategy,... 
    Suggested
    Work at office
    Worldwide

    Airwallex

    San Francisco, CA
    1 day ago
  • $252k - $315k

     ...Staff Software Engineer, Data Platform Software is eating the world, but AI is eating software. We live in unprecedented times – AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, coach, assistant, personal shopper... 
    Suggested
    Full time
    Live in

    Scale AI

    San Francisco, CA
    17 hours ago
  • $248k - $279k

     ...gets excited about building data infrastructure at massive scale and cares deeply...  ...Discord users and Discord engineers. We're building the next...  ...world. If you're the kind of Staff Engineer who sees ambiguity...  ...have ~7+ years of software engineering experience with... 
    Suggested
    Full time
    Work at office
    Worldwide
    Relocation
    Relocation package

    Discord

    San Francisco, CA
    4 days ago
  • $140k - $210k

     ...Capital, and more. About the Role We're looking for a Senior/Staff Data Platform Engineer to build and scale the foundation of Actively's data ecosystem; the pipelines, transformations, and infrastructure that power every agent, insight, and workflow across the... 
    Suggested
    Work at office
    Flexible hours
    Shift work

    Actively AI

    San Francisco, CA
    3 days ago
  •  ...AirOps AirOps is the first end-to-end content engineering platform built for the AI era. In a world where discovery is shifting from traditional...  ...understand exactly how they show up across AI search—and that data has to be fast, accurate, and trusted. We've outgrown "data... 
    Flexible hours
    Shift work

    AirOps

    San Francisco, CA
    1 day ago
  •  ...a decentralized global map data network built by 10s of thousands...  ...develop and deploy software directly to our dashcams to...  ...called Map AI. The Platform Engineering team is responsible for the...  ...core distributed systems, ML infrastructure, data model abstractions, and... 
    Flexible hours

    Hivemapper

    San Francisco, CA
    4 days ago
  • $195k - $257.5k

     ...Data Platform Engineering Team Circle is committed to visibility and stability in everything we do...  ...You'll bring to Circle: Senior Software Engineer (III): ~4+ years of software...  ...databases such as Bigtable, Cassandra Staff Software Engineer (IV): Includes... 
    Contract work
    Remote work
    Flexible hours

    Circle

    San Francisco, CA
    21 days ago
  • $194k - $267k

     ...building the trusted, neutral infrastructure that enables organizations...  ...About the Team The Data Platform team is responsible...  ...expect great things from our engineers and reward them with stimulating...  ...opportunity for experienced Software Engineers to join our fast... 
    Permanent employment
    Work at office
    Local area
    Worldwide
    Flexible hours

    Okta, Inc.

    San Francisco, CA
    1 day ago
  • $220k - $250k

     ...Senior / Staff Software Engineer, Data Platform Title of Role: Senior / Staff Software Engineer, Data Platform Location: San Francisco, hybrid Company Stage of Funding: Venture Round — Software Development, AI Office Type: Hybrid Salary: $220K–$250K Company... 
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  • $207k - $362.25k

     ...addresses. About the role Rippling's Data Cloud underpins every analytical...  ..., and applications. As a Senior Staff Engineer on the Query and Data Platform team, you...  ...architect the multiyear roadmap for our data infrastructure. You aren't just building a feature;... 
    Work at office
    Shift work
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $174k - $273k

     ...Addepar is a global technology and data company that helps investment professionals...  ...integrates with more than 100 software, data and services partners to deliver...  ...Role We are currently seeking a Staff Software Engineer to join the Investment Data Platform team... 
    H1b
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    GrabJobs

    San Francisco, CA
    2 days ago
  • Watershed, located in San Francisco, is seeking a Senior to Staff level Backend Software Engineer to design and maintain their core backend platform. The...  ...impact assessments while collaborating with climate and data scientists. Candidates should have 6+ years of... 
    Work at office

    Watershed

    San Francisco, CA
    17 hours ago
  • $155k - $240k

     ...To learn more visit: The Data Platform team is responsible...  ...We build tools, frameworks, infrastructure and services used by every team...  ...... Be a part of a team of engineers that manages Waabi’s data...  ...research scientists, ML and software engineers, system engineers... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi Innovation Inc.

    San Francisco, CA
    4 days ago
  • $228.4k - $303.55k

    Sr. Staff Software Engineer - Data Platform RDQ126R106 At Databricks, we are passionate about enabling data teams to solve the world’s toughest...  ...by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to... 
    Worldwide

    Databricks Inc.

    San Francisco, CA
    1 day ago
  • $200k - $275k

     ...enable the growth of critical infrastructure. Having recently raised $21...  ...foundational members of our Engineering team, you will architect and develop petabyte-scale data pipelines for our fast-growing...  ...You'll Bring ~7+ years of software development experience ~... 

    Watney Robotics Inc

    San Francisco, CA
    1 day ago
  •  ...Staff Software Engineer, Payroll Data Payroll Data is the source of truth that powers Rippling's Global Payroll ecosystem—fueling reporting, tax...  ...role in designing and building the high-scale data infrastructure and query systems that serve millions of employees globally... 
    Work at office
    3 days per week

    ZoneIn

    San Francisco, CA
    1 day ago
  • $189k - $330.75k

     ...Staff Software Engineer - Data Bridge Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce...  ...If you are serious about your craft, eager to establish infrastructure with a long-term impact, and have a focused approach to... 
    Work experience placement
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  • $148k - $260k

     ...want to impact the world in a positive way. To learn more visit: As a Senior/Staff Software Engineer embedded within our Autonomy & Algorithms team, you will build the scalable ML data pipelines necessary to train and evaluate Waabi's autonomous driving platform. Working... 
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    1 day ago
  • $146k - $270k

     ...Can you translate business needs into technical requirements and implementation? If you answered yes, then our Senior Staff Software Engineer (Data) role on our Xbox Advertising Engineering team may be the right role for you! We are seeking a Senior Staff... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Relocation package

    Microsoft Corporation

    San Francisco, CA
    1 day ago
  • $183.8k - $263.6k

     ...-generation industry-leading platform for machine data? We are looking for a Senior Software Engineer to join Splunk's Data Platform - Data Orchestration...  ...a larger product in quick time working with cloud infrastructure services such as AWS/Azure/GCP, Kubernetes, CI/CD,... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    San Francisco, CA
    3 days ago
  • $200k - $275k

     ...Staff Software Engineer, Data Governance Peregrine helps public safety organizations, state and local and governments, federal agencies, and...  ..., Pulumi, Terraform, and Kubernetes as our underlying infrastructure. About You Build scalable, secure-by-default frameworks... 
    Work at office
    Local area

    Peregrine Corporation

    San Francisco, CA
    1 day ago
  •  ...manage climate and ESG data, produce audit-ready...  ...abstractions, tooling, and infrastructure that empower data...  ..., analysts, and other engineering teams to safely and efficiently...  ...looking for Senior to Staff level for this role....  ...experience in backend software engineering with a... 
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    6 days ago
  • $155.5k - $287.88k

     ...Can you translate business needs into technical requirements and implementation? If you answered yes, then our Senior Staff Software Engineer (Data) role on our ads engineering team may be the right role for you! We are seeking a Senior Staff Software Engineer (... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Relocation package

    King

    San Francisco, CA
    3 days ago
  • $169k - $225k

     ...Senior Staff Software Engineer As a Senior Staff Software Engineer, you will play a key role in...  ...developing scalable, high-throughput data acquisition systems that power IntelliPro...  ...cross-functionally with platform, infrastructure, and DataOps teams to embed data... 
    Full time
    Remote work

    Intellipro Group

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns high-frequency telemetry into engineering insights for mission-critical systems. Teams use Sift to build and operate rockets, satellites, autonomous vehicles, energy systems... 
    Permanent employment
    Work at office
    Relocation

    Sift Science

    San Francisco, CA
    2 days ago
  •  ...Data Cloud Engineer Rippling is the first way for businesses to manage all of their HR & IT—payroll, benefits, computers, apps, and more...  ...analytics copilot. What You'll Do: Develop high-quality software with attention to detail using tech stacks like Python,... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  • $220k - $260k

     ...Staff Software Engineer, Agentic Data Plane San Francisco, CA (Hybrid) Redpanda is pioneering the Agentic Data Plane (ADP) - a new category in AI infrastructure that makes it simple and secure to connect AI agents with enterprise data and systems. Built on a multi-modal... 
    Work at office

    Redpanda Data

    San Francisco, CA
    1 day ago
  •  ...Mission The Privacy & Conversion Data team is responsible for how...  ...operate the core privacy infrastructure behind ads reporting and...  ...Role Summary We’re seeking a Staff Engineer to lead the architecture and...  ...experience. 8+ years of professional software engineering experience, with... 
    Work at office
    Remote work
    Relocation
    Relocation package

    GrabJobs

    San Francisco, CA
    2 days ago
  • $140.4k - $372.3k

     ...the world's leading platform for agentic software development - powered by Copilot to build...  ...United States Overview As a software engineer at GitHub, you will enhance the...  ...Qualifications: Experience with designing a data strategy and leading the development of its... 
    Remote work

    GitHub

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Data Infrastructure. Be the first to apply!