Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Data Infrastructure

$200k - $275k
Full-time

Peregrine Technologies

Backed by leading Silicon Valley investors, Peregrine helps public safety organizations, state and local and governments, federal agencies, and private-sector institutions address society’s challenges with unprecedented speed and accuracy. Our AI-enabled platform turns siloed and disconnected data into operational intelligence — instantly surfacing mission-critical information to empower better, faster decisions that improve outcomes at every touchpoint. Today Peregrine supports hundreds of customers across 30+ states and two countries, serving more than 125 million people — and we’re amplifying our impact as we expand into the enterprise and internationally.

Team

As an engineering team, we believe strongly that empathy improves our solutions. Seeing how people use the product is a priority and the way we get to the right answer. Engineers will have the opportunity to work closely with our team onsite to understand the variety of use cases that Peregrine serves.

We value both ownership and collaboration—you will take full responsibility for major features and work closely with other engineers to drive them to completion. We believe that humility and empathy are essential for building the right solutions—you will collaborate directly with our deployment team and users as we iterate to solve their problems. Perseverance and creativity are crucial to executing our vision.

Role

We are looking for a Staff Data Infrastructure Engineer to join our growing team, where you will have deep ownership over the data layer that underpins everything Peregrine does. You will architect and build the systems that ingest, store, and serve massive volumes of real-time operational data — enabling our customers to make critical decisions with speed and confidence.

This is a senior individual contributor role for someone who thrives on hard technical problems and brings the experience and judgment to shape foundational infrastructure decisions. You will tackle a wide range of complex challenges, including:

  • Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
  • Architecting a scalable open table format layer for reliable data storage at petabyte scale
  • Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
  • Driving performance, reliability, and cost efficiency across the full data infrastructure stack
  • Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
  • Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization

Our stack is constantly evolving but is built on AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, Kubernetes, and more.

About You

  • Deep passion for data infrastructure — you care about building systems that are correct, fast, and resilient at scale
  • Thrive on ambiguity and are energized by defining the right solution to hard, open-ended problems
  • Strong technical vision with the ability to translate complex data requirements into clean, durable infrastructure designs
  • Desire to own significant portions of the data stack end-to-end, from ingestion to serving
  • Committed to operational excellence — you build things you’re proud to operate

What We Look For

  • 8+ years of experience architecting and operating large-scale data infrastructure systems in production environments
  • Deep expertise with open table formats, particularly Apache Iceberg — including schema evolution, partitioning strategies, compaction, and time travel
  • Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
  • Strong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
  • Solid experience with data pipeline orchestration using Airflow or similar tools
  • Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
  • Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures
  • Experience with Kubernetes and containerized deployment of data workloads
  • Degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Located in San Francisco and open to working in office

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Annual Salary + Benefits + Equity (if applicable) + Bonus (if applicable)

$200,000—$275,000 USD

Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, certifications or licenses, and specific work location. Information on the benefits offered is here.

Peregrine Technologies is committed to creating an inclusive environment for all employees. We celebrate diversity and are a proud equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Data Infrastructure in San Francisco, CA vacancy
  •  ...system to one source of truth for employee data, businesses can automate all of the...  ...copilot. What You'll Do:Develop high-quality software with attention to detail using tech...  ...APIs or platform spacesBuild and grow your engineering skills in different challenging areas... 
    Suggested
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  • $208.59k - $429.45k

     ...AI in our recruiting process here.The Data Product Platform is mission-critical...  ...leverage our vast data assets and capable infrastructure effectively.Data Governance: Defining...  ...of all data.We are seeking a Sr. Staff Software Engineer to provide technical leadership and... 
    Suggested
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $250k - $280k

     ...Staff Software Engineer, AI Data Platform Shape the Future of AI At Labelbox, we're building the critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. Since 2018, we've been pioneering data-centric approaches that are... 
    Suggested
    Freelance
    Work at office
    Flexible hours
    3 days per week

    WeHireYou

    San Francisco, CA
    1 day ago
  • $260k - $350k

     ...and ship category-defining software that enables Ryder and its...  ...-facing software to the data platform that will power the...  ...creating impact for the engine of the American economy, you...  ...ll love it here. Role: Staff Software Engineer - Infrastructure Pod: Data Platform... 
    Suggested
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    a month ago
  •  ...Hivemapper Data Platform Engineer Hivemapper is a decentralized global map data network built...  ...Tech-savvy customers develop and deploy software directly to our dashcams to get...  ...for the core distributed systems, ML infrastructure, data model abstractions, and data engine... 
    Suggested
    Flexible hours

    Hivemapper

    San Francisco, CA
    1 day ago
  • $252k - $315k

    Software is eating the world, but AI is eating software. We live in unprecedented times - AI has the potential to exponentially augment...  .... At Scale, our products include the Generative AI Data Engine, SGP, Donovan, and others that power the most advanced LLMs and... 
    Full time
    Live in

    Scale AI

    San Francisco, CA
    4 days ago
  • $279k - $341k

     ...gets excited about building data infrastructure at massive scale and cares deeply...  ...Discord users and Discord engineers. We're building the next...  ...world. If you're the kind of Staff Engineer who sees ambiguity...  ...you should have 7+ years of software engineering experience with... 
    Full time
    Work at office
    Worldwide
    Relocation
    Relocation package
    2 days per week
    1 day per week

    Discord

    San Francisco, CA
    5 days ago
  • $197.3k - $313.7k

     ...Key ManagementInternational Data ResidencyImage Uploads, Downloads...  ...critical production infrastructure — driving reliability and uptime...  ..., and the judgment to weigh engineering vs. product trade-offs and...  ...AWS Building and releasing software with Docker containersKubernetesExperience... 
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  • $245.4k - $429.45k

     ...AI in our recruiting process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions of...  ...with AI.Pinterest’s Product ML Infrastructure (PMLI) team enables fast, safe, and efficient...  ...critical products. We build unified data, training, feature, and inference... 
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce...  ...Enterprise Key Management, International Data Residency, Image Uploads, Downloads,...  ...Experience managing critical production infrastructure, maintaining reliability and uptime,... 
    Work experience placement

    Engg

    San Francisco, CA
    1 day ago
  •  ...Washington D.C., London and Amsterdam. The Data Governance team makes sure Plaid...  ...to us as much as throughput. As a Staff Software Engineer on Data Governance, you will set the...  ...through to shipped, auditable infrastructure — decomposing the hard problems, aligning... 
    Full time
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    5 days ago
  •  ...ambition in the physical world. Critical infrastructure is constrained by labor shortages, hazardous...  ...speed and capacity of buildout, starting with data centers. About the Role At Watney, ML Infrastructure engineers turn data collected from a live fleet of... 

    Watney

    San Francisco, CA
    a month ago
  • $177.19k - $364.8k

     ...recruiting process here.We are looking for a Staff Software Engineer to help improve the quality and velocity of data science at Pinterest. You will shape the future...  ...in automation, anomaly detection, or infrastructure/workflow optimization.Experience building internal... 
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  •  ...Salesforce is seeking engineers for the Slack Infrastructure team focused on Distributed Data Services. You will design, build and maintain edge caching services powering a large portion of Slack's API traffic, collaborating across the engineering stack to ensure reliability... 

    Jobleads-US

    San Francisco, CA
    22 hours ago
  • $194k - $267k

     ...of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era...  ...the world. We are looking for an experienced full stack Staff Software Engineer (with a focus on UI) who is passionate about building large... 
    Permanent employment
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    3 hours ago
  •  ...do. About the role: As a member of the infrastructure team, you’ll play a key role in maintaining...  ...customer growth Partner with other engineering teams to ensure we build reliable product...  ...) You have 9+ years of experience in software engineering, and you’ve worked in in the... 
    Work at office
    Remote work
    3 days per week

    Orb

    San Francisco, CA
    3 days ago
  • $200k - $260k

    About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns high-frequency telemetry into engineering insights for mission-critical systems. Teams use Sift to build and operate rockets, satellites, autonomous vehicles, energy systems,... 
    Permanent employment
    Work at office
    Relocation

    Sift Science

    San Francisco, CA
    1 day ago
  • $210k - $300k

     ...obsessed team of the world's best engineers and operators. If you are obsessed...  ...About the Role We're looking for a Software Engineer to join our ML Infrastructure team. In this role, you'll help...  ..., including high-throughput data ingestion, dataset sharding and sampling... 
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    a month ago
  •  ...CoreWeave combines superior infrastructure performance with deep...  ...for working with data, alongside a world-class...  ...tackling challenging engineering problems, and are...  ...About the Role: As a Staff Engineer on Marimo's molab...  ...years of experience in software engineering - Strong fundamentals... 
    Full time
    Work experience placement
    Worldwide

    Coreweave

    San Francisco, CA
    23 days ago
  • $300 per month

     ...only vertically integrated AI infrastructure company built from the...  ...across energy, manufacturing, data center construction, and cloud...  ...Data Center Infrastructure Engineering (DCIE) team is fundamental to...  ...highly skilled and motivated Software Engineer to join Crusoe’s... 
    Temporary work

    Crusoe

    San Francisco, CA
    22 days ago
  • $207.6k - $273.6k

     ...London and Amsterdam. Making data driven decisions is key to...  ...and guidance to teams across engineering, product, and business and...  ...effectively. Engineers on Data Infrastructure are domain experts in Data...  ...~6+ years of software engineering experience ~ Extensive... 
    Remote job
    Full time
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    a month ago
  •  ...the Role You'll build the software backbone that powers autonomous...  ...at Tenkara. As a Senior/Staff Software Engineer on the Platform team, you'...  ...scalable backend services, data pipelines, and integrations...  ...productionize LLM-based agents, AI/ML infrastructure, and RAG patterns for... 
    Full time

    Tenkara

    San Francisco, CA
    19 days ago
  • $160k - $250k

     ...serving US manufacturers. As a Senior/Staff Platform Engineer, you will build the software layer that powers autonomous...  ...backend services, intelligent data pipelines, and deep integrations...  ...productionize LLM-based agents, AI/ML infrastructure, and RAG patterns for... 
    Visa sponsorship

    Clera

    San Francisco, CA
    a month ago
  • $215k - $260k

     ...As the only vertically integrated AI infrastructure company built from the ground up, we...  ...experts across energy, manufacturing, data center construction, and cloud services...  ...About the Role: We are seeking a Staff Software Engineer to lead distributed systems design... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    a month ago
  • $185k - $240k

     ...teams to turn ideas into working software, we are hiring a Staff Platform Software Engineer to ensure that this new...  ...Engineers, application teams, and infrastructure partners, you will define the platforms...  ...working with internal tools, data systems, or AI-enabled... 
    Local area

    Zipline

    San Francisco, CA
    a month ago
  • $189k - $236k

     ...on the lookout for talented Mobile iOS Engineers with 12+ years of experience who have the...  ...Identity, Security, System Design, and Infrastructure, collaborating to build solutions that...  ...0 years of experience in Swift and iOS software engineering, with at least 12 years in... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    gusto

    San Francisco, CA
    more than 2 months ago
  •  ...Staff Software Engineer Opportunity Lunar is a stealth technology company building a new type...  ...fundamental rebuild of the information infrastructure that runs health systems. All of it –...  ...essential for handling real-time patient data in mission-critical settings like... 

    Lunar GMBH

    San Francisco, CA
    2 days ago
  • $250k - $295k

     ...Staff Software Engineer Unify is building the first AI-native outbound platform where agents and sellers work side by side. We help revenue...  ...teams identify buyers already in market, enrich accounts with data from 40+ sources, and execute personalized, multi-channel outreach... 

    Unify

    San Francisco, CA
    4 days ago
  •  ...and implement secure multi-tenant infrastructure that isolates customer data and supports AI model serving....  ...Cursor or Claude Code to improve engineering effectiveness. ~ Experience with...  ...engineer; internal platform development; software supply-chain security; static... 
    Full time
    Work at office

    Decagon

    San Francisco, CA
    3 days ago
  •  ...Sentry is seeking a Staff Software Engineer for the Issues team in San Francisco. You will architect systems powering the issue workflow, build real-time data pipelines, search backends, and analytics that scale to billions of events. You’ll guide architectural decisions... 

    Jobleads-US

    San Francisco, CA
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Data Infrastructure. Be the first to apply!