Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$170k - $240k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $170,000-$240,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in San Francisco, CA vacancy
  •  ...About the Role Join a startup building an agentic data lakehouse platform. As a Senior Software Engineer, Distributed Data Systems, you'll work on a greenfield...  ..., or platform engineer ~ Experience with big data systems (Apache Spark, Hadoop) ~ Strong background... 
    Senior
    Big data
    Full time

    Clera

    San Francisco, CA
    1 day ago
  •  ...are looking for passionate engineers who are excited to build the data foundation for the...  ...layer of the internet. As a senior engineer on the Data Platform...  ...years of experience in software engineering, with deep...  ...Hands-on experience with big-data or streaming technologies... 
    Senior
    Big data
    Full time
    For contractors
    Internship
    Immediate start

    Persona

    San Francisco, CA
    1 day ago
  • $185k - $218k

     ...CheckrCheckr is building the data platform to power safe and...  ...every Checkr product. As a Senior Data Engineer, you'll lead the execution of...  ...proposalsWhat you bring5+ years of software engineering experience...  ...processingFamiliarity with big data technologies such as Kafka... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    3 days ago
  •  ...com addresses.About the Data Cloud TeamRippling Data...  ...first "context-aware, senior analyst" for HR and Finance...  ...- Owns the query engine (RQL, Rippling Query Language...  ...high-quality software with attention to detail...  ...CDC, and KafkaLeverage big data technologies like... 
    Senior
    Big data
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...their business. Founded by engineers — and customer obsessed — we...  ...traditional SQL query engines. As a software engineer on the Runtime team...  ...source standard framework for big data.Data Plane Storage:... 
    Senior
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    5 days ago
  • $185k - $218k

     ...Senior Data EngineerDenver, Colorado, United States; San Francisco, California...  ...product.As a Senior Data Engineer, you'll lead the execution of...  ...You Bring5+ years of software engineering experience building...  ...stream processingFamiliarity with big data technologies such as... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    3 days ago
  • $123.7k - $254.67k

     ...platform purpose-built for performance marketers. We leverage massive data and cutting-edge science to automate and optimize TV advertising...  ...platform advertisers can trust to grow their business.As a Data Engineer at tvScientific, you will be a key player in implementing the... 
    Big data
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $170.4 per hour

     ...Databricks, we are passionate about enabling Data & AI teams to solve the world's toughest...  ...to improve their business. Founded by engineers, we leap at every opportunity to tackle technical...  ...Track: Expertise in large-scale big data solutions and ETL pipelines using Spark... 
    Senior
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  •  ...world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our...  ...opportunities, join us, and build real world value. As a Senior Software Engineer on the Data Engineering team, you are a core builder of the Caspian Data... 
    Senior
    Full time

    Ripple

    San Francisco, CA
    1 day ago
  •  ...and how we use AI in our recruiting process here.We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  •  ...billions in ad spend worldwide. With support from PhD economists, data scientists, and growth experts, Haus’ AI-driven technology...  ...~4+ years experience building backend services & APIs (backend Engineer, full stack engineer, data engineer or similar) ~ Proficiency in... 
    Senior
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Haus Analytics

    San Francisco, CA
    1 day ago
  •  ...growing rapidly and looking for exceptional people to join us. About the Role We are looking for a Senior Software Engineer to join our Online Data Stores team, a critical part of the Infrastructure team at Persona. You'll play a key role in building, maintaining... 
    Senior
    Remote job
    Full time
    For contractors
    Internship

    Persona

    San Francisco, CA
    1 day ago
  • $266k

     ...Platform at OpenAI owns the foundational data stack powering critical product, research...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ...at OpenAI. You will scale and harden big data compute and storage platforms, build... 
    Big data
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $144k - $288k

     ...Your Impact at LILA Join us in shaping the future of science! We are seeking Senior Software Engineers with backend experience to join our Data Platform Team (Data), where you’ll collaborate with software engineers, lab scientists, and machine learning engineers... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    1 day ago
  • $164k

     ...About the Role The Data engineering team has been created keeping in mind the importance and criticality of data for the overall success...  ...company, and our members. We believe in being bold, dreaming big, and taking risks, while also working together, embracing our... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Night shift

    Chime Financial

    San Francisco, CA
    1 day ago
  • $190k - $240k

     ...reliable access for training and evaluation. This is a senior software engineering role responsible for the systems after capture and the contracts...  ...remain reproducible rather than becoming ungoverned data volume. What you will do Build reliable ingestion... 
    Senior
    Full time
    Contract work

    Galactic Resource Advancement Mechanism

    San Francisco, CA
    1 day ago
  • PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Software Engineer - API & Data ConnectorsThis role sits in Data Products, which leverages the company's go-to-market, operations, and SRE functions and adheres to the company's engineering standards and tooling,... 
    Senior
    Local area
    Shift work

    Three Pillars Recruiting

    San Francisco, CA
    4 days ago
  • $162k - $216k

     ...design and ship category-defining software that enables Ryder and its 50,...  ...-facing software to the data platform that will power the next...  ...and creating impact for the engine of the American economy, you’ll...  ...foundation in data analytics and big data technologies, with the... 
    Big data
    Full time
    Work at office
    Immediate start

    Baton Trucking

    San Francisco, CA
    4 days ago
  •  ...Member Of Technical Staff - Data Infrastructure Software EngineerArena Intelligence is seeking a Member...  ...Staff - Data Infrastructure software engineer to join our team and build the data pipelines...  ...focus on data engineering and big data technologiesProficiency in SQL and... 
    Big data
    Permanent employment

    Arena AI

    San Francisco, CA
    3 days ago
  •  ...experience5+ years of experience in software development, with...  ...Circle CI, TravisExperience with big data, pharmaceutical/MedTech data,...  ...prioritizationPractical knowledge of software engineering best practices, including...  ...family.WHAT YOU'LL DOAs a Senior Software Engineer with the... 
    Senior
    Big data
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    4 days ago
  • $164k

    About the RoleThe Data engineering team has been created keeping in mind the importance and criticality of data for the overall success of Chime...  ...company, and our members.We believe in being bold, dreaming big, and taking risks, while also working together, embracing our... 
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    6 days ago
  •  ...backed by top-tier VCs. About You You are a passionate Senior Software Engineer eager to develop and scale our multi-tenant SaaS...  ...Developer certification is highly desirable. ~ Experience with Big Data technologies. ~ Work from anywhere in the US! We are fully... 
    Senior
    Big data
    Immediate start
    Remote work
    Home office
    Flexible hours

    Britive

    San Francisco, CA
    4 days ago
  • About the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases...  ...decision-making at DoorDash.About the RoleDoorDash is looking for a Senior Data Engineer to be a technical powerhouse to help us scale... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    6 days ago
  • $160k

    About the RoleThe Data Governance function is pivotal in ensuring the integrity, trustworthiness...  ...across the company. As a Data Governance Engineer, you will develop and implement policies...  ....We believe in being bold, dreaming big, and taking risks, while also working together... 
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    6 days ago
  • $167.7k - $245.2k

     ...worldwide, ingesting petabytes of data every day. This data powers...  ....We’re looking for a Data Engineer to help build and operate the...  ...pragmatic, organized approach to software quality, testing, and operational...  ...with empathy to make really big things happen on a global scale... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    CISCO Systems

    San Francisco, CA
    5 days ago
  • $166k - $225k

     ...are passionate about enabling data teams to solve the world's toughest...  ...their business. Founded by engineers — and customer obsessed — we...  ...'re only getting started.As a software engineer with a backend focus,...  ...management infrastructure powering the big data and machine learning... 
    Senior
    Big data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...the reason Anvil's handheld data collection system goes from "...  ...Physical AI: robotics hardware and software that is radically more...  ...Anvil already has specialist engineers deep in each piece of this system...  ...share of them under a senior engineer's cover — and is ready... 
    Senior
    Full time
    Relocation

    Anvil Robotics

    San Francisco, CA
    1 day ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...simplify data workflows for engineers, analysts, and ML practitioners...  ...Code, Codex, Cursor) in the full software development lifecycle,...  ...softwareExperience working on big data domains (streaming, batch... 
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • $192k - $240k

     ..., bill pay, and travel software, Brex enables founders...  ...only be limited by how big you can dream. We make...  ...to grow your career. Engineering at Brex Engineering...  ...Our teams span Software, Data, Security, and IT, and...  ...backend systems. As a Senior Software Engineer, you’... 
    Senior
    Full time
    Work at office
    Remote work
    Work from home

    Brex Inc.

    San Francisco, CA
    1 day ago
  • $180k - $225k

     ...ecosystem that ambitious teams build on. About this role: As a Senior Data Engineer at fal, you will build the data infrastructure that turns...  ...about in near real-time. This role sits at the intersection of software engineering and data engineering. You\'ll partner closely... 
    Senior
    Currently hiring
    Remote work
    Relocation package

    The Consensus

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!