Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$170k - $240k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $170,000-$240,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in San Francisco, CA vacancy
  • $180k - $250k

     ...the deployment of the data centers that will power...  ...for the AI economy. Our software helps the world's largest...  ...role supports Core Engineering needs within the organization...  ...or a related field Senior level software...  ...knowledge of scaling "big data" solutions in cloud... 
    Big data
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    29 days ago
  • About the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases...  ...decision-making at DoorDash.About the RoleDoorDash is looking for a Senior Data Engineer to be a technical powerhouse to help us scale... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    12 hours ago
  • $193.93k - $291.15k

     ...output generalists where ML and systems engineering converge. This is  not a "run the models...  ...performance, and raise the bar on the data and evaluation loop that drives autonomy...  ...quantitative area. ~4+ years of industry software engineering experience with Python... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    29 days ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...simplify data workflows for engineers, analysts, and ML practitioners...  ...Code, Codex, Cursor) in the full software development lifecycle,...  ...softwareExperience working on big data domains (streaming, batch... 
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    12 hours ago
  • $162k - $216k

     ...design and ship category-defining software that enables Ryder and its 50,...  ...-facing software to the data platform that will power the next...  ...and creating impact for the engine of the American economy, you'll...  ...foundation in data analytics and big data technologies, with the... 
    Big data
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    29 days ago
  • $190k - $240k

    Senior Data Platform Engineer San Francisco, California, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help...  ...) Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience managing clusters that run... 
    Senior
    Big data
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    2 days ago
  •  ...ecosystem that ambitious teams build on. About this role: As a Senior Data Engineer at fal, you will build the data infrastructure that turns...  ...in near real-time. This role sits at the intersection of software engineering and data engineering. You'll partner closely with... 
    Senior
    Currently hiring
    Relocation package

    features and labels

    San Francisco, CA
    12 hours ago
  • $162k - $215k

     ...require a BA/BS in Computer Science or equivalent practical experience. We look for 6+ years of post-university experience in data engineering, integration engineering, or backend/full stack engineering, ideally in financial services or trading. We need a strong... 
    Senior
    Full time
    Apprenticeship
    Work at office
    Work from home
    Flexible hours

    BlackRock

    San Francisco, CA
    14 days ago
  • $133k - $150k

     ...you're considering We are seeking a highly experienced Senior Data Engineering Lead with minimum 8+ years' experience in modern data engineering...  ...Synapse, Azure SQL, Amazon Redshift, Snowflake or Google Big Query), and data lake technologies on the Azure cloud.... 
    Senior
    Big data
    Full time
    Local area

    Capgemini

    Brisbane, CA
    2 days ago
  • $160k - $221k

     ...About the Role The Data Governance function is pivotal in ensuring the integrity, trustworthiness...  ...across the company. As a Data Governance Engineer, you will develop and implement policies...  .... We believe in being bold, dreaming big, and taking risks, while also working... 
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Chime Financial, Inc

    San Francisco, CA
    2 days ago
  • $170k - $205k

     ...experts across energy, manufacturing, data center construction, and cloud services...  ...This Role: Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing...  ...Across Engineering Teams: Partner with software engineers, data scientists, and... 
    Senior
    Full time
    Temporary work
    Work at office
    Remote work

    Crusoe

    San Francisco, CA
    4 days ago
  • Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building fast...  ...learning, data scientists, design, software engineering, and business process optimization...  ...Experience with Apache Spark or other Big Data frameworks; working with cloud... 
    Senior
    Big data
    Full time
    Work experience placement

    1872 Consulting

    San Francisco, CA
    2 days ago
  •  ...Well-established consumer software company with a large global...  ...parental leave. The Role Senior IC role on a data innovation team responsible...  ...at the intersection of data engineering, data science, and data quality...  ...-wide Apply AI/ML and big-data techniques to automate... 
    Senior
    Big data
    Local area

    Syndesus, Inc.

    San Francisco, CA
    2 days ago
  • $150.4k - $277.6k

    Senior Data Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming great...  ...with a background in large scale software development and delivery in hyper-scale...  ...Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI workflows... 
    Senior
    Big data
    Relocation

    Apple

    San Francisco, CA
    2 days ago
  • $185k - $218k

     ...Checkr Checkr is building the data platform to power safe and...  ...every Checkr product. As a Senior Data Engineer, you'll lead the execution of...  ...What You Bring 5+ years of software engineering experience...  ...processing. Familiarity with big data technologies such as Kafka... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours
    3 days per week

    Checkr, Inc.

    San Francisco, CA
    12 hours ago
  • Lead Software Engineer San Francisco, California Onsite Job Summary: As a Lead...  ...Software Engineer focused on Data Quality, you will lead the...  ...at least 2 years in a lead or senior engineering role. Strong proficiency...  ...Apache Spark and Hadoop for big data processing. Solid... 
    Senior
    Big data

    Yantran LLC

    San Francisco, CA
    12 hours ago
  • $260k - $350k

     ...design and ship category-defining software that enables Ryder and its 50,...  ...-facing software to the data platform that will power the next...  ...and creating impact for the engine of the American economy, you'll...  ...Comprehensive knowledge of modern big data ~5+ years experience in... 
    Big data
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    29 days ago
  • $196k - $269.5k

     ...At Faire, we're using the power of tech, data, and machine learning to connect this thriving...  ...of hypergrowth. As a product analytical engineer, you will own the end-to-end ads data...  ...knowledge of data warehousing concepts, ETLs, big data technologies, and analytics platforms... 
    Senior
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    1 day ago
  • $165k - $221k

     ...improve healthcare, we'd love to hear from you. About the Role - Foremost a software engineer . You exemplify high code quality and guide others, and have at least 5 years of industry experience as a data engineer or similar role. - You are experienced in creating automated... 
    Senior
    Full time
    Remote work
    Work from home
    Home office
    Flexible hours

    Doximity

    San Francisco, CA
    21 days ago
  • $160k - $200k

     ...systems that move essential goods where they are needed. As a Senior Data Engineer on the Data Platform team, you will build cloud data...  ...tradeoffs. What You'll Bring ~5+ years of professional software or data engineering experience, including production systems... 
    Senior
    Full time
    Local area

    Zipline

    San Francisco, CA
    29 days ago
  •  ...legal entity.Atlassian’s Trusted Data Platform (TDP) provides...  ...database platform. It gives engineering teams a supported way to build...  ...independently.We are looking for a Senior Engineering Manager to lead...  ...potential of every team. Our software products help teams all over... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    2 days ago
  • A leading compensation platform company in San Francisco is seeking experienced backend engineers to build and maintain robust, data-rich systems for compensation processes. Ideal candidates have strong product intuition and hands-on experience with technologies like Node... 
    Senior
    Flexible hours

    Jobleads-US

    San Francisco, CA
    12 hours ago
  • $150k - $180k

    Senior AI Platform Engineer SS&C Advent's financial solutions are going Agentic! And we're growing the team to get us there. Our best-of-breed products...  ..., and advanced orchestration on top of our enterprise big data platform. We are looking for Senior AI Platform Engineers... 
    Senior
    Big data
    Ongoing contract
    Casual work
    Flexible hours

    Blue Prism Group

    San Francisco, CA
    1 hour ago
  •  ...Job Description Job Description JOB DESCRIPTION  We’re looking for a Big Data Systems Engineer - Cloud (DevOps). We offer: remote work with a globally disparate team; an opportunity to join an AWS Advanced Technology Partner; and unrivalled Kubernetes global... 
    Big data
    Remote work

    Hired Recruiters

    San Francisco, CA
    9 days ago
  •  ...Job Description Job Description Sr. Data Engineer  Employment Type: Full-Time, Mid-level Department: Business Intelligence   CGS...  ...manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding... 
    Senior
    Big data
    Full time
    Flexible hours

    Contact Government Services, LLC

    San Francisco, CA
    a month ago
  • $132.26k - $155.6k

     ...at—all from Day One.Job DescriptionJob Duties -Responsible for big data/analytics projects that gather and integrate large volumes of...  ...in a quantitative field such as statistics, computer science, engineering or applied mathematics, or equivalent work experience - Six to... 
    Senior
    Big data
    Full time
    Work experience placement
    Local area

    US Bank

    San Francisco, CA
    3 days ago
  •  ...(s).Schwab Asset Management Technology supports the platforms, data, and research capabilities that help drive investment insights and product innovation across the firm. As a Quantitative Software Engineer - Research Data & Models, you will lead a team responsible for... 
    Full time
    Work at office

    The Charles Schwab Corporation

    San Francisco, CA
    1 day ago
  •  ...fraud before it starts. The mission is big, the problems are complex, and the impact...  ...a highly skilled and experienced Senior Software Engineer to join our dynamic engineering team within...  ...cloud computing, NoSQL databases, big data analytics, machine learning services, or... 
    Senior
    Big data

    Socure Inc

    San Francisco, CA
    5 days ago
  • $102.1k - $136.9k

    Job Posting Title:Product Software Engineer IReq ID:10157015Job Description:On any given day at Disney...  ...people around the world.The Product & Data Engineering team is responsible for end-...  ...Qualifications: Experience with big data tools including Databricks, Snowflake... 
    Big data
    Full time
    Work experience placement
    Worldwide

    Hulu

    San Francisco, CA
    7 hours ago
  •  ...Senior Solutions Engineer   About ArangoDB Arango delivers a unified, natively multimodel contextual data platform that powers AI agents, assistants, and applications with the unified...  ...for enterprise AI, databases, big data systems, analytics, or machine learning... 
    Senior
    Big data
    Full time
    Work from home

    Arango

    San Francisco, CA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!