Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$170k - $240k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $170,000-$240,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in New York, NY vacancy
  • $206k - $255k

     ...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering...  ...to the code?We're looking for a Senior Software Engineer to join Elliptic'...  ...environment.Hands-on experience with big data frameworks such as Spark or Databricks... 
    Senior
    Big data
    Remote work
    Home office

    Elliptic

    New York, NY
    1 day ago
  • Humana is seeking a Senior Cloud Solutions Engineer to design and develop cloud-based big data solutions using Microsoft Azure. You will lead technical decisions, collaborate...  ...to Humana offices; requires 5+ years in software development, strong SQL, and Azure/Data... 
    Senior
    Big data
    Remote job

    Humana

    New York, NY
    21 hours ago
  •  ...seeking a skilled Databricks Engineer with minimum of 5+ years of hands...  ..., and optimize scalable data platforms and analytics solutions...  ...technologies preferably Azure, and big data processing to support...  ...Engineer (9-15 Years Experience) Senior Azure Databricks Data... 
    Senior
    Big data

    EXL Service

    New York, NY
    1 day ago
  •  ...Openkyber in New York, NY is seeking a Senior Data Engineer to design and implement scalable data pipelines, optimize data warehouses, and drive high‑quality analytics through robust ETL processes. This contract role requires 12+ months, hybrid onsite in New York,... 
    Senior
    Big data
    Contract work
    Work at office
    Local area

    Jobleads-US

    New York, NY
    3 days ago
  • $160k - $240k

    Senior Software Engineer - VAULT Location New York Business Area Engineering and CTO Ref...  ...communications and financial transaction data across global enterprises. Thousands of...  ...Data ManagementAt the core of VAULT is big data at scale. Our systems handle... 
    Senior
    Big data
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    14 hours ago
  • $295k

     ...a team of researchers, engineers, designers, and more, who...  ...us!Role Overview:As a Senior Research Engineer in...  ...building tools to enable easy data synthesis, analysis,...  ...combines expertise in software engineering, statistics...  ...(e.g., PyTorch) and Big Data Analytics (e.g. BigQuery... 
    Senior
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    4 days ago
  • Bitsight is seeking a Senior Software Engineer (Big Data) to join our engineering team. This remote-first role focuses on building scalable data pipelines, ratings, and analytics for our Security Ratings product, with a cloud-first AWS stack and emphasis on reliability... 
    Senior
    Big data
    Remote job

    BitSight Technologies

    New York, NY
    4 days ago
  •  ...for the right patients, at the right time.We are seeking a Senior Software Engineer to help design, build, and scale high-quality software systems...  ...turn identified clinical, molecular, and other patient data into research-ready datasets. You'll design and scale the data... 
    Senior
    Full time
    Flexible hours

    Tempus

    New York, NY
    4 days ago
  • $150k - $200k

     ...verticals, supplemented with Data & AI, Cybersecurity, Risk...  ...seeking an experienced Senior Java Developer – Credit Risk & Data Engineering to design, develop, and enhance scalable software and data-processing solutions...  .... Experience with Big Data ecosystems and technologies... 
    Senior
    Big data
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    21 hours ago
  • $169k - $197k

     ...Entertainment is a member of the Sony family of global companies.Sony Music's Product Design Engineering and Global Operations (PDEGO) team is looking for a Senior Software Engineer, Data Operations to own the reliability, observability, and operational health of our data... 
    Senior
    Work at office
    Local area

    Sony Music Entertainment

    New York, NY
    3 days ago
  • $175k - $225k

     ...willingness to challenge consensus.About the TeamThe DRW C/FICCO Data Engineering team is essential to developing valuable datasets and...  ...tradingExperience with Linux-based, concurrent, high-throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g... 
    Senior
    Temporary work
    Flexible hours

    DRW

    New York, NY
    2 days ago
  •  ...About the Team Data Platform at OpenAI owns the foundational data stack powering...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ...at OpenAI. You will scale and harden big data compute and storage platforms, build... 
    Big data
    Work at office
    Relocation package

    OpenAI

    New York, NY
    21 hours ago
  • $184.9k - $250.2k

    Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data... 
    Senior
    Internship
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $195k - $408k

     ...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising...  ...understanding of algorithms, data structures, performance optimization...  ...is a plus Experience with Big Data and cloud services such... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    2 days ago
  • $225k - $300k

     ...’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products - going beyond ID to power a... 
    Senior
    Flexible hours

    Secure Identity

    New York, NY
    2 days ago
  • $186k - $223k

     ...to find a relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible for maintaining and...  ...Streaming : Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks, dbt BI... 
    Senior
    Big data
    Work experience placement

    Tinder

    New York, NY
    3 days ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...simplify data workflows for engineers, analysts, and ML practitioners...  ...Code, Codex, Cursor) in the full software development lifecycle,...  ...softwareExperience working on big data domains (streaming, batch... 
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    New York, NY
    2 days ago
  •  ...remote, fast-growing company building a high-performance advertising platform. The Senior Software Engineer will architect and optimize services, applying machine learning and big data to boost profitability and scale for Audiohook’s core business. You will own data pipelines... 
    Senior
    Big data
    Remote job

    Audiohook

    New York, NY
    21 hours ago
  •  ...decentralized finance (DeFi). The Chainlink stack provides the essential data, interoperability, compliance, and privacy standards needed...  ...Reserve. Learn more at chain.link.About the RoleAs a software engineer on the Data Products team, you’ll collaborate with an... 
    Senior
    Remote work

    Chainlink Labs

    New York, NY
    3 days ago
  •  ...Senior Software Engineer Focusing on Data We're looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems...  ...effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to... 
    Senior
    Flexible hours

    Arya Health

    New York, NY
    4 days ago
  • $210k - $220k

     ..., Addition, Stanford University, Coinbase, and Charles Schwab, among others. The Role Love data and building things that matter? We’re looking for a Software Engineer to join our Data team and help power decisions across the company. You’ll have the chance to dive... 
    Senior
    Flexible hours

    Crypto Pro Network

    New York, NY
    1 day ago
  • $174k - $220k

     ...provider websites and insurance directories to search engines, AI platforms, and more. Healthcare still lacks something...  ...Your Impact on our Mission: Zocdoc is hiring a Senior Software Engineer to build the data platform that connects our products with analytics,... 
    Senior
    Contract work
    Flexible hours

    Zocdoc

    New York, NY
    4 days ago
  • $175k - $250k

    Senior Software Engineer - Data PlatformAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution, innovation and focus, Millennium’s mission is to deliver results for our investors.Our people are empowered with... 
    Senior
    Flexible hours

    Millennium Management

    New York, NY
    2 days ago
  • $192k - $240k

     ...spend management, bill pay, and travel software, Brex enables founders and finance...  ...should only be limited by how big you can dream. We make this a reality...  ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and insights... 
    Senior
    Work at office
    3 days per week

    Brex

    New York, NY
    3 days ago
  •  ...AI-powered healthcare admin workforce with Luna, an AI receptionist that automates patient communication. We are hiring a (Senior) Software Engineer to scale Luna from hundreds to hundreds of thousands of practitioners by shipping production integrations and shaping... 
    Senior
    Remote job

    praxipal

    New York, NY
    3 days ago
  • $160k - $240k

    Senior Software Engineer - Data and Platform Tools - Bloomberg Connects Location New York Business Area Engineering and CTO Ref # 10054281 Description & Requirements Bloomberg Connects is a rapidly growing, free platform that helps museums, galleries... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $150k - $200k

     ...year Requirements: ~8+ years of professional experience in software engineering, data engineering, or application development, preferably in...  ...exposure data, RWA, and VaR. ~ Preferred: Experience with Big Data technologies such as Hive, HDFS, Iceberg, HBase, Impala... 
    Senior
    Big data
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    3 days ago
  • Grafana Labs is seeking a senior leader for the Session Replay squad within Grafana Cloud. You will shape end-to-end technical direction across frontend, backend, and data systems to deliver cohesive user experiences. You will drive backend architecture toward columnar/... 
    Senior
    Remote job

    Grafana

    New York, NY
    1 day ago
  • People Data Labs is hiring engineers to advance our data-as-a-service platform. You will work on both frontend and backend components, focusing on Python-based APIs and React/TypeScript interfaces. You will help evolve our existing patterns, build scalable UI components... 
    Senior
    Remote job

    People Data Labs

    New York, NY
    2 days ago
  • $180k - $230k

     ...performance central limit order book matching engine with automated market making to provide...  ...finance industries.  CoinDesk Data - a broad suite of digital assets market data...  ...and FIXML protocols. Familiarity with big data management and data lake ecosystems (... 
    Senior
    Big data
    Full time

    Bullish

    New York, NY
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!