Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$140k - $200k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:

To actively connect people to their next great opportunity.

Who We Are:

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan

The US base salary range for this full-time position is $140,000-$200,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in New York, NY vacancy
  • $206k - $255k

     ...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering...  ...to the code?We're looking for a Senior Software Engineer to join Elliptic'...  ...environment.Hands-on experience with big data frameworks such as Spark or Databricks... 
    Senior
    Big data
    Remote work
    Home office

    Elliptic

    New York, NY
    4 days ago
  •  ...Senior Software Engineer, Data PlatformThe Viacom Data Platform is looking for an awesome Sr. Software Engineer with professional, hands-on experience...  ...working knowledge of Node.JS and JQueryUnderstanding of big data technologies such as Apache Spark, Apache... 
    Senior
    Big data

    ClifyX

    New York, NY
    1 day ago
  • Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote...  ...and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives. #J-18808-Ljbffr... 
    Senior
    Big data
    Remote job

    Mount Sinai Health System

    New York, NY
    5 days ago
  •  ...technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should...  ...experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional... 
    Senior
    Big data

    TechDigital Group

    New York, NY
    4 days ago
  • $158k - $197k

    Who We AreAddepar is a global data and AI platform empowering...  ...integrates with nearly 650 software, data and consulting partners...  ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data...  ...knowledge on distributed systems & big data processingBuild the... 
    Senior
    Big data
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    4 days ago
  • $158k - $197k

     ...Are Addepar is a global data and AI platform empowering investment...  ...integrates with nearly 650 software, data and consulting...  ...We are currently seeking a Senior Software Engineer to join Addepar’s Data Platform...  ...on distributed systems & big data processing Build the... 
    Senior
    Big data
    Full time
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    2 days ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality...  ...AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $21... 
    Senior
    Big data

    Komodo Health

    New York, NY
    5 days ago
  •  ...impact on those around you through data solutions. Partner with an organization...  ...your leadership career. As a Senior Director of Software Engineering at JPMorganChase within the Employee...  ...Owner or Product ManagerExperience in Big Data technologies handling complex data... 
    Senior
    Big data
    Work at office

    JP Morgan Chase

    New York, NY
    5 hours ago
  • $124k - $135k

     ...Mission or Department Overview The Data Platform Mission aims to...  ...We are looking for Analytics Engineers that can help develop a new function...  ...office in Times Square. As a Senior Analytics Engineer, you'll...  ...Proficiency with GCP, AWS, or other big data environments Familiarity... 
    Senior
    Big data
    Work at office
    Local area
    Flexible hours

    The New York Times

    New York, NY
    2 days ago
  • A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities... 
    Senior
    Big data

    STEM Xpert

    New York, NY
    2 days ago
  • $137.75k - $185k

     ...contribute to a winning culture and team. As a Data Engineer III at JPMorgan Chase within the...  ...protection of enterprise data Executes software solutions, design, development, and...  ...such as JSON, AVRO, Protobuf, or similar, big-data storage formats such as Parquet, Iceberg... 
    Big data
    Full time

    JPMorgan Chase & Co.

    New York, NY
    2 days ago
  • $250.8k - $286.2k

    Capital One is actively seeking a Senior Lead Data Engineer in New York, NY. This position involves collaborating within Agile teams to design and develop innovative solutions using cloud and big data technologies. As a leader, you will guide fellow engineers in tackling... 
    Senior
    Big data

    Capital One

    New York, NY
    2 days ago
  • We're transforming our customer support data from static, disconnected reports into a live...  .... We're looking for an experienced Data Engineer to build the pipelines, storage, and logic...  ...Skills 5+ years in data engineering with big data tools (Hadoop, Hudi, Spark, Presto, Pinot... 
    Senior
    Big data

    Pegasus Knowledge Solutions

    New York, NY
    2 days ago
  •  ...Software Development EngineerAs part of the AWS Applied AI Solutions...  ...Software Development Engineers to join us to innovate on this...  ...development, and work closely with senior technical leaders within the...  ...SOA, NoSQL databases, AI, ML, Big Data and more.This team is a great... 
    Senior
    Big data
    Worldwide

    Amazon

    New York, NY
    5 days ago
  • $270k - $380k

     ...a team of researchers, engineers, designers, and more, who...  ...us!Role Overview:As a Senior Research Engineer in...  ...building tools to enable easy data synthesis, analysis,...  ...combines expertise in software engineering, statistics...  ...(e.g., PyTorch) and Big Data Analytics (e.g. BigQuery... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    2 days ago
  • $184.9k - $250.2k

     ...massive volumes of advertiser data every single day. You'll work...  ...first-rate monitoring so our engineers can keep their heads down...  ...linearizability, eventual consistency), big data problems (propagation...  ...more.We're seeking to hire a Senior Software Development Engineer to join... 
    Senior
    Big data
    Internship
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  •  ...experience5+ years of experience in software development, with...  ...Circle CI, TravisExperience with big data, pharmaceutical/MedTech data,...  ...prioritizationPractical knowledge of software engineering best practices, including...  ...family.WHAT YOU'LL DOAs a Senior Software Engineer with the... 
    Senior
    Big data
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    5 hours ago
  •  ...decentralized finance (DeFi). The Chainlink stack provides the essential data, interoperability, compliance, and privacy standards needed...  ...Reserve. Learn more at chain.link.About the RoleAs a software engineer on the Data Products team, you’ll collaborate with an... 
    Senior
    Remote work

    Chainlink Labs

    New York, NY
    2 days ago
  • $184.9k - $250.2k

    Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data... 
    Senior
    Internship
    Flexible hours

    Amazon

    New York, NY
    4 days ago
  • $175k - $225k

     ...willingness to challenge consensus.About the TeamThe DRW C/FICCO Data Engineering team is essential to developing valuable datasets and...  ...tradingExperience with Linux-based, concurrent, high-throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g... 
    Senior
    Temporary work
    Flexible hours

    DRW

    New York, NY
    5 hours ago
  • $195k - $408k

     ...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising...  ...understanding of algorithms, data structures, performance optimization...  ...is a plus Experience with Big Data and cloud services such... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    5 hours ago
  • $121.4k - $161.8k

     ...where you can learn and collaborate with some of the most talented people in the industry.Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on building a cutting-edge game analytics platform and tools to better understand our... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    3 days ago
  • $100k - $250k

     ...Software Engineer, DataKalshi is defining a new category. Kalshi has defined a new category: prediction...  ...markets.Role RoadmapAs our go to data person at Kalshi, you build and operate...  ...pipelining and machine learning, Spark for big data processing, and visualization through... 
    Big data
    Local area

    Kalshi

    New York, NY
    3 days ago
  • $225k - $300k

     ...’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products - going beyond ID to power a... 
    Senior
    Flexible hours

    Secure Identity

    New York, NY
    5 hours ago
  • $200k - $220k

     ...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and...  ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-...  ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding... 
    Senior
    Big data

    Schonfeld

    New York, NY
    2 days ago
  • $140k - $160k

     ...centers on making journalism so good that it’s worth paying for. About the Role:The New York Times is looking for a Senior Software Engineer to join the Content Data Products team. You will report to an engineering manager and partner with engineers, product and project... 
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week

    The New York Times

    New York, NY
    5 hours ago
  • $190k - $240k

     ...Senior Data Platform Engineer New York, New York, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help...  ...~ Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience managing clusters that run... 
    Senior
    Big data
    Work at office
    2 days per week

    Tatari

    New York, NY
    4 days ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...simplify data workflows for engineers, analysts, and ML practitioners...  ...Code, Codex, Cursor) in the full software development lifecycle,...  ...softwareExperience working on big data domains (streaming, batch... 
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    New York, NY
    5 hours ago
  • $186k - $223k

     ...find a relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible for maintaining and...  ...Actions Streaming : Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks, dbt BI... 
    Senior
    Big data
    Work experience placement

    Match Group

    New York, NY
    2 days ago
  • $145k - $182k

     ...Senior AI/ML EngineerWe're looking for a Senior AI/ML Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven...  ...integrate cutting-edge AI and big data technologiesYou'll...  ...efficiency.Collaborate with software engineers to integrate... 
    Senior
    Big data
    Work at office
    Shift work
    3 days per week

    BlackLine

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!