Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$140k - $200k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $140,000-$200,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in New York, NY vacancy
  • $206k - $255k

     ...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering...  ...to the code?We're looking for a Senior Software Engineer to join Elliptic'...  ...environment.Hands-on experience with big data frameworks such as Spark or Databricks... 
    Senior
    Big data
    Remote work
    Home office

    Elliptic

    New York, NY
    7 days ago
  • Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote...  ...and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives. #J-18808-Ljbffr... 
    Senior
    Big data
    Remote job

    Mount Sinai Health System

    New York, NY
    3 days ago
  • Elevate and drive innovation, data engineering solutions, and serve as a decision maker for Firmwide...  ...Experience data products.As a Senior Lead Software Engineering at JPMorgan Chase within the...  ...volume and size of data.Experience in Big Data technologies handling complex... 
    Senior
    Big data
    Work at office

    JP Morgan Chase

    New York, NY
    4 days ago
  • $158k - $197k

    Who We AreAddepar is a global data and AI platform empowering...  ...integrates with nearly 650 software, data and consulting partners...  ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data...  ...knowledge on distributed systems & big data processingBuild the... 
    Senior
    Big data
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    7 days ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality...  ...AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $21... 
    Senior
    Big data

    Komodo Health

    New York, NY
    3 days ago
  •  ...impact on those around you through data solutions. Partner with an organization...  ...your leadership career. As a Senior Director of Software Engineering at JPMorganChase within the Employee...  ...Owner or Product ManagerExperience in Big Data technologies handling complex data... 
    Senior
    Big data
    Work at office

    JP Morgan Chase

    New York, NY
    3 days ago
  • $158k - $197k

     ...Sr. Software Engineer - Data Platform New York, NY Who We Are Addepar is a global data and AI...  ...The Role We are currently seeking a Senior Software Engineer to join Addepar's Data...  ...technical knowledge on distributed systems & big data processing Build the next... 
    Senior
    Big data
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    2 days ago
  • $61k - $101k

     ...training or certification in data engineering concepts, plus 12+ years of applied...  ...leading technologists and software engineers to manage,...  ...Manager ~ Experience with big data technologies and complex...  ...and influence peer leaders and senior stakeholders across business,... 
    Senior
    Big data
    Work at office

    J.P. Morgan

    New York, NY
    2 days ago
  • A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities... 
    Senior
    Big data

    STEM Xpert

    New York, NY
    15 hours ago
  • Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team and help process the world’s best data on internet performance. You will develop tools, libraries and operations to support data scientists and analysts as they discover new and... 
    Senior
    Big data

    Ziff Davis

    New York, NY
    3 days ago
  • $250.8k - $286.2k

    Capital One is actively seeking a Senior Lead Data Engineer in New York, NY. This position involves collaborating within Agile teams to design and develop innovative solutions using cloud and big data technologies. As a leader, you will guide fellow engineers in tackling... 
    Senior
    Big data

    Capital One

    New York, NY
    1 day ago
  • We're transforming our customer support data from static, disconnected reports into a live...  .... We're looking for an experienced Data Engineer to build the pipelines, storage, and logic...  ...Skills 5+ years in data engineering with big data tools (Hadoop, Hudi, Spark, Presto, Pinot... 
    Senior
    Big data

    Pegasus Knowledge Solutions

    New York, NY
    15 hours ago
  •  ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s workforce...  ...effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to... 
    Senior
    Full time
    Flexible hours

    Arya Health

    New York, NY
    15 hours ago
  •  ...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Senior Data Engineer at Amigo, you'll build the data layer everything else runs on. Healthcare organizations already keep their data in EHRs,... 
    Senior
    Full time
    Flexible hours

    Amigo S.r.l.

    New York, NY
    15 hours ago
  •  ...oncology ecosystem.  We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend...  ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong proficiency... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Flatiron Health

    New York, NY
    15 hours ago
  • $195k - $408k

     ...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising...  ...understanding of algorithms, data structures, performance optimization...  ...is a plus  ~ Experience with Big Data and cloud services such... 
    Senior
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    15 hours ago
  • $175k - $225k

     ...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable...  ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Drw

    New York, NY
    15 hours ago
  •  ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any... 
    Senior
    Full time
    Contract work
    Work at office
    Shift work

    Tab S

    New York, NY
    15 hours ago
  • $270k - $380k

     ...a team of researchers, engineers, designers, and more, who...  ...us!Role Overview:As a Senior Research Engineer in...  ...building tools to enable easy data synthesis, analysis,...  ...combines expertise in software engineering, statistics...  ...(e.g., PyTorch) and Big Data Analytics (e.g. BigQuery... 
    Senior
    Big data
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    5 days ago
  • $184.9k - $250.2k

     ...massive volumes of advertiser data every single day. You'll work...  ...first-rate monitoring so our engineers can keep their heads down...  ...linearizability, eventual consistency), big data problems (propagation...  ...more.We're seeking to hire a Senior Software Development Engineer to join... 
    Senior
    Big data
    Internship
    Flexible hours

    Amazon

    New York, NY
    7 days ago
  •  ...decentralized finance (DeFi). The Chainlink stack provides the essential data, interoperability, compliance, and privacy standards needed...  ...Reserve. Learn more at chain.link.About the RoleAs a software engineer on the Data Products team, you’ll collaborate with an... 
    Senior
    Remote work

    Chainlink Labs

    New York, NY
    5 days ago
  • $169k - $197k

     ...Entertainment is a member of the Sony family of global companies.Sony Music's Product Design Engineering and Global Operations (PDEGO) team is looking for a Senior Software Engineer, Data Operations to own the reliability, observability, and operational health of our data... 
    Senior
    Work at office
    Local area

    Sony Music Entertainment

    New York, NY
    3 days ago
  •  ...experience5+ years of experience in software development, with...  ...Circle CI, TravisExperience with big data, pharmaceutical/MedTech data,...  ...prioritizationPractical knowledge of software engineering best practices, including...  ...family.WHAT YOU'LL DOAs a Senior Software Engineer with the... 
    Senior
    Big data
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    3 days ago
  • $184.9k - $250.2k

    Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data... 
    Senior
    Internship
    Flexible hours

    Amazon

    New York, NY
    7 days ago
  • $121.4k - $161.8k

     ...where you can learn and collaborate with some of the most talented people in the industry.Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on building a cutting-edge game analytics platform and tools to better understand our... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    6 days ago
  • $225k - $300k

     ...’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products - going beyond ID to power a... 
    Senior
    Flexible hours

    Secure Identity

    New York, NY
    3 days ago
  • $200k - $220k

     ...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and...  ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-...  ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding... 
    Senior
    Big data

    Schonfeld

    New York, NY
    15 hours ago
  • $140k - $160k

     ...centers on making journalism so good that it’s worth paying for. About the Role:The New York Times is looking for a Senior Software Engineer to join the Content Data Products team. You will report to an engineering manager and partner with engineers, product and project... 
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week

    The New York Times

    New York, NY
    3 days ago
  • $175k - $225k

     ...challenge consensus. We are seeking a Senior Software Engineer to join our Unified Platform (UP)...  ...-frequency platform . UP consolidates data and technologies into a comprehensive solution...  ...pipelines and platforms using modern "big data" and lakehouse patterns Improve... 
    Senior
    Big data
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Drw Inc

    New York, NY
    15 hours ago
  •  ...About the Team Data Platform at OpenAI owns the foundational data stack powering...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ...at OpenAI. You will scale and harden big data compute and storage platforms, build... 
    Big data
    Work at office
    Relocation package

    OpenAI

    New York, NY
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!