Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Big Data

$170k - $240k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $170,000-$240,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Big Data in New York, NY vacancy
  • $206k - $255k

     ...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering...  ...to the code?We're looking for a Senior Software Engineer to join Elliptic'...  ...environment.Hands-on experience with big data frameworks such as Spark or Databricks... 
    Senior
    Big data
    Remote work
    Home office

    Elliptic

    New York, NY
    4 days ago
  • $61k - $101k

     ...training or certification in data engineering concepts, plus 12+ years of applied...  ...leading technologists and software engineers to manage,...  ...Manager ~ Experience with big data technologies and complex...  ...and influence peer leaders and senior stakeholders across business,... 
    Senior
    Big data
    Full time
    Work at office

    J.P. Morgan

    New York, NY
    8 days ago
  •  ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s workforce...  ...effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to... 
    Senior
    Full time
    Flexible hours

    Arya Health

    New York, NY
    17 hours ago
  •  ...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Senior Data Engineer at Amigo, you'll build the data layer everything else runs on. Healthcare organizations already keep their data in EHRs,... 
    Senior
    Full time
    Flexible hours

    Amigo S.r.l.

    New York, NY
    17 hours ago
  • $175k - $225k

     ...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable...  ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Drw

    New York, NY
    17 hours ago
  •  ...oncology ecosystem.  We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend...  ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong proficiency... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Flatiron Health

    New York, NY
    17 hours ago
  •  ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any... 
    Senior
    Full time
    Contract work
    Work at office
    Shift work

    Tab S

    New York, NY
    17 hours ago
  • $195k - $408k

     ...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising...  ...understanding of algorithms, data structures, performance optimization...  ...is a plus  ~ Experience with Big Data and cloud services such... 
    Senior
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    17 hours ago
  •  ...About the Team Data Platform at OpenAI owns the foundational data stack powering...  ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is...  ...at OpenAI. You will scale and harden big data compute and storage platforms, build... 
    Big data
    Work at office
    Relocation package

    OpenAI

    New York, NY
    2 days ago
  • $175k - $225k

     ...challenge consensus. We are seeking a Senior Software Engineer to join our Unified Platform (UP)...  ...-frequency platform . UP consolidates data and technologies into a comprehensive solution...  ...pipelines and platforms using modern "big data" and lakehouse patterns Improve... 
    Senior
    Big data
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Drw Inc

    New York, NY
    17 hours ago
  • $190k - $240k

     ...Senior Data Platform Engineer New York, New York, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help...  ...~ Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience managing clusters that run... 
    Senior
    Big data
    Work at office
    2 days per week

    Tatari

    New York, NY
    4 days ago
  • $186k - $223k

     ...find a relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible for maintaining and...  ...Actions Streaming : Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks, dbt BI... 
    Senior
    Big data
    Work experience placement

    Match Group

    New York, NY
    2 days ago
  • $130.6k - $192k

     ...reliability tooling that powers the company's data, analytics, and ML workloads. We run...  ...tooling. About the Role As a Senior Software Engineer on Spark Platform, you will set the...  ...Celeborn, Magnet, Cosco, or similar), batch/big-data schedulers (YuniKorn, Volcano,... 
    Senior
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    New York, NY
    17 hours ago
  • $192k - $240k

     ...spend management, bill pay, and travel software, Brex enables founders and finance...  ...should only be limited by how big you can dream. We make this a reality...  ...support you need to grow your career. Data at Brex Our Scientists and Engineers work together to make data — and... 
    Senior
    Full time
    Work at office
    Monday to Friday
    3 days per week

    Brex Inc.

    New York, NY
    17 hours ago
  •  ...About Us: Camber builds software to improve the quality and accessibility...  ...the role: Camber is looking for engineers who are passionate about making...  ...more accessible and available. As a Senior Software Engineer on the Data team you'll work on the core data ingestion... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Camber

    New York, NY
    5 days ago
  •  ...and how we use AI in our recruiting process here . We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most... 
    Senior
    Big data
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    New York, NY
    3 days ago
  • $194k - $235k

     ...Institutions already have the relationships, data, and context to understand each client....  ...About the Role We're looking for a Senior Software Engineer to support our AI application...  ...experience developing data pipelines handling big data Experience contributing to... 
    Senior
    Big data
    Work at office
    Flexible hours

    Monstro

    New York, NY
    10 days ago
  • Elevate and drive innovation, data engineering solutions, and serve as a decision maker for Firmwide...  ...Experience data products.As a Senior Lead Software Engineering at JPMorgan Chase within the...  ...volume and size of data.Experience in Big Data technologies handling complex... 
    Senior
    Big data
    Work at office

    JP Morgan Chase

    New York, NY
    6 days ago
  • $158k - $197k

    Who We AreAddepar is a global data and AI platform empowering...  ...integrates with nearly 650 software, data and consulting partners...  ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data...  ...knowledge on distributed systems & big data processingBuild the... 
    Senior
    Big data
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    4 days ago
  • $175k - $250k

     ...Senior Software Engineer - Data Platform About Millennium Millennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution, innovation and focus, Millennium's mission is to deliver results for our investors. Our people are... 
    Senior
    Flexible hours

    Millennium Management Corp

    New York, NY
    3 days ago
  •  ...Responsibilities Own the data platform architecture and technical direction, including...  ...build-versus-buy decisions and reusable software frameworks. Build and operate...  ...-service pipeline frameworks for product engineers, data engineers, and analysts. Design... 
    Senior
    Full time

    Harvey

    New York, NY
    18 days ago
  • $190k - $210k

    Our client, a growing HealthTech organization, is hiring a Senior Software Engineer to join their team in New York. The successful candidate will...  ...as defining the architecture and building scalable, reliable data systems that enable innovation in healthcare revenue cycle... 
    Senior
    Full time

    Alldus International Consulting Ltd

    New York, NY
    more than 2 months ago
  •  ...Senior Data Engineer We are looking for a Senior Data Engineer to help design, build, and operate...  ...cross-functionally: Work closely with Software Engineers, ML Engineers, and Product Managers...  ..., or Snowflake. Familiarity with big data or distributed processing... 
    Senior
    Big data
    Work at office
    Relocation package

    Nelo Mobile

    New York, NY
    5 days ago
  • $145k - $165k

     ...competencies, collaborate with diverse professionals, share knowledge and enjoy a rewarding career.    We are seeking a Senior Software Engineer – Data Platform to join our Data Engineering team in NYC. You will help build the modern data processing platform behind... 
    Senior
    Work experience placement

    MetTel

    New York, NY
    9 days ago
  • $144k - $236k

     ...marketing, content, and trust platforms. As a Senior AI Software Engineer you will own end-to-end machine...  ..., or tech-debt removal) backed by data. You operate systems reliably as on...  ...Learning and Deep Learning Experience in Big Data Strong technical background &... 
    Senior
    Big data
    Full time
    For contractors
    Work at office
    Immediate start
    Flexible hours

    Linkedin

    New York, NY
    17 hours ago
  • $128.01k - $152.18k

     ...confidence. Job Description AI-First Data Strategy for P&C Insurance Carrier |...  ...Data Solutions We are seeking a Senior Data Engineer to spearhead our transition to a modern,...  ...platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C insurance... 
    Senior
    Big data
    Work at office
    Local area

    American Indemnity

    New York, NY
    1 day ago
  •  ...Overview Job Title: Senior Data Engineer Department: Digital Reporting To: Manager, Data...  ...role in shaping how Audacy utilizes big data on the magnitude of billions of rows...  ...considered on a case-by-case basis. Software Powered by ICIMS ( Job Locations USA... 
    Senior
    Big data
    Full time
    Local area

    Audacy

    New York, NY
    3 days ago
  • $185k

     ...Senior Data Engineer New York, NY (This role is based in Trepp's NYC office and follows a hybrid work schedule) The Data Platform Team powers...  ...application development At least 3 years of experience in big data technologies Demonstrated experience in dimensional... 
    Senior
    Big data
    Temporary work
    Work at office
    Work from home
    Monday to Friday
    Flexible hours

    Trepp, LLC

    New York, NY
    2 days ago
  • $250.8k - $286.2k

     ...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast...  ...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve... 
    Senior
    Big data
    Full time
    Part time
    Internship
    Local area

    Capital One Financial Corp

    New York, NY
    2 days ago
  • $180k - $200k

     ...Senior AI/ML Engineer Starr Insurance Companies is a leading insurance and investment organization...  .... Join the Starr Enterprise Data and Artificial Intelligence Organization...  ...Azure, AWS or other cloud service using big data solutions. ~ Proven ability to understand... 
    Senior
    Big data

    Starr Companies

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!