Senior Software Engineer, Big Data
$140k - $200kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
Summary :
Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.
Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.
Responsibilities:
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Minimum Qualifications:
- 5+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Preferred Qualifications:
- 8+ years of professional software development experience, with a focus on Python and big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $140,000-$200,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
#LI-Remote
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
$206k - $255k
...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering... ...to the code?We're looking for a Senior Software Engineer to join Elliptic'... ...environment.Hands-on experience with big data frameworks such as Spark or Databricks...SeniorBig dataRemote workHome office- ...Senior Software Engineer, Data PlatformThe Viacom Data Platform is looking for an awesome Sr. Software Engineer with professional, hands-on experience... ...working knowledge of Node.JS and JQueryUnderstanding of big data technologies such as Apache Spark, Apache...SeniorBig data
- Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote... ...and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives. #J-18808-Ljbffr...SeniorBig dataRemote job
- ...technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should... ...experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional...SeniorBig data
$158k - $197k
Who We AreAddepar is a global data and AI platform empowering... ...integrates with nearly 650 software, data and consulting partners... ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data... ...knowledge on distributed systems & big data processingBuild the...SeniorBig dataH1bRemote workWorldwideVisa sponsorshipWork visa$158k - $197k
...Are Addepar is a global data and AI platform empowering investment... ...integrates with nearly 650 software, data and consulting... ...We are currently seeking a Senior Software Engineer to join Addepar’s Data Platform... ...on distributed systems & big data processing Build the...SeniorBig dataFull timeH1bRemote workWorldwideVisa sponsorshipWork visa$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality... ...AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $21...SeniorBig data- ...impact on those around you through data solutions. Partner with an organization... ...your leadership career. As a Senior Director of Software Engineering at JPMorganChase within the Employee... ...Owner or Product ManagerExperience in Big Data technologies handling complex data...SeniorBig dataWork at office
$124k - $135k
...Mission or Department Overview The Data Platform Mission aims to... ...We are looking for Analytics Engineers that can help develop a new function... ...office in Times Square. As a Senior Analytics Engineer, you'll... ...Proficiency with GCP, AWS, or other big data environments Familiarity...SeniorBig dataWork at officeLocal areaFlexible hours- A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...SeniorBig data
$137.75k - $185k
...contribute to a winning culture and team. As a Data Engineer III at JPMorgan Chase within the... ...protection of enterprise data Executes software solutions, design, development, and... ...such as JSON, AVRO, Protobuf, or similar, big-data storage formats such as Parquet, Iceberg...Big dataFull time$250.8k - $286.2k
Capital One is actively seeking a Senior Lead Data Engineer in New York, NY. This position involves collaborating within Agile teams to design and develop innovative solutions using cloud and big data technologies. As a leader, you will guide fellow engineers in tackling...SeniorBig data- We're transforming our customer support data from static, disconnected reports into a live... .... We're looking for an experienced Data Engineer to build the pipelines, storage, and logic... ...Skills 5+ years in data engineering with big data tools (Hadoop, Hudi, Spark, Presto, Pinot...SeniorBig data
- ...Software Development EngineerAs part of the AWS Applied AI Solutions... ...Software Development Engineers to join us to innovate on this... ...development, and work closely with senior technical leaders within the... ...SOA, NoSQL databases, AI, ML, Big Data and more.This team is a great...SeniorBig dataWorldwide
$270k - $380k
...a team of researchers, engineers, designers, and more, who... ...us!Role Overview:As a Senior Research Engineer in... ...building tools to enable easy data synthesis, analysis,... ...combines expertise in software engineering, statistics... ...(e.g., PyTorch) and Big Data Analytics (e.g. BigQuery...SeniorBig dataWork at officeLocal areaRemote workHome office$184.9k - $250.2k
...massive volumes of advertiser data every single day. You'll work... ...first-rate monitoring so our engineers can keep their heads down... ...linearizability, eventual consistency), big data problems (propagation... ...more.We're seeking to hire a Senior Software Development Engineer to join...SeniorBig dataInternshipFlexible hours- ...experience5+ years of experience in software development, with... ...Circle CI, TravisExperience with big data, pharmaceutical/MedTech data,... ...prioritizationPractical knowledge of software engineering best practices, including... ...family.WHAT YOU'LL DOAs a Senior Software Engineer with the...SeniorBig dataApprenticeshipEasy work
- ...decentralized finance (DeFi). The Chainlink stack provides the essential data, interoperability, compliance, and privacy standards needed... ...Reserve. Learn more at chain.link.About the RoleAs a software engineer on the Data Products team, you’ll collaborate with an...SeniorRemote work
$184.9k - $250.2k
Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data...SeniorInternshipFlexible hours$175k - $225k
...willingness to challenge consensus.About the TeamThe DRW C/FICCO Data Engineering team is essential to developing valuable datasets and... ...tradingExperience with Linux-based, concurrent, high-throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g...SeniorTemporary workFlexible hours$195k - $408k
...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising... ...understanding of algorithms, data structures, performance optimization... ...is a plus Experience with Big Data and cloud services such...SeniorBig dataWork at officeLocal areaRemote workMonday to ThursdayFlexible hours$121.4k - $161.8k
...where you can learn and collaborate with some of the most talented people in the industry.Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on building a cutting-edge game analytics platform and tools to better understand our...SeniorFull timeWork at office$100k - $250k
...Software Engineer, DataKalshi is defining a new category. Kalshi has defined a new category: prediction... ...markets.Role RoadmapAs our go to data person at Kalshi, you build and operate... ...pipelining and machine learning, Spark for big data processing, and visualization through...Big dataLocal area$225k - $300k
...’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products - going beyond ID to power a...SeniorFlexible hours$200k - $220k
...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and... ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-... ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding...SeniorBig data$140k - $160k
...centers on making journalism so good that it’s worth paying for. About the Role:The New York Times is looking for a Senior Software Engineer to join the Content Data Products team. You will report to an engineering manager and partner with engineers, product and project...SeniorWork at officeLocal areaFlexible hours2 days per week$190k - $240k
...Senior Data Platform Engineer New York, New York, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help... ...~ Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience managing clusters that run...SeniorBig dataWork at office2 days per week- About the TeamDoorDash is a data driven organization and relies on... ...simplify data workflows for engineers, analysts, and ML practitioners... ...Code, Codex, Cursor) in the full software development lifecycle,... ...softwareExperience working on big data domains (streaming, batch...Big dataHourly payWork at officeLocal areaRemote workRelocationFlexible hours
$186k - $223k
...find a relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible for maintaining and... ...Actions Streaming : Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks, dbt BI...SeniorBig dataWork experience placement$145k - $182k
...Senior AI/ML EngineerWe're looking for a Senior AI/ML Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven... ...integrate cutting-edge AI and big data technologiesYou'll... ...efficiency.Collaborate with software engineers to integrate...SeniorBig dataWork at officeShift work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!
- cybersecurity software engineer New York, NY
- graduate software engineer New York, NY
- software developer fintech New York, NY
- new graduate software engineer New York, NY
- senior robotics software engineer New York, NY
- software engineer visa sponsorship New York, NY
- software qa engineer New York, NY
- network software engineer New York, NY
- software engineer remote New York, NY
- part time software developer New York, NY

