Senior Software Engineer, Big Data
$140k - $200kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
Summary :
Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.
Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.
Responsibilities:
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Minimum Qualifications:
- 5+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Preferred Qualifications:
- 8+ years of professional software development experience, with a focus on Python and big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $140,000-$200,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
#LI-Remote
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
$206k - $255k
...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering... ...to the code?We're looking for a Senior Software Engineer to join Elliptic'... ...environment.Hands-on experience with big data frameworks such as Spark or Databricks...SeniorBig dataRemote workHome office- Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote... ...and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives. #J-18808-Ljbffr...SeniorBig dataRemote job
- Elevate and drive innovation, data engineering solutions, and serve as a decision maker for Firmwide... ...Experience data products.As a Senior Lead Software Engineering at JPMorgan Chase within the... ...volume and size of data.Experience in Big Data technologies handling complex...SeniorBig dataWork at office
$158k - $197k
Who We AreAddepar is a global data and AI platform empowering... ...integrates with nearly 650 software, data and consulting partners... ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data... ...knowledge on distributed systems & big data processingBuild the...SeniorBig dataH1bRemote workWorldwideVisa sponsorshipWork visa$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality... ...AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $21...SeniorBig data- ...impact on those around you through data solutions. Partner with an organization... ...your leadership career. As a Senior Director of Software Engineering at JPMorganChase within the Employee... ...Owner or Product ManagerExperience in Big Data technologies handling complex data...SeniorBig dataWork at office
$158k - $197k
...Sr. Software Engineer - Data Platform New York, NY Who We Are Addepar is a global data and AI... ...The Role We are currently seeking a Senior Software Engineer to join Addepar's Data... ...technical knowledge on distributed systems & big data processing Build the next...SeniorBig dataH1bRemote workWorldwideVisa sponsorshipWork visa$61k - $101k
...training or certification in data engineering concepts, plus 12+ years of applied... ...leading technologists and software engineers to manage,... ...Manager ~ Experience with big data technologies and complex... ...and influence peer leaders and senior stakeholders across business,...SeniorBig dataWork at office- A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...SeniorBig data
- Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team and help process the world’s best data on internet performance. You will develop tools, libraries and operations to support data scientists and analysts as they discover new and...SeniorBig data
$250.8k - $286.2k
Capital One is actively seeking a Senior Lead Data Engineer in New York, NY. This position involves collaborating within Agile teams to design and develop innovative solutions using cloud and big data technologies. As a leader, you will guide fellow engineers in tackling...SeniorBig data- We're transforming our customer support data from static, disconnected reports into a live... .... We're looking for an experienced Data Engineer to build the pipelines, storage, and logic... ...Skills 5+ years in data engineering with big data tools (Hadoop, Hudi, Spark, Presto, Pinot...SeniorBig data
- ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s workforce... ...effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to...SeniorFull timeFlexible hours
- ...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Senior Data Engineer at Amigo, you'll build the data layer everything else runs on. Healthcare organizations already keep their data in EHRs,...SeniorFull timeFlexible hours
- ...oncology ecosystem. We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend... ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong proficiency...SeniorFull timeWork at officeWork from homeFlexible hours
$195k - $408k
...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising... ...understanding of algorithms, data structures, performance optimization... ...is a plus ~ Experience with Big Data and cloud services such...SeniorBig dataFull timeWork at officeLocal areaRemote workMonday to ThursdayFlexible hours$175k - $225k
...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable... ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks...SeniorFull timeTemporary workWork experience placementFlexible hours- ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any...SeniorFull timeContract workWork at officeShift work
$270k - $380k
...a team of researchers, engineers, designers, and more, who... ...us!Role Overview:As a Senior Research Engineer in... ...building tools to enable easy data synthesis, analysis,... ...combines expertise in software engineering, statistics... ...(e.g., PyTorch) and Big Data Analytics (e.g. BigQuery...SeniorBig dataWork at officeLocal areaRemote workHome office$184.9k - $250.2k
...massive volumes of advertiser data every single day. You'll work... ...first-rate monitoring so our engineers can keep their heads down... ...linearizability, eventual consistency), big data problems (propagation... ...more.We're seeking to hire a Senior Software Development Engineer to join...SeniorBig dataInternshipFlexible hours- ...decentralized finance (DeFi). The Chainlink stack provides the essential data, interoperability, compliance, and privacy standards needed... ...Reserve. Learn more at chain.link.About the RoleAs a software engineer on the Data Products team, you’ll collaborate with an...SeniorRemote work
$169k - $197k
...Entertainment is a member of the Sony family of global companies.Sony Music's Product Design Engineering and Global Operations (PDEGO) team is looking for a Senior Software Engineer, Data Operations to own the reliability, observability, and operational health of our data...SeniorWork at officeLocal area- ...experience5+ years of experience in software development, with... ...Circle CI, TravisExperience with big data, pharmaceutical/MedTech data,... ...prioritizationPractical knowledge of software engineering best practices, including... ...family.WHAT YOU'LL DOAs a Senior Software Engineer with the...SeniorBig dataApprenticeshipEasy work
$184.9k - $250.2k
Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data...SeniorInternshipFlexible hours$121.4k - $161.8k
...where you can learn and collaborate with some of the most talented people in the industry.Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on building a cutting-edge game analytics platform and tools to better understand our...SeniorFull timeWork at office$225k - $300k
...’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products - going beyond ID to power a...SeniorFlexible hours$200k - $220k
...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and... ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-... ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding...SeniorBig data$140k - $160k
...centers on making journalism so good that it’s worth paying for. About the Role:The New York Times is looking for a Senior Software Engineer to join the Content Data Products team. You will report to an engineering manager and partner with engineers, product and project...SeniorWork at officeLocal areaFlexible hours2 days per week$175k - $225k
...challenge consensus. We are seeking a Senior Software Engineer to join our Unified Platform (UP)... ...-frequency platform . UP consolidates data and technologies into a comprehensive solution... ...pipelines and platforms using modern "big data" and lakehouse patterns Improve...SeniorBig dataFull timeTemporary workWork experience placementFlexible hours- ...About the Team Data Platform at OpenAI owns the foundational data stack powering... ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is... ...at OpenAI. You will scale and harden big data compute and storage platforms, build...Big dataWork at officeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!
- software engineer internship New York, NY
- software development engineer aws New York, NY
- software developer internship no experience New York, NY
- real time software engineer New York, NY
- financial software developer New York, NY
- part time software developer New York, NY
- graduate software developer New York, NY
- software engineer travel New York, NY
- experienced software developer New York, NY
- remote entry level software developer New York, NY



