Senior Software Engineer, Big Data
$170k - $240kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
Summary :
Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.
Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.
Responsibilities:
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Minimum Qualifications:
- 5+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Preferred Qualifications:
- 8+ years of professional software development experience, with a focus on Python and big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $170,000-$240,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
#LI-Remote
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
$206k - $255k
...future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering... ...to the code?We're looking for a Senior Software Engineer to join Elliptic'... ...environment.Hands-on experience with big data frameworks such as Spark or Databricks...SeniorBig dataRemote workHome office$61k - $101k
...training or certification in data engineering concepts, plus 12+ years of applied... ...leading technologists and software engineers to manage,... ...Manager ~ Experience with big data technologies and complex... ...and influence peer leaders and senior stakeholders across business,...SeniorBig dataFull timeWork at office- ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s workforce... ...effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to...SeniorFull timeFlexible hours
- ...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Senior Data Engineer at Amigo, you'll build the data layer everything else runs on. Healthcare organizations already keep their data in EHRs,...SeniorFull timeFlexible hours
$175k - $225k
...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable... ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks...SeniorFull timeTemporary workWork experience placementFlexible hours- ...oncology ecosystem. We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend... ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong proficiency...SeniorFull timeWork at officeWork from homeFlexible hours
- ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any...SeniorFull timeContract workWork at officeShift work
$195k - $408k
...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising... ...understanding of algorithms, data structures, performance optimization... ...is a plus ~ Experience with Big Data and cloud services such...SeniorBig dataFull timeWork at officeLocal areaRemote workMonday to ThursdayFlexible hours- ...About the Team Data Platform at OpenAI owns the foundational data stack powering... ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is... ...at OpenAI. You will scale and harden big data compute and storage platforms, build...Big dataWork at officeRelocation package
$175k - $225k
...challenge consensus. We are seeking a Senior Software Engineer to join our Unified Platform (UP)... ...-frequency platform . UP consolidates data and technologies into a comprehensive solution... ...pipelines and platforms using modern "big data" and lakehouse patterns Improve...SeniorBig dataFull timeTemporary workWork experience placementFlexible hours$190k - $240k
...Senior Data Platform Engineer New York, New York, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help... ...~ Distributed data processing (Spark, PySpark, or similar big data frameworks — or experience managing clusters that run...SeniorBig dataWork at office2 days per week$186k - $223k
...find a relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible for maintaining and... ...Actions Streaming : Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks, dbt BI...SeniorBig dataWork experience placement$130.6k - $192k
...reliability tooling that powers the company's data, analytics, and ML workloads. We run... ...tooling. About the Role As a Senior Software Engineer on Spark Platform, you will set the... ...Celeborn, Magnet, Cosco, or similar), batch/big-data schedulers (YuniKorn, Volcano,...SeniorBig dataHourly payWork at officeLocal areaRemote workRelocationFlexible hours$192k - $240k
...spend management, bill pay, and travel software, Brex enables founders and finance... ...should only be limited by how big you can dream. We make this a reality... ...support you need to grow your career. Data at Brex Our Scientists and Engineers work together to make data — and...SeniorFull timeWork at officeMonday to Friday3 days per week- ...About Us: Camber builds software to improve the quality and accessibility... ...the role: Camber is looking for engineers who are passionate about making... ...more accessible and available. As a Senior Software Engineer on the Data team you'll work on the core data ingestion...SeniorWork at officeRemote workFlexible hours
- ...and how we use AI in our recruiting process here . We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most...SeniorBig dataFull timeWork at officeRemote workRelocationRelocation package
$194k - $235k
...Institutions already have the relationships, data, and context to understand each client.... ...About the Role We're looking for a Senior Software Engineer to support our AI application... ...experience developing data pipelines handling big data Experience contributing to...SeniorBig dataWork at officeFlexible hours- Elevate and drive innovation, data engineering solutions, and serve as a decision maker for Firmwide... ...Experience data products.As a Senior Lead Software Engineering at JPMorgan Chase within the... ...volume and size of data.Experience in Big Data technologies handling complex...SeniorBig dataWork at office
$158k - $197k
Who We AreAddepar is a global data and AI platform empowering... ...integrates with nearly 650 software, data and consulting partners... ...RoleWe are currently seeking a Senior Software Engineer to join Addepar’s Data... ...knowledge on distributed systems & big data processingBuild the...SeniorBig dataH1bRemote workWorldwideVisa sponsorshipWork visa$175k - $250k
...Senior Software Engineer - Data Platform About Millennium Millennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution, innovation and focus, Millennium's mission is to deliver results for our investors. Our people are...SeniorFlexible hours- ...Responsibilities Own the data platform architecture and technical direction, including... ...build-versus-buy decisions and reusable software frameworks. Build and operate... ...-service pipeline frameworks for product engineers, data engineers, and analysts. Design...SeniorFull time
$190k - $210k
Our client, a growing HealthTech organization, is hiring a Senior Software Engineer to join their team in New York. The successful candidate will... ...as defining the architecture and building scalable, reliable data systems that enable innovation in healthcare revenue cycle...SeniorFull time- ...Senior Data Engineer We are looking for a Senior Data Engineer to help design, build, and operate... ...cross-functionally: Work closely with Software Engineers, ML Engineers, and Product Managers... ..., or Snowflake. Familiarity with big data or distributed processing...SeniorBig dataWork at officeRelocation package
$145k - $165k
...competencies, collaborate with diverse professionals, share knowledge and enjoy a rewarding career. We are seeking a Senior Software Engineer – Data Platform to join our Data Engineering team in NYC. You will help build the modern data processing platform behind...SeniorWork experience placement$144k - $236k
...marketing, content, and trust platforms. As a Senior AI Software Engineer you will own end-to-end machine... ..., or tech-debt removal) backed by data. You operate systems reliably as on... ...Learning and Deep Learning Experience in Big Data Strong technical background &...SeniorBig dataFull timeFor contractorsWork at officeImmediate startFlexible hours$128.01k - $152.18k
...confidence. Job Description AI-First Data Strategy for P&C Insurance Carrier |... ...Data Solutions We are seeking a Senior Data Engineer to spearhead our transition to a modern,... ...platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C insurance...SeniorBig dataWork at officeLocal area- ...Overview Job Title: Senior Data Engineer Department: Digital Reporting To: Manager, Data... ...role in shaping how Audacy utilizes big data on the magnitude of billions of rows... ...considered on a case-by-case basis. Software Powered by ICIMS ( Job Locations USA...SeniorBig dataFull timeLocal area
$185k
...Senior Data Engineer New York, NY (This role is based in Trepp's NYC office and follows a hybrid work schedule) The Data Platform Team powers... ...application development At least 3 years of experience in big data technologies Demonstrated experience in dimensional...SeniorBig dataTemporary workWork at officeWork from homeMonday to FridayFlexible hours$250.8k - $286.2k
...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast... ...iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve...SeniorBig dataFull timePart timeInternshipLocal area$180k - $200k
...Senior AI/ML Engineer Starr Insurance Companies is a leading insurance and investment organization... .... Join the Starr Enterprise Data and Artificial Intelligence Organization... ...Azure, AWS or other cloud service using big data solutions. ~ Proven ability to understand...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Big Data. Be the first to apply!
- associate software developer New York, NY
- software engineer part time New York, NY
- software developer intern New York, NY
- summer intern software engineer New York, NY
- software developer fintech New York, NY
- software support engineer New York, NY
- ngo software engineer New York, NY
- intel software engineer New York, NY
- IT software engineer New York, NY
- machine learning software engineer New York, NY



