Software Engineer, Big Data
$130k - $175kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
Summary :
Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.
Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.
Responsibilities:
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Minimum Qualifications:
- 2+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
Preferred Qualifications:
- 4+ years of professional software development experience, with a focus on Python and big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $130,000-$175,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
#LI-Remote
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
$100k - $250k
...Role Roadmap As our go to data person at Kalshi, you build... ...Kalshi. This role is one part data engineering, one part data analysis.... ...and machine learning, Spark for big data processing, and visualization... ..., with 4+ years of hands-on software development Strong command...Big dataLocal area- ...Senior Software Engineer, Data Platform The Viacom Data Platform is looking for an awesome Sr. Software Engineer with professional, hands-on... ...working knowledge of Node.JS and JQuery ~ Understanding of big data technologies such as Apache Spark, Apache Kafka ~ Experience...Big data
$206k - $255k
...to help define the future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering impact at scale? Are... ...in a cloud-based environment.Hands-on experience with big data frameworks such as Spark or Databricks.Knowledge of...Big dataRemote workHome office$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data... ...of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $210,...Big data- ...We are dedicated to leveraging data to drive strategic decision-... ...highly skilled and motivated Data Engineer to join our team. The ideal... ...maintaining integration with software such as Airflow or any Python-... ...environments. Familiarity with big data technologies (e.g., Lambda...Big dataLocal areaRemote workWork from homeFlexible hours
- Job Title Will work on data integration solutions for Optum Consumer Office. Will involve data integration/engineering work involving Azure Databricks, Py Spark, spark/scala and other... ...experience in Azure Databricks platform. Big data platform experience is a plus....Big dataWork at officeLocal areaImmediate startRemote work
$310k - $385k
...the role: We are seeking an execution-focused and visionary Data Engineering Manager to lead our Data Platform Team. In this critical role,... ...~5+ years of hands-on engineering experience, with a focus on Big Data and distributed system and infrastructure ~2+ years of...Big dataWork at officeFlexible hours3 days per week- ...Description Build What Matters at RevStar Role Title: Data & AI Engineer (Databricks Specialist) Reports To: Data & AI Practice Lead... ...greenfield Lakehouse solutions at the bleeding edge of AI and big data? RevStar is an innovation shop and official Databricks Partner...Big dataRemote jobFull time
- We are seeking an execution-focused and visionary Data Engineering Manager to lead our Data Platform Team In this critical role, you will manage... ...5+ years of hands-on engineering experience, with a focus on Big Data and distributed system and infrastructurePreference for...Big dataImmediate startRemote workFlexible hours
- ...Job Title: AI/ML Data Engineer (Python, GenAI, ML Modeling) Location: New York, NY (Hybrid - 3 Days Onsite) Duration: Contract... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
- About the TeamDoorDash is a data driven organization and relies on... ...simplify data workflows for engineers, analysts, and ML practitioners... ...Code, Codex, Cursor) in the full software development lifecycle,... ...softwareExperience working on big data domains (streaming, batch...Big dataHourly payWork at officeLocal areaRemote workRelocationFlexible hours
- Lead Engineer, Data It's fun to work in a company where people truly believe in what they are doing... ...Bachelor's degree in Computer Science, Software Engineering, Information Technology, or... .../alerting. Real-time ETL/ELT and Big Data pipeline experience, especially with...Big dataWork at officeRemote work
- ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any...Full timeContract workWork at officeShift work
$175k - $225k
...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable... ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks...Full timeTemporary workWork experience placementFlexible hours- ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s... ...compounding effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to...Full timeFlexible hours
$120k - $150k
...Software Engineer , Data About IEX IEX (IEX Group, Inc.) is an exchange operator and technology company dedicated to innovating performance in capital markets. Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business...Full timeWork experience placementLocal area$200k - $300k
...constantly evolving our firm’s IT infrastructure and engineering capabilities, positioning us at the forefront... ...global business. What you'll do As a software engineer, you will help build the next generation of data infrastructure at the firm—thinking holistically...Full timeWork experience placement- ...human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier... ...machines, not pipelines. The architecture is not set. Early engineers will decide what it becomes, and the loop between "I shipped this...Full timeWork at officeRelocation package
- ...oncology ecosystem. We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend lives... ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong...Full timeWork at officeWork from homeFlexible hours
$61k - $101k
...~ Formal training or certification in data engineering concepts, plus 12+ years of applied experience... ...~8+ years leading technologists and software engineers to manage, anticipate, and resolve... ...or Product Manager ~ Experience with big data technologies and complex data...Big dataFull timeWork at office$45 - $50 per hour
...Feedinkoo is seeking a full-time Software Engineering Intern for their Santa Monica office. The intern will engage in the entire life cycle... ...internship offers the chance to specialize in disciplines such as Big Data or Mobile Development, with competitive pay between $45.00/...Big dataFull timeInternshipSummer internshipWork at office$388k
...better matching of advertiser and partner data, while ensuring a strong commitment to... ...and member privacy. The Role As a Software Engineer on the Ads Identity Graph team, you will... ...data at extremely large volumes with big data tools like Spark, and building high...Big dataHourly payFull timeImmediate startFlexible hours- ...you will work within a Product Delivery Team fused with UX, engineering, product and data talent. You will help the team design beautiful interfaces... ...if you are looking to segue your career into the FinTech or Big Data arenas. Key Responsibilities Be involved in...Big data
$150k - $275k
...chaos of fragmented financial data, manual workflows, and opaque... ...talented and ambitious backend engineer with 5+ years of experience in... ...massive untapped market. As a software engineer, you’ll have an... ...pipelines Familiarity with big data technologies and comfortable...Big dataFull timePrivate practiceWork at office3 days per week$140k - $200k
...include frontend and backend engineers, AI research scientists, and others... ...We're looking to hire for our Data side of our AI team at... ...We are looking for a skilled Software Engineer to join us. What You... ...work. An opportunity to make a big impact in a transformative industry...Remote jobFull timeWork at officeShift work$153k - $376k
...shape the future of design and collaboration, join us! The Data Platform team at Figma builds and operates the foundational systems... ...of stakeholders, including AI researchers, machine learning engineers, data scientists, product engineers, and business teams that...Full timeRemote workWork from home$388k
...engaged. Our Team The Ads Platform Engineering teams build advertising systems and... ...systems. Forecasting enables near-realtime data-driven decisioning for advertisers, agencies... ...data at extremely large volumes with big data tools like Spark, and building high...Big dataHourly payFull timeImmediate startFlexible hours- ...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise... ...Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify...Big dataTemporary work
$195k - $408k
...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising... ...understanding of algorithms, data structures, performance optimization... ...is a plus ~ Experience with Big Data and cloud services such...Big dataFull timeWork at officeLocal areaRemote workMonday to ThursdayFlexible hours$196k - $278.1k
...Software Engineer, Data San Francisco, CA; Austin, TX; New York, NY Airtable is the no-code app platform that empowers people closest to the work to accelerate their most critical business processes. More than 500,000 organizations, including 80% of the Fortune 1...Remote workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Big Data. Be the first to apply!
- software developer positions New York, NY
- senior software engineer remote New York, NY
- software engineer contract New York, NY
- software qa engineer New York, NY
- IT software developer New York, NY
- cybersecurity software engineer New York, NY
- part time software developer remote New York, NY
- junior software developer internship New York, NY
- junior software engineer New York, NY
- software system engineer New York, NY



