Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Big Data

$130k - $175k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary :

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We're working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we're looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We're working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people's lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 2+ years of professional software development experience with a focus on Python and big data technologies
  • Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 4+ years of professional software development experience, with a focus on Python and big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $130,000-$175,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Big Data in New York, NY vacancy
  • $100k - $250k

     ...Role Roadmap As our go to data person at Kalshi, you build...  ...Kalshi. This role is one part data engineering, one part data analysis....  ...and machine learning, Spark for big data processing, and visualization...  ..., with 4+ years of hands-on software development Strong command... 
    Big data
    Local area

    Kalshi

    New York, NY
    2 days ago
  •  ...Senior Software Engineer, Data Platform The Viacom Data Platform is looking for an awesome Sr. Software Engineer with professional, hands-on...  ...working knowledge of Node.JS and JQuery ~ Understanding of big data technologies such as Apache Spark, Apache Kafka ~ Experience... 
    Big data

    ClifyX

    New York, NY
    1 day ago
  • $206k - $255k

     ...to help define the future of finance?Are you a strong software engineer who's passionate about data, distributed systems, and delivering impact at scale? Are...  ...in a cloud-based environment.Hands-on experience with big data frameworks such as Spark or Databricks.Knowledge of... 
    Big data
    Remote work
    Home office

    Elliptic

    New York, NY
    a month ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data...  ...of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $210,... 
    Big data

    Komodo Health Inc

    New York, NY
    2 days ago
  •  ...We are dedicated to leveraging data to drive strategic decision-...  ...highly skilled and motivated Data Engineer to join our team. The ideal...  ...maintaining integration with software such as Airflow or any Python-...  ...environments. Familiarity with big data technologies (e.g., Lambda... 
    Big data
    Local area
    Remote work
    Work from home
    Flexible hours

    Omada Health

    New York, NY
    4 days ago
  • Job Title Will work on data integration solutions for Optum Consumer Office. Will involve data integration/engineering work involving Azure Databricks, Py Spark, spark/scala and other...  ...experience in Azure Databricks platform. Big data platform experience is a plus.... 
    Big data
    Work at office
    Local area
    Immediate start
    Remote work

    Samprasoft

    New York, NY
    5 days ago
  • $310k - $385k

     ...the role: We are seeking an execution-focused and visionary Data Engineering Manager to lead our Data Platform Team. In this critical role,...  ...~5+ years of hands-on engineering experience, with a focus on Big Data and distributed system and infrastructure ~2+ years of... 
    Big data
    Work at office
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    17 days ago
  •  ...Description Build What Matters at RevStar Role Title: Data & AI Engineer (Databricks Specialist) Reports To: Data & AI Practice Lead...  ...greenfield Lakehouse solutions at the bleeding edge of AI and big data? RevStar is an innovation shop and official Databricks Partner... 
    Big data
    Remote job
    Full time

    Revstar

    New York, NY
    9 hours ago
  • We are seeking an execution-focused and visionary Data Engineering Manager to lead our Data Platform Team In this critical role, you will manage...  ...5+ years of hands-on engineering experience, with a focus on Big Data and distributed system and infrastructurePreference for... 
    Big data
    Immediate start
    Remote work
    Flexible hours

    Garner Health

    New York, NY
    4 days ago
  •  ...Job Title: AI/ML Data Engineer (Python, GenAI, ML Modeling) Location: New York, NY (Hybrid - 3 Days Onsite) Duration: Contract...  ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable... 
    Big data
    Contract work

    Georgia IT Inc

    New York, NY
    1 day ago
  • About the TeamDoorDash is a data driven organization and relies on...  ...simplify data workflows for engineers, analysts, and ML practitioners...  ...Code, Codex, Cursor) in the full software development lifecycle,...  ...softwareExperience working on big data domains (streaming, batch... 
    Big data
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    New York, NY
    2 days ago
  • Lead Engineer, Data It's fun to work in a company where people truly believe in what they are doing...  ...Bachelor's degree in Computer Science, Software Engineering, Information Technology, or...  .../alerting. Real-time ETL/ELT and Big Data pipeline experience, especially with... 
    Big data
    Work at office
    Remote work

    Dutch Bros.

    New York, NY
    5 days ago
  •  ...headquartered in New York and brings deep expertise in finance and AI. About the Role Tabs is looking for a Senior Software Engineer to join the Data Ingest team, part of our broader Integrations org. This team's mission is simple to state and hard to build: any... 
    Full time
    Contract work
    Work at office
    Shift work

    Tab S

    New York, NY
    1 hour ago
  • $175k - $225k

     ...to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable...  ...with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks... 
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Drw Inc

    New York, NY
    9 hours ago
  •  ...About the Role We’re looking for a Senior Software Engineer focusing on Data to join our team and build the pipelines and systems that power Arya’s...  ...compounding effect. A series of quick, small, daily wins add up to big ones over time, and the absence of these can add up to... 
    Full time
    Flexible hours

    Arya Health

    New York, NY
    9 hours ago
  • $120k - $150k

     ...Software Engineer , Data About IEX IEX (IEX Group, Inc.) is an exchange operator and technology company dedicated to innovating performance in capital markets. Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business... 
    Full time
    Work experience placement
    Local area

    Iex Group

    New York, NY
    9 hours ago
  • $200k - $300k

     ...constantly evolving our firm’s IT infrastructure and engineering capabilities, positioning us at the forefront...  ...global business. What you'll do As a software engineer, you will help build the next generation of data infrastructure at the firm—thinking holistically... 
    Full time
    Work experience placement

    Point72

    New York, NY
    9 hours ago
  •  ...human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier...  ...machines, not pipelines. The architecture is not set. Early engineers will decide what it becomes, and the loop between "I shipped this... 
    Full time
    Work at office
    Relocation package

    Mercor

    New York, NY
    9 hours ago
  •  ...oncology ecosystem.  We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend lives...  ...~4+ years of professional experience in data engineering, software engineering, or data-intensive applications ~ Strong... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Flatiron Health

    New York, NY
    1 hour ago
  • $61k - $101k

     ...~ Formal training or certification in data engineering concepts, plus 12+ years of applied experience...  ...~8+ years leading technologists and software engineers to manage, anticipate, and resolve...  ...or Product Manager ~ Experience with big data technologies and complex data... 
    Big data
    Full time
    Work at office

    J.P. Morgan

    New York, NY
    3 days ago
  • $45 - $50 per hour

     ...Feedinkoo is seeking a full-time Software Engineering Intern for their Santa Monica office. The intern will engage in the entire life cycle...  ...internship offers the chance to specialize in disciplines such as Big Data or Mobile Development, with competitive pay between $45.00/... 
    Big data
    Full time
    Internship
    Summer internship
    Work at office

    Feedinkoo

    New York, NY
    5 days ago
  • $388k

     ...better matching of advertiser and partner data, while ensuring a strong commitment to...  ...and member privacy. The Role As a Software Engineer on the Ads Identity Graph team, you will...  ...data at extremely large volumes with big data tools like Spark, and building high... 
    Big data
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    New York, NY
    9 hours ago
  •  ...you will work within a Product Delivery Team fused with UX, engineering, product and data talent. You will help the team design beautiful interfaces...  ...if you are looking to segue your career into the FinTech or Big Data arenas. Key Responsibilities Be involved in... 
    Big data

    Remote VA

    New York, NY
    4 days ago
  • $150k - $275k

     ...chaos of fragmented financial data, manual workflows, and opaque...  ...talented and ambitious backend engineer with 5+ years of experience in...  ...massive untapped market. As a software engineer, you’ll have an...  ...pipelines Familiarity with big data technologies and comfortable... 
    Big data
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    9 hours ago
  • $140k - $200k

     ...include frontend and backend engineers, AI research scientists, and others...  ...We're looking to hire for our Data side of our AI team at...  ...We are looking for a skilled Software Engineer to join us. What You...  ...work. An opportunity to make a big impact in a transformative industry... 
    Remote job
    Full time
    Work at office
    Shift work

    Speechify

    New York, NY
    9 hours ago
  • $153k - $376k

     ...shape the future of design and collaboration, join us! The Data Platform team at Figma builds and operates the foundational systems...  ...of stakeholders, including AI researchers, machine learning engineers, data scientists, product engineers, and business teams that... 
    Full time
    Remote work
    Work from home

    Figma

    New York, NY
    9 hours ago
  • $388k

     ...engaged. Our Team The Ads Platform Engineering teams build advertising systems and...  ...systems. Forecasting enables near-realtime data-driven decisioning for advertisers, agencies...  ...data at extremely large volumes with big data tools like Spark, and building high... 
    Big data
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    New York, NY
    9 hours ago
  •  ...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise...  ...Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify... 
    Big data
    Temporary work

    Damco

    New York, NY
    1 day ago
  • $195k - $408k

     ...business. The mission of the Ad Engineering Team is to build this platform. We are hiring a Senior Software Engineer for the Advertising...  ...understanding of algorithms, data structures, performance optimization...  ...is a plus  ~ Experience with Big Data and cloud services such... 
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    9 hours ago
  • $196k - $278.1k

     ...Software Engineer, Data San Francisco, CA; Austin, TX; New York, NY Airtable is the no-code app platform that empowers people closest to the work to accelerate their most critical business processes. More than 500,000 organizations, including 80% of the Fortune 1... 
    Remote work
    Flexible hours
    Shift work

    Airtable

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Big Data. Be the first to apply!