Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Big Data, Tech Enablement

$135k - $185k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary: 

The Tech Enablement team is central to the velocity and quality of our entire engineering organization. Our mission is to build the scalable, reliable, and efficient infrastructure, tools, and processes that allow every product team to quickly deliver innovative products and services to our customers.

The Tech Enablement team ensures engineering efficiency and provides the foundational building blocks for the entire technology stack:

  • Data Infrastructure & Systems : We help developers at ZipRecruiter sustainably follow best practices and implement robust solutions by allowing engineers and data scientists to focus less on underlying technologies and more on building products and features that delight ZipRecruiter's customers. To do this, the team builds, maintains, and drives adoption of tools for engineers that aid in data processing, dataset ingestion, dataset discoverability, data pipeline orchestration, data documentation, data analysis, building ML model pipelines, and running experiments.
  • AI Enablement : We help developers at ZipRecruiter leverage AI as a part of their tech stack by building and maintaining an agentic AI data exploration and analysis tool to democratize access to data, collaborate on insights, and accelerate data driven decision making. Starting from a natural language chat interface, the AI assisted tool assists with every aspect of using data, from finding the right data sources and writing queries to using them to visualize and analyze the results. We also manage an LLM Gateway which powers all of ZipRecruiter's LLM usage in our customer facing products. 

Key Focuses:

As a Big Data Engineer in Tech Enablement, you will:

  • Data Ingestion & Datalake Management: Design, build, deploy, and maintain the data pipelines and systems that make web events available in our datalake and via event streams for various downstream applications to process.
  • Big Data Processing: You'll tackle challenges with large, evolving datasets, using a mix of batch and streaming techniques to make critical trade-offs between speed, efficiency, and reliability.
  • MLOps: Design, build, deploy, and maintain frameworks and systems that accelerate ML development across teams and products at ZipRecruiter, with the goals of improving the velocity, quality, observability, and reliability of ML development and ML powered products.
  • Data Documentation Framework: Design, build, deploy, and maintain frameworks and systems to improve the comprehensiveness and quality of data documentation at ZipRecruiter through processes and tooling that allows both humans and automated processes to easily add, maintain, and discover documentation.
  • Data Analysis Agent: Design, build, deploy, and maintain an agentic data exploration and analysis tool, Sift, to democratize access to data, collaborate on insights, and accelerate data driven decision making.

Minimum Qualifications:

  • 2+ years of professional software development experience, including building and operating data pipelines that feed into a customer facing product
  • Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale
  • Experience deploying and operating containerized services and batch jobs
  • Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing
  • Professional software development experience, including building and operating data pipelines and infrastructure that feed into a customer facing product

Preferred Qualifications:

  • 4+ years of professional software development experience with a focus on data-intensive systems
  • Working knowledge of AWS (S3, IAM, EC2, MSK or equivalents) and of instrumenting jobs with metrics, logs and alerts
  • Experience with a data lake stack: parquet on object storage, a data catalog such as AWS Glue, and an open table format such as Apache Iceberg or Delta Lake
  • Streaming experience: Kafka producers and consumers, Apache Flink, and/or Spark Structured Streaming
  • Experience with a workflow orchestrator such as Apache Airflow: authoring DAGs, backfills, dependency management and on-call for scheduled pipelines
  • Experience with open table format internals: schema evolution, partitioning, and compaction
  • Experience with deploying services on Kubernetes with Docker
  • Experience building and maintaining a data platform that powers a user-facing product including infrastructure and tools for streaming and batch data ingestion, building ETL pipelines, data permissions management, and data discovery.
  • BS/MS/PhD in Computer Science, Mathematics, Physics or a related field, or equivalent practical experience

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $135,000 - $185,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 19 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Big Data, Tech Enablement in Austin, TX vacancy
  •  ...on the back of petabytes of data.We shape the next generation...  ...teams across Apple. Our systems enable Apple engineering and operations teams to...  ...opportunity to solve challenging software engineering and operational...  ...and development in the Big Data and NoSQL technologies... 
    Big data
    Work experience placement

    Apple

    Austin, TX
    2 days ago
  • $150.4k - $225.3k

    Role Number: 200680196Team: Software and ServicesLocation: Austin; SunnyvalePosted...  ...&T) organization. IS&T is the engine behind everything Apple does...  ...what you could do here.AI & Data Platforms (AiDP) is IS&T's...  ...experience with Big data technologies and data platformsFamiliarity... 
    Big data
    Relocation

    Apple

    Austin, TX
    2 days ago
  • $184.7k - $324.8k

    Role Number: 200687367Team: Software and ServicesLocation: Austin; SunnyvalePosted...  ...&T) organization. IS&T is the engine behind everything Apple does...  ...what you could do here. AI & Data Platforms (AiDP) is IS&T's...  ...databases like SnowFlake, Big Query or ClouderaProgramming... 
    Big data
    Work experience placement
    Relocation

    Apple

    Austin, TX
    2 days ago
  • Optiver is looking for Software Engineers to join our High-...  ...problems end to end, from data ingestion, feature generation...  ...infrastructure that enables rapid experimentation,...  ...we areOptiver is a tech-driven trading firm...  ...research infrastructure and big data computing. What’s... 
    Big data
    Work at office

    Optiver

    Austin, TX
    3 days ago
  •  ...Yearly (Full Time)Employment Type: Full TimeCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)- DBTLocation: Day 1 Sunnyvale, CA...  ...orchestration tools like Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka.... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  • $152k - $241.5k

     ...infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/...  ...computing workloads.The MARS AI Data team owns how NVIDIA's AI research uses...  ...systems or data-infrastructure software.Deep experience with at least one of... 
    Full time
    Local area

    Nvidia

    Austin, TX
    12 hours ago
  • $170k - $240k

     ...opportunity to work on applications and data at scale, serving millions of...  ...employers and need senior data engineers to build fast, scalable, and...  ...Qualifications: ~5+ years of professional software development experience with a focus on Python and big data technologies ~ Experience... 
    Big data
    Full time
    Remote work
    Flexible hours

    ZipRecruiter

    Austin, TX
    3 days ago
  •  ...outsourcing services.CLA is seeking a Back-End Software Engineer to join our growing technology team....  ...server-side systems, APIs, and data solutions.You’ll collaborate with technology...  ...IntegrationBuild and maintain APIs that enable secure and efficient data exchange between... 
    Full time

    CliftonLarsonAllen

    Austin, TX
    12 hours ago
  • $152k - $241.5k

     ...universes to explore, enables amazing creativity and...  ...Stack Web Applications Engineers to join this dynamic and...  ...for VLSI designs. This software development team is a multifaceted...  ...large scale data platform with high QoS....  ...microservices for various big-data scenarios.What we... 
    Big data
    Full time

    Nvidia

    Austin, TX
    12 hours ago
  • Role Number: 200689953Team: Software and Services, Operations and Supply...  ...0-19SummaryThe Apple Services Engineering team (ASE) is one of the most...  ....Within ASE, the Apple Data Platform SRE team keeps a massive...  ...Apple — while specialising in the big data engines and catalog/... 
    Big data

    Apple

    Austin, TX
    2 days ago
  •  ...expertise to drive innovation and adoption of new technology. Your role and responsibilities As a Data Engineer specializing in Data Platforms, you will develop applications on Big Data technologies, including API development. This role requires a strong foundation in... 
    Big data
    Full time
    Temporary work
    Part time
    Worldwide

    IBM

    Austin, TX
    1 day ago
  • Role Number: 200684574Team: Software and ServicesLocation: AustinPosted...  ...&T) organization. IS&T is the engine behind everything Apple does...  ...Imagine what you could do here.AI & Data Platforms (AiDP) is IS&T's...  ...tuning, and model evaluation, enabling rapid experimentation and... 

    Apple

    Austin, TX
    2 days ago
  • $186k - $269k

    Staff Data Engineer The Google Cloud Consulting Professional Services team guides customers through...  ...network, web-scale data centers, and software infrastructure. As part of an innovative...  ...to clarify client requirements and enable data-driven decision-making. CompliancePoint

    CompliancePoint

    Austin, TX
    2 days ago
  • $8k

     ...Employment Type: Full TimeCompany: SRI Tech SolutionsRole: Applied Data Scientist/ Data Science...  ...that will be integrated into software productsCollaborate with software engineers, business stakeholders and...  ...scientists is a plusExperience with Big Data technologies and/or... 
    Big data
    Full time
    Local area
    Relocation
    3 days per week

    SRI Tech

    Austin, TX
    4 days ago
  • $7.99k

     ...ID: SRJ_7986Location: Austin, TXSalary: USD 115-120 / Yearly (Full Time)Employment Type: Full TimeCompany: SRI Tech SolutionsPython/Java Developer with Big Data ExpLocation - Austin, TX (Day 1 Onsite)Employment Type - FTEJob Description:Experience with Python and Java.... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  • $8.49k

     ...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsFull stack Python...  ...) Required skills: strong software development experience in...  ...shell scripting, and knowledge in data analysis within databases....  ...experience building high-performance Big Data and streaming solutions... 
    Big data
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  • $8.46k

     ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJava Bigdata LeadLocation: Austin, TXJob Description:A...  ...development knowledge in Java. Person must have exposure to big data tools.Must have skills:      • Java, Hive, HDFS      • Spark,... 
    Big data
    Hourly pay
    Full time

    SRI Tech

    Austin, TX
    4 days ago
  • We Are:The beginning of a new Data & AI decade that will reshape...  ...Power Ecosystem.You Are:As a Data Engineering, Management & Governance...  ...Build business processes that enable data governance (e.g., stewardship...  ...-on experience on Cloud and Big Data technologies such as serverless... 
    Big data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    12 hours ago
  • $117.8k - $168.3k

     ...Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI...  ..., scalability, and real-world impact. Data Engineering & Processing - Work with large...  ...deployments. Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL... 
    Big data
    Full time
    Remote work
    Flexible hours

    Gainwell

    Austin, TX
    3 days ago
  • $152k - $241.5k

    The NVIDIA DGXC Data Services team builds cloud-native systems, frameworks, and services...  ...and production environments.Use modern software engineering practices, including AI-assisted and...  ...opens up new universes to explore, enables amazing creativity and discovery, and powers... 
    Full time
    Remote work

    Nvidia

    Austin, TX
    2 days ago
  • $22 per hour

    Senior Software Engineer, DataAustin, TX (Onsite 4 days per week) Note: This...  ...Job Summary: The Enterprise Data team’s mission is to unify data...  ...and Microsoft hybrid cloud tech stack. Our data storage layer...  ...data engineering patterns that enable the rapid, scalable, and... 
    Full time
    Temporary work
    Immediate start
    Visa sponsorship
    Flexible hours

    Acrisure

    Austin, TX
    12 hours ago
  • Role Number: 200640140Team: Software and ServicesLocation: AustinPosted...  ...about applying your data skills in a real-world tech environment?Imagine what you...  ...internal partners.The SDS software engineering team is building an environment to enable ground breaking data analysis... 

    Apple

    Austin, TX
    2 days ago
  • $144.7k - $261.3k

     ...experiences.About the TeamEvery autonomous-driving engineer at GM eventually asks the same questions:...  ...answer them, across the full life of AV data:Record and catalog new data as it comes...  ...need to trust and use it: vehicle, software version, location, and ingestion status.... 
    Full time
    Live in
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    2 days ago
  • $134k - $188.6k

     ...RoleJoin our GPSC Insights Engineering team, responsible for...  ..., and delivering new data solutions for global purchasing...  ...data engineering and software engineering expertise...  ...applications.Build AI-enabled data and application...  ...stores, or comparable big-data technologies.Experience... 
    Big data
    Full time
    H1b
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    4 days ago
  •  ...TexasProduct Development - Data & Agentic /Employee /...  ...siteWho is Sonar?Sonar enables organizations to ship...  ...cost and risk of agentic software development.Founded in...  ...for a talented Data Engineer - you! - to join the Code...  ...You have been exposed to big data architecture... 
    Big data
    Full time
    Work at office
    Remote work
    Worldwide
    Relocation
    Flexible hours
    3 days per week

    SonarSource

    Austin, TX
    1 day ago
  •  ...while valuing your unique skills and experiences. **Your role and responsibilities** As a Data Engineer specializing in Data Platforms, you will develop applications on Big Data technologies, including API development. This role requires a strong foundation in... 
    Big data
    Worldwide

    IBM

    Austin, TX
    3 days ago
  •  ...Learning (ML) infrastructure, ML, data, and application pipelines,...  ..., ML platforms, and software to enable moderl prediction and optimization...  ...with business and software engineering teams to drive the adoption...  ...model outputs. Implements big data solutions in the data analytics... 
    Big data
    Full time

    Fidelity Investments

    Austin, TX
    2 days ago
  • $150k - $270k

     ...Role: CrowdStrike is seeking a Senior Software Engineer to help design and build the software...  ...FrontTier Expansions team is responsible for enabling LogScale fleets to run reliably...  ...systems that ingest over 100 PB of event data daily, support decade-long data retention... 
    Hourly pay
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Austin, TX
    18 days ago
  •  ...guidance provided Facilitate software application design...  ..., Spring MVC, Spring Data, JPA and Hibernate. • Hands...  ...Generative AI – Prompt Engineering, Vibe Coding / AI-...  ...services and consulting. We enable clients in more than 50...  ...Skill 4 Technology|Big Data - NoSQL|MongoDB Technical... 
    Big data
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Austin, TX
    2 days ago
  • $94.4k - $293.8k

     ...than 45,000 AI and data professionals across...  ...Stack Agentic AI Engineer leader who focuses...  ...demonstrations to enable credible, highly differentiated...  ...AI applications, big data analytics,...  ...AI / ML based software to a cloud environment...  ...for emergent tech and driving innovationBonus... 
    Big data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Big Data, Tech Enablement. Be the first to apply!