Software Engineer, Big Data, Tech Enablement
$135k - $185kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
Summary:
The Tech Enablement team is central to the velocity and quality of our entire engineering organization. Our mission is to build the scalable, reliable, and efficient infrastructure, tools, and processes that allow every product team to quickly deliver innovative products and services to our customers.
The Tech Enablement team ensures engineering efficiency and provides the foundational building blocks for the entire technology stack:
- Data Infrastructure & Systems : We help developers at ZipRecruiter sustainably follow best practices and implement robust solutions by allowing engineers and data scientists to focus less on underlying technologies and more on building products and features that delight ZipRecruiter's customers. To do this, the team builds, maintains, and drives adoption of tools for engineers that aid in data processing, dataset ingestion, dataset discoverability, data pipeline orchestration, data documentation, data analysis, building ML model pipelines, and running experiments.
- AI Enablement : We help developers at ZipRecruiter leverage AI as a part of their tech stack by building and maintaining an agentic AI data exploration and analysis tool to democratize access to data, collaborate on insights, and accelerate data driven decision making. Starting from a natural language chat interface, the AI assisted tool assists with every aspect of using data, from finding the right data sources and writing queries to using them to visualize and analyze the results. We also manage an LLM Gateway which powers all of ZipRecruiter's LLM usage in our customer facing products.
Key Focuses:
As a Big Data Engineer in Tech Enablement, you will:
- Data Ingestion & Datalake Management: Design, build, deploy, and maintain the data pipelines and systems that make web events available in our datalake and via event streams for various downstream applications to process.
- Big Data Processing: You'll tackle challenges with large, evolving datasets, using a mix of batch and streaming techniques to make critical trade-offs between speed, efficiency, and reliability.
- MLOps: Design, build, deploy, and maintain frameworks and systems that accelerate ML development across teams and products at ZipRecruiter, with the goals of improving the velocity, quality, observability, and reliability of ML development and ML powered products.
- Data Documentation Framework: Design, build, deploy, and maintain frameworks and systems to improve the comprehensiveness and quality of data documentation at ZipRecruiter through processes and tooling that allows both humans and automated processes to easily add, maintain, and discover documentation.
- Data Analysis Agent: Design, build, deploy, and maintain an agentic data exploration and analysis tool, Sift, to democratize access to data, collaborate on insights, and accelerate data driven decision making.
Minimum Qualifications:
- 2+ years of professional software development experience, including building and operating data pipelines that feed into a customer facing product
- Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale
- Experience deploying and operating containerized services and batch jobs
- Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing
- Professional software development experience, including building and operating data pipelines and infrastructure that feed into a customer facing product
Preferred Qualifications:
- 4+ years of professional software development experience with a focus on data-intensive systems
- Working knowledge of AWS (S3, IAM, EC2, MSK or equivalents) and of instrumenting jobs with metrics, logs and alerts
- Experience with a data lake stack: parquet on object storage, a data catalog such as AWS Glue, and an open table format such as Apache Iceberg or Delta Lake
- Streaming experience: Kafka producers and consumers, Apache Flink, and/or Spark Structured Streaming
- Experience with a workflow orchestrator such as Apache Airflow: authoring DAGs, backfills, dependency management and on-call for scheduled pipelines
- Experience with open table format internals: schema evolution, partitioning, and compaction
- Experience with deploying services on Kubernetes with Docker
- Experience building and maintaining a data platform that powers a user-facing product including infrastructure and tools for streaming and batch data ingestion, building ETL pipelines, data permissions management, and data discovery.
- BS/MS/PhD in Computer Science, Mathematics, Physics or a related field, or equivalent practical experience
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $135,000 - $185,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
#LI-Remote
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
- ...on the back of petabytes of data.We shape the next generation... ...teams across Apple. Our systems enable Apple engineering and operations teams to... ...opportunity to solve challenging software engineering and operational... ...and development in the Big Data and NoSQL technologies...Big dataWork experience placement
$150.4k - $225.3k
Role Number: 200680196Team: Software and ServicesLocation: Austin; SunnyvalePosted... ...&T) organization. IS&T is the engine behind everything Apple does... ...what you could do here.AI & Data Platforms (AiDP) is IS&T's... ...experience with Big data technologies and data platformsFamiliarity...Big dataRelocation$184.7k - $324.8k
Role Number: 200687367Team: Software and ServicesLocation: Austin; SunnyvalePosted... ...&T) organization. IS&T is the engine behind everything Apple does... ...what you could do here. AI & Data Platforms (AiDP) is IS&T's... ...databases like SnowFlake, Big Query or ClouderaProgramming...Big dataWork experience placementRelocation- Optiver is looking for Software Engineers to join our High-... ...problems end to end, from data ingestion, feature generation... ...infrastructure that enables rapid experimentation,... ...we areOptiver is a tech-driven trading firm... ...research infrastructure and big data computing. What’s...Big dataWork at office
- ...Yearly (Full Time)Employment Type: Full TimeCompany: SRI Tech SolutionsJob Title: Data Engineer (Snowflake & Python)- DBTLocation: Day 1 Sunnyvale, CA... ...orchestration tools like Airflow or Prefect.Knowledge of other big data technologies such as Databricks, Spark, or Kafka....Big dataFull time
$152k - $241.5k
...infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/... ...computing workloads.The MARS AI Data team owns how NVIDIA's AI research uses... ...systems or data-infrastructure software.Deep experience with at least one of...Full timeLocal area$170k - $240k
...opportunity to work on applications and data at scale, serving millions of... ...employers and need senior data engineers to build fast, scalable, and... ...Qualifications: ~5+ years of professional software development experience with a focus on Python and big data technologies ~ Experience...Big dataFull timeRemote workFlexible hours- ...outsourcing services.CLA is seeking a Back-End Software Engineer to join our growing technology team.... ...server-side systems, APIs, and data solutions.You’ll collaborate with technology... ...IntegrationBuild and maintain APIs that enable secure and efficient data exchange between...Full time
$152k - $241.5k
...universes to explore, enables amazing creativity and... ...Stack Web Applications Engineers to join this dynamic and... ...for VLSI designs. This software development team is a multifaceted... ...large scale data platform with high QoS.... ...microservices for various big-data scenarios.What we...Big dataFull time- Role Number: 200689953Team: Software and Services, Operations and Supply... ...0-19SummaryThe Apple Services Engineering team (ASE) is one of the most... ....Within ASE, the Apple Data Platform SRE team keeps a massive... ...Apple — while specialising in the big data engines and catalog/...Big data
- ...expertise to drive innovation and adoption of new technology. Your role and responsibilities As a Data Engineer specializing in Data Platforms, you will develop applications on Big Data technologies, including API development. This role requires a strong foundation in...Big dataFull timeTemporary workPart timeWorldwide
- Role Number: 200684574Team: Software and ServicesLocation: AustinPosted... ...&T) organization. IS&T is the engine behind everything Apple does... ...Imagine what you could do here.AI & Data Platforms (AiDP) is IS&T's... ...tuning, and model evaluation, enabling rapid experimentation and...
$186k - $269k
Staff Data Engineer The Google Cloud Consulting Professional Services team guides customers through... ...network, web-scale data centers, and software infrastructure. As part of an innovative... ...to clarify client requirements and enable data-driven decision-making. CompliancePoint$8k
...Employment Type: Full TimeCompany: SRI Tech SolutionsRole: Applied Data Scientist/ Data Science... ...that will be integrated into software productsCollaborate with software engineers, business stakeholders and... ...scientists is a plusExperience with Big Data technologies and/or...Big dataFull timeLocal areaRelocation3 days per week$7.99k
...ID: SRJ_7986Location: Austin, TXSalary: USD 115-120 / Yearly (Full Time)Employment Type: Full TimeCompany: SRI Tech SolutionsPython/Java Developer with Big Data ExpLocation - Austin, TX (Day 1 Onsite)Employment Type - FTEJob Description:Experience with Python and Java....Big dataFull time$8.49k
...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsFull stack Python... ...) Required skills: strong software development experience in... ...shell scripting, and knowledge in data analysis within databases.... ...experience building high-performance Big Data and streaming solutions...Big dataFull time$8.46k
...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJava Bigdata LeadLocation: Austin, TXJob Description:A... ...development knowledge in Java. Person must have exposure to big data tools.Must have skills: • Java, Hive, HDFS • Spark,...Big dataHourly payFull time- We Are:The beginning of a new Data & AI decade that will reshape... ...Power Ecosystem.You Are:As a Data Engineering, Management & Governance... ...Build business processes that enable data governance (e.g., stewardship... ...-on experience on Cloud and Big Data technologies such as serverless...Big dataWork experience placementLive inWork at officeLocal area
$117.8k - $168.3k
...Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI... ..., scalability, and real-world impact. Data Engineering & Processing - Work with large... ...deployments. Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL...Big dataFull timeRemote workFlexible hours$152k - $241.5k
The NVIDIA DGXC Data Services team builds cloud-native systems, frameworks, and services... ...and production environments.Use modern software engineering practices, including AI-assisted and... ...opens up new universes to explore, enables amazing creativity and discovery, and powers...Full timeRemote work$22 per hour
Senior Software Engineer, DataAustin, TX (Onsite 4 days per week) Note: This... ...Job Summary: The Enterprise Data team’s mission is to unify data... ...and Microsoft hybrid cloud tech stack. Our data storage layer... ...data engineering patterns that enable the rapid, scalable, and...Full timeTemporary workImmediate startVisa sponsorshipFlexible hours- Role Number: 200640140Team: Software and ServicesLocation: AustinPosted... ...about applying your data skills in a real-world tech environment?Imagine what you... ...internal partners.The SDS software engineering team is building an environment to enable ground breaking data analysis...
$144.7k - $261.3k
...experiences.About the TeamEvery autonomous-driving engineer at GM eventually asks the same questions:... ...answer them, across the full life of AV data:Record and catalog new data as it comes... ...need to trust and use it: vehicle, software version, location, and ingestion status....Full timeLive inLocal areaRemote workWork from homeRelocation packageFlexible hours$134k - $188.6k
...RoleJoin our GPSC Insights Engineering team, responsible for... ..., and delivering new data solutions for global purchasing... ...data engineering and software engineering expertise... ...applications.Build AI-enabled data and application... ...stores, or comparable big-data technologies.Experience...Big dataFull timeH1bLocal areaWork from homeRelocation packageFlexible hours- ...TexasProduct Development - Data & Agentic /Employee /... ...siteWho is Sonar?Sonar enables organizations to ship... ...cost and risk of agentic software development.Founded in... ...for a talented Data Engineer - you! - to join the Code... ...You have been exposed to big data architecture...Big dataFull timeWork at officeRemote workWorldwideRelocationFlexible hours3 days per week
- ...while valuing your unique skills and experiences. **Your role and responsibilities** As a Data Engineer specializing in Data Platforms, you will develop applications on Big Data technologies, including API development. This role requires a strong foundation in...Big dataWorldwide
- ...Learning (ML) infrastructure, ML, data, and application pipelines,... ..., ML platforms, and software to enable moderl prediction and optimization... ...with business and software engineering teams to drive the adoption... ...model outputs. Implements big data solutions in the data analytics...Big dataFull time
$150k - $270k
...Role: CrowdStrike is seeking a Senior Software Engineer to help design and build the software... ...FrontTier Expansions team is responsible for enabling LogScale fleets to run reliably... ...systems that ingest over 100 PB of event data daily, support decade-long data retention...Hourly payPermanent employmentFull timeWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week- ...guidance provided Facilitate software application design... ..., Spring MVC, Spring Data, JPA and Hibernate. • Hands... ...Generative AI – Prompt Engineering, Vibe Coding / AI-... ...services and consulting. We enable clients in more than 50... ...Skill 4 Technology|Big Data - NoSQL|MongoDB Technical...Big dataFull timeTemporary workRelocation
$94.4k - $293.8k
...than 45,000 AI and data professionals across... ...Stack Agentic AI Engineer leader who focuses... ...demonstrations to enable credible, highly differentiated... ...AI applications, big data analytics,... ...AI / ML based software to a cloud environment... ...for emergent tech and driving innovationBonus...Big dataWork experience placementLive inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Big Data, Tech Enablement. Be the first to apply!
- senior software design engineer Austin, TX
- software web developer Austin, TX
- senior software engineer Austin, TX
- labview software developer Austin, TX
- software developer fintech Austin, TX
- software support engineer Austin, TX
- security software engineer Austin, TX
- software developer night shift Austin, TX
- integration software engineer Austin, TX
- scientific software engineer Austin, TX



