Engineering Manager, Big Data, Job Understanding
$200k - $265kZipRecruiter
Job Description
Job Description
We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
Our Mission:
To actively connect people to their next great opportunity.
Who We Are:
ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.
About the Team:
Recommendations Ecosystem
The Recommendations Ecosystem group owns the intelligence that connects job seekers and jobs in our marketplace. We aim to understand every job and every job seeker well enough to make matches that work for both sides. We structure and enrich the jobs corpus, build the foundational models that encode jobs and job seekers, and run the matching engines that put the right opportunities in front of the right people.
What our team owns
Our group is the authoritative source for job understanding and matching intelligence, focusing on accuracy, relevance, and trust:
- Jobs Corpus Understanding: ZipRecruiter takes in millions of job postings from employers, partners, and feeds. We own the ingestion and enrichment pipelines that turn raw postings into structured data. We use ML classifiers to infer job attributes like education requirements and pay, and we attach company and location data. We find and suppress fraudulent listings or terms of use violations, so the marketplace stays safe and worth using. The result is a canonical view of every job that recommendations, search, and employer products build on.
- Foundational Models and Embeddings: At the core of ZipRecruiter's matching ecosystem are models that encode everything we can learn about jobs and job seekers. We build LLM-based embedding models from job content, resumes, and behavioral signals. These are the building blocks for matching and other ML models across the company, and we serve them at scale online and in batch.
- Matching Engines: We are responsible for the ML systems that recommend jobs to job seekers and job seekers to employers across our app, website, and email. The engines cover large-scale candidate retrieval over vector DBs and orchestration that delivers fresh, personalized recommendations.
About the Job:
ZipRecruiter's Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.
We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.
- Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
- Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
- Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
- Own and lead improvements to fraud detection and blocking mechanisms.
- Partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
- Ensure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience.
Minimum Qualifications:
- 5+ years of professional software development experience.
- 2+ years of experience as a software engineering leader
- Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
- Streaming technologies (Kafka, Flink, Beam).
- Strong CS fundamentals (data structures, algorithms) and coding skills.
- Experience with containerization technologies like Docker and Kubernetes.
- Experience working on a B2C or B2B Product
- This role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.
- Must have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations)
Preferred Qualifications:
- Cloud platforms (GCP, AWS, Azure).
- Modern data storage solutions (Delta Lake, HBase, Hudi).
- Scala
As part of our team you'll enjoy:
- Competitive compensation
- Exceptional benefits package
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
The US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.
Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.
Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice
- ...this Opportunity Spokeo is seeking a Data Engineering Manager to help build a state-of-the-art... ...partner closely with our Product Owners to understand requirements, provide technical... ...Azure) ~5+ years of experience with big data technologies (Spark, Hadoop, MapReduce...Big dataRemote workHome office
- ...At Riot, Data Engineers play a critical role in transforming data into actionable... ...a Senior Data Engineering Manager within VALORANT, you will be... ...data to better serve and understand our game and our players.... ...team. ~ Hands-on expertise in big-data technologies,...Big dataLocal areaWorldwideFlexible hours
$190k - $240k
...team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of... ...job seekers alike. As part of this effort, we're hiring an Engineering Manager to lead our Big Data Engineering team. Our business is complex; we're...Big dataFull timeRemote workFlexible hours$175.5k - $263.8k
...meditations, fun games and more. The Services Data Science & Analytics organization... ..., and is seeking a self-starting Engineering Program Manager to manage a portfolio of analytics projects... ...with initiatives involving analytics, Big Data, data governance, AI, and/or data...Big dataRelocation$88.54k - $141.69k
...Manager of Data Science The Manager of Data Science is responsible for supporting advanced... ...fields ~ Deep theoretical and practical understanding of statistical/ML techniques and... ...~ Advanced proficiency with SQL for big data analytics and Python for production...Big dataTemporary workFreelanceFlexible hours- ...this Opportunity Spokeo is seeking a Data Engineering Manager to help build a state-of-the-art... ...partner closely with our Product Owners to understand requirements, provide technical... ...Azure) ~5+ years of experience with big data technologies (Spark, Hadoop, MapReduce...Big dataRemote workHome office
$140k - $160k
...Description Description We are seeking a highly motivated Manager - Data Engineering to join our growing team. This role will report to the... ...programming languages such as Python or Spark. Solid understanding of database structures, data modeling (normalized, star...Remote work$200.4k - $268.7k
...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all... ...are seeking a Principal Product Manager to lead strategy, roadmap, and... ...Expertise with Data Management, Big Data & Analytics, Data Warehouse...Big data$129.5k - $207.5k
...the interest of national security. Job Title: Manager, Master Data (Manager, Manufacturing Engineering) Job Code: 45436 Job Location: All Locations... ...in master data management with a solid understanding of how key master data fields impact MRP highly desired...Local areaFlexible hours- ...expertise in digital media supply chain, data & analytics, IP & rights management, broadcast transformation,... ...high-quality project execution Understand, develop and articulate complex business... ...patterns Bachelor’s degree in engineering, information systems, computer...InternshipWork at officeRemote workFlexible hours
$149.3k - $200.2k
...location. About The Role The Data Science team at DTC combines... ..., marketing, product, and engineering teams at Disney+, Hulu and... ...What You'll Do Modeling: Manage and apply state of the art... ...opportunities, and create common understanding of how people are interacting...Work experience placementWorldwide$50k - $95k
...Agency Hearts & Science Job Function Data and Analytics Job Subfunction Data Engineering Job Description Manager, Offline Media Data Operations Role Overview The Manager... ...to identify potential data issues. Understand how Television campaigns are planned, purchased...Work at officeLocal area3 days per week$135k - $175k
...DATABASE RELIABILITY ENGINEER SpaceX is looking for... ...internal customers to understand current challenges, plan... ...configurations. Perform data migration / data... ...database technical issues. Manage PowerBI licensing,... ...Strong understanding of big data and data warehouse...Big dataTemporary workRemote workFlexible hoursWeekend work- ...Insight Global is seeking a Director of Data Engineering to lead the strategy, architecture,... ...with 5+ years of leadership experience managing Data Engineers, Technical Leads and third... ...Apache Flink, Flink, Lamndas, • Deep understanding of ETL/ELT pipelines, data modeling,...
- ...Assistance Services Finance Technology Big Data Business Intelligence Employee... ...years of sales experience, and a deep understanding of the intricacies of labor and Taft-... ...yet rewarding, environment. Hiring Manager Title VP, Public and Labor...Big data
$239.3k - $272.1k
...looking for a Head of Data Platform & AI to lead... ...evaluation, and difficult engineering problems. You will... ...leaders across Octave.Management Responsibilities: Develops... ...opportunities, understand technical feasibility... ...problems, no matter how big, because someone should...Full timeRemote workHome office- ...Information Technology & Services Big Data Big Data Analytics Financial Services... .... Responsibilities also include managing lobbyists, trade associations, and coalitions... ...is required, along with a strong understanding of Congress and the Executive Branch. The...Big data
$111.3k - $175.62k
...our team.KPMG is currently seeking a Manager, Data Solutions Delivery to join our Digital... ...across solutionsMentor and guide data engineers and developers, establish standards for... ...repositories and CI/CD processes, along with an understanding of data consumption platforms and...H1bWork at officeLocal area- ...: The Senior Analyst, Data Analytics is an experienced... ..., independently manages high-impact assignments... ...Statistics, Mathematics, Engineering, or a closely related... ...processing, or big-data analytics is a plus... ...and PowerPoint. Strong understanding of data quality, data...Big data
- ...-leading SQL database management system Industry... ...Categories Columnar Data Warehouse Database... ...Services Analytics Big Data Cloud Data... ..., measurable new-logo engine, driven by fearless prospecting... ...approach, and a deep understanding of enterprise...Big data
$200k - $230k
...practice in life. OVERVIEW ~ We are seeking an experienced Manager of Data Engineering to lead a team responsible for building and maintaining... ...-based data technologies, preferably AWS. ~ Strong understanding of ETL/ELT, data modeling, data lake, and lakehouse...- ...HealthTech) company providing cloud-based data solutions Industry... ...accuracy ehr interoperability big data integration revenue cycle management pharmacy solutions data visualization... ...demands a leader with a strong understanding of the healthcare data and...Big data
$222.5k - $261.9k
...impact?West Monroe is seeking a Senior Manager, Data Program Management to lead large-scale... ...cross-functional teams across data engineering, architecture, analytics, infrastructure... ...transformation strategies, helping clients understand how modern data platforms, automation,...Local areaImmediate startFlexible hours- ...across markets.SKIMS is seeking a Product Manager, Data to shape and deliver data products... .... They will partner closely with Data Engineering, Analytics, Data Science, and teams across... ...with business stakeholders to understand workflows, decisions, pain points, and...Work at officeImmediate start
- ...Technology Enabled Services.Job DescriptionWorking knowledge of Big Data ( Hadoop & NoSQL) on Cloud.Experience preferred with Azure,... ...or any other NoSQL solution (any one is fine) with some understanding of Architecture Methodologies like TOGAF, RM-ODP, Rational 4+...Big dataFull time
- ...Director, Data Science Location: New York /Chicago/Los Angeles Reports To: Senior... ...driven outcomes. Excellent project management skills with an ability to set and achieve... ...with non-technical teams. Clear understanding of digital clean rooms, and their related...Full timeLocal area
$200k - $275k
...opportunity for a strategic Director, Data Engineering & AI to join our Technology practice.... ...with high level client counterparts. Manage and influence multi-disciplinary teams... ...AI use cases at enterprise scaleStrong understanding of AI-oriented data architecture concepts...Work at officeLocal areaImmediate startFlexible hours2 days per week1 day per week$179k - $228.5k
...ROLEWe are looking for a Director of Data Engineering to provide technical and people leadership... ...engineering teamsDeep technical understanding of modern data engineering architectures... ...data modeling, data contracts, metadata management, lineage, governance, data quality,...Full timeLocal areaImmediate start$170k - $175k
...Description: Cloud Data Architect Los... ...architectures Very strong understanding and experience on Data... ...with LLMs, prompt engineering, and agent frameworks... ...with memory, context management, and tool usage. Define... ...(batch, real-time, big data) and analytics platforms...Big dataFull time- ...We are seeking an experienced and highly knowledgeable Engineering Manager to lead the engineering department. The ideal candidate is... ...Engineering Manager must be able to walk onto the shop floor, understand the machining challenges, evaluate processes, communicate effectively...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Big Data, Job Understanding. Be the first to apply!
- junior data engineer remote Los Angeles, CA
- principal data engineer Los Angeles, CA
- data engineer analytics Los Angeles, CA
- data science developer Los Angeles, CA
- data engineer manager Los Angeles, CA
- big data developer Los Angeles, CA
- big data devops engineer Los Angeles, CA
- data center engineer Los Angeles, CA
- big data cloud engineer Los Angeles, CA
- big data engineer Los Angeles, CA





