Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Big Data, Job Understanding

$200k - $265k

ZipRecruiter

Job Description

Job Description

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission:  

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

About the Team:

Recommendations Ecosystem

The Recommendations Ecosystem group owns the intelligence that connects job seekers and jobs in our marketplace. We aim to understand every job and every job seeker well enough to make matches that work for both sides. We structure and enrich the jobs corpus, build the foundational models that encode jobs and job seekers, and run the matching engines that put the right opportunities in front of the right people.

What our team owns

Our group is the authoritative source for job understanding and matching intelligence, focusing on accuracy, relevance, and trust:

  • Jobs Corpus Understanding: ZipRecruiter takes in millions of job postings from employers, partners, and feeds. We own the ingestion and enrichment pipelines that turn raw postings into structured data. We use ML classifiers to infer job attributes like education requirements and pay, and we attach company and location data. We find and suppress fraudulent listings or terms of use violations, so the marketplace stays safe and worth using. The result is a canonical view of every job that recommendations, search, and employer products build on.
  • Foundational Models and Embeddings: At the core of ZipRecruiter's matching ecosystem are models that encode everything we can learn about jobs and job seekers. We build LLM-based embedding models from job content, resumes, and behavioral signals. These are the building blocks for matching and other ML models across the company, and we serve them at scale online and in batch.
  • Matching Engines: We are responsible for the ML systems that recommend jobs to job seekers and job seekers to employers across our app, website, and email. The engines cover large-scale candidate retrieval over vector DBs and orchestration that delivers fresh, personalized recommendations.

About the Job:

ZipRecruiter's Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.

We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.

  • Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
  • Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
  • Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
  • Own and lead improvements to fraud detection and blocking mechanisms.
  • Partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
  • Ensure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience. 

Minimum Qualifications:

  • 5+ years of professional software development experience.
  • 2+ years of experience as a software engineering leader
  • Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
  • Streaming technologies (Kafka, Flink, Beam).
  • Strong CS fundamentals (data structures, algorithms) and coding skills.
  • Experience with containerization technologies like Docker and Kubernetes.
  • Experience working on a B2C or B2B Product
  • This role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.
  • Must have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations) 

Preferred Qualifications:

  • Cloud platforms (GCP, AWS, Azure).
  • Modern data storage solutions (Delta Lake, HBase, Hudi).
  • Scala

As part of our team you'll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice:  For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: -applicant-privacy-notice

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Big Data, Job Understanding in Chicago, IL vacancy
  •  ...Data Engineering, Management & Governance As a Data Engineering, Management & Governance professional...  ...of hands-on experience on Cloud and Big Data technologies such as serverless...  ...differently across systems) A good understanding of governance and security best practices... 
    Big data
    Work experience placement

    Accenture

    Chicago, IL
    2 days ago
  •  ...Visit us at accenture.com.You Are:As a Data Engineering, Management & Governance professional, you will...  ...of hands-on experience on Cloud and Big Data technologies such as serverless...  ...defined differently across systems)A good understanding of governance and security best... 
    Big data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Chicago, IL
    1 day ago
  • $190k - $240k

     ...team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of...  ...job seekers alike. As part of this effort, we're hiring an Engineering Manager to lead our Big Data Engineering team.  Our business is complex; we're... 
    Big data
    Full time
    Remote work
    Flexible hours

    ZipRecruiter

    Chicago, IL
    29 days ago
  • $88.54k - $141.69k

     ...Manager of Data Science The Manager of Data Science is responsible for supporting advanced...  ...fields ~ Deep theoretical and practical understanding of statistical/ML techniques and...  ...~ Advanced proficiency with SQL for big data analytics and Python for production... 
    Big data
    Temporary work
    Freelance
    Flexible hours

    Spark Foundry

    Chicago, IL
    3 days ago
  • $148.2k - $211.2k

    Reporting to the Data Platform and Engineering Director, the Data Engineering Senior Manager leads the design, build, and optimization of the scalable data platforms that...  ...leadership or team management roleAdvanced knowledge of big-data architecture and distributed processing,... 
    Big data
    Full time

    Sidley Austin

    Chicago, IL
    2 days ago
  •  ...Chainlink Engineering Manager for Data Feeds Chainlink is the industry-standard oracle platform bringing the capital markets onchain and...  ...available, customer-facing production infrastructure. Strong understanding of blockchain or oracle infrastructure, backend platform... 
    Remote work

    Chainlink Labs

    Chicago, IL
    4 days ago
  •  ...Job-ID: 12033 Category: Data & Analytics Location:...  ...She/he will hire and manage a team of data scientists...  ...machine learning and big data. 2+ years...  ...of data science, data engineering and statistics best practices...  ..., cleaning and understanding data in collaboration... 
    Big data
    Full time

    RB Global

    Westchester, IL
    1 day ago
  • $160k - $190k

     ...delivering solutions around data-driven enterprise, IT modernization...  ...Reply, we are hiring a Manager for the Data & AI team. The person...  ...to our customers. A strong understanding of data governance and...  ...working environments for data engineers and scientists, and general knowledge... 
    Full time

    Reply

    Chicago, IL
    1 day ago
  •  ...development and camaraderie. Role Summary At Tovala, the Data Engineering Manager leads the Data Engineering team and owns the pipelines,...  ...— partnering closely with Software and Data Analytics to understand what slows them down, then removing it so teams can ship faster... 
    Casual work
    Work at office
    Immediate start
    Flexible hours

    Tovala

    Chicago, IL
    1 day ago
  •  ...helping high-profile clients understand, analyze, and respond...  ...is currently seeking a Manager, Ignition to join our...  ...solutions working with data scientists, data...  ...foreign equivalent in engineering, computer science, information...  ...learning and/or big data tools such as Spark... 
    Big data
    Local area

    KPMG

    Chicago, IL
    4 days ago
  •  ...Fortune 500 and Global 2000 enterprises for data-driven decision-making. Founded in 2016...  ...We are seeking an experienced Data Engineering Manager with expertise in Pharmaceutical / Life...  ...Partner with business stakeholders to understand challenges and translate them into scalable... 
    Work experience placement
    3 days per week

    MathCo

    Chicago, IL
    1 day ago
  • $160k - $190k

     ...offer a new opportunity to join our dedicated team as a Manager, Data Engineering. Job Description The Manager, Data Engineering...  ...Infrastructure as Code (Terraform) and CI/CD automation. Strong understanding of data warehousing, semantic modeling, data quality, and... 
    Work at office

    The Aspen Group

    Chicago, IL
    a month ago
  • $162.7k - $199.3k

     ...happiness of those that occupy them. The Data Engineering team builds and operates the data...  ...job involves As Senior Data Engineering Manager, you will lead multiple related scrum...  ...You earn credibility with engineers by understanding the technical detail – from distributed... 
    Daily paid
    Full time
    Local area

    Jones Lang LaSalle

    Chicago, IL
    3 days ago
  • $120k - $145k

     ...feedback is encouraged. We leverage data to reflect on progress, own...  ...This roleis responsible forcreating, managing, andoptimizingdata engineering pipelines, managing data platform operations...  ...multiple workstreams; Leverages understanding of an organization’s operating... 
    Full time
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours

    Kipp

    Chicago, IL
    4 days ago
  •  ...Manager Data Engineering (Payments Migration) Cloud Solution Exposure: Strong exposure to cloud-based solution design and implementation...  ...including scalable data architectures for enterprise use cases. Understanding of Kafka platform Data Migration Programs: Proven... 

    Saxon Global

    Chicago, IL
    1 hour ago
  • $209k - $238.5k

     ...Senior Manager, Data Science - US Card (Upmarket Segments) Data is at...  ...customer records to unlock the big opportunities that help...  ...of data scientists, software engineers, and product managers to deliver...  ...and structures. You know understanding the data is often the key to... 
    Big data
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Chicago, IL
    4 days ago
  • $124k - $335k

     ...Forward Deployed Data Engineering - Senior Manager The Opportunity As a Forward Deployed Data Engineering - Senior Manager, you will be at the...  ...issues Building and maintaining client relationships to understand and address their evolving needs Promoting a culture... 

    PwC (US)

    Chicago, IL
    3 days ago
  •  ...Data Engineer Accenture helps the world's leading enterprises reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries. Our strategy is to be the reinvention partner of choice for our clients... 
    Work experience placement

    Accenture

    Chicago, IL
    2 days ago
  • $70k - $125k

     ...Data Engineer MissionOne Media is a brand within BarkleyOKRP that combines full-funnel media planning and buying services, CRM, data...  ...scientists, data analytics teams, reporting teams, and IT to understand and aid in the implementation of database requirements, analyze... 
    Work experience placement
    Flexible hours

    MissionOne Media

    Chicago, IL
    4 days ago
  •  ...Data Engineering Leader Founded in 2017, NinjaHoldings works to give everyday Americans better...  ...access to data so teams can safely understand and use data without relying on Data...  ...~2+ years of experience leading or managing Data Engineers or other technical teams... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    NinjaHoldings

    Chicago, IL
    12 hours ago
  • $160k - $262k

     ...Senior Manager Data Engineering Publicis Sapient is a digital transformation partner helping established organizations get to their future...  ...; specific platform experience is less important than understanding how AI engineering differs from traditional data engineering... 
    Contract work

    Digitas North America

    Chicago, IL
    2 days ago
  • $180k - $230k

     ...clients a Technical Product Manager, Data and Internal Products - this...  ...transactions by leveraging a deep understanding of identity and risk, and...  ...needs. Partner with engineering, data science, solutions...  ...Strong understanding of big data concepts, data pipelines... 
    Big data
    Immediate start
    Remote work
    Flexible hours

    Career Renew

    Chicago, IL
    27 days ago
  • $179.4k - $204.7k

    Manager, Data Scientist - Alternative Data Strategy Data is at the...  ...customer records to unlock the big opportunities that help...  ...vendors and data products, engineer high-impact features, build...  ...sources and structures. You know understanding the data is often the key to... 
    Big data
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    Chicago, IL
    4 days ago
  •  ...Field Engineering Manager The Databricks Field Engineering team activates...  ...our customers get from their data and AI. Major Enterprises in...  ...on enterprise software, big data/analytics, data engineering...  ...AI). ~ A deep technical understanding of the impact that Data + AI... 
    Big data
    Worldwide

    Databricks

    Chicago, IL
    2 days ago
  • $120k - $165k

     ...Data Engineer Opportunity Let's be unstoppable together! At Circana,...  ...we celebrate victories both big and small in an environment that...  ...Cloud Data Engineering Manage cloud infrastructure and cost...  ...Engage directly with clients to understand business needs, communicate... 
    Big data
    Remote work
    Flexible hours

    Circana

    Chicago, IL
    1 day ago
  • $149.8k - $171k

     ...Manager, Ontology & Data Modeling The role of the Manager of Ontology and...  ...displaying a comprehensive understanding of ontologies and optimized...  ...see and communicate the big picture in an inspiring way...  ...science, computer science, engineering, library science, ontology... 
    Full time
    Part time
    Local area
    Immediate start

    HITEC

    Chicago, IL
    3 days ago
  • $160.5k - $238.7k

     ...process exchanges and returns, and manage risk. We enable consumers to...  ...with legal, compliance, and engineering teams to implement, test, and...  ...: Lead and manage data science projects, ensuring timely...  ...with cross-functional teams to understand data needs and provide actionable... 
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    Chicago, IL
    12 hours ago
  • $129.7k - $226.9k

     ...Group IT Advanced Analytics And Data Role Chamberlain Group (CG...  ...business leaders and truly understand their strategy, key...  ...their goals, and (ii) lead, manage, and coach highly technical data...  ..., mathematics, econometrics, engineering, or other quantitative field... 
    Temporary work
    Work experience placement
    Worldwide

    Chamberlain Group

    Oak Brook, IL
    2 days ago
  •  ...Song, Supply Chain and Engineering, and Talent, with advanced...  ...capabilities in AI and Data, Industry and Process,...  ...is seeking a Senior Manager to lead Planning transformation...  ...find new ways to understand how to make their...  ...Sciences industryExpertise in big data technologies,... 
    Big data
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Chicago, IL
    1 day ago
  •  ...expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Chicago, IL
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Big Data, Job Understanding. Be the first to apply!