Senior AI/ML Engineering Manager

General InformationJob TitleSenior AI/ML Engineering ManagerJob ID108808Work AreasTechnology & EngineeringEmployment TypePermanent Full-TimeLocation(s)Atlanta, Austin, Chicago, Dallas, HoustonDescription & RequirementsWHAT MAKES US A GREAT PLACE TO WORKWe are proud to be consistently recognized as one of the world’s best places to work. We are currently the top ranked consulting firm on Glassdoor’s Best Places to Work list and have earned the #1 overall spot a record seven times.Extraordinary teams are at the heart of our business strategy, but these don’t happen by chance. They require intentional focus on bringing together a broad set of backgrounds, cultures, experiences, perspectives, and skills in a supportive and inclusive work environment. We hire people with exceptional talent and create an environment in which every individual can thrive professionally and personally.WHO YOU’LL WORK WITHAs the premier consulting partner for the private equity industry, Bain's PEG boasts a global practice that is over three times larger than any competitor. Our network of over 1,000 professionals supports private equity and institutional investor clients through every stage of the investment life cycle, from deal generation and due diligence to portfolio value creation and exit planning.Bain & Company is developing a suite of cutting-edge data and software solutions designed to revolutionize how the private equity industry uses data for investment insights and decision-making. The PEG Innovation team's mission is to create analytical solutions for Bain clients, teams, and the broader institutional investor space using proprietary software and data products. This includes the development, commercialization, and daily management of Bain's proprietary datasets, data, and software businesses.WHERE YOU’LL FIT WITHIN THE TEAMSenior AI/ML Engineering Managers lead the Data and ML Engineering function for the Diligence Platform: they own the people, delivery, and technical direction of the teams that build feature and embedding pipelines, model serving and LLMOps infrastructure, and production RAG and retrieval systems. You manage and develop a team of Data and ML Engineers — hiring, coaching, performance management, and career growth — while owning the roadmap, delivery commitments, and operational health of everything the team ships. You remain hands-on where it matters most: setting architectural direction, prototyping hard problems, reviewing critical code, and stepping into individual contribution when delivery, incidents, or complexity demand it. You partner with Data Science, the Agent / AI squad, Product, and Platform leadership to translate platform strategy into staffed, sequenced, and measurable engineering work. This is a player-coach role: the team’s output, reliability, and engineering standards are the measure of success.WHAT YOU'LL DOTeam Leadership and Engineering Management (50%)Manage a team of Data and ML Engineers: hiring and onboarding, goal setting, coaching, performance management, and career development.Own delivery for the team’s roadmap: scope and sequence work, set realistic commitments, track progress, and remove blockers before they become escalations.Set and enforce engineering standards across data and ML systems — testing, typing, observability, runbooks, and SLAs — and hold the team to production quality from the first commit.Own the operational health of the team’s systems: on-call and incident response ownership, post-incident reviews, and follow-through on reliability and cost improvements.Allocate capacity across pipeline, serving, retrieval, and evaluation workstreams; balance feature delivery against platform and technical-debt investment.Partner with Data Science, the Agent / AI squad, Product, and Platform leadership to translate platform strategy into staffed, sequenced engineering work with clear ownership.Grow senior engineers into technical leaders: delegate architectural ownership, coach through design review, and build bench depth behind every critical system.Communicate roadmap, trade-offs, risks, and delivery status to platform leadership and non-technical stakeholders.Hands-On Engineering and Technical Direction (35%)Set architectural direction for the platform’s data, serving, and retrieval systems; own design review and the build-versus-buy calls that follow.Contribute directly to production code where depth or delivery pressure requires it: inference and serving systems, model and prompt lifecycle in MLflow, LLMOps tooling, and RAG and retrieval pipelines.Prototype hard or ambiguous problems personally to de-risk them before handing an established pattern to the team.Own the evaluation and monitoring bar for production ML: golden datasets, metric definitions, regression gates in CI, and drift and hallucination monitoring.Review critical pull requests and lead incident response on the highest-severity production ML and data issues.Other (15%):Contribute to platform-wide engineering standards, repository conventions, and interviewing and hiring loops beyond the immediate team.Mentor senior and mid-level engineers and Data Scientists on production ML, LLMOps, and data engineering practice.Set the team’s standards for AI-assisted development: how coding assistants are used, and how generated code is reviewed before it enters the codebase.Use LLMs to generate first-draft documentation, runbooks, and status and evaluation reports; validate and refine outputs before publishing.ABOUT YOUBachelor’s degree in Computer Science, Engineering, Machine Learning, Data Science, Statistics, or a related field (or equivalent practical experience).8+ years of experience building and operating production data and ML systems, including model deployment, serving, and post-deployment monitoring.3+ years of direct people-management experience leading data, ML, or platform engineers, including hiring, performance management, and career development.Demonstrated experience owning delivery for a team: roadmap planning, capacity allocation, and accountability for commitments and operational health.Demonstrated experience owning the model and prompt lifecycle end-to-end (packaging, registry, promotion, rollout, monitoring, and rollback).Demonstrated experience building and operating production RAG or retrieval systems end-to-end, from embedding and retrieval through re-ranking and evaluation.Experience setting architectural direction across data and ML systems and leading design review for a team of engineers.Experience partnering with Data Science, Product, and platform leadership to translate strategy into staffed, sequenced engineering work.Strong Python for production ML, with the technical depth to contribute code and review critical pull requests while managing.Experience working in a modern cloud ML platform environment (Databricks or AWS), including managed training / serving and governed model access.Leadership and people managementBuilds and develops high-performing engineering teams: hires well, sets clear expectations, gives direct feedback, and manages underperformance early.Delivery management: decomposes ambiguous platform goals into sequenced, owned, and estimable engineering work.Coaches through design and code review rather than taking over; delegates architectural ownership deliberately.Operates as the accountable owner for team systems: on-call structure, incident process, post-incident follow-through, and cost and reliability targets.Communicates clearly upward and across: trade-offs, risk, and delivery status framed for both engineers and non-technical stakeholders.ML engineering / LLMOpsStrong Python: ML and serving code written to production engineering standards (type hints, Pydantic, pytest, Ruff, mypy strict).MLflow: experiment tracking, model registry, custom model flavours, promotion workflows, and model serving configuration.LLMOps tooling: prompt and instruction versioning, model gateways (e.g., Portkey), inference orchestration frameworks (LangChain, LlamaIndex, or equivalent), and response caching.Model serving and inference optimisation: request batching, concurrency and throughput tuning, latency budgeting, and awareness of quantisation and hardware trade-offs.RAG pipeline engineering: chunking strategies, contextual embedding, hybrid retrieval, cross-encoder re-ranking, and context assembly.Data engineering breadth: batch and streaming pipelines, orchestration, data quality, and feature and embedding pipeline design at scale.Model evaluation and monitoring: golden datasets, metric definition, calibration, LLM-as-judge, regression gates in CI, and production drift monitoring.Docker and Kubernetes, and infrastructure familiarity: able to review ML-serving infrastructure (IAM roles, model endpoints, GPU / CPU workloads) provisioned via Terraform.Generative AI and agentic systemsOwns the team’s inference and retrieval services that feed agent workflows as structured tool responses consumed by the Agent Gateway.Sets the RAG quality bar: embedding and retrieval strategy, and recall / precision and groundedness benchmarks the team is held to.Directs use of LLM-as-judge patterns in evaluation pipelines where qualitative criteria are required.Builds feedback-to-evaluation and feedback-to-training-data loops from production signals, and staffs the work to sustain them.GeneralTreats every ML system as a production system from the first commit: tests, observability, a runbook, and an SLA are not optional — and holds the team to the same bar.Raises model quality, reliability, and delivery risks proactively; does not wait for users or leadership to surface them.Sets the standard for AI-assisted development: uses AI tooling to move faster, but reviews all generated code and documentation critically before it enters the codebase.Strong communication skills; able to explain retrieval-quality, latency, cost, and staffing trade-offs to engineers, senior stakeholders, and non-technical audiences.This role follows a hybrid model, requiring in-office presence at least 1 day per weekU.S. COMPENSATION INFORMATIONCompensation for this role includes base salary, annual discretionary performance bonus, 401(k) plan with an annual employer contribution based on years of service and Bain’s best in class benefits package (details listed below).Some local governments in the United States require a good-faith, reasonable salary range be included in job postings for open roles. The estimated annualized compensation for this role is as follows:In Atlanta, the good-faith, reasonable annualized full-time salary range for this role is between $148,500 - $162,000In Texas, the good-faith, reasonable annualized full-time salary range for this role is between $155,875 - $170,000In Chicago, the good-faith, reasonable annualized full-time salary range for this role is between $163,375 - $178,250Placement within these ranges will vary based on factors such as experience, education, training, and skill level.Compensation also includes a discretionary annual performance bonus, 401(k) plan with employer contribution, and Bain’s best-in-class benefits—including full premium coverage for medical, dental, and vision, generous paid time off, and more.Annual discretionary performance bonus This role may also be eligible for other elements of discretionary compensation4.5% 401(k) company contribution, which increases after 3 years of service and is 100% vested upon start dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence, protection and stability in the areas most important to you and your family.Bain pays 100% individual employee premiums for medical, dental and vision programs, offering one of the most comprehensive medical plans for employees without impacting your paycheckGenerous paid time off, including parental leave, sick leave and paid holidaysFully vested 401(k) company contributionPaid Life and Long-Term Disability insuranceGo back