Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Engineering Manager - Pipelines Engine

$228.6k - $317.23k

Databricks Inc.

P-1110

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. 

We are the Lakeflow Engineering team,  responsible for Databricks ETL product line: Jobs , Spark Declarative Pipelines , and Genie Code for Data Engineering . We run one of the world's biggest (if not the biggest) data engineering platforms - responsible for processing exabytes of data daily for tens of thousands of customers. 

We're seeking a dedicated Engineering Leader to spearhead the Pipelines Engine engineering team. The team is responsible for building next generation Runtime ETL features and ensuring that Lakeflow Pipelines has state of art performance for ETL workloads. You will also spearhead the Agentic Data Engineering infrastructure, by building the next generation engine to power agentic pipeline authoring, execution and maintenance.

The main responsibilities include:

  • You will lead an engineering team building the next-generation ETL features for the Databricks Lakeflow platform.

  • You will oversee sustained recruitment of top-tier talent, and upskilling talent on the team.

  • You will build processes to implement product vision and strategy, according to organizational goals and priorities.

  • You will build software that is not just high quality but easy to operate. 

  • You will manage technical debt, including long-term technical architecture decisions and balance product roadmap.

What we look for:

  • Minimum 3 years of experience in managing top-tier engineering teams

  • 5+ years experience building data infrastructure systems such as Apache Spark™ or database internals.

  • A passion for database systems, storage systems, distributed systems,  or performance optimization

  • Experience working with product management, and directly with customers; ability to understand customer needs.

  • Can ensure the team builds high quality and reliable infrastructure services. Experience being responsible for testing, quality, and Service Level Agreements of a product. Experience building and managing teams in a complex technical domain, such as on distributed data systems or database internals.

  • Expertise in attracting, hiring and coaching engineers, who will meet the Databricks hiring standards. Experience up-leveling teams via hiring top-notch talent and growing existing team members.

 

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.  Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here .

 

Local Pay Range

$228,600—$317,233 USD

About Databricks

Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram .

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here .

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Sr. Engineering Manager - Pipelines Engine in Mountain View, CA vacancy
  • $167k - $301k

     ...the threats detected in their environments. This is a Sr. Engineering Manager role in the CTIO team. In this role you will build and lead...  ...machine learning models and building the data pipelines that feed them to delivering efficient on-device inference,... 
    Pipeline
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    a month ago
  • $175.5k - $311.7k

     ...crafting the best customer experiences.We are looking for an Engineering Program Manager who will work closely with the Generative AI Experiences...  ...complex UX software and familiarity with machine learning pipelines, platforms, tools and processes that deliver end-to-end... 
    Pipeline
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $175.5k - $263.8k

     ...large-scale ML lifecycle—from massive data pipelines and distributed training to...  ...Qualifications6+ years of experience in program management in the data acquisition of ML...  ...and collaborating with Legal, Privacy Engineering, Security and other teams across the organization... 
    Pipeline
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...patients worldwide.Were a team of engineers, clinicians, and innovators...  ...:The Senior Manager, Electrical Engineering owns people...  ...robotic platform. In this role, the Sr. Manager leads the team directly...  ...information, and build the leadership pipeline needed to sustain a high-... 
    Pipeline
    Senior
    Local area
    Immediate start
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    2 days ago
  • $237.6k - $401.7k

     ...experiences. We are looking for a senior, hands-on Machine Learning Engineering Manager to lead a small team working at the intersection of model...  ...papers and experimental results to production-quality ML pipelines, while mentoring engineers and aligning teams around a clear... 
    Pipeline
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $250k - $300k

     ...charged with fueling the future of Crusoe’s engineering muscle. We’re responsible for critical...  ...quality. We’re looking for a Senior manager who will own multiple charter’s within...  ...how to integrate it into a seamless CI/CD pipeline. Language & Version Control Mastery:... 
    Pipeline
    Senior
    Full time
    Temporary work
    Remote work

    Crusoe

    Sunnyvale, CA
    16 days ago
  • $164k - $295k

     ...About the Role: CrowdStrike is seeking an experienced SDET Engineering Manager to lead our quality engineering efforts within the AI...  ...code hygiene Define and maintain quality gates across CI/CD pipelines, ensuring automated validation is comprehensive and reliable... 
    Pipeline
    Permanent employment
    Contract work
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    a month ago
  • $198k - $326k

     ...LinkedIn operates one of the largest privately managed compute infrastructures in the world...  ...the public cloud providers. As a Senior Engineering Manager on the Compute Infrastructure...  ...members, to large-scale data and analytics pipelines processing petabytes daily, to the AI/ML... 
    Pipeline
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    4 days ago
  •  ...clients to create next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers embed...  ...source models — including building abstraction layers to manage multi-provider pipelines.Minimum of 10 years of experience programming in Python,... 
    Pipeline
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    2 days ago
  •  ...transportation on a global scale. Commercial Software Engineering builds digital products and platforms that help fleet customers manage their operations and benefit from connected...  ...talent while building a strong succession pipeline. Demonstrate managerial courage to challenge... 
    Pipeline
    Senior
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Sunnyvale, CA
    15 hours ago
  •  ...of deep industry knowledge, applied AI engineering, and trusted AI governance. We help the...  ...You Are:You are a Responsible AI Senior Manager who makes trustworthy AI real by building...  ...directly into engineering and MLOps/LLMOps pipelines rather than bolting them on after the... 
    Pipeline
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    1 day ago
  •  ...everyone. Role Summary We are looking for an experienced engineering manager to lead the hardware design team responsible for the end-to-...  ...embedded software and systems teams on boot BSP display pipeline and HW/SW interface definition so that bring-up is planned... 
    Pipeline
    Senior
    Full time
    Contract work

    Rivian and Volkswagen Group Technologies

    Palo Alto, CA
    8 days ago
  • $202.83k - $338.05k

     ...data centers. Job Description Sr. Principal Engineer for KIOXIA's Innovation Lab, working...  ...for flash storage in AI workloads, RAG pipelines, enterprise applications, and related...  ...block device layer drivers, or data management functionality for storage systems.... 
    Pipeline
    Senior
    Local area
    Worldwide
    Flexible hours

    Kioxia

    Alviso, CA
    3 days ago
  • $171k - $325k

     ...visit .Summary of Role:We are seeking an experienced CPU IP Design Engineer. Responsible for Defining, leading and owning RTL development...  .... Required Qualifications: Hands-on working knowledge of the pipeline stages of an in-order or out-of-order high-performance CPU coreThorough... 
    Pipeline
    Senior
    Full time
    Local area

    Globalfoundries

    Santa Clara, CA
    3 days ago
  •  ...brands turn customer interactions into an engine for growth, moving service beyond a cost...  ...and team leader with deep experience managing senior stakeholder relationships. You will...  ...model serving and inference, deployment pipelines, environments, and tooling across cloud... 
    Pipeline
    Senior
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Mountain View, CA
    1 day ago
  •  ...brands turn customer interactions into an engine for growth, moving service beyond a cost...  ...and team leader with deep experience managing senior stakeholder relationships. You will...  ...ontologies, knowledge models, curation pipelines, and accelerators.Bring AI-augmented delivery... 
    Pipeline
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    1 day ago
  • $267.8k - $401.7k

     ...future, and we're looking for a senior engineering leader to make it real.DescriptionPeople...  .... You will lead and develop a team of managers and engineers. You will also build the...  ...simulation environments, synthetic data pipelines, or large-scale evaluation infrastructure... 
    Pipeline
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $254.4k - $381.6k

     ...Apple ecosystem.DescriptionWe are seeking an exceptional Senior Engineering Manager to lead the engineering organization responsible for...  ...distillation, content understanding, and knowledge enrichment pipelines that continuously improve AI quality and freshness.Strong product... 
    Pipeline
    Senior
    Worldwide
    Relocation

    Apple

    Santa Clara, CA
    3 days ago
  • $240k - $290k

     ...The Opportunity:Sonatus is looking for an experienced Senior Engineering Manager to build and lead our AI Validation function — the team...  ...end-to-end validation strategy for AI/ML models, LLMs, RAG pipelines, and agentic AI workflows—from data pipelines and model training... 
    Pipeline
    Senior
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    2 days ago
  • $237.6k - $401.7k

     ...Siri makes that possible, working across engineering teams to bring Siri and the Apple...  ....We're looking for a Senior Engineering Manager to lead a multi-team AI engineering organization...  ...and conventions, plus the tooling and pipelines that make launching a new language faster... 
    Pipeline
    Senior
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $220k - $330k

     ...engage, and retain talent across our global Engineering organization. Reporting directly to the...  ...a global team of recruiters, program managers, and events professionals, establishing...  ...programs that create lasting talent pipelines is a plusStrong business acumen and analytical... 
    Pipeline
    Senior
    Full time
    Internship

    AppLovin

    Palo Alto, CA
    3 days ago
  • $201.3k - $352.3k

     ...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious...  ...scientists, engineers, and product managers with a dual mission. We build and evolve...  ...accuracy. Validate Grounding & RAG Pipelines : Partner with search and data fabric teams... 
    Pipeline
    Senior
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    17 days ago
  • $144.6k - $263.8k

     ...Softwareis seeking a Technical Program Manager to drive high-performance ML frameworks...  ...hardware and software platforms. We support ML engineers andscientists through technologies that...  ..., measurement), data processing pipelines, large-scale and high-throughput backend... 
    Pipeline
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $164k - $295k

     ...delivery of our sensor on Linux platforms. Our tools engineers own development of our test pipelines, Linux distro provisioning, and work closely with...  ...engineering, quality engineering, or configuration management. ~10+ years or greater of software development experience... 
    Pipeline
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week
    Sunnyvale, CA
    a month ago
  • $143k - $275k

     ...Role: We are seeking a Senior Principal Engineer Business Development to accelerate growth...  ...driving new business opportunities and managing key customer relationships, from early engagement...  ...PipelineDevelop and maintain a strong pipeline of qualified opportunitiesEnsure... 
    Pipeline
    Senior
    Full time
    Contract work
    Work at office
    Local area
    Immediate start

    Globalfoundries

    Santa Clara, CA
    15 hours ago
  • $190.4k - $308k

     ...CareerAs a Senior Principal Machine Learning Engineer, you will serve as the chief technical...  ...: Bridge the gap between Product Management, Security Researchers, Data Science, and...  ...preprocessing, and feature engineering pipelines using Apache Spark, SQL, and BigQuery across... 
    Pipeline
    Senior
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  •  ...transformation. About the role The Revenue Cycle Management team is hiring for a Senior Engineering Manager to join the team. We build software that...  ...to date as money comes in. This is the start of the pipeline — everything downstream depends on it being correct.... 
    Pipeline
    Senior
    Remote job
    Full time
    Work at office
    Immediate start
    Shift work
    Night shift

    Commure

    Mountain View, CA
    9 days ago
  • $272k - $431.25k

     ...capabilities to developers.We are seeking a deeply technical Senior Engineering Manager to lead our Graphics APIs and Platforms team, spanning...  ...understanding of GPU architecture, graphics and compute pipelines, and how software interacts with hardware.Strong C/C++ programming... 
    Pipeline
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    15 hours ago
  • $240k - $320k

     ...and we are looking for senior electrical and system integration engineers to define, build, and scale our vehicle platform hardware.Job...  ...Engine, including fleet data loop automation, active learning pipelines, auto-labeling, simulation, and MLOps tooling.Oversee the end-... 
    Pipeline
    Senior
    Full time
    Work experience placement
    Local area
    Flexible hours

    Robert Bosch

    Sunnyvale, CA
    1 day ago
  •  ...transformation. About the Role We’re looking for a Senior Engineering Manager to lead the Ambient Product Engineering team powering the...  ...with Ambient Labs to define clean contracts between LLM pipelines and product features, and turn note-quality gains into shipped... 
    Pipeline
    Senior
    Remote job
    Full time
    Work at office
    Immediate start
    3 days per week

    Commure

    Mountain View, CA
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Engineering Manager - Pipelines Engine. Be the first to apply!