Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Databricks Data Engineering Manager

$125.5k - $230.2k

EY

Location: Anywhere in Country Technology – Data and Decision Science – Data Engineering – Manager We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills. The opportunity In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Understanding and analyzing business requirements to translate them into technical requirements. Designing, building, and operating scalable data architecture and modeling solutions. Staying up to date with the latest trends and emerging technologies to maintain a competitive edge. Key Responsibilities As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Your time will be spent across various responsibilities, including: Leading workstream delivery and ensuring quality in all processes. Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services. Implementing resource plans and budgets while managing engagement economics. Travel may be required regularly based on client needs. Skills and attributes for success Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices. Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value. Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance. Drive end‑to‑end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services. Communicate effectively with stakeholders, including technical and non‑technical audiences, to convey complex data concepts and project progress. Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics. Strong analytical and problem‑solving abilities. Excellent communication skills, with the ability to convey complex information clearly. Proven experience in managing and delivering projects effectively. Ability to build and manage relationships with clients and stakeholders. To qualify for the role, you must have: Bachelor’s degree in computer science, engineering, or a related field required; master’s degree preferred. No less than 4–6 years of relevant experience in data engineering, with a focus on cloud data solutions and analytics. Proven expertise in Databricks and experience with Spark for big data processing. Strong background in data architecture and design, with experience in building complex cloud analytics solutions. Experience in leading and managing teams, with a focus on mentoring and developing talent. Strong programming skills in languages such as Python, Scala, or SQL. Excellent problem‑solving skills and the ability to work independently and as part of a team. Strong communication and interpersonal skills, with a focus on client management. Required Expertise for Managerial Role Strategic leadership: align data engineering initiatives with organizational goals and drive strategic vision. Project management: manage multiple projects and teams, ensuring timely delivery and adherence to project scope. Stakeholder engagement: engage with various stakeholders, including executives, to understand needs and present solutions effectively. Change management: guide clients through change processes related to data transformation and technology adoption. Risk management: identify potential risks in data projects and develop mitigation strategies. Technical leadership: lead technical discussions and make architectural decisions that impact project outcomes. Documentation and reporting: create comprehensive documentation and reports to communicate project progress and outcomes to clients. Large‑Scale Implementation Programs Enterprise Data Lake Implementation: led design and deployment of a cloud‑based data lake solution for a Fortune 500 retail client, integrating data from multiple sources to enable advanced analytics. Real‑Time Analytics Platform: managed development of a real‑time analytics platform using Databricks for a financial services organization, enabling fraud detection and risk assessment through streaming data ingestion. Data Warehouse Modernization: oversaw modernization of a legacy data warehouse to a cloud‑native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility. Ideally, you’ll also have Experience with advanced data analytics tools and techniques. Familiarity with machine learning concepts and applications. Knowledge of industry trends and best practices in data engineering. Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. Knowledge of data governance and compliance standards. Experience with machine learning frameworks and tools. We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. If you are driven by results and have a desire to make a meaningful impact, we want to hear from you. What We Offer You Comprehensive compensation and benefits package, including medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Base salary range for the U.S. is $125,500 to $230,200, with higher ranges for select metro areas. Individual salaries are determined by education, experience, skills, and geography. Hybrid work model: most external, client‑serving roles will work together in person 40–60% of the time over the course of an engagement, project or year. Flexible vacation policy: determine your own vacation time based on personal circumstances, with additional time off for EY Paid Holidays, seasonal breaks, personal/family care, and other leaves of absence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities, including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1‑800‑EY‑HELP3, select Option 2 for candidate–related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry, which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at View email address on click.appcast.io. #J-18808-Ljbffr EY

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Databricks Data Engineering Manager in Palo Alto, CA vacancy
  • A global professional services firm is seeking a Manager of Data Engineering to lead the design and implementation of cloud analytics solutions. The ideal candidate will have significant experience in data architecture, cloud technologies, and exceptional leadership skills... 
    Databricks
    Flexible hours

    Ernst & Young Oman

    Palo Alto, CA
    4 days ago
  • A global consulting firm in the United States is seeking a Manager of Data Engineering to design and implement cloud analytics solutions, with a focus on Databricks. The ideal candidate will have strong expertise in data architecture and analytics, alongside exceptional... 
    Databricks

    Ernst & Young Oman

    Palo Alto, CA
    2 days ago
  •  ...Director, Data Engineering Mastercard is a global technology company in the payments industry...  ..., and event-driven platform design (Databricks, Spark, Kafka, Delta/Iceberg) to...  ...align engineers, AI scientists, product managers, and executives. Comfortable operating... 
    Databricks

    Dynamic Yield

    Mountain View, CA
    15 hours ago
  • $150k - $300k

     ...Business or the Channel utilized. We're seeking aSenior Manager of Data Engineering to lead the evolution of our Claims Data Platform. This...  ...Hands-on experience with Snowflake, BigQuery, Redshift, or Databricks ~ Data Pipelines: Proficiency with Apache Airflow, dbt,... 
    Databricks
    Hourly pay
    Work experience placement
    Local area
    Flexible hours

    GEICO

    Palo Alto, CA
    4 days ago
  • $125.5k - $230.2k

     ...help to build a better working world. Technology – Data and Decision Science – Data Engineering – Manager We are looking for a dynamic and experienced...  ...cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise... 
    Databricks
    Summer holiday
    Flexible hours

    EY

    Palo Alto, CA
    3 days ago
  • $83.98 - $111.27 per hour

    Senior Manager, Data Engineering page is loaded## Senior Manager, Data Engineeringremote type: Hybridlocations: 1830 Embarcadero - PALO ALTOtime...  ...., GCP, AWS, Azure) and data warehousing solutions (e.g., Databricks). + Define and implement the strategy for enterprise... 
    Databricks

    Stanford Health Care - ValleyCare

    Palo Alto, CA
    2 days ago
  •  ...Data Engineering Manager Location: Palo Alto, CA - Hybrid – (Not On-site every week Mostly remote) Length: 6-12 months Start: ASAP Interview: Video Special note: This Position might reach its maximum submission limit in our System Within 1 — 3 Hour, So... 
    Immediate start
    Remote work
    Flexible hours

    RIT Solutions

    Palo Alto, CA
    4 days ago
  •  ...by orders of magnitude. Why this role matters As a Data Engineering Manager , you will lead a high-performing team responsible for transforming...  ..., UB04). Experience with cloud platforms (AWS/GCP), databricks , streaming frameworks (Kafka/SQS), and containerized... 
    Databricks
    Remote job

    Machinify

    Palo Alto, CA
    more than 2 months ago
  •  ..., mentor, and develop a high‑performing team of data engineers, fostering an engineering culture centered on collaboration...  ...continuous improvement. Architect, design, and manage data warehouse and lakehouse solutions on Databricks and Azure, ensuring scalability, security, and... 
    Databricks
    Full time
    Remote work

    ExpertHiring

    Menlo Park, CA
    15 hours ago
  •  ...seeking a highly skilled Senior Consultant Data Engineer to design and build analytics solutions...  .... You will work with technologies like Databricks and lead data pipeline development,...  ...solving abilities, and exceptional client management skills. This position may require... 
    Databricks

    Ernst & Young Oman

    Palo Alto, CA
    2 days ago
  • ExpertHiring is looking for an experienced data engineering leader based in Menlo Park, California, to guide a team in developing data solutions on Databricks and Azure. This full-time role includes leading a high-performing team, architecting data warehouses, and implementing... 
    Databricks
    Full time

    ExpertHiring

    Menlo Park, CA
    15 hours ago
  •  ...Description Job Description Job Title:  Data Engineer Lead Location:  Palo Alto, CA 94304...  ...to and from firm data repositories. Manage finance-related data models, schemas,...  ...technologies (Azure Synapse, Azure Databricks, Microsoft Fabric, etc.). ~ Experience... 
    Databricks
    Permanent employment
    Full time
    Work experience placement
    Work from home
    2 days per week

    AMS Staffing, Inc.

    Palo Alto, CA
    22 days ago
  •  ...27-0836 Summary We are seeking pragmatic Data Product Engineering Lead to join a team passionate about creating...  ...with cloud platforms (AWS, Azure, GCP) and data management and analytics tools like Snowflake, Databricks and Tableau or other visualization tools. ~... 
    Databricks

    Apple

    Cupertino, CA
    15 hours ago
  • $228.1k - $342.8k

    Data Engineering Manager, Finance Data & AI Foundation Sunnyvale, California, United States Software and Services We are seeking a hands‑on Engineering Manager to lead Finance Data and AI Engineering initiatives, building scalable, high‑performance financial data systems... 
    Relocation

    Apple Inc.

    Sunnyvale, CA
    2 days ago
  • $193.8k - $285k

    A leading delivery and logistics company is seeking a Data Engineering Manager in California. This role involves guiding teams in developing scalable data solutions while fostering a culture of excellence. The ideal candidate has extensive experience in data engineering... 

    DoorDash USA

    Sunnyvale, CA
    11 days ago
  • $181.1k - $272.1k

    Data Product Engineering Lead - Wallet, Payments & Commerce Cupertino, California, United States Software and Services...  ...cloud platforms (AWS, Azure, GCP) and data management and analytics tools like Snowflake, Databricks and Tableau or other visualization tools. Strong... 
    Databricks
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  • $278.2k - $339.25k

    A leading AI and data platform company in Mountain View is seeking a Senior Data Security leader to enhance the security of its infrastructure...  ...representing the company at various events. Competitive salary range between $278,200 and $339,250 USD. #J-18808-Ljbffr Databricks Inc.
    Databricks

    Databricks Inc.

    Mountain View, CA
    1 day ago
  • $141.7k - $268.3k

     ...human progress. To support this, we are transforming our data into an active, self-optimizing engine. This Director role will drive AI Readiness across...  ...program for employees and family members and management leases Tuition assistance Established and active... 
    Immediate start
    Visa sponsorship
    Flexible hours

    Ford Motor Company

    Palo Alto, CA
    15 hours ago
  •  ...Data Engineer Location: Mountainview, CA (Hybrid 3 days' work from office) C2C pay rate: $70-75/hr for both the roles. Role Summary...  ...graph creation Data pipeline development (Spark, Databricks, Kafka) Strong understanding of data quality, ingestion, and... 
    Databricks
    Work at office

    Kasmo Global

    Mountain View, CA
    4 days ago
  •  ...AWS Data Engineer Developing data pipelines in Python, Spark, or SQL to push structured enterprise...  .... Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Databricks and Privacera). Evaluating Databricks... 
    Databricks

    United IT

    Mountain View, CA
    4 days ago
  •  ...Summary We are seeking an experienced Data Engineer Lead to join our onshore team and drive...  ...Data Services (Data Factory, Synapse, Databricks, etc.). - Strong knowledge of...  ...data engineering. - Understanding of data governance, lineage, and metadata management
    Databricks

    Prophecy Technologies

    Palo Alto, CA
    4 days ago
  •  ...New REQ ... Mid-Level Data Engineer (AWS, Databricks, debugging) *** Requirements for ALL Databricks Candidate submittals Title: Mid-Level Data Engineer (AWS, Databricks, debugging, pipelines) Location: 100% remote living in PST or CST time zone... 
    Databricks
    Full time
    Contract work
    For contractors
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    3B Staffing LLC

    Mountain View, CA
    4 days ago
  • $178.3k - $407k

     ...a better working world. AI and Data – Data Scientist – Senior Manager EY delivers unparalleled cross...  ...intelligence, big data and cloud engineering. We always support and enable big...  ...cloud platforms (GCP, AWS, Azure, Databricks) including responsible-AI guardrails... 
    Databricks
    Summer holiday
    Flexible hours

    EY

    Palo Alto, CA
    15 hours ago
  •  ...DynamoDB) and leadership experience in designing distributed data systems, managing data modeling, and optimizing performance. Key...  ...recovery, and HA/DR strategies are in place. Mentor junior engineers and provide technical leadership on NoSQL topics. Stay updated... 

    Tranzeal

    Mountain View, CA
    4 days ago
  •  ...build a better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly...  ...in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and communication skills, along with a... 
    Databricks

    Ernst & Young Oman

    Palo Alto, CA
    4 days ago
  • $207k - $300k

    A leading tech company in California seeks a Software Engineering Manager to lead teams in developing SDN frameworks and applications for their data centers. You will guide engineers, define strategies, and ensure the operational excellence of large-scale networking solutions... 
    Full time

    Google Inc.

    Sunnyvale, CA
    1 day ago
  •  ...We are currently seeking a Data Engineer to join the Finance Technology and Digital Transformation...  ...and from firm data repositories. - Manage finance-related data models, schemas,...  ...technologies (Azure Synapse, Azure Databricks, Microsoft Fabric, etc.). - Experience... 
    Databricks

    Insight Global

    Palo Alto, CA
    2 days ago
  • $204k - $343k

    Applied Intuition is seeking an Engineering Manager for their Data Intelligence team in Mountain View, CA. In this full-time role, you will lead a high-performing engineering team to drive the development of innovative data solutions for autonomy. Ideal candidates will... 
    Full time

    Decisive Point

    Mountain View, CA
    15 hours ago
  • $100k

     ...One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023...  .../ Data Scientists, and Machine Learning engineers for full-time positions with clients....  ...skills: NLP, Text mining, Tableau, PowerBI, Databricks, Tensorflow REQUIRED SKILLS For Java... 
    Databricks
    Full time
    H1b

    SynergisticIT

    Palo Alto, CA
    1 day ago
  • $217k - $312.2k

    Databricks is seeking a Senior Engineering Manager to lead the User Activation team, responsible for growing customer adoption and managing a team of ~20 software engineers. You will define strategies for seamless onboarding and integration, while collaborating closely... 
    Databricks

    I did my part and supported the Regular Toilet

    Mountain View, CA
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Data Engineering Manager. Be the first to apply!