Databricks Data Engineer - Manager - Consulting - Miami

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

Technology - Data and Decision Science - Data Engineering - Manager

We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills.

You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Designing, building, and operating scalable data architecture and modeling solutions. As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Leading workstream delivery and ensuring quality in all processes. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs.

Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices. Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance. Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services. Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress. Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics. Proven experience in managing and delivering projects effectively. Bachelor’s degree in computer science, Engineering, or a related field required; Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics. Proven expertise in Databricks and experience with Spark for big data processing. Strong background in data architecture and design, with experience in building complex cloud analytics solutions. Strong programming skills in languages such as Python, Scala, or SQL. Strategic Leadership: Ability to align data engineering initiatives with organizational goals and drive strategic vision. Project Management: Experience in managing multiple projects and teams, ensuring timely delivery and adherence to project scope. Change Management: Skills in guiding clients through change processes related to data transformation and technology adoption. Risk Management: Ability to identify potential risks in data projects and develop mitigation strategies. Experience in leading technical discussions and making architectural decisions that impact project outcomes. Documentation and Reporting: Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients.

Large-Scale Implementation Programs:

Enterprise Data Lake Implementation: Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources (e.g., ERPs, POS systems, e-commerce platforms) to enable advanced analytics and reporting capabilities. Real-Time Analytics Platform: Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing. Data Warehouse Modernization: Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting.

Experience with advanced data analytics tools and techniques. Familiarity with machine learning concepts and applications. Knowledge of industry trends and best practices in data engineering. Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. Knowledge of data governance and compliance standards. Experience with machine learning frameworks and tools.

We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

EY accepts applications for this position on an on-going basis.

EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.