Senior Data Engineer

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us. Job Summary Eli Lilly and Company is seeking a highly skilled and experienced Sr Data Engineer Lead to design, develop, and maintain robust and scalable data pipelines and platforms. This role will be crucial in enabling data-driven insights and supporting various analytical and operational needs across the organization. Job Responsibilities Lead the design, development, and implementation of complex data pipelines using various ETL/ELT tools and programming languages (e.g., Python, Scala, SQL). Develop and optimize data models, schemas, and data warehousing solutions (e.g., Databricks, AWS Redshift) to ensure high performance and data integrity. Serve as a recognized authority across multiple data technologies and business domains, independently resolving ambiguous or complex data problems. Collaborate with data scientists, analysts, and other collaborators to understand data requirements and translate them into technical solutions. Implement and maintain data quality checks, data governance policies, and data security measures. Troubleshoot and resolve data pipeline, infrastructure, and platform issues, ensuring data availability and reliability. Evaluate and recommend new data technologies and tools to improve efficiency and capabilities. Challenge existing approaches and recommend improvements to team and business data processes that drive innovation. Mentor and coach data engineers by sharing knowledge in specialized technologies and business domains to increase team technical growth. Promote ideas and influence technical decisions across multiple teams, including business and non-engineering collaborators. Participate in code reviews and ensure adherence to coding standards and architectural guidelines. Document data flows, processes, and system architectures comprehensively. Your Minimum Basic Qualifications Bachelor's degree in computer science, Engineering, Information Systems, or a related quantitative field. 8+ years of experience in data engineering, data warehousing, or a related field. Proven expertise in designing and building scalable data pipelines using cloud-based platforms (e.g., AWS, Azure, GCP). Strong hands‑on experience with Databricks (e.g., Delta Lake, notebooks, workflows, Unity Catalog) for building and optimizing large‑scale data solutions. Hands‑on experience with Apache Airflow for orchestrating, scheduling, and monitoring complex data pipelines. Strong proficiency in SQL and at least one programming language (Python, Scala, Java). Extensive experience with data warehousing concepts and technologies (e.g., Airflow, Databricks, Redshift, Teradata). Experience with data visualization tools (e.g., Tableau, Power BI, Looker) to support analytics, reporting, and stakeholder communication. Solid understanding of data modeling techniques (dimensional, relational, star/snowflake schemas). What You Should Bring Masters degree preferred Excellent problem‑solving, analytical, and communication skills. Ability to work independently and collaboratively in a fast‑paced environment. Strong troubleshooting skills, with the ability to diagnose and resolve complex data pipeline and infrastructure issues. Experience with big data technologies (e.g., Spark, Hadoop) is a plus. Familiarity with data governance, data quality, and data security principles. Experience with CI/CD pipelines and DevOps practices for data solutions. Location & Work Flexibility This role is based at our Corporate Center in Indianapolis, IN. We offer a flexible hybrid work model, with three days onsite and two days working remotely each week , supporting both collaboration and work‑life balance. Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form ( for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response. Lilly is proud to be an EEO Employer and does not discriminate on the basis of age, race, color, religion, gender identity, sex, gender expression, sexual orientation, genetic information, ancestry, national origin, protected veteran status, disability, or any other legally protected status. Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia (AMECA), Black Employees at Lilly (View email address on click.appcast.io), Chinese Culture Network (CCN), EnAble, Evolve, Lilly Indian Network (LIN), Organization of Latinx at Lilly (OLA), Pride (LGBTQ+ Allies), Veterans Leadership Network (VLN) and Women’s Initiative for Leading at Lilly (WILL). Actual compensation will depend on a candidate’s education, experience, skills, and geographic location. The anticipated wage for this position is $132,000 - $244,200 Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities). Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees. #WeAreLilly #J-18808-Ljbffr