Data Engineer II

Job Description

Location: Deerfield, IL
Hybrid - 4 Days a week in office

Job Summary
We are seeking a mid-level Data Engineer with 3-5 years of experience to design, build, optimize and manage scalable data pipelines and analytical architectures. You will develop ELT/ETL workflows using Azure Databricks, Azure Data Factory, manage relational data in SQL Server, and enforce strict CI/CD practices using Azure DevOps.

Job Responsibilities

• Data Pipeline Development: Design and maintain robust data ingestion, processing, and transformation pipelines using Azure Databricks (PySpark and Spark SQL)
• SQL Server & Database Management: Write, analyze, and optimize complex T-SQL queries, stored procedures, and triggers to support legacy systems, reporting layers, and warehouse performance.
• CI/CD & Orchestration: Build and manage automated build and release pipelines utilizing Azure DevOps for version control, testing, and deployment across environments.
• Lakehouse Architecture: Implement scalable medallion architectures (Bronze, Silver, Gold layers) leveraging Delta Lake formats.
• Data Optimization: Troubleshoot pipeline failures, tune Databricks cluster usage, and optimize SQL Server workloads to reduce execution times and cloud compute costs.
• Develop software applications and tools using Agile development methodologies.
• Participates actively in the design, architecture and build phases, to aim at producing high-quality deliverables, working with existing architects where appropriate.
• Participates in the evaluation of compatibility of programs with existing communications hardware and software features. Develops professional expertise, applies company policies and procedures to resolve a variety of issues.
• Works on problems of moderate scope where analysis of situations or data requires a review of a variety of factors. Exercises judgment within defined procedures and practices to determine appropriate action.
• Builds productive internal/external working relationships.
• Receives general instructions on routine work, detailed instructions on new projects or assignments. Usually works with some supervision, conferring with superiors on unusual or complex matters

About Walgreens
Founded in 1901, Walgreens ( has a storied heritage of caring for communities for generations and proudly serves nearly 9 million customers and patients each day across its approximately 8,500 stores throughout the U.S. and Puerto Rico, and leading omni-channel platforms. Walgreens has approximately 220,000 team members, including nearly 90,000 healthcare service providers, and is committed to being the first choice for retail pharmacy and health services, building trusted relationships that create healthier futures for customers, patients, team members and communities.

External Basic Qualifications

• Bachelor's degree and at least 2 years of experience in Engineering, Software Engineering or similar field OR a High School Diploma/GED and at least 4 years of experience in Engineering, Software Engineering or related field
• Engineering, Software Engineering or similar field
• Experience writing code for applications or automation
• Experience with programming languages for online applications, microservices, APIs or mobile applications
• Experience building ,testing applications or automation
• Knowledge of the Software Development Life Cycle
• Willing to travel up to/at least 10% of the time for business purposes (within state and out of state).

Preferred Qualifications

• Bachelor's Degree in Computer Science, Information Technology or similar field
• Experience identifying operational issues and recommending and implementing strategies to resolve problems, especially in Data and Cloud Engineering
• Azure Cloud ecosystem
• Good knowledge of GIT workflows and Repo management
• Design and maintain robust data ingestion, processing, and transformation pipelines using Azure Databricks
• Write, analyze, and optimize complex T-SQL queries, stored procedures, and triggers to support legacy systems, reporting layers, and warehouse performance.
• Working knowledge of Kubernetes and microservices architecture and other DevOps tooling and Linux environments
• Proficient in back-end languages like Java, Python etc. with exposure to performance optimization of high traffic & scalable services
• Excellent knowledge of distributed SQL (e.g., Oracle, MySQL), NoSQL (MongoDB, Cassandra) design & consumption patterns
• Have an exposure to implementation, capacity planning & performance tuning of Cloud technologies - Azure (ACS, AKS), Google, IBM, AWS or Cloud Foundry
• Knowledge of software engineering best practices including coding standards, code reviews, source control management, build process, testing & operations

We will consider employment of qualified applicants with arrest and conviction records.


The Salary below is being provided to promote pay transparency and equal employment opportunities at Walgreens. The actual hourly salary within this range that you will be offered will depend on a variety of factors including geography, skills and abilities, education, experience and other relevant factors. This role will remain open until filled. To review benefits, please click here jobs.walgreens.com/benefits. If you are applying on a job board or unable to click on the link, please copy and paste this URL into your browser jobs.walgreens.com/benefits