Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (Python, Databricks, SQL)

$150k - $165k

Canadian Imperial Bank of Commerce

We’re building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what’s right for our clients.At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute.To learn more about CIBC, please visit CIBC.comUS Technology, Infrastructure & Innovation (US TI&I) enables the continuous transformation of our Bank by accelerating the shift to digital, strengthening operational resilience, simplifying what we do, improving CIBC's speed to market and protecting our Bank's assets.The teams work to maximize the investment in resources and technology while building an appropriate balance between high-touch client service and our fiduciary responsibility to protect CIBC, our clients, and our shareholders from undue risk.What You’ll Be DoingThe Lead Data Engineer will own end-to-end delivery of U.S. Data Strategy capabilities, including ETL, analytics, and data consumption, aligned to a multi-year product roadmap. They will translate business and product objectives into secure, scalable cloud data solutions in partnership with Product, Architecture, Data, and key stakeholders. Continuously improve SDLC throughput via intake/estimation and KPI management, and drive innovation through proofs of concept and continuous modernization. This is a hands-on position.CIBC we enable the work environment most optimal for you to thrive in your role. You’ll have the flexibility to manage your work activities within a hybrid work arrangement where you’ll spend 2 days per week on-site, while other days may be remote .How You’ll SucceedStrategic Delivery: Set goals aligned to strategy; translate priorities into roadmaps, metrics, dependencies, and release plans; manage capacity and resourcing. Leverage GitHub Copilot in development best practices.Technical Strategy and Architecture: Define secure, scalable architecture; modernize and reduce technical debt. Drive best practice engineering through automation, testing, CI/CD, observability, and continuous improvement.Industry and Domain Leadership: Apply banking/domain expertise to guide platform direction and improve client and operational outcomes.Risk and Compliance Oversight: Embed risk management and security/privacy by design; ensure regulatory compliance and partner with Compliance/Audit. You oversee risk management activities within their area, influence risk culture, and align risk management with departmental goals. You also Oversee compliance adherence within their area of responsibility; ensure alignment with regulatory requirements; engage with Compliance and Audit teams as needed.Lead by Example: Provide Technical Leadership, be able to develop solutions based on Databricks/Python/PySpark as well as strong SQL Server experience.Who You AreYou possess 8-12 years of related experience OR Combination of education and experience, ideally within financial services or tech.You possess Azure/Databricks data engineering expertise (PySpark/Scala, ETL, Azure SQL, REST APIs). Expertise in data ingestions, data pipeline development, and optimization, reporting, and advanced analytics using Azure and Databricks (Pyspark/Scala) services and/or SQL Server/SSIS is a must.Strong SQL Server development experience (required) and SSIS (desired) along with strong pipeline delivery skills (ingestion, transformation, optimization, reporting/analytics).You bring DevOps/SDLC excellence (CI/CD, environment integrity, security, compliance, release management) along with an exposure to Integration and BI Tools such as Tableau, Cognos or Power BI. Automation mindset to reduce manual processes and improve operational efficiency is desired.Agile delivery mastery (Jira/Azure DevOps, story writing/pointing, velocity management).Executive-level communication for technical recommendations and governance forums.Degree/diploma in Computer Science, Engineering, MIS, or related field or relevant certifications and/or completion of a relevant bootcampExtensive knowledge of banking products (desired), services, and industry regulations; expert understanding of current industry trends and developments; ability to influence strategic decisions using industry knowledgeCalifornia residents — your privacy rights regarding your actual or prospective employmentAt CIBC, we offer a competitive total rewards package. This role has an expected salary range of $150,000.00 - $165,000.00 for the Chicago market based on experience, qualifications, and location of the position. The successful candidate may be eligible to participate in the relevant business unit’s incentive compensation plan, which may also include a discretionary bonus component. CIBC offers a full range of benefits and programs to meet our employee’s needs; including Medical, Dental, Vision, Health Savings Account, Life Insurance, Disability, and Other Insurance Plans, Paid Time Off (including Sick Leave, Parental Leave and Vacation), Holidays and 401(k), in addition to other special perks reserved for our team members.”This position does not offer visa sponsorship.#LI-TAWhat CIBC OffersAt CIBC, your goals are a priority. We start with your strengths and ambitions as an employee and strive to create opportunities to tap into your potential. We aspire to give you a career, rather than just a paycheck.We work to recognize you in meaningful, personalized ways including a competitive salary, incentive pay, banking benefits, a benefits program*, a vacation offering, wellbeing support, and MomentMakers, our social, points-based recognition program.Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients.We cultivate a culture where you can express your ambition through initiatives like Purpose Day; a paid day off dedicated for you to use to invest in your growth and development.Subject to plan and program terms and conditionsWhat you need to knowCIBC is committed to creating an inclusive environment where all team members and clients feel like they belong. We seek applicants with a wide range of abilities and we provide an accessible candidate experience. If you need accommodation, please contact View email address on click.appcast.io need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit .We may ask you to complete an attribute-based assessment and other skills tests (such as simulation, coding, MS Office). Our goal for the application process is to get to know more about you, all that you have to offer, and give you the opportunity to learn more about us. #J-18808-Ljbffr Canadian Imperial Bank of Commerce

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Python, Databricks, SQL) in Chicago, IL vacancy
  • $179.4k - $204.7k

     ...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you...  ...based data warehousing services such as Snowflake, Databricks Optimize information system for end-user and downstream... 
    Databricks
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    Chicago, IL
    5 days ago
  • UNAVAILABLE is seeking an experienced engineer to build and maintain data pipelines using Spark and SQL. This role focuses on high-...  ...-art technologies like AWS and Databricks. Ideal candidates will have...  ...experience in Apache Spark, Scala, and Python. You will also mentor junior... 
    Databricks
    SQL

    UNAVAILABLE

    Chicago, IL
    4 days ago
  • $98k - $182k

     ...high‑impact team of engineers operating at massive...  ...directly connects our data ecosystem to the biggest...  ...using Spark, Scala, Python, AWS EMR and Databricks. See Your Impact:...  ...Spark (Scala/Python) and SQL to build our...  ...Mentorship & Quality: Lead code reviews, enforce... 
    Databricks
    SQL

    Publicis Groupe Holdings B.V

    Chicago, IL
    5 days ago
  •  ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX...  ...such as AWS Glue, Spark, and Databricks. Optimize database performance...  ...data integrity across both SQL and NoSQL systems (including...  ...programming skills in Python, Scala, Java, and experience... 
    Databricks
    SQL
    Long term contract
    Work at office

    InterSources

    Chicago, IL
    3 days ago
  •  ...Activation Delivery Platform Engineer The Epsilon Activation...  ...work directly connects our data ecosystem to the biggest platforms...  ...stack using Spark, Scala, Python, AWS EMR, and Databricks. See Your Impact: Your code...  ...Spark (Scala/Python) and SQL to build out our core... 
    Databricks
    SQL
    Local area
    Flexible hours

    Digitas

    Chicago, IL
    3 days ago
  • $150k - $220k

     ...native technology company is seeking a Lead Data Engineer to join their data platform team. This...  ...working with modern technologies including Databricks, Snowflake, dbt, Azure, and Tableau....  ...building scalable ETL/ELT pipelines Advanced SQL and data modeling experience Hands‑on... 
    Databricks
    SQL
    Full time

    Motion Recruitment Partners LLC

    Chicago, IL
    1 day ago
  • $145.2k - $165k

     ...scalable, cost-efficient AWS data platform that enables...  ...platform performance Lead foundational technical...  ...growing team of data engineers and cross‑functional...  ...Strong proficiency in Python and SQL with experience...  ...Snowflake, Redshift, or Databricks Salary $145,200 - $16... 
    Databricks
    SQL
    Flexible hours

    Coates-Group

    Chicago, IL
    2 days ago
  • $127.1k - $190.7k

     ...leaders. We deliver cloud, data and customer...  ...Our partnerships with leading cloud, design and business...  ...highly skilled Lead Data Engineer with strong expertise...  ..., ADLS Gen2, Azure SQL, Databricks (optional) • Build interactive...  ...• Proficiency in Python, PySpark, SQL, and... 
    Databricks
    SQL
    Permanent employment
    Full time
    Temporary work
    Remote work

    TEKsystems

    Chicago, IL
    5 days ago
  • $150k - $165k

    Canadian Imperial Bank of Commerce seeks a Lead Data Engineer to oversee U.S. Data Strategy capabilities. This hands-on role involves delivering secure, scalable cloud data solutions and driving innovation through continuous modernization. The candidate will enjoy a hybrid... 
    Databricks

    Canadian Imperial Bank of Commerce

    Chicago, IL
    2 days ago
  •  ...Design, develop and maintain scalable data pipelines on Databricks and Microsoft Azure to ingest and...  ...and translate them into scalable engineering solutions. Qualifications...  ...at scale. Strong proficiency in Python, PySpark and Spark SQL for large‑scale data processing.... 
    Databricks
    SQL
    Remote job
    Work at office
    Local area
    Flexible hours

    iManage

    Chicago, IL
    5 days ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI...  ...and analytics engineering focus on leveraging...  ...experiences you need to lead and deliver value...  ...Core, Snowflake Databricks Data Engineer...  ...Proficient in Python and structured/unstructured...  ...Proficient in SQL and relational databases... 
    Databricks
    SQL
    Full time
    H1b

    PwC

    Chicago, IL
    5 days ago
  • $109.76k - $164.64k

     ...video content, robust data, and advanced...  ...success which underpin engineering execution in a...  ...range of programming (Python, Java, JavaScript,...  ...Terraform. Solid SQL skills, with...  ...Aerospike, Snowflake, Databricks, Spark, Presto, or...  ...how you work and lead. Do what's right for... 
    Databricks
    SQL
    Full time
    Work experience placement
    Night shift
    Weekend work

    Comcast

    Chicago, IL
    21 hours ago
  •  ...Job Title: Senior Data Engineer Location: Chicago, IL Work Model: Hybrid 3 Days Onsite per Week Experience: 10+ Years We are looking...  ...and hands‑on Data Engineer with strong expertise in Databricks, Python, and SQL. The ideal candidate should have experience building scalable... 
    Databricks
    SQL
    Work at office
    Local area
    3 days per week

    VeeRteq Solutions Inc.

    Chicago, IL
    1 day ago
  •  ...Senior Data Engineer Location - Chicago, IL (3 days onsite mandatory) Rate – 65-70 Databricks, ADF Role Overview The Senior Data Engineer...  ...solutions leveraging Databricks, Python, ETL, DevOps. This role...  ...platforms). ~ Proficiency in SQL and performance tuning. ~... 
    Databricks
    SQL

    E-Solutions

    Chicago, IL
    5 days ago
  • $200k

     ...Chicago is seeking a seasoned Data Engineer to support and advance the...  ...with cutting-edge tools like Databricks, Apache Spark, and Delta Lake...  ...pipelines at scale Advanced Python skills and deep experience with...  ...or MLflow Proven ability to lead projects independently and deliver... 
    Databricks
    Work at office
    Local area
    Immediate start

    Optiver

    Chicago, IL
    3 days ago
  • Milliman is seeking a skilled Data Engineer to join MedInsight's engineering team. This role involves designing...  ...data engineering with a strong proficiency in SQL and Python, as well as knowledge of frameworks like Databricks and Spark. The position offers a flexible work... 
    Databricks
    SQL
    Remote job
    Flexible hours

    Milliman

    Chicago, IL
    4 days ago
  • Glocomms is seeking a Senior Data Engineer to join a high-impact marketing data team in Chicago...  ...teams while leveraging tools like Databricks and Informatica. The ideal candidate will...  ...data engineering experience with strong SQL skills, and experience with Snowflake and... 
    Databricks
    SQL

    Glocomms

    Chicago, IL
    3 days ago
  • Vizient, Inc in Chicago is seeking a Senior Data Engineer to enhance a modern data enablement...  ...build scalable data solutions using Azure Databricks and collaborate with various teams to...  ..., proficiency in tools like PySpark and SQL, and a relevant degree. Competitive compensation... 
    Databricks
    SQL

    Vizient, Inc

    Chicago, IL
    19 hours ago
  • $180k - $200k

     ...with excellent work ethics. Role Description We are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable...  ...Deep expertise in data engineering fundamentals (Python, SQL) with production experience Proven experience designing scalable... 
    SQL
    Work at office

    HARBOR CAPITAL ADVISORS

    Chicago, IL
    5 days ago
  •  ...Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be...  ...languages like Java, Scala, Python and Open Source RDBMS and...  ...including Python, SQL, Scala, or Java* 4+ years... 
    SQL
    Full time
    Part time
    Internship

    Capital One

    Chicago, IL
    3 days ago
  • Flynaut LLC. is seeking a Data Engineer to join their AI & Data team in Chicago or remotely...  ...lakehouse architectures on Databricks and Snowflake, and developing data quality...  ...engineering experience with strong skills in Python, SQL, and experience with Apache Spark and... 
    Databricks
    SQL
    Remote job
    Flexible hours

    Flynaut

    Chicago, IL
    2 days ago
  • $60k - $120k

     ...healthcare-focused technology company is looking for a Senior DataBricks Developer for a fully remote role. The ideal candidate will have over 7 years of experience in data engineering, strong skills in Python and SQL, and hands-on experience with Databricks. The position... 
    Databricks
    SQL
    Remote job
    Flexible hours

    Lumenalta

    Chicago, IL
    4 days ago
  •  ...Overview: Data Engineering Testing: 5+ years of experience in QA...  ...similar. Strong expertise in Python for test automation, with...  ...unittest. Proficiency in SQL for data validation and querying...  ...data platforms like Azure Databricks (preferred) or Snowflake... 
    Databricks
    SQL

    Purple Drive

    Chicago, IL
    5 hours ago
  • $80.25k - $133.75k

     ...Impact As a Senior Software Engineer on Publicis’s Data Warehouse projects, you...  ...power our industry-leading digital marketing...  ...frameworks such as Spark, Databricks, and Airflow, and directly...  ...Databricks), SQL (basic & advanced), and Python. Experience building scalable... 
    Databricks
    SQL
    Local area
    Flexible hours

    Publicis Groupe Holdings B.V

    Chicago, IL
    1 day ago
  •  ...Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT Job Description: Required Skills: 6-8 years+ experience on...  ...metrics in any specific business Responsibilities: • Lead data warehouse development activities for a team, leading more... 
    SQL

    Omni Inclusive

    Chicago, IL
    5 days ago
  •  ...Overview: Job Title: Senior Data Engineer (Databricks) Location: Chicago, IL / Remote Job Type: Full-Time Job Summary We are...  ...Engineer with strong expertise in Databricks, Apache Spark, SQL, and cloud-based ETL pipelines . The ideal candidate should... 
    Databricks
    SQL
    Full time
    Remote work

    Purple Drive

    Chicago, IL
    5 hours ago
  • VeeRteq Solutions Inc. is seeking a skilled Senior Data Engineer located in Chicago, IL. This hybrid role requires working onsite 3 days per week and demands expertise in Databricks, Python, and SQL, among other skills. Candidates should possess over 10 years of experience... 
    Databricks
    SQL
    Local area
    3 days per week

    VeeRteq Solutions Inc.

    Chicago, IL
    4 days ago
  • $150k - $224k

     ...evidence. Our team builds the distributed data backbone that powers AI-assisted...  ...Discover Truth, and Act on It. As a Lead Data Engineer, you are the technical leader for your...  ...across modern data tooling, including Databricks, Kafka, dbt, and Snowflake, to directly... 
    Databricks
    Worldwide

    Relativity

    Chicago, IL
    3 days ago
  •  ...Manager For The Data & Ai Team Valorem Reply is...  ..., including Fabric and Databricks for our customers. As a...  ...as a hands-on manager leading a team on enterprise scale...  ..., Power BI, Azure SQL, Azure Cosmos DB, and Azure...  ...environments for data engineers and scientists, and general... 
    Databricks
    SQL

    Reply

    Chicago, IL
    3 days ago
  • Blue Cross Blue Shield in Chicago is seeking a Data Engineer with expertise in building and optimizing...  ...experience in data engineering, proficiency in Python and SQL, and familiarity with cloud-based tools like AWS and Databricks. The position offers hybrid work options and... 
    Databricks
    SQL

    Blue Cross Blue Shield

    Chicago, IL
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (Python, Databricks, SQL). Be the first to apply!