Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Azure Data Engineering Lead / Technical Lead

Lorven Technologies

Azure Data Engineering Lead Indianapolis, IN (Onsite) Full-Time Skills / Experience 5+ years of experience in Azure Cloud platform, Azure Databricks with PySpark. 2+ years of experience in Databricks workflow & Unity catalog. 3+ years of experience in ADF (Azure Data Factory), ADLS Gen 2 and Azure SQL. 2+ years of experience in Python programming & package builds. Secondary Skills / Good to have Azure Entra/AD skills and GitHub Actions; Orchestration experience using Airflow, Dagster, LogicApp. Working on event-driven architectures using Kafka, Azure Event Hub; Exposure on Google Cloud Pub/Sub Developing and maintaining Change Data Capture (CDC) solutions preferably using Debezium. Experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse. Managing cloud storage solutions on Azure Data Lake Storage . Experience with Google Cloud Storage will be an advantage Job / Role Description Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows. Ability to design modular, reusable workflows using tasks, triggers, and dependencies Experience in configuring data permissions, object lineage, and access policies with Unity Catalog. Understanding of integrating Unity Catalog with Azure AD, external metastores, and audit trails Experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads. Understanding of VNets, Private Endpoints, Key Vaults Managed Identities, and Azure Monitor. Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform) Experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2 Data management experience handling Analytics workload covering design, development, and maintenance of Lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service, supporting batch and near-real-time ingestion, transformation, and processing Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs; Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management; Skilled in governing and manage data access for Azure Data Lakehouse with Unity Catalog Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers; Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization; Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL. Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries. Ability to write unit tests using Pytest/unit test and integrate with CI/CD pipelines Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git). Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams Ability to articulate technical concepts clearly to both technical and business audiences. Experience in working with product owners, QA, and business analysts to translate requirements into deliverables Communicate effectively with internal and customer stakeholders; Strong interpersonal skills to build and maintain productive relationships with team members Provide constructive feedback during code reviews and be open to receiving feedback on your own code Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps. Provides regular updates, proactive and due diligent to carry out responsibilities Lorven Technologies

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Azure Data Engineering Lead / Technical Lead in Indianapolis, IN vacancy
  • We Are  The beginning of a new Data & AI decade that will reshape work and society...  ...are A strong Data Architect / Data Engineering Lead who can provide technical leadership, architectural direction,...  ...with cloud platforms such as Azure, AWS, or GCP.Experience with data governance... 
    Suggested
    Temporary work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  • $159k - $233.2k

     ...to join us.  NLP & Market Research Data Engineering Lead Customer Insights and Analytics (CIA...  ...reusable patterns, and self-service. ● Set technical direction & standards. Own the...  ...code (OPA / Rego), and Git-based CI/CD (Azure DevOps or equivalent); transformation-... 
    Suggested
    Full time
    Contract work
    Flexible hours

    Eli Lilly

    Indianapolis, IN
    9 days ago
  •  ...Engineering Technical Lead Our client, an energy technology organization, is seeking an Engineering Technical Lead to join their team. As an Engineering Technical Lead, you will be part of the Engineering organization supporting cross-functional gas turbine program... 
    Suggested

    Experis

    Indianapolis, IN
    10 hours ago
  •  ...Job Title: Lead Azure Data Engineer Location: Indianapolis, IN (Onsite) Position Type: Long Term Contract Required Experience: 12...  ...Azure Cloud Platform, CI/CD, Git, Azure DevOps Must-Have Technical Qualifications ~12+ overall years of experience in Data... 
    Suggested
    Long term contract

    Envision

    Indianapolis, IN
    1 day ago
  •  ...Indianapolis, INContract: ContractPosted: 2026-11-18Deadline: 0001-01-01Our client, an energy technology organization is seeking a Engineering Technical Lead to join their team. As a Engineering Technical Lead, you will be part of the Engineering organization supporting cross-... 
    Suggested

    Experis

    Indianapolis, IN
    8 hours ago
  • $129k - $231k

     ...leader headquartered in Indianapolis, Indiana. As Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team, you will own the technical direction and...  ...customer and partner profiles. You will set engineering standards, guide a team of data engineers, and... 
    Full time
    Flexible hours

    Eli Lilly

    Indianapolis, IN
    15 days ago
  • $100k - $150k

     ...delivers world-class end-to-end engineering solutions by leveraging our...  ...and skills: A Data engineer works on implementing...  ...roles including 2+ years in leading end-to-end design and implementation...  ...data storage technology using Azure data management components -... 
    Temporary work

    QuEST Global

    Indianapolis, IN
    1 day ago
  • $43.35 per hour

     ...Job Description Job Description Azure Databricks Synapse Data Engineer PySpark, Spark SQL, Delta Lake Job...  ...reviewing solutions, and providing technical support. The position also supports...  ...Collaborate with solution leads, project managers, data architects,... 
    Hourly pay
    Contract work
    Local area
    1 day per week

    Vision Square Inc

    Indianapolis, IN
    29 days ago
  • $140k - $175k

    Position Summary The Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions...  ...will your job entail? Job Responsibilities: • Provide technical leadership in data architecture and engineering,... 
    Full time
    Work experience placement
    Work visa

    Ryan Specialty

    Carmel, IN
    1 day ago
  •  ...Job Description Job Description We are seeking a Lead Power BI Developer with deep functional expertise in Life Sciences...  .... This role is critical for bridging the gap between technical data engineering and the specialized requirements of a GMP (Good Manufacturing... 

    Macpower Digital Assets Edge Private Limited

    Indianapolis, IN
    24 days ago
  •  ...Job Description Job Description Job title : Azure Data Engineer Microsoft Fabric & Power BI Work Location with Zip code: Indianapolis, IN 46241 (2 days a week in Office) Must Have Skills: Azure Data Factory (ADF), Azure Databricks, Power BI (Semantic Models... 
    Work at office
    2 days per week

    eTeam Inc.

    Indianapolis, IN
    24 days ago
  •  ...Biotech Health Data Governance Lead (AI Training) About the Role What if your expertise in biotech data governance could directly...  ...and clinical trial data Skilled at bridging scientific, technical, and business teams to align on data standards and best practices... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    Indianapolis, IN
    3 days ago
  • $134.5k - $265.1k

     ...Summary Join our AI & Engineering team in transforming...  ...solutions in software, data, AI, network, and...  ...oriented professional to help lead our Life Sciences...  ...Services (AWS), Microsoft Azure, or Google Cloud...  ...sessionsExperience presenting technical content to both large... 
    Local area
    Visa sponsorship

    Deloitte

    Indianapolis, IN
    1 day ago
  • We Are:Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched...  ...people, shareholders, partners, and communities.You Are:A hands-on data delivery lead with deep life insurance and annuities experience,... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  • $122k - $240.5k

     ...Summary Legacy Modernization Data Architect LeadSoftware Engineer III- AI & Engineering/...  ...You’ll DoYou are a hands-on technical leader who designs, builds...  ...relationshipsAbility to lead projects or workstreamsAbility...  ...infrastructure (AWS, Azure, or GCP), including containerized... 
    Local area
    Flexible hours

    Deloitte

    Indianapolis, IN
    3 days ago
  • $170k

     ...A Day in the Life: The Director, Data Engineer owns the strategy, reliability, and evolution...  ...experience. What You'll Do: Lead the strategy, roadmap, and governance of...  ...mentor high-performing BI platform and technical services teams Establish operating models... 
    Worldwide

    The Hertz Corporation

    Indianapolis, IN
    4 days ago
  • We Are The beginning of a new Data & AI decade that will reshape work...  ...automation.The WorkWe are seeking a Data Engineering, Management & Governance Manager to own the technical integrity and delivery of...  ...(Snowflake, Databricks, Azure Synapse, BigQuery), pipeline engineering... 
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  • $99k - $232k

    The Opportunity As an AI Data Governance Engineer- Manager, you will help clients make data more trustworthy...  ...questions. As a Manager, you will lead client workstreams with accountability...  ...(Power BI), cloud platforms (AWS, Azure, GCP), or predictive modeling/ML (Python... 
    H1b

    PwC

    Indianapolis, IN
    1 day ago
  • Senior Technical Integration Lead - Robotics & DronesWe are Aptiv - a global technology company with 20...  ...As a Senior Technical Integration Lead Engineer, you will lead the integration,...  ...implementation.Analyze system performance data and communicate results, risks, and recommendations... 
    Full time
    Remote work

    Control Tec

    Carmel, IN
    4 days ago
  •  ...professionalism.V2X is seeking an Autonomous Systems Technical Lead with a passion for autonomous vehicle...  ...and test to join our Systems Engineering team in Indianapolis, IN. This position...  ...developmentExperience using standard data languages and tools (C/C++, Python, etc... 

    V2X

    Indianapolis, IN
    16 hours ago
  • $93.1k - $131.1k

     ...Consultant on the team, you will be responsible for: Leading the design, coordination, and delivery of Oracle HCM Cloud technical integrations across enterprise systemsDefining...  .../outbound interfaces, middleware coordination, data mapping, and end-to-end validationPartnering... 
    Local area

    Deloitte

    Indianapolis, IN
    1 day ago
  • $137.5k - $193.6k

     .... We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances...  ...relationshipsAbility to lead projects or workstreamsAbility to...  ...presenting complex data insights to non-technical audiencesExperience with deep... 
    Local area

    Deloitte

    Indianapolis, IN
    4 days ago
  •  ...US): 151000Minimum Salary (US): 95000Job SummaryThis position entails leading a team of developers in the implementation of projects using React, Angular, and Java technologies. The Senior Technical Lead will be responsible for overseeing the technical architecture, development... 

    HCL Technologies

    Indianapolis, IN
    4 days ago
  •  ...Mid-Level Data Engineer We are seeking a Mid-Level Data Engineer to support a growing data and AI team focused on modernizing how enterprise...  ...ideal candidate is a hands-on engineer who can work within an Azure-based data environment, build reliable data solutions, and... 

    Agility Partners

    Carmel, IN
    1 day ago
  • Data Leader You must be authorized to work in the United States without employer sponsorship now or in the future. We will not sponsor...  ...data marketplace. Role Overview The Data Marketplace Governance Lead owns and evolves the governance standards that determine what is... 
    Remote work
    Visa sponsorship
    Work visa

    Liberty Information Technology Limited

    Indianapolis, IN
    1 day ago
  • $120.47k

     ...450 Elanco Circle, Indianapolis, IN 46221 2. H-1B Job Title: Data Engineer 3. Occupation Code: 15-2051.00 (Data Scientists) 3. Period of...  ...Winner/Finalist - reflecting our consistent delivery of industry-leading solutions and our deep, trusted partnership with Microsoft.... 
    H1b
    Work at office

    WinWire

    Indianapolis, IN
    1 day ago
  •  ...At Xenon7, we work with leading enterprise clients and innovative...  ...-impact projects across Data, AI, Cloud, and Software Engineering. Our expertise in AI...  ...and specialized technical talent allows us to partner...  ...Databricks, Snowflake, AWS/Azure), PySpark, and SQL. Ensure... 
    Full time
    Contract work
    For contractors
    3 days per week

    Xenon7

    Indianapolis, IN
    4 days ago
  •  ...Senior Data Engineer Anywhere Type: Permanent Category: Data Industry: Technology Workplace Type: Remote Standard Hours...  ...and one orchestrator such as dbt Cloud, Airflow, Dagster, or Azure Data Factory. ~ Hands-on Git and CI/CD for data using GitHub... 
    Hourly pay
    Permanent employment
    Full time
    Local area
    Remote work

    Eliassen Group

    Indianapolis, IN
    1 day ago
  • The Data Quality Lead is responsible for leading the execution of the Enterprise Data Warehouse (EDW) Data Quality (DQ) controls framework...  .... This role partners closely with Data Owners/Stewards, EDW Engineering, Governance, and Program Management to operationalize data quality... 

    Vergence Group

    Carmel, IN
    1 day ago
  • Data & AI Engineer Location: Indianapolis, IN Summary: Develop and integrate the technical components that capture, store, process, and deliver business context to the client’s existing AI ecosystem. Responsibilities: Develop and maintain the Business Context Repository... 
    Full time

    Radcube

    Indianapolis, IN
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Azure Data Engineering Lead / Technical Lead. Be the first to apply!