Azure Data Engineering Lead / Technical Lead
Lorven Technologies
Azure Data Engineering Lead Indianapolis, IN (Onsite) Full-Time Skills / Experience 5+ years of experience in Azure Cloud platform, Azure Databricks with PySpark. 2+ years of experience in Databricks workflow & Unity catalog. 3+ years of experience in ADF (Azure Data Factory), ADLS Gen 2 and Azure SQL. 2+ years of experience in Python programming & package builds. Secondary Skills / Good to have Azure Entra/AD skills and GitHub Actions; Orchestration experience using Airflow, Dagster, LogicApp. Working on event-driven architectures using Kafka, Azure Event Hub; Exposure on Google Cloud Pub/Sub Developing and maintaining Change Data Capture (CDC) solutions preferably using Debezium. Experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse. Managing cloud storage solutions on Azure Data Lake Storage . Experience with Google Cloud Storage will be an advantage Job / Role Description Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows. Ability to design modular, reusable workflows using tasks, triggers, and dependencies Experience in configuring data permissions, object lineage, and access policies with Unity Catalog. Understanding of integrating Unity Catalog with Azure AD, external metastores, and audit trails Experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads. Understanding of VNets, Private Endpoints, Key Vaults Managed Identities, and Azure Monitor. Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform) Experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2 Data management experience handling Analytics workload covering design, development, and maintenance of Lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service, supporting batch and near-real-time ingestion, transformation, and processing Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs; Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management; Skilled in governing and manage data access for Azure Data Lakehouse with Unity Catalog Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers; Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization; Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL. Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries. Ability to write unit tests using Pytest/unit test and integrate with CI/CD pipelines Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git). Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams Ability to articulate technical concepts clearly to both technical and business audiences. Experience in working with product owners, QA, and business analysts to translate requirements into deliverables Communicate effectively with internal and customer stakeholders; Strong interpersonal skills to build and maintain productive relationships with team members Provide constructive feedback during code reviews and be open to receiving feedback on your own code Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps. Provides regular updates, proactive and due diligent to carry out responsibilities Lorven Technologies
- We Are The beginning of a new Data & AI decade that will reshape work and society... ...are A strong Data Architect / Data Engineering Lead who can provide technical leadership, architectural direction,... ...with cloud platforms such as Azure, AWS, or GCP.Experience with data governance...SuggestedTemporary workWork experience placementLive inWork at officeLocal area
$159k - $233.2k
...to join us. NLP & Market Research Data Engineering Lead Customer Insights and Analytics (CIA... ...reusable patterns, and self-service. ● Set technical direction & standards. Own the... ...code (OPA / Rego), and Git-based CI/CD (Azure DevOps or equivalent); transformation-...SuggestedFull timeContract workFlexible hours- ...Engineering Technical Lead Our client, an energy technology organization, is seeking an Engineering Technical Lead to join their team. As an Engineering Technical Lead, you will be part of the Engineering organization supporting cross-functional gas turbine program...Suggested
- ...Job Title: Lead Azure Data Engineer Location: Indianapolis, IN (Onsite) Position Type: Long Term Contract Required Experience: 12... ...Azure Cloud Platform, CI/CD, Git, Azure DevOps Must-Have Technical Qualifications ~12+ overall years of experience in Data...SuggestedLong term contract
- ...Indianapolis, INContract: ContractPosted: 2026-11-18Deadline: 0001-01-01Our client, an energy technology organization is seeking a Engineering Technical Lead to join their team. As a Engineering Technical Lead, you will be part of the Engineering organization supporting cross-...Suggested
$129k - $231k
...leader headquartered in Indianapolis, Indiana. As Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team, you will own the technical direction and... ...customer and partner profiles. You will set engineering standards, guide a team of data engineers, and...Full timeFlexible hours$100k - $150k
...delivers world-class end-to-end engineering solutions by leveraging our... ...and skills: A Data engineer works on implementing... ...roles including 2+ years in leading end-to-end design and implementation... ...data storage technology using Azure data management components -...Temporary work$43.35 per hour
...Job Description Job Description Azure Databricks Synapse Data Engineer PySpark, Spark SQL, Delta Lake Job... ...reviewing solutions, and providing technical support. The position also supports... ...Collaborate with solution leads, project managers, data architects,...Hourly payContract workLocal area1 day per week$140k - $175k
Position Summary The Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions... ...will your job entail? Job Responsibilities: • Provide technical leadership in data architecture and engineering,...Full timeWork experience placementWork visa- ...Job Description Job Description We are seeking a Lead Power BI Developer with deep functional expertise in Life Sciences... .... This role is critical for bridging the gap between technical data engineering and the specialized requirements of a GMP (Good Manufacturing...
- ...Job Description Job Description Job title : Azure Data Engineer Microsoft Fabric & Power BI Work Location with Zip code: Indianapolis, IN 46241 (2 days a week in Office) Must Have Skills: Azure Data Factory (ADF), Azure Databricks, Power BI (Semantic Models...Work at office2 days per week
- ...Biotech Health Data Governance Lead (AI Training) About the Role What if your expertise in biotech data governance could directly... ...and clinical trial data Skilled at bridging scientific, technical, and business teams to align on data standards and best practices...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$134.5k - $265.1k
...Summary Join our AI & Engineering team in transforming... ...solutions in software, data, AI, network, and... ...oriented professional to help lead our Life Sciences... ...Services (AWS), Microsoft Azure, or Google Cloud... ...sessionsExperience presenting technical content to both large...Local areaVisa sponsorship- We Are:Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched... ...people, shareholders, partners, and communities.You Are:A hands-on data delivery lead with deep life insurance and annuities experience,...Work experience placementLive inWork at officeLocal area
$122k - $240.5k
...Summary Legacy Modernization Data Architect LeadSoftware Engineer III- AI & Engineering/... ...You’ll DoYou are a hands-on technical leader who designs, builds... ...relationshipsAbility to lead projects or workstreamsAbility... ...infrastructure (AWS, Azure, or GCP), including containerized...Local areaFlexible hours$170k
...A Day in the Life: The Director, Data Engineer owns the strategy, reliability, and evolution... ...experience. What You'll Do: Lead the strategy, roadmap, and governance of... ...mentor high-performing BI platform and technical services teams Establish operating models...Worldwide- We Are The beginning of a new Data & AI decade that will reshape work... ...automation.The WorkWe are seeking a Data Engineering, Management & Governance Manager to own the technical integrity and delivery of... ...(Snowflake, Databricks, Azure Synapse, BigQuery), pipeline engineering...Live inWork at officeLocal area
$99k - $232k
The Opportunity As an AI Data Governance Engineer- Manager, you will help clients make data more trustworthy... ...questions. As a Manager, you will lead client workstreams with accountability... ...(Power BI), cloud platforms (AWS, Azure, GCP), or predictive modeling/ML (Python...H1b- Senior Technical Integration Lead - Robotics & DronesWe are Aptiv - a global technology company with 20... ...As a Senior Technical Integration Lead Engineer, you will lead the integration,... ...implementation.Analyze system performance data and communicate results, risks, and recommendations...Full timeRemote work
- ...professionalism.V2X is seeking an Autonomous Systems Technical Lead with a passion for autonomous vehicle... ...and test to join our Systems Engineering team in Indianapolis, IN. This position... ...developmentExperience using standard data languages and tools (C/C++, Python, etc...
$93.1k - $131.1k
...Consultant on the team, you will be responsible for: Leading the design, coordination, and delivery of Oracle HCM Cloud technical integrations across enterprise systemsDefining... .../outbound interfaces, middleware coordination, data mapping, and end-to-end validationPartnering...Local area$137.5k - $193.6k
.... We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances... ...relationshipsAbility to lead projects or workstreamsAbility to... ...presenting complex data insights to non-technical audiencesExperience with deep...Local area- ...US): 151000Minimum Salary (US): 95000Job SummaryThis position entails leading a team of developers in the implementation of projects using React, Angular, and Java technologies. The Senior Technical Lead will be responsible for overseeing the technical architecture, development...
- ...Mid-Level Data Engineer We are seeking a Mid-Level Data Engineer to support a growing data and AI team focused on modernizing how enterprise... ...ideal candidate is a hands-on engineer who can work within an Azure-based data environment, build reliable data solutions, and...
- Data Leader You must be authorized to work in the United States without employer sponsorship now or in the future. We will not sponsor... ...data marketplace. Role Overview The Data Marketplace Governance Lead owns and evolves the governance standards that determine what is...Remote workVisa sponsorshipWork visa
$120.47k
...450 Elanco Circle, Indianapolis, IN 46221 2. H-1B Job Title: Data Engineer 3. Occupation Code: 15-2051.00 (Data Scientists) 3. Period of... ...Winner/Finalist - reflecting our consistent delivery of industry-leading solutions and our deep, trusted partnership with Microsoft....H1bWork at office- ...At Xenon7, we work with leading enterprise clients and innovative... ...-impact projects across Data, AI, Cloud, and Software Engineering. Our expertise in AI... ...and specialized technical talent allows us to partner... ...Databricks, Snowflake, AWS/Azure), PySpark, and SQL. Ensure...Full timeContract workFor contractors3 days per week
- ...Senior Data Engineer Anywhere Type: Permanent Category: Data Industry: Technology Workplace Type: Remote Standard Hours... ...and one orchestrator such as dbt Cloud, Airflow, Dagster, or Azure Data Factory. ~ Hands-on Git and CI/CD for data using GitHub...Hourly payPermanent employmentFull timeLocal areaRemote work
- The Data Quality Lead is responsible for leading the execution of the Enterprise Data Warehouse (EDW) Data Quality (DQ) controls framework... .... This role partners closely with Data Owners/Stewards, EDW Engineering, Governance, and Program Management to operationalize data quality...
- Data & AI Engineer Location: Indianapolis, IN Summary: Develop and integrate the technical components that capture, store, process, and deliver business context to the client’s existing AI ecosystem. Responsibilities: Develop and maintain the Business Context Repository...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineering Lead / Technical Lead. Be the first to apply!
- junior data engineer remote Indianapolis, IN
- data engineer analytics Indianapolis, IN
- data science developer Indianapolis, IN
- data center engineer Indianapolis, IN
- senior data center engineer Indianapolis, IN
- entry level big data engineer Indianapolis, IN
- senior data quality engineer Indianapolis, IN
- data developer Indianapolis, IN
- sr data engineer Indianapolis, IN
- data engineer Indianapolis, IN





