Databricks Integration Lead

Full-time

New York Technology Partners

Veeva CRM to Vault CRM Migration

Location: Indianapolis, IN preferred. Open to candidates based in Chicago, IL, Cincinnati, OH, or surrounding areas within reasonable proximity to Indianapolis.

About the Opportunity

We are seeking a senior, hands-on Databricks Integration Lead to lead the integration architecture for a large-scale Veeva CRM to Vault CRM migration within the life sciences industry.

This role involves managing integrations across 5 Veeva CRM organizations and 46 integration points, optimizing existing integrations, and ensuring a seamless transition to Vault CRM.

The ideal candidate has deep, hands-on Databricks expertise, strong integration architecture experience, and a background in pharmaceutical or life sciences environments. This is a technical leadership role requiring active involvement in architecture, pipeline development, and engineering team oversight.

Key Responsibilities

Lead end-to-end integration architecture across Databricks, Veeva CRM, Vault CRM, and connected systems.
Analyze and optimize 46 integration points, identifying opportunities for consolidation and standardization.
Design scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
Establish standards for medallion architecture, Unity Catalog, workflow orchestration, and CI/CD.
Develop data mapping and integration strategies to support the Veeva CRM to Vault CRM migration.
Provide hands-on technical guidance, review pipelines, and troubleshoot complex integration challenges.
Lead engineering teams, including offshore resources.
Ensure data validation, governance, regulatory compliance, and successful migration cutover.

Required Qualifications

10+ years of experience in data integration, engineering, or architecture.
5+ years of deep, hands-on Databricks experience in enterprise environments.
Expertise in PySpark, Spark SQL, Delta Lake, Delta Live Tables, Auto Loader, Workflows/Jobs, and Unity Catalog.
Hands-on experience with Veeva CRM integrations and data models.
Experience in pharmaceutical or life sciences commercial environments, including HCP/HCO data, call activity, samples, and consent.
Experience delivering complex, multi-system integration projects.
Strong API integration experience (REST/SOAP), data pipelines, and performance optimization.
Proven technical leadership experience, including managing distributed or offshore engineering teams.
Familiarity with GxP validation and regulated environments.

Preferred Qualifications

Experience with Vault CRM or Veeva CRM to Vault CRM migrations.
Databricks certifications.
Experience with Veeva Network, OpenData, or multi-org integrations.
Experience with Terraform, Azure DevOps, GitHub Actions, or cloud platforms (AWS, Azure, GCP).

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Databricks Integration Lead in Indianapolis, IN vacancy

ERP Analytics & Reporting Lead
...seeking an experienced Enterprise Analytics & Reporting Lead to own the strategy, architecture, delivery, and... ...Business Data Cloud, SAP Datasphere, Azure Data Lake, Databricks, embedded SAP analytics, and integrated SAP and non-SAP enterprise analytics solutions.The successful...
Databricks
Work at office
Local area
1 day per week
Corteva
Indianapolis, IN
5 days ago
Associate Director, Medical Affairs Intelligence Capability Lead
$132k - $213.4k
...Director, Medical Affairs Intelligence Capability Lead role sits within the Medical Insights & AI... ...scientific intelligence, cloud/data platforms, and integrated analytics solutions (e.g., Veeva CRM, H1, MedVA, Databricks, AWS, ZAIDYN, or comparable platforms)Strong technical...
Databricks
Work at office
Local area
Remote work
Visa sponsorship
Work visa
Flexible hours
Eli Lilly and Company
Indianapolis, IN
2 days ago
Oracle Utilities Integration Lead
...notice of our work, too. Visit us here to find out more about Accenture's Oracle practice (.)You Are:A senior Oracle Utilities Integration Lead who brings both the architectural vision and the hands-on delivery credibility to own a complex integration workstream end-to-...
Suggested
Full time
Work experience placement
Live in
Work at office
Local area
Remote work
Accenture
Carmel, IN
2 days ago
Enterprise Data and Analytics Platform Leader
...successful candidate will join a globally distributed Integrated Enterprise Solutions organization and play a... ..., AI, and machine learning solutions.Lead platform engineering efforts supporting technologies such as Databricks, Fabric, Power Platform.Partner with business...
Databricks
Local area
Remote work
1 day per week
Corteva
Indianapolis, IN
3 days ago
IDO Delivery Leader
$189.2k - $372.9k
...foundation work only holds up if the person leading it has lived on both sides of the OT/IT... ...architecture), OT-focused systems integrator, or consulting delivery — breadth matters... ...representative: Cognite, HighByte, AVEVA, Databricks, Snowflake, Palantir, AWS, GCP)Experience...
Databricks
Local area
Deloitte
Indianapolis, IN
4 days ago
Technology Analyst | Cloud Integration | Azure Data Factory (ADF)
...Job title : Lead Data Engineer Work Location with Zip code: Indianapolis, IN 4624... ...Skills: Azure Data Factory (ADF), Azure Databricks, Power BI (Semantic Models, DAX, Reporting... ...platforms. Experience with API integrations, SQL, Python, and modern cloud-based data...
Databricks
Contract work
Work at office
Relocation
2 days per week
Ipolarity LLC
Indianapolis, IN
4 days ago
Value Stream Integration Leader
$84.35k - $137.07k
Job DescriptionJob Title: Value Stream integration LeaderWorking Pattern: Hybrid/Onsite in office 3 days/weekWorking location: Indianapolis... ...via a robust Sales & Operations Execution (S&OE) process and leading significant interventions to improve the outlook both through...
Full time
Work at office
Remote work
Relocation
Flexible hours
Rolls-Royce
Indianapolis, IN
10 hours ago
Snowflake Advanced AI Solution Lead
...environment where you can help clients shift to the New using leading-edge technologies on some of the coolest projects you can imagine... ..., and UI designers, to achieve end-to-end project goals and integrate into productionTravel may be required for this role. The amount...
Full time
Work experience placement
Live in
Work at office
Local area
Shift work
Accenture
Carmel, IN
2 days ago
Senior Data Engineer
$115k - $145k
...Senior Data Engineer – Databricks / Snowflake / Azure Indianapolis, IN | Hybrid Relocation... ...with a confidential, industry-leading organization in the infrastructure and construction... ...and maintain Delta Lake architecture Integrate Databricks with Azure services (ADF,...
Databricks
Relocation
Relocation package
MS Companies
Indianapolis, IN
4 days ago
Oracle HCM Payroll Lead
...Are:Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched... ...payroll processes within Oracle HCM, including conversions, integrations, reports, fast formulas, configuration tables, etc.Provide expertise...
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
1 day ago
Data Engineer- Consultant AI& E
$95k - $112k
...understand the designBuild low level data pipeline specifications in Databricks and Apache Hadoop using SparkUnit test the data pipelinesWork... ...-edge engineering capabilities to build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network,...
Databricks
Local area
Deloitte
Indianapolis, IN
10 hours ago
Data Engineer Sr. Consultant
$127k - $150k
...partnerships with many of the world's leading technological companies, allowing us to... ...scalable healthcare data platforms and integration pipelines across claims, payments, member... ...cloud-based data products using Azure Databricks, PySpark, Python, AWS services, Teradata...
Databricks
Local area
Visa sponsorship
Deloitte
Indianapolis, IN
21 hours ago
Manager, Data & AI Architecture
$127.2k - $246.9k
...our Clients and Markets organization.Responsibilities:Lead the architectural design, strategy, and hands-on... ...data pipelines and multi-tiered architectures using Databricks and Medallion Architecture, integrating Salesforce (Marketing Cloud, Sales Cloud, Data Cloud)...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
2 days ago
Lead Engineer I, Solution Architecture
...join our team.KPMG is currently seeking a Lead Engineer I, Data and Information... ...technologies and industry trendsAct with integrity, professionalism, and personal responsibility... ...platforms, including Fabric, Power BI, Azure Databricks, Azure Synapse, SQL Server, DocumentDB,...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
1 day ago
Lead Adobe Commerce Architect
$134.5k - $265.1k
...digital products, marketing, commerce, sales, and service. As a Lead Business Transformation Architect specializing in Adobe... ...including cloud configuration, build and deployment workflows, integrations, performance optimization, and operational troubleshooting.Build...
Local area
Visa sponsorship
Deloitte
Indianapolis, IN
2 days ago
IDO Delivery Manager
$155.6k - $306.8k
...Work you'll do In this role, you will lead core delivery execution for industrial data... ...own the design oversight of the data integration layer between operational technology (OT... ...in engagements, you may coordinate with Databricks and AWS alliance solution architects for...
Databricks
Local area
Deloitte
Indianapolis, IN
5 days ago
Lead Architect with Anthropic Experience
$141.2k - $278.3k
Position Summary Lead Architect with Agentic AI Experience, AI & Engineering/Engineering as a ServiceAgentic AI is moving from... ...-edge engineering capabilities to build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and...
Work at office
Local area
Visa sponsorship
Flexible hours
Shift work
Deloitte
Indianapolis, IN
21 hours ago
AWS/Databricks Cloud Data Engineer
$85k - $125k
...show empathy and caring in all interactions. This is the base of our core values: Accountability, Balance, Collaboration, Focus, Integrity, Social Responsibility, Support and Transparency.Moser Consulting believes in equal opportunity for all people and is committed to...
Databricks
Full time
Work at office
Local area
Flexible hours
Moser Consulting
Indianapolis, IN
4 days ago
Manager, Data Solutions Delivery
$105.74k - $247.37k
...across cloud-based data platforms while leading technical execution from solution... ...troubleshooting and resolving complex data integration, performance, and quality issuesDevelop... ...expertise with the Azure data stack, including Databricks, Unity CatalogProven proficiency in...
Databricks
H1b
Work at office
Local area
KPMG
Indianapolis, IN
4 days ago
Manager, Data Analysis Discovery & Requirements
...disciplines and borders to develop and lead global initiatives. We deliver strategic... ...Office (DSGO) is responsible for building an integrated strategy and operating model to... ...processes, and analytics ecosystems such as Databricks or SnowflakeExperience with enterprise systems...
Databricks
Work experience placement
Work at office
Deloitte
Indianapolis, IN
3 days ago
Sr. Specialist, Advanced Analytics
$100.95k - $183.3k
...leadership. Here’s what you’ll do: Lead the full analytical project lifecycle —... ...Stay current on emerging SnowFlake, SQL, Databricks, emerging AI and machine learning... ...be honest, trustworthy, and operate with integrity. Discrimination and harassment of any kind...
Databricks
Local area
Remote work
DIRECTV
Indianapolis, IN
1 day ago
Lead Solution Architect
...exercise sound judgment. Most important, demonstrate a high level of integrity and dependability with a strong sense of urgency and results-... ...the Firm. Once the direction is set, this role prioritizes and leads those efforts. They also create architecture drawings,...
Full time
CliftonLarsonAllen
Indianapolis, IN
1 day ago
Data Engineer
$28 per hour
...data for analytics and reporting Work with team members to integrate data from multiple business systems using Microsoft Fabric and... ...or cloud technologies Exposure to Microsoft Fabric, Azure, Databricks, Power BI, Snowflake, AWS, or similar data platforms Familiarity...
Databricks
Long term contract
Permanent employment
Contract work
Internship
Local area
3 days per week
Brooksource
Indianapolis, IN
2 days ago
Medical Affairs Solutions Lead
...Medical Affairs Solutions Lead Indianapolis, IN Hybrid role (3 days/week onsite) 12-month contract Start Date: ASAP ABOUT... ...-functional teams, including Field Medical, is essential to integrate education into engagement models and training plans. The ideal...
Contract work
Immediate start
3 days per week
Medasource
Indianapolis, IN
1 day ago
Principal Data Engineer
...ensuring scalability, compliance, and seamless integration with the broader enterprise landscape (e... ...g., SAP ERP, Veeva RIM, Ennov).Act as a lead mentor and coach, fostering a culture of... .../integration services (Logic Apps, Databricks); (4) Engineering and delivering...
Databricks
Full time
Work at office
Elanco
Indianapolis, IN
2 days ago
Data Engineer - Hybrid - Indianapolis
...platforms. You will play a key role in data integration, cloud migration initiatives, ETL... ...sharing on enterprise data initiatives. Lead or support complex data projects and... ...Platforms Required 2+ Azure Databricks Required 2+ ETL...
Databricks
Full time
Remote work
1 day per week
aFit Staffing Inc.
Indianapolis, IN
8 days ago
Senior Associate, Data Strategy Enablement & Innovation
...professional development, and share knowledge with peersAct with integrity, professionalism, and personal responsibility to uphold KPMG's... ...with required experience in Microsoft Azure (including Azure Databricks) and a strong preference for experience with the Google Cloud...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
2 days ago
Lead IT Security Architect SailPoint REMOTE any US based location in CST or EST zones
$130.5k - $195.7k
Job DetailsCNO Financial Group, Inc. (NYSE: CNO) is a leading insurance and financial services company focused on securing the future... ...financial foundation, national presence, and a culture rooted in integrity, excellence, and people‑first values, CNO offers meaningful...
Full time
Work at office
Remote work
Flexible hours
CNO Financial Group
Carmel, IN
2 days ago
Lead IT Security Architect - REMOTE from any EST or CST US-based time zone
Job DetailsCNO Financial Group, Inc. (NYSE: CNO) is a leading insurance and financial services company focused on securing the future... ...financial foundation, national presence, and a culture rooted in integrity, excellence, and people‑first values, CNO offers meaningful...
Full time
Work experience placement
Work at office
Remote work
Flexible hours
CNO Financial Group
Carmel, IN
2 days ago
AI Technical Program Manager
...startup within a Fortune 100 company, we are leading a digital disruption that will redefine... ...toward federated adoption. Maintain an integrated program plan and delivery rhythm across... ...technology partners including AWS, Databricks, Snowflake, Microsoft, Datadog, and Zscaler...
Databricks
Local area
Remote work
Visa sponsorship
Work visa
Shift work
Liberty Mutual
Indianapolis, IN
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Integration Lead. Be the first to apply!