Databricks Integration Lead

Full-time

New York Technology Partners

Role Overview

We need a senior, hands-on Databricks Integration Lead to own the integration architecture for a large migration from

Veeva CRM to Vault CRM. The scope covers 5 Veeva CRM orgs and 46 unique integration points that must be

analyzed, rationalized, and optimized before connecting to the new Vault CRM platform. The lead sets technical

direction, makes architecture decisions, and guides a skilled Databricks engineering team (including offshore

resources). Deep, current, hands-on Databricks expertise is the top screening criterion. This is not an

oversight-only role.

Key Responsibilities

• Own end-to-end integration architecture across Databricks, 5 Veeva CRM orgs, Vault CRM, and connected systems

• Catalog and analyze all 46 integration points; consolidate, retire, or standardize rather than lift-and-shift

• Define standards: medallion architecture, Delta Lake, Unity Catalog governance, workflow orchestration, CI/CD

• Design coexistence patterns while Veeva CRM and Vault CRM run in parallel

• Define Veeva-to-Vault data mapping (accounts, HCP/HCO, calls, samples, consents, territories)

• Review designs, notebooks, and pipelines; act as technical escalation point for the team

• Establish validation/reconciliation frameworks and support GxP, privacy, and audit requirements

• Own technical cutover plan, rollback strategy, and monitoring/operational support model

Required Qualifications

• 10+ years in data integration/architecture; 5+ years deep, hands-on Databricks in enterprise production

• Expert in PySpark/Spark SQL, Delta Lake, Workflows/Jobs, Delta Live Tables, Auto Loader, Unity Catalog,

performance and cost tuning

• Delivered large multi-source integration programs (dozens of interfaces)

• Hands-on Veeva CRM data model and integration experience; Vault CRM knowledge strongly preferred

• Life sciences / pharma commercial experience (HCP/HCO data, call activity, samples, consent, MDM)

• Strong REST/SOAP API, bulk load, and file/event-based integration skills

• Proven technical leadership of engineering teams, including distributed/offshore teams

• Familiarity with GxP validation and regulated-environment delivery

Preferred Qualifications

• Databricks certifications (Data Engineer Professional, Solution Architect, or equivalent)

• Prior Veeva CRM to Vault CRM or other CRM-to-CRM migration experience

• Experience with Veeva Network, OpenData, or multi-org integration rationalization

• DevOps for Databricks (Terraform, Azure DevOps, GitHub Actions); AWS, Azure, or GCP

Apply

Vacancy posted 21 hours ago

Similar jobs that could be interesting for youBased on the Databricks Integration Lead in Indianapolis, IN vacancy

Databricks Integration Lead (Veeva/Vault CRM)
...Job Description Databricks Integration Lead (Veeva/Vault CRM) \n We are seeking a senior, hands-on Databricks Integration Lead to drive integration architecture for a large-scale migration from Veeva CRM to Vault CRM. This role will oversee the analysis and optimization...
Databricks
New York Technology Partners
Indianapolis, IN
3 days ago
Lead Databricks Architect
...Lead Databricks Architect Location: Indianapolis, IN — Hybrid, 3 days onsite/week Industry: Pharmaceutical Contract: Long Term... ...have multiple enterprise-scale Databricks implementations/integrations and hands-on experience designing and migrating complex AWS...
Databricks
Long term contract
Contract work
3 days per week
Kaltech Consulting Inc
Indianapolis, IN
4 days ago
Oracle Utilities Integration Lead
...notice of our work, too. Visit us here to find out more about Accenture's Oracle practice (.)You Are:A senior Oracle Utilities Integration Lead who brings both the architectural vision and the hands-on delivery credibility to own a complex integration workstream end-to-...
Suggested
Work experience placement
Live in
Work at office
Local area
Remote work
Accenture
Carmel, IN
3 days ago
IDO Delivery Leader
$189.2k - $372.9k
...foundation work only holds up if the person leading it has lived on both sides of the OT/IT... ...architecture), OT-focused systems integrator, or consulting delivery — breadth matters... ...representative: Cognite, HighByte, AVEVA, Databricks, Snowflake, Palantir, AWS, GCP)Experience...
Databricks
Local area
Deloitte
Indianapolis, IN
2 days ago
Battery Compliance & Integration Lead (Hybrid)
...Carrier Global Corporation is seeking a Battery Conformity, Integration and Project Manager to ensure US battery conformity and lead integration projects. The role reports to the Global Battery Center, with a hybrid schedule: 2 days onsite and 3 days remote, and involves...
Suggested
Remote work
C01 Carrier Corporation
Indianapolis, IN
3 days ago
Technology Analyst | Cloud Integration | Azure Data Factory (ADF)
...our clients. Description: Job title : Lead Data Engineer Work Location with Zip... ...Skills: Azure Data Factory (ADF), Azure Databricks, Power BI (Semantic Models, DAX, Reporting... ...platforms. Experience with API integrations, SQL, Python, and modern cloud-based data...
Databricks
Contract work
Work at office
Relocation
2 days per week
IMCS Group Inc
Indianapolis, IN
2 days ago
Principal Integrated Product Team Lead
$107.5k - $204.5k
...solving the world’s most complex problems. With our three market leading businesses, world-class operations and investments in research... ...shape the future of aerospace and defense.We are seeking an Integrated Project Team Lead to join our Systems Engineering & Test...
Temporary work
For contractors
Work experience placement
Work at office
Remote work
Relocation package
Flexible hours
Raytheon
Indianapolis, IN
2 days ago
Senior Lead GTM Growth Platforms
$105.79k - $141.05k
...impact, and help shape the future of AI‑ready connectivity, join us today. The Role The Sr. Lead, GTM Growth Platforms is a critical role within Lumen’s new Integrated Demand & GTM team, reporting directly to the Sr. Director, Integrated Demand & GTM. This...
Full time
Temporary work
Remote work
Lumen
Indianapolis, IN
21 hours ago
Consumption Pricing Monetization Lead
$105.79k - $141.05k
...product packaging. We are hiring a Consumption Pricing Monetization Lead with deep expertise in consumption-based pricing to lead the... ...they transact with hyperscalers and cloud providers. You will be integral in building a repeatable process that maximizes flexibility...
Full time
Contract work
Temporary work
Remote work
Flexible hours
Lumen
Indianapolis, IN
1 day ago
Marketing Operations Analyst
...adhere to privacy regulations, including GDPR and CCPA. Data Integration: Collaborate with cross-functional teams such as IT and... ...with Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau...
Databricks
Full time
FocusKPI
Indianapolis, IN
3 days ago
Senior Data Scientist - Azure Databricks & Data Lakehouse
...IN seeks a Data Scientist for a hybrid role focused on data integration, pipeline development, governance, and documentation to deliver... ...include building batch and streaming pipelines in Azure Databricks with PySpark, Spark SQL, and Delta Lake, designing dimensional...
Databricks
Saipro Systems LLC
Indianapolis, IN
4 days ago
Life Sciences Solutions Engineer, Lead (Commercialization)
$134.5k - $265.1k
...cutting-edge engineering capabilities to build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network,... ...seeking a visionary and results-oriented professional to help lead our Life Sciences Commercial Operations practice, specializing...
Local area
Visa sponsorship
Deloitte
Indianapolis, IN
2 days ago
Data Architect
$58 per hour
...client is seeking a Data Architect to lead the design, development, and implementation... ...strategy, ensuring data quality and integrity, and building scalable solutions across... ...including Azure , AWS , and Azure Databricks . Partner with engineering teams to...
Databricks
Full time
Contract work
Local area
Brooksource
Indianapolis, IN
1 day ago
Data Engineer- Consultant AI& E
$95k - $112k
...understand the designBuild low level data pipeline specifications in Databricks and Apache Hadoop using SparkUnit test the data pipelinesWork... ...-edge engineering capabilities to build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network,...
Databricks
Local area
Deloitte
Indianapolis, IN
4 days ago
SAP AI Transformation - Consultant - SAP Data & Analytics
$82.6k - $162.8k
...where innovation, industry insight, and leading technology come together to solve... ...repeatable patterns for data acquisition, integration, transformation, modeling, reporting, and... ...analytics, SAP HANA Cloud modeling, SAP Databricks, Business Data Cloud Connect, SAP Smart...
Databricks
Local area
Deloitte
Indianapolis, IN
9 hours ago
Data Architect Sr. Manager
...active metadata, knowledge graphs, cataloging, and automated integration into a connected data layer that powers analytics and AI — and... ...and data product concepts, cloud data platforms (Snowflake, Databricks, Azure Synapse, BigQuery), and streaming/API architectures to...
Databricks
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Network and Voice - Senior Team Lead
...InfrastructureResponsibilities:The Network and Voice Senior Team Lead provides hands-on technical and operational leadership for... ...internet edge, cloud interconnect, and secure access service edge integration· Coordinate carrier and circuit delivery, inventory, performance...
Local area
Remote work
1 day per week
Corteva
Indianapolis, IN
4 days ago
Workforce Analytics Manager
$96.6k - $185k
...initiatives by designing cloud-native data pipelines leveraging Databricks and modern analytics platformsServe as a trusted technical... ...documentation, support procedures, and operational runbooksAct with integrity, professionalism, and personal responsibility to uphold KPMG's...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
4 days ago
Workday Certified Compensation/Benefits Lead
$73.8k - $218.8k
...services company, searching for a Workday Certified Compensation/Benefits Lead.This individual will be part of a team of advisory professionals focused on cloud-based data-reporting operations that integrate and optimize the essential corporate functions of finance, analytics...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Senior Lead Marketing Manager
$105.79k - $141.05k
...meaningful impact, and help shape the future of AI‑ready connectivity, join us today. The Role The Senior Lead Marketing Manager will shape scalable, integrated marketing programs that translate business priorities, sales goals, and pipeline needs into measurable...
Full time
Temporary work
Work from home
Lumen
Indianapolis, IN
21 hours ago
Workday Certified Financials Lead (FDM/R2R)
$73.8k - $218.8k
...From rapid deployments to entire transformations, you’ll deliver integrated, payroll, cloud-based HR and financial management solutions... ...the fast track to a better way to work.As a Workday Financials Lead - FDM/R2R your primary responsibilities may include:Manage teams...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Workday Certified Financials Adaptive Lead
...From rapid deployments to entire transformations, you’ll deliver integrated, payroll, cloud-based HR and financial management solutions... ...track to a better way to work. As a Workday Adaptive Insights Lead, your primary responsibilities may include: Identification of business...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Oracle Utilities CCS Billing Variance Triage Lead
...testing environments where every discrepancy has a deadline.The Work:Lead Tier 1 and Tier 2 billing variance analysis across bill... ...and technical teams across CCS billing, rate engine, MDM, and integration workstreams to resolve complex variance scenarios.Maintain and...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Oracle Batch Lead (OUAF, C2M/CC&B)
...batch processes to support billing, metering, data conversion, and integration workstreams.Build and maintain shell scripts and automation... ...recover batch jobs across environments.Collaborate with functional leads, architects, and offshore teams to translate business...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Oracle Record to Report Lead
...problems to help their companies do more. You’re as comfortable leading projects and teams as you are diving into the details of... ...solutions and ensure that all the pieces work together in an integrated environment; understand and apply Oracle methodologies.Plan and...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Oracle Utilities Onshore Report Strategy Lead
...Oracle Utilities data models and reporting architectures. You lead with strategy — designing frameworks that are sustainable and scalable... ...with Oracle Utilities functional leads, data architects, and integration teams to ensure reporting designs are grounded in accurate,...
Work experience placement
Live in
Work at office
Local area
Accenture
Carmel, IN
3 days ago
Lead Engineer I, Solution Architecture
...join our team.KPMG is currently seeking a Lead Engineer I, Data and Information... ...technologies and industry trendsAct with integrity, professionalism, and personal responsibility... ...platforms, including Fabric, Power BI, Azure Databricks, Azure Synapse, SQL Server, DocumentDB,...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
4 days ago
Manager, Data & AI Architecture
$127.2k - $246.9k
...our Clients and Markets organization.Responsibilities:Lead the architectural design, strategy, and hands-on... ...data pipelines and multi-tiered architectures using Databricks and Medallion Architecture, integrating Salesforce (Marketing Cloud, Sales Cloud, Data Cloud)...
Databricks
H1b
Local area
KPMG
Indianapolis, IN
21 hours ago
Director, Global CTI Lead
$198k - $368k
...join our team.KPMG is currently seeking a Director, Global CTI Lead to join our Global Digital team which is part of KPMG International... ..., government agencies, and key security partnersAct with integrity, professionalism, and personal responsibility to uphold KPMG's...
H1b
Local area
KPMG
Indianapolis, IN
4 days ago
Sr. AI Software Engineer
...software solutions. Proven track record leading the adoption of new technologies and... ...Microsoft Copilot, Claude, AWS Bedrock, Databricks, or similar AI technologies. Strong knowledge... ...capabilities.Build and maintain integrations with generative AI platforms, large language...
Databricks
Full time
Work at office
Remote work
Worldwide
Monday to Thursday
Rheem Manufacturing Company
Indianapolis, IN
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Integration Lead. Be the first to apply!