Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Integration Lead - Databricks & AWS

Full-time

PineQ Lab Technology

We are seeking an experienced| hands-on Integration Lead to design| build| and deliver integrations that consume Master Data products published in Databricks and feed them into an enterprise commercial CRM platform| as part of a large-scale CRM modernization program.Master Data sources (customer| account| and product master) are exposed as governed data products in Databricks curated Delta tables registered in Unity Catalog. This role owns the consumption of those data products and their reliable| validated delivery into the target CRM and enterprise ecosystem| while re-platforming existing integrations onto modern| cloud-native patterns.This is a working| hands-on leadership role. The person leads the integration workstream and personally performs the coding| code review| and deployment work not oversight alone. Every skill listed is expected to be backed by direct| hands-on delivery experience.

Key Responsibilities

1. Hands-On Integration Delivery

• Personally perform coding, code review, and deployment activities, and any other assigned work related to this transformation – leading the team does not replace individual hands-on contribution.

• Must have hands-on experience across all required skills; the person is expected to build, not only direct others who build.

• Own the end-to-end integration lifecycle: design specification, build, unit testing, deployment across dev / sandbox / UAT / prod, runbooks, and knowledge transfer.

• Produce design specifications, deployment steps, and rollback approaches, and deliver them hands-on.

2. Databricks Data-Product Consumption & Integration

• Consume Databricks data products (Delta Lake tables via Unity Catalog) as the source of master data, respecting the data-product contract – schema, refresh cadence, quality guarantees, and access model

• Move master data from Databricks into the CRM using the appropriate pattern – Apache Iceberg interoperability, Spark / PySpark-based movement, or API-based delivery – selecting the right mechanism per integration by volume, latency, and directionality.

• Build transformation and mapping logic (PySpark / Spark SQL) to reconcile the data-product schema with the target CRM data model, including handling master-data change (deltas, data-change requests, reference data).

• Re-platform existing master-data integrations onto the Databricks-data-product and modern integration patterns, ensuring parity, reconciliation, and no data loss during transition.

• Implement observability, data-quality checks, error handling, data-gap detection, and reprocessing across the Databricks-to-CRM flows.

3. Client Engagement & Meetings

• Participate in and lead all relevant client meetings – design reviews, working sessions, governance forums, and status discussions – representing the integration workstream directly with the client.

• Communicate technical decisions, risks, and dependencies clearly to client stakeholders and delivery teams.

4 . Multi-Vendor (Dual-SI) Collaboration

• Collaborate with the second System Integrator (SI) partner responsible for independently testing and validating this team’s build.

• Review the second SI’s test findings, triage them, and resolve the defects – ensuring fast, clean cross-vendor root-cause and closure rather than back-and-forth.

• Maintain clean build-to-test handoffs and shared traceability so defects are resolved efficiently across vendors.

5. Patterns, Standards & Data Partnership

• Define reusable integration patterns and interface contracts for master-data flows that other build and assurance teams can work to.

• Partner with data-product owners and data-engineering teams to align on data-product schemas, versioning, refresh frequency, access, and change management.

• Ensure data integrity, security, privacy, and, where applicable, regulated-industry compliance across connected systems.

Must-Have Technical Skills

All of the following require direct, hands-on experience:

• Databricks – hands-on with Delta Lake, Unity Catalog, and consuming / publishing data products; lakehouse / medallion architecture.

• AI – hands-on experience applying AI in a data, integration, or software-development context.

• Data services on AWS – hands-on experience building data and transformation services / pipelines on AWS.

• API – hands-on REST API design, build, and implementation at scale.

• PySpark – strong, hands-on PySpark and Spark SQL for data movement and transformation.

• Master Data / MDM – hands-on experience integrating customer, account, and product master data into downstream systems, including schema mapping, reconciliation, and master-data change handling.

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Integration Lead - Databricks & AWS in Indianapolis, IN vacancy
  •  ...Role Overview We need a senior, hands-on Databricks Integration Lead to own the integration architecture for a large migration from Veeva CRM...  ...integration rationalization • DevOps for Databricks (Terraform, Azure DevOps, GitHub Actions); AWS, Azure, or GCP... 
    Amazon Web Service
    Databricks
    Shift work

    New York Technology Partners

    Indianapolis, IN
    16 days ago
  •  ...clients to differentiate and scale business growth.You Are:The Integration Lead Architect playing a pivotal role in ensuring that diverse...  ...experience with cloud architecture and integration patterns across AWS or Azure, including containerized and Kubernetes-based... 
    Amazon Web Service
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    22 hours ago
  •  ...Description: Job title : Lead Data Engineer Work Location...  ...Azure Data Factory (ADF), Azure Databricks, Power BI (Semantic Models, DAX...  .... Experience with API integrations, SQL, Python, and modern cloud...  ...Blob Storage Dataverse AWS (EC2, S3, Lambda) Power Automate... 
    Amazon Web Service
    Databricks
    Contract work
    Work at office
    Relocation
    2 days per week

    IMCS Group Inc

    Indianapolis, IN
    24 days ago
  • $58 per hour

     ...client is seeking a Data Architect to lead the design, development, and...  ...strategy, ensuring data quality and integrity, and building scalable solutions across...  ...cloud platforms including Azure , AWS , and Azure Databricks . Partner with engineering teams... 
    Amazon Web Service
    Databricks
    Contract work
    Local area

    Brooksource

    Indianapolis, IN
    22 days ago
  • $105.79k - $141.05k

     ...hiring a Consumption Pricing Monetization Lead with deep expertise in consumption-based pricing...  ...and cloud providers. You will be integral in building a repeatable process that maximizes...  ...strategy to mirror players like Azure, AWS, GCP, Snowflake and other consumption pricing... 
    Amazon Web Service
    Full time
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Lumen

    Indianapolis, IN
    2 days ago
  •  ...responsible for building, scaling, and leading a high-performing partner...  ...including Microsoft, Google Cloud, AWS, Salesforce, Anthropic, OpenAI, Databricks, and Snowflake. You are passionate...  ...partners such as resellers, integrators, and alliance partners. Collaborate... 
    Amazon Web Service
    Databricks
    Remote work
    Worldwide
    Flexible hours

    Marlabs Inc.

    Indianapolis, IN
    22 hours ago
  •  ...systems and analytics, tasked with leading the development and integration of extensive business intelligence...  ...big data technologies such as Spark, Databricks, and modern data warehousing...  ...familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.... 
    Amazon Web Service
    Databricks

    EXOS

    Indianapolis, IN
    2 days ago
  • $132.23k - $176.31k

     ...join us today. The Role The Senior Lead Marketing Data Platform Architect is...  ...implementation, and operational strategy of Databricks as the strategic platform for marketing...  ..., and business teams to ensure seamless integration across the marketing technology ecosystem... 
    Databricks
    Full time
    Temporary work

    Lumen

    Indianapolis, IN
    1 day ago
  •  ...opportunities! At Xenon7, we work with leading enterprise clients and...  ...production ML systems, model integration APIs, and scalable MLOps...  ...TorchServe, MLflow, Kubeflow, or Databricks ML runtime. Infrastructure...  ...cloud platform ecosystems (AWS/Azure). Monitoring & Integration... 
    Amazon Web Service
    Databricks
    Full time
    Contract work
    For contractors
    3 days per week

    Xenon7

    Indianapolis, IN
    4 days ago
  •  ...opportunities! At Xenon7, we work with leading enterprise clients and innovative...  ...Process Engineering & Manufacturing Integration Ingest, harmonize, and model operational...  ...using modern cloud platforms (Databricks, Snowflake, AWS/Azure), PySpark, and SQL. Ensure all... 
    Amazon Web Service
    Databricks
    Full time
    Contract work
    For contractors
    3 days per week

    Xenon7

    Indianapolis, IN
    4 days ago
  • $86.7k - $170.9k

     ...pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured...  ...use casesApply data architecture, integration, and data modeling practices to improve...  ...one cloud platform: Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform... 
    Amazon Web Service
    Databricks
    Local area

    Deloitte

    Indianapolis, IN
    2 days ago
  •  ...software solutions. Proven track record leading the adoption of new technologies and...  ...Copilot, Microsoft Copilot, Claude, AWS Bedrock, Databricks, or similar AI technologies. Strong...  ...automation capabilities.Build and maintain integrations with generative AI platforms, large... 
    Amazon Web Service
    Databricks
    Full time
    Work at office
    Remote work
    Worldwide
    Monday to Thursday

    Rheem Manufacturing Company

    Indianapolis, IN
    2 days ago
  •  ...Databricks Data Engineer Anywhere Type: Permanent Category: Development Industry...  ..., infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL...  ...data pipelines to ensure data quality, integrity, and availability. Research industry... 
    Amazon Web Service
    Databricks
    Hourly pay
    Permanent employment
    Full time
    Local area
    Remote work

    Eliassen Group

    Indianapolis, IN
    2 days ago
  • $85k - $125k

     ...our core values: Accountability, Balance, Collaboration, Focus, Integrity, Social Responsibility, Support and Transparency.Moser Consulting...  ...leadership alongside two existing engineers to build out AWS-based data pipelines that support genomic data science models —... 
    Amazon Web Service
    Databricks
    Full time
    Work at office
    Local area
    Flexible hours

    Moser Consulting

    Indianapolis, IN
    4 days ago
  •  ...systems and analytics, tasked with leading the development and integration of extensive business intelligence...  ...Preferred: At least 1 year experience in Databricks Required: Bachelor's degree in...  ...familiarity with cloud platforms, such as AWS, Azure, or Google Cloud. Experience... 
    Amazon Web Service
    Databricks
    Work at office

    Indiana University Health

    Indianapolis, IN
    1 day ago
  • $45.45 - $49.24 per hour

     ...Rate Range: $ 45.45 - 49.24/hr. Test Lead Job Description:  The Test Lead is responsible...  ...efforts across functional, regression, integration, performance, and security testing ·...  ...testing cloud-based applications (AWS, Azure, GCP) and microservices Key Competencies... 
    Amazon Web Service

    Varite, Inc

    Indianapolis, IN
    24 days ago
  •  ...Most important, demonstrate a high level of integrity and dependability with a strong sense of...  ...is set, this role prioritizes and leads those efforts. They also create architecture...  ...- Proficiency in cloud platforms (e.g., AWS, Azure, GCP) and hybrid architectures· Integration... 
    Amazon Web Service
    Full time

    CliftonLarsonAllen

    Indianapolis, IN
    22 hours ago
  • $105.4k - $207.8k

     ...requirements into architecture, integration, and production controls. You...  ...guide junior practitioners, lead demonstrations, and help...  ...with data security patterns in AWS, Azure, or Google Cloud.Implementing...  ..., Vertex AI Vector Search, Databricks, or SnowflakeData security... 
    Amazon Web Service
    Databricks
    Local area
    Visa sponsorship

    Deloitte

    Indianapolis, IN
    3 days ago
  • $99k - $232k

     ...questions. As a Manager, you will lead client workstreams with...  ...reinforce professional standards, integrity, and PwC's values in your...  ...a Certification in databases (Databricks, MS SQL), visualization tools (Power BI), cloud platforms (AWS, Azure, GCP), or predictive modeling... 
    Amazon Web Service
    Databricks
    H1b

    PwC

    Indianapolis, IN
    1 day ago
  • We Are:Accenture helps the world's leading enterprises reinvent by building...  ...SuccessFactors solutions, including integrations with other systemsDevelop and...  ...platforms like Microsoft Fabric, AWS, Google Cloud, Snowflake, Databricks etc.You have experience with SAP BDC... 
    Amazon Web Service
    Databricks
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  •  ...addressing issues during setup and integration, and support in developing...  ...Skill and Experience• Lead the configuration, administration...  ...OneTrust, Collibra, Ataccama, Databricks Unity Catalog, or similar...  ...platforms• Familiarity with Azure, AWS, and Google Cloud Platform (... 
    Amazon Web Service
    Databricks
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Indianapolis, IN
    3 days ago
  • $134.5k - $265.1k

     ...Cyber for AI team, you will lead client engagements that secure...  ...security controls in either AWS, Azure, and/or Google Cloud with...  ...and identity-aware retrieval.Integrating classification, catalog,...  ...Google Vertex AI RAG Engine, or Databricks AI capabilities.Enterprise data... 
    Amazon Web Service
    Databricks
    Local area
    Visa sponsorship

    Deloitte

    Indianapolis, IN
    3 days ago
  • $134.5k - $265.1k

     ...capabilities to build, deploy, and operate integrated/verticalized sector solutions in software...  ...results-oriented professional to help lead our Life Sciences Commercial Operations practice...  ..., including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform... 
    Amazon Web Service
    Local area
    Visa sponsorship

    Deloitte

    Indianapolis, IN
    3 days ago
  • $141.2k - $278.3k

     ...ends on 12/31/2026. Work you’ll do The Lead Architect owns the technical vision for IntelligentOps...  ...selection, build versus buy, and integration approach, and communicate tradeoffs...  ...experience architecting cloud-native systems on AWS, Azure, or Google Cloud, including... 
    Amazon Web Service
    Work experience placement
    Local area

    Deloitte

    Indianapolis, IN
    14 hours ago
  • $91.1k - $179.5k

     ...quality controls, and monitoring. Lead the design, development, and...  ..., including proficiency in Databricks or Snowflake.Ability to...  ...Human Capital platforms and integrations (e.g., Workday, SAP SuccessFactors...  ...more of Amazon Web Services (AWS), Microsoft Azure, or Google... 
    Amazon Web Service
    Databricks
    Local area

    Deloitte

    Indianapolis, IN
    22 hours ago
  •  ...points if you have: Experience in large-scale data integration and data warehouse solutions, Databricks or Snowflake.Ability to lead and effectively facilitate design sessions...  ...and data design informationCloud (e.g. AWS) data path certificationsBusiness acumen and domain... 
    Amazon Web Service
    Databricks
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  • $125.3k - $196.79k

     ...Solution Design & Architecture: Lead the design and evolution of...  ..., ensuring effective integration across SAP BRIM, Salesforce,...  ...Platform (GCP) ; experience with AWS or Azure is also valuable. Deep...  ...platforms (e.g., BigQuery , Databricks, Tableau, Looker, AI Solutions... 
    Amazon Web Service
    Databricks
    Full time
    Temporary work
    Work experience placement
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Indianapolis, IN
    1 day ago
  •  ...typically cross service-group. Lead early-stage positioning with...  ...industry-leading Snowflake or Databricks transformation strategies and...  ...mobilize the Ecosystem partners ( AWS , MS , SAP etc ) for driving...  ...abilities.Unquestionable professional integrity, credibility and character.... 
    Amazon Web Service
    Databricks
    Contract work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    4 days ago
  •  ...assigned Job Role of Domain Project Lead 1, your Area Of Responsibility...  ...with Microsoft Azure Databricks• Experience with platform automation...  ...& DR environments.• Integrate Azure Databricks with Microsoft...  ...on cloud platforms like Azure, AWS, or GCP.• Skillset of integrating... 
    Amazon Web Service
    Databricks
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Indianapolis, IN
    3 days ago
  •  ...intelligent customer experiences.We integrate commerce platforms, customer...  ...effective agent reasoning.Lead data preparation, integration,...  ...architectures).Cloud & DeploymentLeverage AWS, Azure, or GCP for scalable AI...  ...CD-based environments.Utilize Databricks for large-scale modeling... 
    Amazon Web Service
    Databricks
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Integration Lead - Databricks & AWS. Be the first to apply!