Lead Data Engineer: AI-Driven Lakehouse on Azure
Jobleads-US
Cephas Consultancy Services Private Limited in Cary, NC seeks a senior Lead Data Engineer to own end-to-end data and AI layer design on Azure Databricks. You will ship production-grade Python, Scala, and PySpark code weekly and lead data platform initiatives across ingestion, governance, and semantic layers.
The role requires extensive hands-on experience with Delta Lake, Unity Catalog, and Azure data tools, plus leadership of engineering teams in a fast-paced environment.
#J-18808-Ljbffr Jobleads-USVacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: AI-Driven Lakehouse on Azure in Cary, NC vacancy
- ...Brickstech seeks a true hands-on Lead Data Engineer to own the end-to-end data and AI architecture for an enterprise lakehouse on Azure Databricks. You will guide design, review production code, optimize Spark workloads, and establish engineering guardrails. The role...Suggested
- ...URGENT HIRING ROLE: Lead Data Engineer – Hands-On Client:... ...building a centralized, AI-first enterprise Data... ...organization using Azure Databricks . The platform... ...enterprise-scale Lakehouse architecture.... ...components. Metadata-Driven Ingestion Design parameterized...SuggestedFull time
NAZZTEC
Cary, NC1 day ago - ...Programming & Data Engineering Expert - level proficiency... ...tuning, Model Serving. Azure data stack — ADLS Gen2... .../ metadata-driven frameworks, error handling... ...Azure Event Hubs. AI & Machine Learning ~... ...delivery of a medallion/lakehouse architecture at enterprise...SuggestedFull timeContract work
Reuben Cooley Inc.
Cary, NC2 days ago - ...Position : Lead Data Engineer (Hands-On) Location : Cary, NC (... ...Own the end-to-end lakehouse architecture: Bronze /... ...Design and build metadata-driven, parameterized ingestion... ...and ADF pipelines in Azure DevOps using... ...Structured Streaming. AI-Augmented Ingestion &...SuggestedFull timeContract workShift work
Smart IT Frame LLC
Cary, NC14 hours ago - ...of a centralized, AI-first enterprise Data Hub for a global insurance... ..., built on Azure Databricks . The... ...leadership role . The Lead Data Engineer will own the end-to-... ...Own the enterprise lakehouse architecture, including... ...Build metadata-driven and parameterized ingestion...SuggestedFull time
- ...Lead Data Engineer (Hands-On) Cephas Consultancy Services Private... ...A centralized, AI-first enterprise Data... ...financial services client on Azure Databricks. The... ...architecture and engineering: lakehouse architecture (Bronze /... ...). Metadata-driven, parameterized ingestion...Full timeShift work
- ...Build a centralized, AI-first enterprise data hub for a global insurance... ...services client on Azure Databricks. The... ...implementations for the engineering team, and ship production... ...and engineering: Lakehouse architecture (Bronze... ...Ingestion: Metadata-driven, parameterized frameworks...Full timeShift work
Cephas Consultancy Services Private Limited
Cary, NC3 days ago - ...build batch and streaming data pipelines using Azure, Databricks, and Kafka.... ...Implement and support Data Lake / Lakehouse architectures Integrate... ...of experience in data engineering in azure using Azure Databricks... ...Exposure to Generative AI / GenAI use cases in data platforms...Full time
Programmers.io
Cary, NC4 days ago - ...build batch and streaming data pipelines using Azure, Databricks, and Kafka. \n... ...Implement and support Data Lake / Lakehouse architectures \n... ...years of experience in data engineering in azure using Azure Databricks... ...Exposure to Generative AI / GenAI use cases in data platforms...
Programmers.io
Cary, NC11 days ago - ...ABOUT THE ENGAGEMENT A centralized, AI-first enterprise Data Hub for a global insurance and financial services client on Azure Databricks. The platform ingests 150 inbound... ...build reference implementations for the engineering team, and ship production-grade Python, Scala...
Innovative Information Technologies....
Cary, NC1 day ago $128.94k - $168k
...Lead Data EngineerThis is a remote role that may be hired... ...experienced Lead Data Engineer to join our Data Platform... ...growing Cloud Data and AI Platform organization,... ...streaming and event-driven architectures.Partner with... ...platforms such as AWS, Azure, or GCP.Advanced...Remote workFirst Citizens Bank
Raleigh, NC1 day ago$103k - $143k
...Responsibilities: Own the end-to-end technical design of the data and AI layers Build reference implementations for the engineering team Deliver production-grade code each week Technologies: AI Azure Databricks Python Scala Cloud Embedded...Full timeInnovative Information Technologies Inc
Cary, NC2 days ago$128k - $249k
...and impactful work lead to the same place.We... ...are seeking a Senior Data Engineer to join the firm. The... ..., Data, and AI Platforms group, designing... ...and optimization of Lakehouse, Warehouse, and Azure AI Foundry data pipelines... ...real-time, event-driven architecture using...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Research Triangle Park, NC4 days ago- ...Azure Data EngineerWe are seeking a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing and... ...or Scala.Implement and support Data Lake / Lakehouse architectures.Integrate data from legacy and...Work experience placement
Artech
Cary, NC20 hours ago - ...re looking for a Senior Data Scientist to implement... ...BigQuery, Dataflow, Dataproc, AI Platform). Experience... ...cloud platforms (AWS, Azure) considered.... ...systems, and other data-driven solutions. Communication... ...including product management, engineering, and business...Contract work
hackajob
Cary, NC2 days ago - ..., Arizona & Texas. We are seeking a Lead Data Engineer with deep, hands-on experience designing... ..., and freshness. Enable CI/CD-driven transformation deployments. Snowflake... ...Glue, DynamoDB, and IAM, or equivalent Azure services. Collaborate on CI/CD, infrastructure...Remote work
- ...consulting company that leads with outcomes to bring... ...custom software, data, AI, and cloud solutions with... ...Our Data Architecture & Engineering team sees data as the... ...(AWS), Microsoft Azure, Google Cloud Platform... ...distributed processing, lakehouse architectures, streaming...Temporary workWork at officeLocal area
Slalom
Raleigh, NC3 days ago - ...Azure Data EngineerLocation: Raleigh, NC (5 Days Work From Office) Duration: 12+ Months Rate: DOEExpert level skills writing and optimizing... ...Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making....Work at office
Georgia IT Inc
Raleigh, NC3 days ago $95k - $125k
...and delivery, leveraging AI, automation, and contemporary... ...The OpportunityThe Senior Engineer - Infrastructure Operations, Data Security is responsible... ...environments such as Microsoft Azure and IBM Cloud, applying... ..., is one of the world’s leading financial services companies...Full timeTemporary workWork at officeLocal areaWorldwideRelocation package3 days per weekMetropolitan Life Insurance Company
Cary, NC1 day ago- Job TitleExperience with Azure: Data Factory, Synapse, Blob Storage, ADLS, Azure SQL, Logic AppsSolid knowledge of data processing languages, such as SQL, Python, or Scala.Data MigrationAzure DevOpsETL Experience with SSIS, Informatica
The Dignify Solutions, LLC
Cary, NC2 days ago $128k - $252.5k
...are hiring a Senior Data Scientist to... ...tools, products, and AI services. You will... ...interdisciplinary data scientists, engineers, architects, and... ...production Lead client initiatives... ...commitment to data-driven decision making... ...environments (AWS, Azure, or GCP) to deploy...Visa sponsorshipDeloitte France
Raleigh, NC2 days ago- ...Transflo is a leading provider of mobile, telematics... ...cutting-edge SaaS and AI solutions that enable... ...Transflo is seeking a Senior Data Engineer to architect and own... ...evolution, and SLA-driven pipeline design... ...formats (Parquet, ORC) and lakehouse patterns using Amazon...Remote work
Transflo
Raleigh, NC2 hours ago $134k - $203k
...Senior Data EngineerSenior data engineers at Thoughtworks are engineers who build... ...experience with data-driven approaches and can... ...cloud platforms (AWS, Azure or GCP) and Machine Learning/AI/Gen AI/LLM.Professional... ...revolutionizing tech. As a leading technology consultancy...For contractorsThoughtWorks
Raleigh, NC2 hours ago- Position Summary Join our AI & Engineering team in transforming technology platforms, driving... ...sector solutions in software, data, AI, network, and hybrid cloud infrastructure... ...unique requirements. Work you’ll do As a Lead Data Engineer II on the AI & Data team,...Visa sponsorship
Deloitte
Raleigh, NC12 hours ago $147.9k - $220k
...with cross‑functional engineering teams to model, measure... ...analytical and creative, and driven to deliver measurable... .... Apply AI-assisted performance engineering... ...in operating systems, data structures, and standard... ...Cloud, AWS, and Microsoft Azure, we empower customers...Work at officeLocal area- ...are seeking a Senior Data Scientist to lead the vision, strategy,... ...of advanced AI and machine learning... ...product strategy, and engineering, driving innovations... ...opportunities for AI-driven differentiation, and... ...platforms such as AWS, Azure, or Google Cloud....Full time
Robert Half
Raleigh, NC2 days ago - ...winning games or crafting engine technology that enables... ....ANALYTICSWhat We DoOur Data & Analytics teams build... ...analytics team to enhance data-driven decision-making across... ...and leveraging AI workflowsExperience with... ...ABOUT USEpic Games is a leading interactive entertainment...
Epic Games
Cary, NC4 days ago - ...mission.Why Join Q2?Q2 is a leading provider of digital... .... As a Senior Data Scientist on the team,... ...where data science and AI can create highest business... ...Typical Day:Explore and engineer features from large, complex... ...(AWS, GCP, or Azure)Experience with BI tooling...Full timeBank staffWork visa
Q2 Software
Cary, NC1 day ago $86.49k - $148.26k
...1Company: Siemens Data Scientist Job ID... ...connected insights, AI-powered technology,... ...product managers, engineers, domain experts, and... ...and compare model-driven approaches against... ...data platform such as Azure, AWS, GCP,... ...junior practitioners or leading a defined technical...Permanent employmentFull timeLocal areaRemote workSiemens
Raleigh, NC12 hours ago- ...We are looking for motivated & self-driven data engineers to join our expanding Scientific Data Foundation... ...such YAML Understanding of AI/ML, data science concepts & cloud architecture... ...in cloud computing platforms like AWS, Azure, and Google Cloud Platform (GCP) for...Flexible hours
Zifo
Raleigh, NCa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: AI-Driven Lakehouse on Azure. Be the first to apply!
