Azure Data Engineer
Full-time
Programmers.io
Role Descriptions:
- Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
- Develop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala
- Implement and support Data Lake / Lakehouse architectures
- Integrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.
- Expertise in handling Data migration using API’s.
- Apply data quality checks and support data governance basics (metadata, lineage, access controls)
- Optimize Spark jobs for performance, reliability, and cost
- Collaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers
Required Skills & Experience:
- 8+ years of experience in data engineering in azure using Azure Databricks.
- Strong experience with Azure Data Lake, Databricks, ADF, Postgres.
- Strong Data Engineering experience in Big Data (Cloudera)
- Hands-on expertise in SQL, Python and PySpark or Scala
- Proven experience with batch & real-time ingestion
- Experience with Kafka and big data processing
Added good to have experience with:
- Informatica PowerCenter
- Informatica IDMC or equivalent cloud data integration tools
- SQL Server, Oracle, Azure SQL
- Cosmos DB
- Unix/Linux
- Maestro (or similar enterprise schedulers)
- Data tools such as Precisely or equivalent
Added Advantage
- Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)
- Experience with Azure DevOps (AzDO) and GitHub-based CI/CD
- Practical usage of Copilot for data engineering and development productivity
- Exposure to Generative AI / GenAI use cases in data platforms and analytics
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Cary, NC vacancy
- ...Azure Data EngineerWe are seeking a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing and building data pipelines, developing ETL/ELT solutions, and implementing data architectures using...SuggestedWork experience placement
Artech
Cary, NC2 days ago - ...Descriptions: \n \n \n Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka. \n Develop ETL/ELT solutions... ...& Experience: \n \n ~8+ years of experience in data engineering in azure using Azure Databricks. \n ~ Strong experience...Suggested
Programmers.io
Cary, NC8 days ago - ...Azure Data EngineerLocation: Raleigh, NC (5 Days Work From Office) Duration: 12+ Months Rate: DOEExpert level skills writing and optimizing complex SQLExperience with complex data modelling, ETL design, and using large databases in a business environmentExperience with...SuggestedWork at office
Georgia IT Inc
Raleigh, NC20 hours ago - ...Summary: The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The engineer will... ...package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...SuggestedFor contractorsWork at officeLocal area
ADEX
Cary, NC2 days ago - ...Sr. Data EngineerCGI is seeking an experienced Senior Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies, cloud platforms, and modern...SuggestedFull time
CGI
Cary, NC3 days ago - ...SQL Data EngineerThis is for BECU Business Intelligence Data Engineer. For the SQL Data Engineer role: experience with Snowflake, SQL Server migration, ADF, Power BI semantic models, Clienture DevOps/GitHub, Cortex, AIM, and Apache Iceberg. Must have skills: experience...
Resource Logistics
Cary, NC20 hours ago $95k - $154k
...demand typically includes roles such as entry-level software programmer, Java full stack developer, Python/Java developer, data analyst, data engineer, data scientist, and machine learning/AI engineer. In other words, SynergisticIT focuses on building candidates across...Full timeH1bRemote workNight shiftSynergisticIT
Cary, NC1 day ago- ...Palantir Data EngineerMandatory Skills: Data Engineer with experience on Palantir Palantir Data Engineer We are seeking a highly skilled Palantir Data Engineer... ....Cloud & Big Data Ecosystems: Familiarity with AWS, Azure, or GCP and Big Data tools (e.g., Spark, Hadoop)....
Omni Inclusive
Cary, NC20 hours ago - ...Role: Lead Data Engineer Location: Cary, NC (Onsite) Job Type: Fulltime About The Engagement: Client is building a centralized... ...Data Hub for a global insurance and financial services client on Azure Databricks. The platform ingests 150+ inbound data feeds,...Full timeContract workShift work
Zodiac Solutions, Inc
Cary, NC13 hours ago - ...Data EngineerCGI is seeking an experienced Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies, cloud platforms, and modern data engineering...Full time
CGI
Cary, NC20 hours ago - ...sponsorship for this position. The Role The Electrical Shift Engineer provides support for the multiple critical business environments... ...experience Universal EPA certification is required. Data Center Engineering and supervision experience desirable AAS...Full timeShift workAfternoon shift
Fidelity Investments
Morrisville, NC4 days ago $115k - $135k
At MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our Data &... ...data - one that’s governed responsibly, engineered for scalability, and designed for growth.... ...Big Data Platforms including Hadoop and Azure Cloud platforms, with rich experience in...Temporary workWork at officeLocal area3 days per week- ...embedding technical talent directly inside business functions. Data Engineers are the foundation builders in that model, making sure the... ...connect data assets into Microsoft AI and productivity platforms, Azure services, internal platforms, and workflow tools where...Local area
- Job Title: Lead Data Engineer Location: Cary, NC (On-site / Hybrid) Job Type: FTE only MUST-HAVE SKILLS & EXPERIENCE Programming... ...and pool management, performance tuning, Model Serving. Azure data stack — ADLS Gen2 (zone design, ACLs, lifecycle), Azure Data...Contract work
TechNeptune Consulting Inc
Cary, NC2 days ago $145k - $165k
...Job Description We're looking for a hands-on data engineer to own, maintain and expand the data infrastructure behind our Siding & Accessories... ...~ Experience with ETL tools or integration platforms (SSIS, Azure Data Factory, Boomi, Informatica, or similar). ~...Full timeCornerstone Building Brands
Cary, NC2 days ago- ...Azure Cloud Engineer (Azure App Services, IIS, Automation)- 100% Remote/Direct Hire Optomi, in partnership with an industry leader is looking... ..., etc. Monitoring the environment using tools such as Data Dog (configuration, reviewing dashboards, etc) Research of...Full timeRemote workShift workDay shift
Optomi
Cary, NC13 hours ago - ...architect, and implement scalable and reliable cloud solutions on the Azure platform, leveraging a variety of Azure services and... ...services, databases, storage account, virtual network, function app, data factory, key vault, service bus, event grid, databricks etc....
Omni Inclusive
Cary, NC2 days ago - ...Raleigh, NC Our client has an opening for Power BI and Data engineer (806590). This position is up to 12 months, with the option... ...optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 3 Years....
Focused HR Solutions
Cary, NCa month ago - ...6a1kMvyS65NP3cxK69ePILRMCaJ-RyjemgeI=Job Code: ATS #57179Location: Raleigh, NC, United StatesJob Title: Data EngineerLocation: Raleigh, NCJob Summary - Data Engineer:We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality...
InstantServe
Raleigh, NC1 day ago $128k - $249k
...impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the... ...implementation, and optimization of Lakehouse, Warehouse, and Azure AI Foundry data pipelines. Role involves mentoring staff, collaborating...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Raleigh, NC1 day ago- ...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...Full timeTemporary workRelocation
Infosys Technologies
Raleigh, NC20 hours ago $104.9k - $174.7k
...individual legal use case. The company employs over 2,000 technologists, data scientists, and experts to develop, test, and validate solutions... ...complex technical problems?We are seeking a Consulting Data Engineer to join our team in Raleigh, NC. This position provides...Full timeLocal areaWorldwideFlexible hoursRELX Group
Raleigh, NC20 hours ago$100.79k - $160.26k
...your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data... ...Data Platform & StorageDesign and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks,...Full timeWork at officeRemote workVisa sponsorshipDLA Piper
Raleigh, NC3 days ago$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI, and cloud products with clients who are ready... ...(COE) is focused on injecting intelligence into products, engineering systems that support learning and insight and creating innovative...Temporary workWork at officeLocal areaFlexible hoursSlalom
Raleigh, NC1 day ago- ...WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who... ...organizations.Our Data Architecture & Engineering team sees data as the foundation for... ...across Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks,...Temporary workWork at officeLocal area
Slalom
Raleigh, NC20 hours ago - ...The Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex business...Full timeTemporary workRelocation
Infosys
Raleigh, NC1 day ago $113k - $188.4k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs an Analytics and Insights Engineer III on the AI & Data team, you will be responsible for:Conduct research and...Local areaDeloitte
Raleigh, NC2 days ago- ...NetApp is seeking a hands-on, innovative Software Engineering Manager to lead globally distributed software engineering and data science teams responsible for AI-driven analytics, recommendation systems, intelligent insights, and customer success platforms. This leader...
- ...Data EngineerWe are seeking a Data Engineer to join our growing Data & Analytics team. This role is responsible for designing, developing, and maintaining... ...ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using Azure Data Factory, SQL Server, SSIS, and Python.Develop SQL...Full timeWork at officeFlexible hours
Kimley-Horn
Raleigh, NC3 days ago $74.1k - $148.3k
...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly expanding... ...digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader, driving...Temporary workLive inLocal areaWorldwideRelocationRelocation packageFlexible hoursOracle
Raleigh, NC4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Cary, NC
- finance data engineer Cary, NC
- data center engineer Cary, NC
- senior cloud data engineer Cary, NC
- data engineer Cary, NC
- data engineer analytics Cary, NC
- senior data center engineer Cary, NC
- data science developer Cary, NC
- data developer Cary, NC
- data engineering intern summer Cary, NC