Azure Data Engineer
programmers.io
Role Descriptions:
- Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
- Develop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala
- Implement and support Data Lake / Lakehouse architectures
- Integrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.
- Expertise in handling Data migration using API’s.
- Apply data quality checks and support data governance basics (metadata, lineage, access controls)
- Optimize Spark jobs for performance, reliability, and cost
- Collaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers
Required Skills & Experience:
- 8+ years of experience in data engineering in azure using Azure Databricks.
- Strong experience with Azure Data Lake, Databricks, ADF, Postgres.
- Strong Data Engineering experience in Big Data (Cloudera)
- Hands-on expertise in SQL, Python and PySpark or Scala
- Proven experience with batch & real-time ingestion
- Experience with Kafka and big data processing
Added good to have experience with:
- Informatica PowerCenter
- Informatica IDMC or equivalent cloud data integration tools
- SQL Server, Oracle, Azure SQL
- Cosmos DB
- Unix/Linux
- Maestro (or similar enterprise schedulers)
- Data tools such as Precisely or equivalent
Added Advantage
- Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)
- Experience with Azure DevOps (AzDO) and GitHub-based CI/CD
- Practical usage of Copilot for data engineering and development productivity
- Exposure to Generative AI / GenAI use cases in data platforms and analytics
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Cary, NC vacancy
- ...Azure Data EngineerWe are seeking a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing and building data pipelines, developing ETL/ELT solutions, and implementing data architectures using...SuggestedWork experience placement
Artech
Cary, NC2 days ago - Job Title Experience with Azure: Data Factory, Synapse, Blob Storage, ADLS, Azure SQL, Logic Apps Solid knowledge of data processing languages, such as SQL, Python, or Scala. Data Migration Azure DevOps ETL Experience with SSIS, Informatica The Dignify Solutions, LLCSuggested
- ...Azure Data EngineerLocation: Raleigh, NC (5 Days Work From Office) Duration: 12+ Months Rate: DOEExpert level skills writing and optimizing complex SQLExperience with complex data modelling, ETL design, and using large databases in a business environmentExperience with...SuggestedWork at office
Georgia IT Inc
Raleigh, NC5 days ago - ...Summary: The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The engineer will... ...package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...SuggestedFor contractorsWork at officeLocal area
ADEX
Cary, NC2 days ago - ...Sr. Data EngineerCGI is seeking an experienced Senior Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies, cloud platforms, and modern...SuggestedFull time
CGI
Cary, NC3 days ago - ...SQL Data EngineerThis is for BECU Business Intelligence Data Engineer. For the SQL Data Engineer role: experience with Snowflake, SQL Server migration, ADF, Power BI semantic models, Clienture DevOps/GitHub, Cortex, AIM, and Apache Iceberg. Must have skills: experience...
Resource Logistics
Cary, NC5 days ago - ...Data EngineerCGI is seeking an experienced Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies, cloud platforms, and modern data engineering...Full time
CGI
Cary, NC5 days ago - ...Palantir Data EngineerMandatory Skills: Data Engineer with experience on Palantir Palantir Data Engineer We are seeking a highly skilled Palantir Data Engineer... ....Cloud & Big Data Ecosystems: Familiarity with AWS, Azure, or GCP and Big Data tools (e.g., Spark, Hadoop)....
Omni Inclusive
Cary, NC5 days ago - ...sponsorship for this position. The Role The Electrical Shift Engineer provides support for the multiple critical business environments... ...experience Universal EPA certification is required. Data Center Engineering and supervision experience desirable AAS...Full timeShift workAfternoon shift
Fidelity Investments
Morrisville, NC4 days ago - ...embedding technical talent directly inside business functions. Data Engineers are the foundation builders in that model, making sure the... ...connect data assets into Microsoft AI and productivity platforms, Azure services, internal platforms, and workflow tools where...Local area
$90k - $150k
Description Your role at GEI. The Data Engineer is responsible for designing, building, and maintaining the data pipelines and integrations... ...with PySpark or Spark is strongly preferred. Experience with Azure data services, including Azure Data Factory, Azure Synapse...Work at officeFlexible hours$90k - $110k
...Requirements The Team You Will Join At MetLife, data isn’t just a tool - it is a catalyst for... ...data - one that’s governed responsibly, engineered for scalability, and designed for growth.... ..., and support data pipelines using Azure Data Factory, Databricks, PySpark, Spark...Temporary workWork at officeLocal area3 days per week$115k - $135k
At MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our Data &... ...data - one that’s governed responsibly, engineered for scalability, and designed for growth.... ...Big Data Platforms including Hadoop and Azure Cloud platforms, with rich experience in...Temporary workWork at officeLocal area3 days per week- Job Title: Lead Data Engineer Location: Cary, NC (On-site / Hybrid) Job Type: FTE only MUST-HAVE SKILLS & EXPERIENCE Programming... ...and pool management, performance tuning, Model Serving. Azure data stack — ADLS Gen2 (zone design, ACLs, lifecycle), Azure Data...Contract work
TechNeptune Consulting Inc
Cary, NC2 days ago $145k - $165k
...at . Job Description We're looking for a hands-on data engineer to own, maintain and expand the data infrastructure behind our... ...~ Experience with ETL tools or integration platforms (SSIS, Azure Data Factory, Boomi, Informatica, or similar). ~ Experience...Full timeWork at officeCornerstone Building Brands
Cary, NC13 days ago- ...Raleigh, NC Our client has an opening for Power BI and Data engineer (806590). This position is up to 12 months, with the option... ...optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 3 Years....
Focused HR Solutions
Cary, NCa month ago $128k - $249k
...impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the... ...implementation, and optimization of Lakehouse, Warehouse, and Azure AI Foundry data pipelines. Role involves mentoring staff, collaborating...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Research Triangle Park, NC1 day ago- ...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...Full timeTemporary workRelocation
Infosys Technologies
Raleigh, NC4 days ago - ...6a1kMvyS65NP3cxK69ePILRMCaJ-RyjemgeI=Job Code: ATS #57179Location: Raleigh, NC, United StatesJob Title: Data EngineerLocation: Raleigh, NCJob Summary - Data Engineer:We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality...
InstantServe
Raleigh, NC1 day ago $100.79k - $160.26k
...your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data... ...Data Platform & StorageDesign and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks,...Full timeWork at officeRemote workVisa sponsorshipDLA Piper
Raleigh, NC3 days ago$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI, and cloud products with clients who are ready... ...(COE) is focused on injecting intelligence into products, engineering systems that support learning and insight and creating innovative...Temporary workWork at officeLocal areaFlexible hoursSlalom
Raleigh, NC1 day ago$104.9k - $174.7k
...individual legal use case. The company employs over 2,000 technologists, data scientists, and experts to develop, test, and validate solutions... ...complex technical problems?We are seeking a Consulting Data Engineer to join our team in Raleigh, NC. This position provides...Full timeLocal areaWorldwideFlexible hoursRELX Group
Raleigh, NC5 days ago- ...WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who... ...organizations.Our Data Architecture & Engineering team sees data as the foundation for... ...across Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks,...Temporary workWork at officeLocal area
Slalom
Raleigh, NC5 days ago $113k - $188.4k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs an Analytics and Insights Engineer III on the AI & Data team, you will be responsible for:Conduct research and...Local areaDeloitte
Raleigh, NC2 days ago- ...NetApp is seeking a hands-on, innovative Software Engineering Manager to lead globally distributed software engineering and data science teams responsible for AI-driven analytics, recommendation systems, intelligent insights, and customer success platforms. This leader...
$74.1k - $148.3k
...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly expanding... ...digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader, driving...Temporary workLive inLocal areaWorldwideRelocationRelocation packageFlexible hoursOracle Defunct
Raleigh, NC2 days ago$95k - $125k
...future of technology forward.The OpportunityThe Senior Engineer - Infrastructure Operations, Data Security is responsible for engineering, automating, and... ..., databases, and cloud environments such as Microsoft Azure and IBM Cloud, applying working knowledge of data security...Full timeTemporary workWork at officeLocal areaWorldwideRelocation package3 days per weekMetropolitan Life Insurance Company
Cary, NC2 days ago$91.1k - $179.5k
...digital products and innovation, marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy, technology, creativity, and ongoing managed services...Local areaDeloitte
Raleigh, NC1 day ago- ...Data EngineerWe are seeking a Data Engineer to join our growing Data & Analytics team. This role is responsible for designing, developing, and maintaining... ...ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using Azure Data Factory, SQL Server, SSIS, and Python.Develop SQL...Full timeWork at officeFlexible hours
Kimley-Horn
Raleigh, NC3 days ago - ...Data EngineerThis position is not eligible for visa sponsorship. Applicants must be authorized to work in the United States without the need for current or future sponsorship.The Data Engineer supports the NSF-funded Programmable Cloud Lab Center's research mission by...Work at office
North Carolina State University
Raleigh, NC3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Cary, NC
- finance data engineer Cary, NC
- data center engineer Cary, NC
- senior cloud data engineer Cary, NC
- data engineer Cary, NC
- data engineer analytics Cary, NC
- senior data center engineer Cary, NC
- data science developer Cary, NC
- data developer Cary, NC
- data engineering intern summer Cary, NC