Data Engineer
$50 - $60 per hourDiverse Lynx
Data Engineer
Pay Rate $50 - $60 Location: Local to Cary NC Only! Duration: 6 months
Roles & Responsibilities:
- Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
- Develop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala
- Implement and support Data Lake / Lakehouse architectures
- Integrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.
- Expertise in handling Data migration using API's.
- Apply data quality checks and support data governance basics (metadata, lineage, access controls)
- Optimize Spark jobs for performance, reliability, and cost
- Collaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers
Required Skills & Experience:
- 8+ years of experience in data engineering in Azure using Azure Databricks.
- Strong experience with Azure Data Lake, Databricks, ADF, Postgres.
- Strong Data Engineering experience in Big Data (Cloudera)
- Hands-on expertise in SQL, Python and PySpark or Scala
- Proven experience with batch & real-time ingestion
- Experience with Kafka and big data processing
- Added good to have experience with:
- Informatica PowerCenter
- Informatica IDMC or equivalent cloud data integration tools
- SQL Server, Oracle, Azure SQL
- Cosmos DB
- Unix/Linux
- Maestro (or similar enterprise schedulers)
- Data tools such as Precisely or equivalent
Added Advantage:
- Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)
- Experience with Azure DevOps (AzDO) and GitHub-based CI/CD
- Practical usage of Copilot for data engineering and development productivity
- Exposure to Generative AI / GenAI use cases in data platforms and analytics
Role Descriptions: Microsoft Azure (ADB/ADF) Essential Skills: Microsoft Azure (ADB/ADF) Experience Required: 6-8 Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Cary, NC vacancy
$90k - $110k
...Description and Requirements The Team You Will JoinAt MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our... ...building the future of data - one that’s governed responsibly, engineered for scalability, and designed for growth. When you join us, you...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- ...celebrate that “Every one of us is different. Every one of us is Chiesi."Who we are looking forThis is what you will doThe Data Integration Engineer will play a crucial role in designing, developing, and maintaining scalable data pipelines and cloud data architecture...SuggestedWork at officeLocal area
$115k - $135k
...Description and Requirements The Team You Will JoinAt MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our... ...building the future of data - one that’s governed responsibly, engineered for scalability, and designed for growth. When you join us, you...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- ...Computer Science and at least 2 years of relevant experience. Responsibilities include designing and maintaining ETL pipelines, resolving data issues, and collaborating with analysts. The position allows telecommuting from anywhere in the US, with some travel required. #J-18...SuggestedRemote work
SunTechPros
Morrisville, NC5 days ago - ...Data EngineerCGI is seeking an experienced Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies, cloud platforms, and modern data engineering...SuggestedFull time
CGI
Cary, NC1 day ago - ...Q2 is hiring a Machine Learning Engineer to strengthen its Risk & Fraud team. You will build production ML systems that detect fraud at... ...for banks, credit unions, and fintechs. You will collaborate with data scientists and engineers to turn models into reliable, real-time...
Q2 India
Cary, NC8 hours ago $90k - $150k
...Data EngineerThe Data Engineer is responsible for designing, building, and maintaining the data pipelines and integrations that power GEI's AI solutions and digital initiatives. This role focuses on ensuring enterprise data is accessible, reliable, and governed so that...GEI Consultants
Cary, NC1 day ago- ...development and L2 production support. The candidate will be responsible for supporting, monitoring, troubleshooting, and enhancing data integration solutions using IICS. The role requires strong analytical, problem-solving, and communication skills to ensure smooth operation...
Yochana
Morrisville, NC3 days ago - ...Value Proposition The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...
- MetLife’s Global Technology team is seeking an Associate Database Engineer to design automated data workflows that improve performance data accessibility and reliability. You’ll contribute to a centralized data warehouse and reporting hub, integrating diverse data sources...Work at office
- MetLife in Cary, NC is seeking a Data Engineer II to build and validate data pipelines using Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, and Python. You’ll focus on validation activities and progressively contribute to pipeline development and operational support...
$70k - $90k
...to push boundaries and set new industry standards? Join us and help drive the future of technology forward. The Opportunity The Data Engineer (Entry-Level) supports the data and analytics lifecycle and contributes to building production-grade data and analytics...Temporary workInternshipWork at officeLocal areaWorldwide3 days per week- ...Fidelity Investments in Morrisville, NC is seeking an Electrical Shift Engineer to support a 7x24 data center engineering team. The role focuses on hands-on maintenance, coordinating with vendors, and maintaining critical power and cooling systems to prevent business impact...Shift work
Soteria Reinsurance Ltd.
Morrisville, NC3 days ago $77.8k - $172.4k
Sr. Data Engineer Position Description CGI is seeking an experienced Senior Data Engineer with a strong database development background to design, develop, and modernize enterprise data solutions. The ideal candidate will bring expertise in Oracle, ETL technologies...Full timeLocal areaCary, NC6 days ago- ...Summary: The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The engineer... ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...For contractorsWork at officeLocal area
ADEX
Cary, NC3 days ago - ...immigration sponsorship for this position. The Electrical Shift Engineer provides support for the multiple critical business environments... ...minimum of trade experience Universal EPA certification is required. Data Center Engineering and supervision experience desirable AAS in a...Full timeShift workAfternoon shift
Soteria Reinsurance Ltd.
Morrisville, NC4 days ago $115k - $135k
At MetLife, data isn’t just a tool - it is a catalyst for growth. As part of our Data & Analytics organization, you’ll unlock trusted... ...building the future of data - one that’s governed responsibly, engineered for scalability, and designed for growth. When you join us, you...Temporary workWork at officeLocal area3 days per week$115k - $130k
...providers to enable their employees to live their healthiest lives. Vida Health is seeking a Senior Analytics Engineer to serve as a high-impact, full-stack data partner. Positioned at the intersection of analytics engineering and data analysis, this role requires a...Local areaRemote workVisa sponsorshipWork visaGrabJobs
Cary, NC2 days ago$125k - $185k
Corporate Bank Technology - Cash Management Domain - Lead Data Engineer Job Title Corporate Bank Technology - Cash Management Domain - Lead Data Engineer Corporate Title Vice President Location Cary, N.C Who we are In short - an essential part of Deutsche Bank’s technology...Work at officeWork from homeShift work- MetLife's Global Technology team seeks an Entry-Level Data Engineer to support data lifecycles and build production-grade data solutions. You will work with Big Data technologies and be mentored by senior engineers, gaining exposure to Spark, Scala, Hive, HBase, Kafka,...Work at office
- ...69ePILRMCaJ-RyjemgeI=Job Code: ATS #57179Reference: 54156Location: Raleigh, NC, United StatesJob Title: Data EngineerLocation: Raleigh, NCJob Summary - Data Engineer:We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality...
$76.73k - $127.88k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...Local areaVisa sponsorship- Who You’ll Work WithAt Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their... ...organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...Temporary workLocal area
- Job TitleExperience with Azure: Data Factory, Synapse, Blob Storage, ADLS, Azure SQL, Logic AppsSolid knowledge of data processing languages, such as SQL, Python, or Scala.Data MigrationAzure DevOpsETL Experience with SSIS, Informatica
The Dignify Solutions, LLC
Cary, NC5 days ago $100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$47.5 - $50 per hour
...Lead Data EngineerMaxonic maintains a close and long-term relationship with our direct client. In support of their needs, we are looking for a Lead Data Engineer.Job Title: Lead Data EngineerJob Type: ContractJob Location: 6501 Six Forks Rd. Raleigh, NC 27615Work Schedule...Contract workWork at officeImmediate startRemote workMonday to FridayMaxonic
Raleigh, NC1 day ago- ...Senior Data EngineerJersey Hired is scouting for a heavy-hitting Senior Data Engineer to join a global consulting powerhouse. This isn't just about moving data from Point A to Point B, it's about architecting a fortress.We need a pro who can design, build, and operate...
Jersey Hired
Raleigh, NC1 day ago $128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$158.31k - $180k
...anywhere in the U.S.Architect and implement complex, high-volume data pipelines between Snowflake and Databricks utilizing PySpark... ...and cluster configurations for cross-functional data science and engineering teams.Design and deploy intelligent retrieval architecture and...Contract workWork experience placementWork at officeRemote workFlexible hours$109.7k - $164.5k
...customer-first mindset for bold business leaders. We deliver cloud, data and customer experience solutions. Our partnerships with leading... .... Ready to join us?We are seeking a highly skilled Sr. Data Engineer with strong expertise in Microsoft Fabric, Azure analytics ecosystem...Permanent employmentFull timeTemporary workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineer analytics Cary, NC
- senior cloud data engineer Cary, NC
- data center engineer Cary, NC
- data engineer Cary, NC
- sr information security engineer Cary, NC
- data developer Cary, NC
- etl data engineer Cary, NC
- senior data center engineer Cary, NC
- data engineer machine learning Cary, NC
- finance data engineer Cary, NC