Data Engineer

Euclid Innovations

Role: Cloud Data Engineer
Location: Charlotte, NC
Duration: 12+ Months

Job Description:
This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in DataBricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

5+ years Python coding experience.
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Experience with Cloud based data architectures, messaging, and analytics.
Cloud certification(s).
Any experience with Airflow is a Plus.

Education

Minimally a BA degree within an engineering and/or computer science discipline
Master's degree strongly preferred

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Charlotte, NC vacancy

Lead Data Engineer (Hybrid)
$130k - $176k
...sponsor or assume the sponsorship of an employment visa at this time.” Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the Claims team within the Information Management group. This group...
Suggested
Work experience placement
Selective Insurance Company of America
Charlotte, NC
5 days ago
Lead Data Engineer
$130k - $145k
...Lead Data Engineer Large Healthcare organization is seeking a lead Data Engineer to join their expanding team. This is a direct hire position in Charlotte NC with a salary range of $130,000 – 145,000 based on experience with excellent benefits. This is a full onsite...
Suggested
PCR Staffing
Charlotte, NC
4 days ago
Lead Data Engineer
...Job Title: Lead Data Engineer Location: Charlotte, NC 28202 (Onsite) Duration: 12 Months Interview Process (Is face to face required): Yes (2nd round) Job Details: Must Have Skills Strong experience in AWS services ( hands-on experience) Data engineering...
Suggested
eTeam
Charlotte, NC
3 days ago
Lead Data Engineer
...Lead Data Engineer Charlotte, NC (Hybrid) 6-month contract to hire Requirements: Looking for 8+ years of experience Building pods (about 4-5 different pods in org.) all reporting to Pradeep. This person will support one project at first...
Suggested
Contract work
My3Tech Inc
Charlotte, NC
13 hours ago
Machine Learning / Data Science Engineer
...government agencies, a list that spans across the country. Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine...
Suggested
Full time
Visa sponsorship
Work visa
Captech Consulting
Charlotte, NC
1 day ago
Data Engineer
$100k - $115k
...At Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their digital transformation... ...organizations that drive true change. Our Data Architecture & Engineering team sees data as the foundation for decision-making,...
Temporary work
Local area
Slalom
Charlotte, NC
3 days ago
Data Engineer
$69.5 - $76.16 per hour
...Data Engineer Charlotte, North Carolina Hybrid Contract $69.5/hr - $76.16/hr Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Data Pipeline Engineer in Charlotte, NC or Irving, TX (Hybrid). Work with the...
Long term contract
Full time
Contract work
Temporary work
Flexible hours
Motion Recruitment
Charlotte, NC
4 days ago
Data Engineer II
$108.8k - $136k
...Denver, CO and Charlotte, NC area) Position Summary Join our mission to transform pharmacy benefits and healthcare navigation as a Data Engineer II (Analytics Engineer). You will build and maintain reliable data models within Snowflake with dbt, and improve data quality...
Local area
Capital Rx
Charlotte, NC
5 days ago
Data Engineer - GCP
...Description Key Responsibilities Design and build scalable ETL/data pipelines using Spark and Python Develop data workflows to... ...large-scale data processing Proficiency in Python for data engineering (ETL pipelines) Experience designing and developing data...
Euclid
Charlotte, NC
3 days ago
Data Engineer
...Overview: We are seeking a highly skilled Data Engineer to join a dynamic team in the Charlotte, NC area. This role focuses on the collection, modeling, storage, processing, and evaluation of large-scale data sets that are rapidly changing and complex. The goal is...
Work experience placement
True North Consultants
Charlotte, NC
15 hours ago
Data Engineer
...Position: Data Engineer Location: Charlotte, NC or Denver, CO ~4x/week onsite Contract Length: 12+ months Top Requirements: # Python # Prefect # AWS # Athena # Terraform # JavaScript Plusses # FinOps background # Redshift...
Contract work
Local area
My3Tech Inc
Charlotte, NC
2 days ago
Data Engineer
$65 per hour
...Data Engineer Rate:$65.00 Location: Durham, NC client:Fidelity Investments - Raleigh Durham The client, Fidelity, is initiating a migration project to enhance and update their current reporting infrastructure, aiming to move away from the existing ecosystem of Oracle...
Argyle Infotech
Belmont, NC
4 days ago
Data Engineer
...Data Engineer Our client, a leading financial services organization, is seeking a Data Engineer to join their team. As a Data Engineer, you will be part of the Data Strategy team supporting the development of a strategic data platform. The ideal candidate will demonstrate...
Experis
Charlotte, NC
2 days ago
MDM Data Engineer
$60 per hour
...MDM Data Engineer Location: Remote, working EST hours Duration: 6-12-month contract-to-hire Pay: $60+/hour JOB DESCRIPTION Our global Fortune 500 client, with U.S. headquarters in Charlotte, NC, is a world class food service provider with a strong...
Contract work
Remote work
Flexible hours
CRG
Charlotte, NC
15 hours ago
Data Engineer
...Advice and Wealth Management through cutting-edge technology and data science. As part of our team, you'll: Design, validate, and... ...financial advice and portfolio management. Collaborate closely with engineers and cross-functional teams to improve LLM prompting, accuracy,...
Insight Global
Charlotte, NC
4 days ago
Data Engineer II
$93.69k - $114.51k
...support, balance, and resources to make a positive impact on the future - including your own. Pacific Life is actively seeking a Data Engineer II to join our Customer Data team onsite in Charlotte, North Carolina. As a Data Engineer II, you will contribute to...
Flexible hours
Pacific Life
Charlotte, NC
3 days ago
Data Engineer
## Data EngineerApplyremote type: On-sitelocations: LC11013 - 13024 Ballantyne Corporate Place, Charlotte, NC: LC10530 - 2160 Superior... ...program, and a wellness program.**Position Overview:**The Data Engineer works with the Data Platform team to design, build, and maintain...
Temporary work
CrossCountry Mortgage
Charlotte, NC
5 days ago
Data Engineer
...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise...
Euclid
Charlotte, NC
3 days ago
Data Engineer
$70.23 per hour
...term relationships and delivering excellence through innovation, collaboration, and integrity. Job Description Position Summary Data Engineers provide businesses with data-driven solutions to help improve processes, decision-making, and overall business performance....
Contract work
Immediate start
BCforward
Charlotte, NC
2 days ago
Data Engineer
$136.28k - $140k
...Job ID 12008: Data Engineer Ardor IT Solutions has multiple Data Engineer job openings at competitive salaries, ranging from $136,282.00 to $140,000.00/year. Job Duties Participate in all phases of the SDLC such as requirement specification, analysis, design, and development...
Relocation
Ardor-IT-Solution
Charlotte, NC
1 day ago
Data Engineer
...Data Engineer We are looking for a talented, highly enthusiastic team player to join a team of data enthusiasts on the Reporting Team. The ideal candidate would be interested in data and look for different ways to tell the story with data, and possess excellent analytical...
InterSources
Charlotte, NC
3 days ago
Data Engineer
...Number of position : 5 Only Full Time Full-time I, Shakib (i3 infotek) would like to share a job opportunity as Data Engineer based in Charlotte, NC (Onsite) location for a Full-time position. *** In case, if you are not comfortable with this...
Full time
Work visa
Syntricate Technologies
Charlotte, NC
4 days ago
Data Engineer
$111k - $209k
...Job Summary We are seeking an experienced Data Engineer with a strong focus on Microsoft Fabric to design, implement, and maintain enterprise data solutions. The ideal candidate will have a minimum of 2 years hands‑on experience implementing Microsoft Fabric, including...
Temporary work
Work experience placement
Local area
Remote work
Relocation
Flexible hours
K&L Gates LLP
Charlotte, NC
4 days ago
Data Engineer
...Role : Data Engineer Location: Charlotte, NC Duration: Long term Skills - Python, Pyspark, GCP, ETL-Big Data/Data Warehouse, Data Analytics, SQL, Git Job Description ~ BS or MS degree in computer science, computer engineering, or other...
Work experience placement
Inficare
Charlotte, NC
5 days ago
Data Engineer
...Data Engineer Responsibilities: Data Engineers will be data mining, writing code, and creating tables/environments in S3 Qualifications: Engineer required - SQL, Python, Pyspark, S3, AWS, environment creation Preferable for both - retail business knowledge...
Samprasoft
Charlotte, NC
4 days ago
Data Engineer
$63.02 per hour
...Genesis10 is currently seeking a Data Engineer position with a financial client located in Charlotte, NC. This is a hybrid 6+ month contract opportunity. Summary: Our client is leading a Digital Transformation across their Americas Division as they continue to...
Hourly pay
Permanent employment
Contract work
Genesis10
Charlotte, NC
5 days ago
Data Engineer
...Seeking Sr Data Engineer - financial services to join our Charlotte, NC (onsite 3 days a week is a must in Hybris) long-term contract. Only local to Charlotte, NC who can come in-person interview only Key Responsibilities: • Develop and maintain...
Long term contract
Local area
3B Staffing LLC
Charlotte, NC
3 days ago
Data Engineer
...responsible for leading complex efforts to develop and deliver complex data solutions to accomplish cyber security technology and business... ...systems. They guide stakeholders, Product Owners, and Software Engineers through the design and execution processes. These individuals...
Diverse Lynx
Charlotte, NC
3 days ago
Data Engineer
...OFG Bancorp is looking for an experienced Mid‑Level Data Engineer to design, build, and operate scalable data pipelines and data platforms supporting banking and financial services data domains, including customer, account, transaction, and product data. This role operates...
Permanent employment
OFG Bancorp
Charlotte, NC
2 days ago
Data Engineer
$44 - $54 per hour
...employees work in their local metro area onsite at the project, significantly reducing and/or eliminating the demands to travel. As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions that support data generation, collection, and...
Hourly pay
Work experience placement
Live in
Work at office
Local area
Immediate start
Flexible hours
3 days per week
Accenture
Charlotte, NC
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!