Data Engineer

Carolina IT Professionals, Inc

Matthews, NC

Job Description
Job Description
Daily responsibilities
Develop Spark/ BQ data pipelines in GCP DataProc Cluster
Develop data models and schema to support business requirements
Ensure data quality and reliability by developing automated checks in place
Optimize performance and ensure adherence to SLAs
Document and share learnings with the rest of the team.

Candidate will be working on and migrating workloads from Hadoop OnPrem cluster to GCP.
Team is geographically spread based mainly out of Charlotte, NC and Bangalore, India.
Candidate should be able to communicate in a concise and clear manner to keep the team
appraised of day-to-day progress.

Required Skills
GCP/ Big query Experience ? 1 year minimum
Scala/ Python - 3+ years
SQL ? 3+ years
Strong SQL, one or more programming language Scala/ Python

Preferred Skills
Exposure to building semantic layer in LookML
GCP Certification
Master?s Degree In related field

Apply

Vacancy posted 8 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Matthews, NC vacancy

Azure Data Engineer
...Azure Data Engineer We are seeking a highly skilled and experienced Azure Data Engineer who specializes in Azure Data Factory (ADF) to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in designing, developing, and implementing data integration...
Suggested
Samprasoft
Matthews, NC
21 hours ago
Lead Data Engineer (Hybrid)
$130k - $176k
...assume the sponsorship of an employment visa at this time". Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the Claims team within the Information Management group. This group...
Suggested
Work experience placement
Selective Insurance Company of America
Charlotte, NC
2 days ago
Lead Data Engineer
...Lead Data Engineer Location: Charlotte NC Duration: Long term Mandatory Skills: Advanced Oracle RDMS expertise, including object creation (tables, views, indexes, partitioned objects). Proficient in SQL and PL/SQL for data manipulation and analysis....
Suggested
Local area
E-Solutions
Charlotte, NC
2 hours ago
Data Engineer
...Position: Data Engineer Location: Charlotte, NC or Denver, CO ~4x/week onsite Contract Length: 12+ months Top Requirements: # Python # Prefect # AWS # Athena # Terraform # JavaScript Plusses # FinOps background # Redshift...
Suggested
Contract work
Local area
My3Tech Inc
Charlotte, NC
3 days ago
Data Engineer
...Overview: We are seeking a highly skilled Data Engineer to join a dynamic team in the Charlotte, NC area. This role focuses on the collection, modeling, storage, processing, and evaluation of large-scale data sets that are rapidly changing and complex. The goal is...
Suggested
Work experience placement
True North Consultants
Charlotte, NC
2 days ago
Data Engineer
...We are currently seeking a Big Data Engineer for an onsite position located in Charlotte, NC, Denver, CO, Jacksonville, FL and Chicago, IL. This is a 12+ month W2 contract opportunity. Summary: Join a passionate, tight-knit, and supportive team as a Big Data...
Contract work
Work experience placement
Redolent
Charlotte, NC
4 days ago
Data Engineer
$50 - $55 per hour
...A client of Innova Solutions is immediately hiring for a Data Engineer Title: Data Engineer Position type: Full Time - Contract Duration:24+Months Location: Charlotte, NC (Hybrid-3 days onsite and 2 days Remote) Data Engineer, You will: Design, build...
Full time
Contract work
Temporary work
Work experience placement
Immediate start
Remote work
Worldwide
Flexible hours
Innova Solutions
Charlotte, NC
4 days ago
Data Engineer
...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise...
Euclid
Charlotte, NC
4 days ago
Data Engineer II
$108.8k - $136k
...and Charlotte, NC area Position Summary: Join our mission to transform pharmacy benefits and healthcare navigation as a Data Engineer II (Analytics Engineer). You will build and maintain reliable data models within Snowflake with dbt, and improve data quality and...
Local area
Flexible hours
Capital Rx
Charlotte, NC
2 days ago
Data Engineer
...Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced software Data engineers spread across Charlotte (N.C), Jersey City (N.J) and India, with 10...
BAMM USA
Charlotte, NC
21 hours ago
Data Engineer
...Data Engineer We are looking for a talented, highly enthusiastic team player to join a team of data enthusiasts on the Reporting Team. The ideal candidate would be interested in data and look for different ways to tell the story with data, and possess excellent analytical...
InterSources
Charlotte, NC
4 days ago
Data Engineer
$59.99 - $69.99 per hour
...Genesis10 is currently seeking a Data Engineer for a contract position with a Major Financial Services Firm located in Charlotte, NC. This is a 12+ month contract opportunity. This role is a critical member of a data team, responsible for designing and developing...
Hourly pay
Permanent employment
Contract work
Genesis10
Charlotte, NC
1 day ago
Data Engineer
...Number of position : 5 Only Full Time Full-time I, Shakib (i3 infotek) would like to share a job opportunity as Data Engineer based in Charlotte, NC (Onsite) location for a Full-time position. *** In case, if you are not comfortable with this...
Full time
Work visa
Syntricate Technologies
Charlotte, NC
21 hours ago
Data Engineer
...Job Description Insight Global is seeking a Data Engineer to support one of our largest financial clients in Charlotte, NC. The Data Engineer will help design, build, and maintain a centralized performance and analytics repository that integrates data from multiple...
Insight Global
Charlotte, NC
21 hours ago
Data Engineer
...Data Engineering Support Duration: 6+ months Location: On-site 3-4 days/week in Charlotte, NC | Addison, TX U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor or transfer visas at this time. No Vendors/3rd parties...
Visa sponsorship
3 days per week
The Brixton Group, Inc.
Charlotte, NC
4 days ago
Data Engineer
...Overview We are seeking an experienced Senior Power BI & GCP Data Analytics Consultant to support enterprise analytics, reporting... ...deep expertise in Power BI, Google Cloud Platform (GCP), data engineering, business intelligence, and statistical analytics to deliver solutions...
For contractors
Artech
Charlotte, NC
2 days ago
Data Engineer
...Seeking Sr Data Engineer - financial services to join our Charlotte, NC (onsite 3 days a week is a must in Hybris) long-term contract. Only local to Charlotte, NC who can come in-person interview only Key Responsibilities: • Develop and maintain...
Long term contract
Local area
3B Staffing LLC
Charlotte, NC
4 days ago
Data Engineer
...Role : Data Engineer Location: Charlotte, NC Duration: Long term Skills - Python, Pyspark, GCP, ETL-Big Data/Data Warehouse, Data Analytics, SQL, Git Job Description ~ BS or MS degree in computer science, computer engineering, or other...
Work experience placement
Inficare
Charlotte, NC
1 day ago
Data Engineer
...Data Engineer Responsibilities: Data Engineers will be data mining, writing code, and creating tables/environments in S3 Qualifications: Engineer required - SQL, Python, Pyspark, S3, AWS, environment creation Preferable for both - retail business knowledge...
Samprasoft
Charlotte, NC
21 hours ago
Data Engineer
...Data Engineer Location: Charlotte, NC (Hybrid) Schedule: Full-Time | Hybrid (3 days onsite) Interview Process: In-Person Interview Required About The Role We are seeking a Data Engineer to join a team focused on modernizing enterprise data platforms and supporting...
Full time
Kaleidoscope Innovation
Charlotte, NC
2 days ago
Data Engineer
$97.9k - $133.5k
...Become a part of our caring community We are looking for a motivated and detail-oriented Data Engineer II to join our Home Health Data Engineering team. In this role, you will contribute to the design, development, and maintenance of cloud-based data solutions that...
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Charlotte, NC
4 days ago
Lead Machine Learning / Data Science Engineer
...Lead Machine Learning / Data Science Engineer CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech Consulting
Charlotte, NC
2 days ago
Big Data Engineer
...Job Title Required Qualifications ~5+ years of experience in Big Data engineering within large enterprise environments. ~ Strong hands-on expertise with PySpark, Scala, Spark, and SQL. ~ Proven experience with data sourcing, ingestion, and conformance on distributed...
Saxon Global
Charlotte, NC
1 day ago
Lead Data Engineer
...We are seeking a Lead Data Engineer with strong experience in delivering enterprise-scale cloud data and analytics solutions. The ideal candidate will have expertise in Google Cloud Platform (GCP), technical project leadership, and end-to-end delivery of modern data platforms...
Temporary work
Techvilla Solutions
Charlotte, NC
a month ago
Lead Data Engineer
Lead Data Engineer | Charolette, NC | 5 Days Onsite We are currently looking to fill an on-site Databricks position and are seeking a Senior or Lead Data Engineer who can contribute to one of our strategic initiatives
Cortex consultants LLC
Charlotte, NC
2 days ago
Senior Data Engineer
...Job Title: Senior Data Engineer Location: West Des Moines, IA OR Charlotte, NC - hybrid Wells Fargo - W2 ONLY!!!!! Rate: $50.00/hr on W2 Duration: 12+-month Contract ONLY W2 CANDIDATES ELIGIBLE FOR THIS PROJECT Key...
Contract work
3B Staffing LLC
Charlotte, NC
4 days ago
Senior Data Engineer
...description below. If you're interested, could you send me your updated resume? Looking forward to hearing from you! Job Title: Data engineer Location: Charlotte, NC ( Hybrid - 3days Office - 2 days WFH) Full-time role Job Summary:...
Full time
Work at office
Work from home
ACI Infotech
Charlotte, NC
3 days ago
Senior Data Engineer
...strength, creating a dynamic environment where creativity meets practicality. Visit our website: FCG is seeking a Senior Data Engineer to work on our Central Data Platform team, utilizing Snowflake, dbt, and Fivetran, and responsible for end-to-end ELT development...
Local area
Flow Control Group Company
Charlotte, NC
2 days ago
Senior Data Engineer
...Senior Data Engineer Jersey City, New Jersey;Charlotte, North Carolina; Plano, Texas To proceed with your application, you must be at least 18 years of age. Acknowledge ( Bank of America employees are required to meet all posting eligibility requirements...
Work at office
Shift work
Day shift
Bank of America
Charlotte, NC
1 day ago
Senior Data Engineer
...Job Title: Senior Data Engineer Work Location : Charlotte, NC 28203 (hybrid - 2 days onsite per week)(Locals) Contract duration: 12 months Target Start Date: 06 Dec 2025 Visa: USC and GC only Job Details: Must Have Skills: Spark, Python...
Contract work
Local area
2 days per week
Argyll Infotech, Inc.
Charlotte, NC
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!