Data Engineer
VDart Inc
Job Title: Data Engineer
Location: Charlotte, NC (Hybrid)
Type: Contract
Job Description:
- This role involves working with cross-functional teams to develop, manage, and optimize cloud-based data solutions for cybersecurity analytics.
- The ideal candidate will have experience in AWS Glue, Apache Kafka, Terraform, Data Warehousing, Data Lakes, Snowflake, and API development to ensure secure, scalable, and efficient data processing and storage.
Responsibilities:
- Develop and maintain AWS Glue ETL pipelines to process and transform cybersecurity-related data.
- Design, implement, and optimize Data Warehouses and Data Lakes to support security analytics and reporting.
- Manage Terraform-based Infrastructure-as-Code (IaC) deployments.
- Work with Snowflake to develop and optimize secure data storage, querying, and performance tuning for large datasets.
- Create and manage API calls to ingest, transform, and exchange data between front-end applications and backend data systems.
- Assist in data governance, security controls, and compliance within cloud-based data platforms.
- Monitor production data jobs, troubleshoot failures, and execute batch processing efficiently.
- Participate in code reviews, security audits, and architecture discussions to improve data workflows.
Job Requirements:
- 5+ years of experience in cloud-based data engineering and big data processing.
- Hands-on experience with AWS Glue for ETL development and job orchestration.
- Expertise in Terraform for cloud infrastructure automation and deployment.
- Strong background in Data Warehousing and Data Lake architectures (AWS S3, Snowflake
- , etc.).
- Proficiency in Snowflake for data storage, modelling, and query performance optimization.
- Experience in creating and managing API calls for data ingestion from front-end applications and external systems.
- Experience in creating SSIS packages/ Debugging the SSIS Packages.
- Knowledge of RESTful APIs, JSON, and authentication mechanisms (OAuth, API keys, etc.).
- Strong skills in SQL, Python, and Spark for data transformations and analysis.
- Hands on experience using Apache Kafka in ETL process
- Experience with data security best practices, encryption, and access control in cloud environments
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Charlotte, NC vacancy
$130k - $176k
...sponsor or assume the sponsorship of an employment visa at this time”.Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the Claims team within the Information Management group. This group...SuggestedWork experience placement- ...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...SuggestedFull timeTemporary workRelocation
$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex...SuggestedFull timeTemporary workRelocation- Who You’ll Work WithAt Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their... ...organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...SuggestedTemporary workLocal area
- ...government agencies, a list that spans across the country. Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine...SuggestedFull timeVisa sponsorshipWork visa
Captech Consulting
Charlotte, NC11 hours ago $125k - $145k
...us!Job Description:What we're buildingOur team runs a range of data and AI projects across the GPS business.A few examples:•A modern... ...on.Who we're looking forThis is a hybrid role that spans data engineering, AI product enablement, and platform architecture. You'll build...Full timeWork at officeFlexible hoursDay shift$128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. The...Full timeContract workFlexible hours$65 per hour
...work W2!DescriptionKey Responsibilities• Lead and mentor Oracle developers while providing technical guidance and best practices for data integration and ETL development.• Design, build, and support SSIS packages and data integration workflows across enterprise systems....Contract workTemporary work- About this role: Senior Data Engineer The Data, Analytics and Reporting Technology team is responsible for a cross-cutting set of capabilities within the Global Operations at Wells Fargo. The AI/ML Data Architecture, Engineering and Enablement team is seeking a Senior Data...Full timeWork experience placementWork at officeRemote workFlexible hours
$60 - $66 per hour
DescriptionKforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.Requirements* Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark* Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step...$100k - $196k
...About this role: Wells Fargo is seeking a Senior Data Engineer within the Commercial & Corporate & Investment Banking Technology (CCIBT) organization. The role resides in the Enterprise Counterparty Risk Technology (ECRT) team, which develops and supports technology solutions...Full timeWork experience placementRelocation package- ..., balance, and resources to make a positive impact on the future - including your own.Pacific Life is actively seeking a Senior Data Engineer to join our Customer Datateam onsite in Charlotte, North Carolina.As a Senior Data Engineer, you will contribute to the design,...Full timeFlexible hours
- ...We are seeking a Lead Data Engineer with strong experience in delivering enterprise-scale cloud data and analytics solutions. The ideal candidate will have expertise in Google Cloud Platform (GCP), technical project leadership, and end-to-end delivery of modern data platforms...
Techvilla Solutions
Belmont, NC2 days ago - ...has a real heart to help, we encourage you to join us as a:Lead Data EngineerThis is What You'll DoLead design, development, and... ...management is preferredResponsibility includes leading a team of data engineers and mentoring in best practices.Utilize Python for data...Work at officeFlexible hours
Octapharma Plasma
Charlotte, NC17 hours ago - ...Location (City State, Street Name): Charlotte NC 28273 Type : Contract to Hire Only W2 Large Healthcare organisation is seeking a lead Data Engineer to join their expanding team Must have very strong Data Bricks experience using the latest version Poweer BI and Microstrategy...Contract work
DELTA SYSTEM & SOFTWARE INC
Charlotte, NC4 days ago - ...Octapharma Plasma, Inc. is seeking a Lead Data Engineer in Charlotte, NC to shape and implement scalable data platforms. You will lead data pipelines, enforce quality, and mentor a team of engineers, collaborating with stakeholders to deliver robust data solutions. The...
Octapharma Plasma
Charlotte, NC2 days ago - ...Lead Data EngineerCharlotte, NC (Hybrid)6-month contract to hireRequirements:Looking for 8+ years of experienceBuilding pods (about... ...be retail, finance operations, loyalty, etc.)Will have 2-6 Data Engineers under the Lead (still reporting to Pradeep)Python, SQL and...Contract work
My3Tech Inc
Charlotte, NC3 days ago $100k
...are always looking for ways to improve our games and how we operate them. We’re growing our LiveOps team and are looking for a Data Engineer/Analyst who can help us scale our LiveOps systems, reporting, and player insights to the next level. About the Role You’ll work...Full timeRemote workWorldwideGrabJobs
Charlotte, NC3 days ago- ...Cloud Data EngineerThis position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise...
Euclid
Charlotte, NC17 hours ago - ...Data EngineerWe are a leading construction company committed to delivering high-quality, innovative projects. Our team integrates cutting... ...across all levels. We are looking for a talented Data Engineer to join our team and contribute to developing robust data solutions...For contractorsOverseas
DPR Construction
Charlotte, NC3 days ago - ...processes and flow of AI Compliance Governance frameworkMonitors the Data Lake constantly and ensures that the appropriate support teams... ...platforms on GCP is a must6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data AnalyticsVery strong...
Samprasoft
Charlotte, NC3 days ago - ...Overview We are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as a 18 month contract with a high possibility of extending the contract. Candidates must be local to Charlotte and be a US Citizen, Green Card Holder...Contract workH1bLocal area2 days per week
Comcentric Consulting
Charlotte, NC4 days ago $53k - $88k
...Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer I to support the development, maintenance, and enhancement of data pipelines, cloud-based data platforms, and...InternshipFlexible hoursGuidehouse Digital, LLC
Charlotte, NC17 hours ago- ...Role Description We are currently seeking a talented and motivated Senior Data Engineer to join our Cloud data solutions team. This role will be responsible for designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects and...Work at officeLocal areaWork from home
SMBC Group
Charlotte, NC3 days ago - ...Galent in Charlotte, NC is seeking a hands-on Data Engineer for an in-person, 12+ month contract. The role focuses on building scalable ELT pipelines, data models, and cloud-based data solutions using Snowflake, Synapse, dbt, Airflow, and Python and SQL. You will develop...Contract work
Galent
Charlotte, NC2 days ago - ...Data EngineerLocation: Charlotte, NCContract/Full-time: +12 Months contract with possible extension.The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with...Full timeContract workFor contractors
LanceSoft
Charlotte, NC3 days ago - ...Data Engineer Hybrid3 days onsite Charlotte (locals only) 10+ monthsResponsibilities:Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.Designing and implementing highly performant data ingestion pipelines from...Work experience placementLocal area
RIT Solutions
Charlotte, NC11 hours ago - ...Data EngineerWe are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as an 18 month contract with a high possibility extending the contract.Candidates must be local to Charlotte and be a US Citizen, Green Card Holder...Contract workH1bLocal area2 days per week
Comcentric
Charlotte, NC3 days ago - ...Highbrow LLC in Charlotte, NC seeks a Senior Data Engineer with PySpark and Python to design and optimize large-scale data pipelines and deliver scalable data solutions. You will collaborate with data scientists, analysts, and stakeholders to translate requirements into...
Highbrow
Charlotte, NC17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote Charlotte, NC
- director data engineering Charlotte, NC
- hadoop big data developer Charlotte, NC
- senior data quality engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data engineer contract Charlotte, NC
- data infrastructure engineer Charlotte, NC
- entry level big data engineer Charlotte, NC
- data science developer Charlotte, NC
- junior big data engineer Charlotte, NC