Data Engineer - ETL Pipelines, PySpark & AWS
Compunnel
A prominent tech company seeks a skilled Data Engineer to design and implement data integration solutions. The role demands proficiency in Python and PySpark, along with experience in AWS services. Responsibilities include developing ETL pipelines, collaborating with teams, and ensuring scalable data solutions. Ideal candidates should have strong SQL skills and experience with Agile methodologies. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - ETL Pipelines, PySpark & AWS in Charlotte, NC vacancy
- A leading staffing agency is seeking an experienced AWS Data Engineer in Charlotte, North Carolina. The ideal candidate will have at least... ...with AWS. Responsibilities include creating and testing AWS pipelines, data analysis, and enhancing existing models to unify store...Amazon Web ServicePipeline
$110k - $120k
...Requirements Eexperience in a data engineering or backend development... ...‑on experience with PySpark and Python, especially... ...large‑scale data pipelines using PySpark and... ...transformation, and loading (ETL). Collaborate closely... ...manner. Leverage AWS cloud services (e.g.,...Amazon Web ServicePipelineWork experience placementWork at office- NTT DATA North America is seeking an AWS Data Engineer Senior Specialist to join our team in Charlotte, North Carolina. This role involves developing and optimizing ETL pipelines using AWS Glue and designing scalable data solutions with Snowflake. The ideal candidate should...Amazon Web ServicePipeline
- Pacific Life is seeking a Data Engineer II to join its Customer Data team in Charlotte, North... ...involves designing and supporting ETL/ELT data pipelines and collaborating with teams to meet data... ..., SQL proficiency, and knowledge of AWS and Snowflake. Pacific Life offers comprehensive...Amazon Web ServicePipeline
- Limelight Health is seeking a Data Engineer, Specialist to build and maintain scalable data pipelines for seamless integration across platforms... ...and cloud solutions including AWS. Your responsibilities will include developing ETL processes, managing databases, and...Amazon Web ServicePipeline
- NTT DATA strives to hire exceptional, innovative and passionate individuals who want... ...now. We are currently seeking a Data Engineer (Onsite Hybrid) to join our team in... ...Responsibilities Develop, maintain, and optimize AWS Glue ETL pipelines for ingesting and transforming...Amazon Web ServicePipelineWork experience placement
$140k - $160k
SC Works Trident is seeking a Senior Data Engineer for a contract-to-hire opportunity in Charlotte... ...hands-on development of data ingestion pipelines and maintaining data infrastructure... ...SQL skills, as well as familiarity with AWS services. This position offers a remote...Amazon Web ServicePipelineRemote jobContract work- ...The Data Engineer plays a key role in designing and implementing data... ...role involves developing data pipelines, performing data... ...data processing using Python, PySpark, and AWS services. The engineer collaborates... ...deploy, and maintain custom ETL infrastructure. Develop and...Amazon Web ServicePipelineFor contractors
Compunnel
Charlotte, NC4 days ago - ...AWS Data Engineer Charlotte, NC Visa status: U.S. Citizens and those authorized... ...and maintain optimal data pipeline using Python Spark - Build... ...DB2 JASON NUMPY PANDAS. PYSPARK) - Able to store-migrate... ...using AWS Lambda Function Glue ETL Step function - Work with...Amazon Web ServicePipeline
Keylent Inc
Charlotte, NC4 days ago $105.75k
...Charlotte, NC worksite for $105,747/year: Data Engineer: Design and maintain scalable data pipelines and ETL/ELT workflows using Apache Airflow, AWS Glue, or custom Python/SQL scripts.... ...Data, Python, SQL, ETL, Snowflake, PySpark. Any suitable combination of...Amazon Web ServicePipelineFull timeEval Consulting Inc.
Charlotte, NC3 days ago- ...Insight Global is looking for an AWS Data Engineer to join one of our financial... ...resource should have an ETL background with a strong... ...creating code, testing AWS pipelines, running through and managing... ...initio, talend, AWS Glue, etc) Pyspark Object oriented programming...Amazon Web ServicePipeline
- ...Infosys Limited is looking for a candidate skilled in developing ETL pipelines from various data sources for its team in Charlotte, North Carolina. The ideal candidate will facilitate software design discussions, participate in coding, and implement test strategies, ensuring...Amazon Web ServicePipeline
Infosys
Charlotte, NC2 days ago - Technical Skills AWS services: RedShift,... ...Experience with AWS data warehousing tools such... ...and executing ETL processes tailored... ...and refining data pipelines within AWS Proficient... ...Languages: Python, Spark, PySpark, and Pandas... ...Lead Developers (Data Engineer, Software Engineer,...Amazon Web ServicePipeline
- Job Title: Senior Data Engineer (Teradata / Ab Initio / BigQuery... ...in Teradata, Ab Initio ETL, and cloud data... ...develop, and maintain ETL pipelines using Ab Initio Work extensively... ...experience with Spark, PySpark, or Python 3+ years of... ...certifications ( GCP, AWS, or Azure ) Experience...Amazon Web ServicePipelineContract workWork at officeRemote work
$100k - $110k
...Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array... ...have expertise in ETL workflows within big... ...scalable and efficient data pipelines and analytics... ...transformation using Pyspark, Python, and Scala to... ...platform experience (AWS, Azure, GCP) is a plus...Amazon Web ServicePipelineTemporary workFlexible hours$110k - $130k
...Description Must Have Technical/Functional Skills Primary skill: Python, ETL/ELT pipelines, SQL, PySpark/Pandas, Big Data (Spark, Hadoop), Airflow, Data Modeling & Warehousing, AI/ML data pipelines, Cloud (AWS/Azure/GCP), Data Integration, Git Experience: Minimum 10 years...Amazon Web ServicePipeline- Programming: Python/PySpark, Scala is a plus Big Data: Hadoop (HDFS, YARN), Hive, Spark... ..., tuning) Databases/ETL: MongoDB (indexing, sharding... ...-based ingestion, Reverse engineering & lineage tools CI/CD & DevOps... ...Reverse engineer ETL pipelines (SSIS, Spark, stored procedures...PipelineLocal area
- ...(preferred) , or Strong data engineering and integration experience... ...Design, build, and maintain ETL/ELT pipelines integrating: ~ Kinaxis ~... ...) Cloud platforms (Azure, AWS, GCP) Data tools (Airflow, ADF, SSIS, Snowflake, PySpark) Strong understanding of...Amazon Web ServicePipelinePermanent employmentTemporary workWork at officeFlexible hours
Honeywell Aerospace
Charlotte, NC5 days ago - ...and groupings.Develop and optimize ETL/ELT pipelines, to load data from on premise and online systems.Ensure... ...field AND five (5) year s as Data Engineer, Big Data Engineer, Data Architect,... ...ecosystem: Spark API, Spark SQL, PySpark, Scala, Python, and data Streaming.-...PipelineFull timeTemporary workWork at officeRemote work
- ...services company to hire a Data Engineering Associate Manager. **... ...high-performance data pipelines and integrated... ...streaming data utilizing PySpark, Go, Kubeflow, Kafka Streams... ..., including Azure, AWS, and GCP while... ...Denormalization; Developing ETL/ELT workflows,...Amazon Web ServicePipeline
$110k - $125k
...IBM Infosphere Data Replication Specialist Must Have Technical... .../ Jenkins, Cloud basics (AWS/Azure/GCP), ETL & data integration basics,... ...architects, DBAs, and platform engineers. • Drive the technical... ...integrity in all replication pipelines. Salary Range- $110,000-$...Amazon Web ServicePipelineTata Consultancy Services
Charlotte, NC5 days ago- ...Data Engineer-1 Duration: 07 Months + Possible extension Location: Iselin,... ...Services Responsibilities: Develop ETL frameworks and tools Design and... ...and manage cloud solutions on AWS (Lambda, Glue, S3, Airflow). Implement CI/CD pipelines, security best practices, and...Amazon Web ServicePipeline
eTeam
Charlotte, NC4 days ago $132.5k - $338.3k
...beginning of a new Data & AI decade that will... ...compliance across engineering teams. Develop... ...decisions and managing ETL projects and... ...Jenkins for CI/CD pipeline automation, and Apache... ...utilizing GitLab, AWS, and Splunk. Developing... ...leveraging Scala, Python, PySpark, AWS services, PL/...Amazon Web ServicePipelineWork experience placementLive inWork at officeLocal area- ...Technical Expertise: 1) BigData Data warehousing GCP ? Strong... ...Google BigQuery, Snowflake, AWS Redshift, or similar. ? Proficiency... ...). ? Familiarity with ETL/ELT pipelines and tools like Apache Airflow... ...work across teams, including engineers, analysts, and product managers...Amazon Web ServicePipeline
Fisec Global
Charlotte, NC2 days ago - ...Click Here Job Title: Senior Data Engineer Req ID: CPGJP00001801 Location... ...in developing data ingestion pipelines. This role is crucial in... ...data from APIs using Python and AWS Lambda and automate workflows... ...communication skills. Familiarity with ETL/ELT processes. Experience...Amazon Web ServicePipelineContract workRemote work
Gravity IT Resources
Charlotte, NC2 days ago $65 per hour
...Data Engineer Rate:$65.00 Location: Durham, NC client:Fidelity Investments - Raleigh... ...Snowflake and Power BI hosted on AWS and Azure platforms, respectively.... ...implementing, and optimizing data pipelines specifically for AWS. Manage ETL processes and data integration...Amazon Web ServicePipelineArgyle Infotech
Belmont, NC5 days ago$105.75k
...Publishing Company is looking for a full-time Data Engineer at its Charlotte, NC location. The ideal candidate will design and maintain scalable data pipelines and ETL workflows, using technologies like Apache Airflow and AWS Glue. Successful applicants will hold a...Amazon Web ServicePipelineFull time- ...Position- AWS Data Engineer Duration-Contract Location- Charlotte, NC /Hybrid... ...Primary Skills AWS Cloud Formation, ETL, Python The person on this role will... ...building scalable and cost-effective data pipelines, data lakes, and analytics systems....Amazon Web ServicePipelineContract workImmediate start
Syntricate Technologies
Charlotte, NC5 days ago - ...Job Title : Data Engineer with Mongo DB Location : Charlotte, NC... ...large-scale data. Data Pipeline Development: Building and maintaining robust ETL/ELT (Extract, Transform, Load)... ...cloud services (e.g., GCP, AWS, Azure), and support data-driven...Amazon Web ServicePipeline
AceStack LLC
Charlotte, NC4 days ago - Lead and manage a team of ETL developers supporting Apache NiFi and AWS ETL workloads. Oversee the design,... ...development, and optimization of ETL pipelines (NiFi, PySpark, SQL, AWS EMR). Provide... ...professional experience in ETL/Data Engineering roles. 1+ years of people...Amazon Web ServicePipelinePermanent employmentContract workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - ETL Pipelines, PySpark & AWS. Be the first to apply!
Related searches
- senior data center engineer Charlotte, NC
- data engineer manager Charlotte, NC
- data science developer Charlotte, NC
- etl data engineer Charlotte, NC
- entry level big data engineer Charlotte, NC
- data engineer Charlotte, NC
- big data cloud engineer Charlotte, NC
- junior big data engineer Charlotte, NC
- remote data engineer Charlotte, NC
- senior data engineer Charlotte, NC