Data Engineer: ETL & Spark Pipelines (Python/AWS)
Infosys
Infosys DNA is seeking a Technology Consultant 2 to contribute to requirements elicitation, design discussions, and coding across the SDLC. You will participate in testing, reviews, and production issue resolution while documenting technical decisions and maintaining code artifacts. You will work with Python, Spark, and AWS on data/analytics projects and may relocate or travel for assignments as needed. #J-18808-Ljbffr Infosys
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer: ETL & Spark Pipelines (Python/AWS) in Charlotte, NC vacancy
- ...Charlotte NC Data Engineer Company is looking... ...scalable data pipelines and data platforms... ...using Snowflake and AWS. MAIN DUTIES &... ...and maintain ELT/ETL pipelines for batch... ...solutions using SQL and Python. • Integrate... ...g., dbt, Airflow, Spark/PySpark, or...Amazon Web ServicePipelinePythonFull time
Ryan Consulting Group
Charlotte, NC4 days ago - Jobtailor in Charlotte, NC, is seeking a data engineer to design, build, test, and support ETL/ELT pipelines that populate Snowflake on AWS. You will transform customer data, develop... ...engineering experience, strong SQL and Python or Java, and hands-on cloud skills with Snowflake...Amazon Web ServicePipelinePython
- ...a Technology Consultant 2 in the United States to join the Data and Analytics (DNA) group. You will contribute to requirements... ...elicitation, design discussions, and code updates, applying Python, Spark, and AWS to deliver robust data solutions. Expect to collaborate...Amazon Web ServicePython
- Overview The Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business... ...and do software integration. Required Skill and Experience Python, Spark AWS Preferred Skill and Experience Python, Spark AWS Additional...Amazon Web ServicePythonFull timeTemporary workRelocation
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda,... ...business analysis and develop ETL code to meet all technical...Amazon Web ServicePipelinePythonFull timeLocal areaImmediate startRemote work
- ...AWS Data Engineer - Create and maintain optimal data pipeline using Python Spark - Build the infrastructure required for optimal extraction transformation and loading of data... ...data in cloud using AWS Lambda Function Glue ETL Step function - Work with data and analytics experts...Amazon Web ServicePipelinePython
3B Staffing LLC
Charlotte, NC4 days ago - ...Position- AWS Data Engineer Duration-Contract... ...platforms. Strong Python experience in building... ...application in AWS Spark Shell scripting and... ...AWS Cloud Formation, ETL, Python The person... ...and cost-effective data pipelines, data lakes, and analytics...Amazon Web ServicePipelinePythonContract workImmediate start
Syntricate Technologies
Charlotte, NC1 day ago - ...build, test, and support ETL/ELT data pipelines ingesting and... ...data into Snowflake on AWS Develop and maintain data... ...Collaborate with senior data engineers, architects, and... ...programming language, such as Python or Java Ability to... ...or platforms, such as Spark, is a plus Experience...Amazon Web ServicePipelinePython
Jobtailor
Charlotte, NC3 days ago $106.84k - $160.25k
Req ID:386062NTT DATA strives to hire exceptional... ...seeking a Data Engineer - Cybersecurity... ...experience with AWS Glue, Snowflake, AWS S3, Terraform, Python, SQL, Spark, and Kafka, along... ...high-performing data pipelines and platforms.Key... ...optimize AWS Glue ETL pipelines for...Amazon Web ServicePipelinePythonFull timeTemporary workWork at officeRemote workFlexible hours$80k - $133k
Job Family:Data Science & AnalysisTravel... ...seeks a Senior Data Engineer to design, develop... ...data platforms, pipelines, and cloud-based analytics... ...pipelines and ETL/ELT processes... ...engineering solutions using Python, SQL, Spark, and related... ...leveraging AWS, Azure, Databricks...Amazon Web ServicePipelinePythonFull timeContract workFlexible hours- ...The Senior Data Engineer will design, develop, and optimize... ...high-performance ETL/ELT pipelines, implementing data engineering... ...strong expertise in Python, SQL, cloud data... ...cloud platforms such as AWS, Azure, or GCP. Experience... ...with Apache Spark or PySpark for distributed...Amazon Web ServicePipelinePython
Compunnel
Charlotte, NC2 days ago - ...Lead Data Engineer Charlotte, NC (Hybrid... ...to Pradeep) Python, SQL and PySpark... ...open to other (GCP, AWS) Databricks, Snowflake... ...- building pipelines Gathering requirements... ...strong Python, Spark, SQL programming... ...data pipelines, ETL processes, and...Amazon Web ServicePipelinePythonContract work
My3Tech Inc
Charlotte, NC3 days ago $110.2k - $144.7k
...Description: Senior Data Engineer Are you passionate... ...and optimize scalable ETL/ELT pipelines for structured and semi... ...with SQL and Python. ~5+ years of experience... ...cloud platforms (Azure, AWS, or GCP). ~ At least... ...valued. Experience with Spark, Kafka, or other...Amazon Web ServicePipelinePythonFull timeWork experience placementMitsubishi Chemical Group
Charlotte, NC3 days ago$93.69k - $114.51k
...Data Engineer II – Customer Data Providing for loved ones... ...hosted on AWS. This role supports ongoing... ...build, test, and support ETL/ELT data pipelines that ingest and transform... ...language such as Python or Java . Ability to... ...or platforms (e.g., Spark). Experience using AI...Amazon Web ServicePipelinePythonPacific Life
Charlotte, NC1 day ago- ...Click Here Senior Data Engineer | Onsite | Charlotte... ...of complex data pipeline components Provide... ...Develop scalable ETL/ELT processes and... ...Technical Stack AWS: Athena, S3, Lambda... ...CloudWatch Languages: Python, Java, Scala,... ...to have: PySpark, Spark, SQL, Hadoop, CI/CD...Amazon Web ServicePipelinePythonContract workH1bVisa sponsorship
$100k - $110k
...Cloud & DevOps, Data, and Software Engineering, servicing an array... ...expertise in ETL workflows within... ...and efficient data pipelines and analytics solutions... ...Apache Hadoop, Spark, and Hive.... ...transformation using Pyspark, Python, and Scala to... ...experience (AWS, Azure, GCP) is a...Amazon Web ServicePipelinePythonTemporary workFlexible hoursSynechron
Charlotte, NC3 days ago$95k - $115k
Job Description Data engineer - Prod support Must Have Technical... ...Skill: PySpark, Hive, Python, SQL, Hadoop... ...designing and building ETL/ELT pipelines, data ingestion processes... ...tools such as Apache Spark, Databricks, or Hadoop... ...Snowflake, SQL Server, Azure/AWS/GCP). Solid...Amazon Web ServicePipelinePython- Job Family:Data Science & AnalysisTravel... ...seeks a Data Engineer to support the development... ...of data pipelines, cloud-based... ...data pipelines and ETL/ELT processes... ...technologies such as Python, SQL, and... ...and services in AWS and Azure.Assist... ...to Databricks, Spark, or large-scale...Amazon Web ServicePipelinePythonPermanent employmentFull timeInternshipWork at officeFlexible hours
$50 - $55 per hour
...immediately hiring for a Data Engineer Title: Data Engineer... ...batch and near real?time ETL pipelines using Ab Initio, Python, PySpark, SQL, and PL/SQL.... ...Initio migration to modern Spark/SQL patterns. Data governance... ...States (NMSDC, 2024) AWS Advanced Tier Services...Amazon Web ServicePipelinePythonFull timeContract workTemporary workWork experience placementImmediate startRemote workWorldwideFlexible hoursInnova Solutions
Charlotte, NC19 hours ago- .... They're hiring a Data Engineer, Senior Specialist... ...and optimise data pipelines and architectures for... ...ll build and manage ETL workflows,... ...frameworks (Apache Spark, Hadoop, or Databricks). Strong Python, Scala, or Java programming... ...cloud data services on AWS, Azure, or GCP (...Amazon Web ServicePipelinePythonVisa sponsorship
- ...below. Job Title: Data Platform Engineer (Python, PySpark) Contract Length... ...scalable data pipelines, improving data quality... ...in data engineering, ETL development, or data... ...~ PySpark / Apache Spark ~ Advanced SQL ~... ...cloud platforms such as AWS, Azure, or GCP. Experience...Amazon Web ServicePipelinePythonContract workRemote workVisa sponsorship
Leading Utilities Organization
Charlotte, NC4 days ago - ...a Mid-Level Software Engineer / Data Engineer with strong hands... ...in Ab Initio, Python, UNIX Shell Scripting,... ...PLSQL, and enterprise ETL development . Key Responsibilities... ...near-real-time data pipelines. Develop complex ETL... ...Python, PySpark, Spark, and SQL patterns. Use...PipelinePythonContract work
Staffing Spot, Inc.
Charlotte, NC2 days ago - Synechron is seeking an ETL / Data Engineer (BigQuery & Starburst) to design, build, and optimize modern data platforms... ...will leverage Google BigQuery, Starburst/Trino, Python, SQL and Spark to create scalable pipelines and enable data-driven decisions for business stakeholders...PipelinePython
$110k - $120k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of... ...key global markets. As an ETL / Data Engineer (BigQuery & Starburst... ...BigQuery, Starburst/Trino, Python, SQL, and Spark to create scalable ETL/ELT pipelines, deliver high-performance...PipelinePythonTemporary workFlexible hoursSynechron
Charlotte, NC3 days ago- ...Data EngineerRequired Skills5+ years of experience in Data Engineering.Strong hands-on experience with AWS Glue, Python, SQL, Snowflake, and dbt.Strong understanding of ETL/ELT architecture and data pipeline development.Advanced SQL skills including complex joins, CTEs...Amazon Web ServicePipelinePython
Omega Hires
Charlotte, NC19 hours ago $166k - $172k
...not competitors. Data & Metrics Driven... ...Senior Software Engineer - Data... ...won’t just write pipelines — you’ll define... ...building scalable ETL/ELT pipelines, data... ...processing (e.g., Spark, Flink, Hadoop)... ...programming language (Python, Java, Scala).... ...infrastructure (AWS preferred:...Amazon Web ServicePipelinePythonFull timeLocal areaFlexible hours- ...Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array... .... Proficiency in Python, including data... ...cloud, preferably AWS. Experience with stream... ...such as Kafka, Spark, Flink, or similar... ...and streaming data pipelines, including ETL/ELT workflows, using...Amazon Web ServicePipelinePythonTemporary workFlexible hours
- ...consulting firm is seeking a Big Data Engineer to design, develop, and... ...candidate will have expertise in ETL workflows and proficiency in big... ...such as Apache Hadoop, Spark, and Hive. Responsibilities include maintaining ETL pipelines, collaborating with teams to solve...Pipeline
$135 per hour
...AWS Data EngineerLocation: Charlotte, NCEmployment Type: FulltimeSalary... ...(Data Streams & Firehose)Glue (ETL + Crawlers)Step FunctionsAmazon... ...Build and manage scalable data pipelines using AWS Glue (ETL jobs, Crawlers), PySpark, and Python for data ingestion, transformation...Amazon Web ServicePipelinePythonDiverse Lynx
Charlotte, NC1 day ago- ...company to hire a Data Engineering Associate Manager.... ...-performance data pipelines and integrated solutions... ...including Hadoop, Spark, Snowflake, and... ...including Azure, AWS, and GCP while... ...applications with Python and SAS; Developing... ...Denormalization; Developing ETL/ELT workflows,...Amazon Web ServicePipelinePython
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer: ETL & Spark Pipelines (Python/AWS). Be the first to apply!
Related searches
- data center engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data infrastructure engineer Charlotte, NC
- sr information security engineer Charlotte, NC
- hadoop big data developer Charlotte, NC
- data visualization developer Charlotte, NC
- remote data engineer Charlotte, NC
- etl data engineer Charlotte, NC
- data engineer analytics Charlotte, NC
- sr data engineer Charlotte, NC