AWS Data Engineer - Data Lakes, ETL & Cloud Pipelines
Capgemini
Capgemini is looking for an experienced AWS Data Engineer to join their team in New York, NY. The role involves designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on AWS. The ideal candidate should have a robust background in data engineering, including ETL development and cloud technologies. Additionally, they should be well-versed in big data processing frameworks and proficient in AWS services. #J-18808-Ljbffr Capgemini
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer - Data Lakes, ETL & Cloud Pipelines in New York, NY vacancy
- ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York... ...a common pool implementing data pipelines based on the ETL model. Strong Tech lead in Development... ...Spark, Hive, Mapreduce is required AWS Cloud experience is a big plus...Amazon Web ServicePipelineCloud
Cardinal Integrated
New York, NY5 days ago $118k
Capgemini is hiring a Data Engineer to support a strategic Financial... ...enjoys building scalable data pipelines, developing ETL/ELT solutions, optimizing... ..., and working with modern cloud-based data platforms. What... ...reconciliation efforts Work with AWS-based data platforms and...Amazon Web ServicePipelineCloud- ...About the job DataBricks Data Engineer DataBricks... ...platform components: Delta Lake, Delta Live Tables,... ...ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.... ...integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources...Amazon Web ServicePipelineCloud
Global Channel Management
New York, NY2 days ago - ...building a centralized cloud data warehouse to unify... ...Senior Data Cloud Engineer will play a... ...delivering a scalable AWS-based data... ...engineer who can design pipelines, implement infrastructure... ...• Develop Zero-ETL pipelines using... ...warehouse or data lake architectures•...Amazon Web ServicePipelineCloud
$123k - $215.25k
...benefitsJob Function: Engineering &... ...grounded in our data technology model... ...of scalable data pipelines and data architecture... ...and incremental ETL/ELT workflows, including... ...POS data from AWS S3 into... ...Python, SQL, and AWS cloud services while ensuring... ...and modern data lake/lakehouse...Amazon Web ServicePipelineCloudWorldwideVisa sponsorship- Compunnel, Inc. is seeking a data engineering lead to design and implement scalable ETL pipelines and data products for critical trading... ..., and archive data to data lakes for analytics. The role demands expertise in Python, SQL, cloud services, and resilient API architectures...Amazon Web ServicePipelineCloud
- ...Job Title Cloud Technologies: Proficiency in cloud platforms like Azure, AWS, or Google Cloud. Data Engineering: Strong understanding of data warehousing, data lakes, and ETL processes. Programming: Experience... ...Understanding of CI/CD pipelines and automation....Amazon Web ServicePipelineCloud
Saxon Global
New York, NY4 days ago - ...passionate Senior Data Engineer to design and execute... ...solutions in the cloud leveraging nascent... ...including AWS and Azure cloud, APIs... ...deployment of optimal data pipelines taking advantage... ...and ETL/ELT processes using... ...experience with data lakes, data warehouses,...Amazon Web ServicePipelineCloudLocal area3 days per week
- ...Data Engineer Location - New York, NY Onsite... ...experience in building ETL using Databricks SaaS... ...in developing data pipeline solutions to ingest... .... • Expertise in AWS Compute (EC2, EMR),... ...• Proficiency in Cloud infrastructure provisioning... ...Good knowledge of Lake house architecture....Amazon Web ServicePipelineCloudPermanent employmentFull time
AceStack LLC
New York, NY2 days ago - ...Data Engineering Manager Location: Toronto, Ontario,... ...of our Databricks and AWS-based data ecosystem.... ...Databricks, Spark, and modern cloud data frameworks.... ...Platform, including Delta Lake versioning and large-... ...implement scalable ETL/ELT pipelines using Spark (Python/Scala...Amazon Web ServicePipelineCloudFull time
Perennial Resources International
New York, NY2 days ago $215.2k - $244.7k
...clients developing Big Data strategy and... ...and processing pipelines for analysis using... ...Models (LLMs), prompt engineering, embeddings,... ...experience with ETL procedures and ideation... ...using cloud platforms such as AWS, Azure, GCP etc.Experience... ...SQL, Azure Data Lake or Azure Data...Amazon Web ServicePipelineCloudLocal areaImmediate startFlexible hours- ...Design and implement lake house... ...Delta Lake, Azure Data Lake Storage Gen2,... ...develop, and maintain ETL pipelines for structured and... ...unstructured data across cloud and on-prem... ...Information Systems, Data Engineering, or related field... ...experience with AWS and Azure data services...Amazon Web ServicePipelineCloud
- ...and optimize scalable ETL/ELT pipelines using Databricks and Apache... .../Scala). Build robust data ingestion workflows... ...performance and scalability in cloud-based environments.... ...and optimize data lake or Lakehouse architecture... ...and querying skills. AWS Services: EC2, EMR, S3,...Amazon Web ServicePipelineCloud
- ...Description Position: Data Engineer - AWSLocation: Hybrid (Must... ...VillageCare's cloud data foundation by advancing... ...analytics-ready datasets in our AWS environment. This role... ...build, and support ELT/ETL pipelines and datasets within an AWS Data Lake- Monitor and tune AWS...Amazon Web ServicePipelineCloudWork from homeMonday to FridayNight shift
Village Care
New York, NY7 days ago - Responsibilities Data Pipeline Expertise: Capable... ...maintain complex ETL (Extract, Transform... ...products to data lakes for comprehensive... ...Programming and Cloud Technologies: Expert... ...skills in Python, SQL, AWS Cloud Services (... ...). Resilience Engineering Techniques: Distributed...Amazon Web ServicePipelineCloud
$130.8k - $196.2k
...Security Automation Engineer with experience in Data Engineering to... ...sustainable automated pipelines with the goal of... ...tooling, coding, cloud development, and... ...enterprise-ready ETL/ELT processes and... ...and data lake architectures using... ...experience with AWS and cloud services...Amazon Web ServicePipelineCloudFull time- ...Role: AWS Data Engineer Location: NYC, NY - Onsite Position summary... ..., build, and support data pipelines and analytics datasets that... ...systems, organizing it in a cloud-based data lake, and enabling reliable... ...and maintain Python-based ETL pipelines within AWS Glue....Amazon Web ServicePipelineCloud
United IT Solutions
New York, NY1 day ago $73k - $98k
...seeking a Databricks Engineer with AWS expertise to build... ...our enterprise data Lakehouse infrastructure... ...-performance data pipelines, implementing... ..., optimize Delta Lake storage (e.g., Z-Ordering... ...Catalog or native cloud security controls.... ...production-grade ETL/ELT pipelines,...Amazon Web ServicePipelineCloudFull timeWork at officeLocal areaWork from homeWorldwideSumitomo Mitsui Banking Corporation
New York, NY2 days ago- ...experience (large-scale data processing,... ...performance tuning). AWS Cloud ECS (Elastic... ...AWS Glue and/or AWS Lake Formation - Strongly... ...Spark-based data pipelines using Python/... ...Develop and maintain ETL/ELT workflows for... ...platform, and cloud engineering teams. Seniority...Amazon Web ServicePipelineCloudFull timeH1b
$153k - $204k
CoreWeave is The Essential Cloud for AI. Built for... ...About the role:As a Senior Data Engineer you will own and evolve the data lake and analytics stack that... ...Spark, Apache Superset) and ETL pipelines, while delivering ad-hoc... ...cloud platforms (e.g., AWS, GCP, Azure) and related...Amazon Web ServicePipelineCloudPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ...implement Python-based ETL/ELT pipelines, orchestrate workflows... ...Snowflake, Spark, and AWS to deliver high-performance... ...with modern Cloud platforms ( AWS , GCP...Amazon Web ServicePipelineCloudWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
New York, NY2 days ago - ...hedge fund is looking for a senior data engineer to work with Systematic portfolio managers... ...and maintain scalable Python-based ETL pipelines for ingesting and transforming... ...infrastructure. Build and manage cloud data lake solutions (AWS/Databricks) for storing and retrieving...Amazon Web ServicePipelineCloud
$160k - $200k
As a Senior Data Engineer at Rearc, you'll be the technical... ...ll write code, build pipelines, and architect... ...platform, including Delta Lake architectures, Unity... ...across at least two major cloud platforms (AWS, Azure, GCP) with... ...experience spans ETL/ELT design, data warehousing...Amazon Web ServicePipelineCloudWork experience placement$125k - $165k
...skilled and motivated Data Engineer who also possesses... ...not Limited to:Data Pipeline Development: Design,... ...and optimize scalable ETL/ELT pipelines to ingest... ...relational, NoSQL, data lakes, data warehouses) to... ...: Experience with cloud platforms (AWS, Azure, Snowflake) and...Amazon Web ServicePipelineCloudFull timeLocal area- ...connecting real-time data with world-class... ...Director, Data Engineering who will be... ...transformations and data pipelines in Snowflake and... ...using Delta Lake and... ...triggers and ELT/ETL packages using PySpark... ...such as Python and AWS GlueDesign,... ...Experience with cloud platforms (AWS,...Amazon Web ServicePipelineCloudTemporary workFreelanceFlexible hours
$90k - $198.5k
...Forward Deployed Data Engineer, you will design and... ...scalable data pipelines, data models, semantic... .... Build ELT/ETL pipelines using SQL... ...hyperscalers, and cloud-native environments... ...data models, data lakes, lakehouses, and data... ...cloud platforms (AWS, Azure, or GCP)....Amazon Web ServicePipelineCloudPermanent employmentFull timeWork at officeWorldwideFlexible hoursSAP
New York, NY13 days ago- ...growth Digital, Data and AI Transformation... ...“Power of 3”: Engineering & Operations... ....Data Engineer- AWS & Streaming Location... ...streaming data pipelines, implement... ...maintain scalable ETL/ELT pipelines using... ..., and cost in cloud environments Collaborate... ...with data lake/lakehouse...Amazon Web ServicePipelineCloud
$180k - $225k
...Career with Point72’s Data Engineering Technology Team As Point... ...on solutions such as cloud computing, data... ...maintain robust data pipelines and ETL workflows in Databricks... ...PySpark or Scala), Delta Lake, and notebook-based development... ...(preferably Azure or AWS). Strong programming...Amazon Web ServicePipelineCloudWork experience placement- ...American countries. Collaborate with Data Science teams to design,... ...Develop, test, and maintain data pipelines, ETL processes, and feature engineering pipelines using AWS (Lambda, S3, Glue, Kinesis,... ...complex ETL and SQL issues in Data Lake, Data Warehouse, and Data Mart...Amazon Web ServicePipelineCloudContract work
- ...AWS Data Engineer Choosing Capgemini means choosing a company... ...optimize scalable data pipelines and architectures on the AWS cloud platform. The ideal candidate... ..., and maintain scalable ETL/ELT data pipelines using... ...Build and manage data lakes and data warehouses (e.g...Amazon Web ServicePipelineCloudPermanent employmentFull timeContract workLocal area
Capgemini
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer - Data Lakes, ETL & Cloud Pipelines. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- azure data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY