AWS Data Engineer: Data Lakes, ETL, & Cloud CI/CD
BSL Consulting
BSL Consulting seeks a senior data engineer to design and manage large-scale data pipelines on AWS. You will build data lakes, data warehouses, and ingestion architectures, while guiding a team of engineers to deliver scalable analytics solutions. Ideal candidates have 6+ years in data engineering, strong Python/SQL skills, and hands-on experience with cloud-native data services, DevOps, and IaC tools. NJ location; full-time role with collaboration across teams. #J-18808-Ljbffr BSL Consulting
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer: Data Lakes, ETL, & Cloud CI/CD in New York, NY vacancy
- Capgemini is looking for an experienced AWS Data Engineer to join their team in New York, NY. The... ...maintaining scalable data pipelines and cloud-based data solutions on AWS. The ideal candidate... ...in data engineering, including ETL development and cloud technologies. Additionally...Amazon Web ServiceCloud
- ...and optimize scalable ETL/ELT pipelines using... ...). Build robust data ingestion workflows... ...and scalability in cloud-based environments.... ...Maintain and optimize data lake or Lakehouse... ...infrastructure using CI/CD pipelines (GitLab) and... ...and querying skills. AWS Services: EC2, EMR,...Amazon Web ServiceCloud
Veriipro
New York, NY4 days ago $160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the technical... ..., including Delta Lake architectures, Unity Catalog... ...at least two major cloud platforms (AWS, Azure, GCP) with genuine... ...a DataOps mindset: CI/CD for data pipelines, automated... ...Your experience spans ETL/ELT design, data...Amazon Web ServiceCloudWork experience placementRearc
New York, NY2 days ago- ...looking for a Snowflake Data Engineer in NYC with strong... ...and maintain ETL/ELT pipelines for structured... ...Experience with AWS / Azure / GCP Knowledge of cloud storage (S3, ADLS, etc... ...with Delta Lake / Lakehouse architecture Exposure to CI/CD tools and Git Knowledge...Amazon Web ServiceCloud
Capgemini
New York, NY5 days ago - ...We are seeking a Data Engineer with 5+ years of experience... ...data pipelines and cloud-based data... ...Apache Spark, and ETL/ELT development, along... ...one cloud platform (AWS, Azure, or Google Cloud... ...and maintain data lakes and cloud-based... ...Follow DevOps and CI/CD best practices for...Amazon Web ServiceCloud
ATC, Inc.
New York, NY2 days ago - ...Data EngineerLocation: Malvern, PA / Charlotte... ...: FulltimeSkills: AWS | PythonSalary: 120... ...SkillsPython, Glue ETL, Attunity, Pyspark,... ...(S3, IAM, Lambda, Cloud Formation)Roles &... ...Build and manage data lakes and storage... ...solutions.Support CI/CD processes, perform...Amazon Web ServiceCloud
Diverse Lynx
New York, NY3 days ago $141.9k - $190.3k
...Posting Title:Sr Data EngineerReq ID:1... ...organization of engineers, product... ...more), land it in cloud storage, and transform... ...work across AWS, Databricks, Unity... ...maintain scalable ETL/ELT pipelines... ...including Delta Lake, Unity Catalog,... ...with Git/GitHub, CI/CD, and modern DevOps...Amazon Web ServiceCloudFull time- ...Data EngineerLocation - New York, NY OnsiteExperience... ...in building ETL using Databricks SaaS... ....• Expertise in AWS Compute (EC2, EMR),... ...tools.• Proficiency in CI/CD and deployment automation... ....• Proficiency in Cloud infrastructure... ...• Good knowledge of Lake house architecture.•...Amazon Web ServiceCloudPermanent employment
AceStack LLC
New York, NY3 days ago $123k - $215.25k
...benefitsJob Function: Engineering &... ...grounded in our data technology model... ...and incremental ETL/ELT workflows, including... ...Rooam POS data from AWS S3 into... ...Python, SQL, and AWS cloud services while ensuring... ...automation, CI/CD, observability,... ...and modern data lake/lakehouse...Amazon Web ServiceCloudWorldwideVisa sponsorship$73k - $98k
...Data EngineerSMBC Group is a top-tier global... ...a Databricks Engineer with AWS expertise to build... ...(DLT).Data Ops & CI/CD Deployment: Standardize... ..., optimize Delta Lake storage (e.g., Z-... ...Catalog or native cloud security controls.... ...production-grade ETL/ELT pipelines, handling...Amazon Web ServiceCloudWork at officeLocal areaWork from homeWorldwideSmbc Global Foundation Inc
New York, NY3 days ago- ...Senior AWS Data EngineerSoftware Guidance & Assistance... ...a Senior AWS Data Engineer for a contract... ..., and optimize cloud-native data platforms and AWS Data Lake solutions supporting... ...optimize scalable ETL/ELT pipelines using... ...support Git-based CI/CD pipelines for AWS data...Amazon Web ServiceCloudContract workRemote work
SGA
New York, NY3 days ago - Greetings ! Role:Senior Data Engineer Experience:10+ Years... ...optimize scalable ETL/ELT pipelines using... ...Create and maintain cloud-native data platforms on AWS and/or Azure.... ...frameworks. Develop CI/CD pipelines and automate... ...Git Docker Data Lake / Lakehouse Architecture...Amazon Web ServiceCloudRemote work
- ...Design and implement lake house... ...Delta Lake, Azure Data Lake Storage Gen... ...develop, and maintain ETL pipelines for... ...unstructured data across cloud and on-prem... ...Systems, Data Engineering, or related... ...ETL tools, and CI/CD pipelines Hands... ...experience with AWS and Azure data services...Amazon Web ServiceCloud
$130.8k - $196.2k
...Security Automation Engineer with experience in Data Engineering to... ...tooling, coding, cloud development, and... ...enterprise-ready ETL/ELT processes and... ...pipelines and data lake architectures... ...systems through CI/CD environments, and... ...experience with AWS and cloud services...Amazon Web ServiceCloudFull time$141.9k - $190.3k
...Senior Data EngineerTechnology is at... ...organization of engineers, product developers... ...), land it in cloud storage, and transform... ...work across AWS, Databricks,... ...maintain scalable ETL/ELT pipelines for... ...including Delta Lake, Unity Catalog,... ...with Git/GitHub, CI/CD, and modern...Amazon Web ServiceCloudThe Walt Disney Studios
New York, NY3 days ago- ...RoleDailyPay is looking for a Data Engineer II to join our Data... ...maintain company's ETL and data... ...dimensional models, data lakes, data lakehouses, and... ...driven architecture and cloud platforms (e.g. AWS, Azure, GCP)Experience... ...systemsExperience with CI/CD, automated releases,...Amazon Web ServiceCloudTemporary workLocal area
DailyPay
New York, NY2 days ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation... ...and manage Delta Lake architectures for... ...retrieval. Implement robust ETL/ELT workflows using... ...cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure... ...and MLflow. Develop CI/CD pipelines for data and...Amazon Web ServiceCloudContract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY3 days ago- ...Reports To Manager, Data Engineering FLSA Status Exempt... ...Dynamics 365 F&O, Azure, AWS, SQL, Snowflake,... ...with both current ETL/Data Warehousing... ...premises and Azure cloud environments Migrates... ...automated testing, CI/CD, version control,... ...within Databricks/Delta Lake environments...Amazon Web ServiceCloudFlexible hours
32bjfunds
New York, NY4 days ago $180k - $225k
...Career with Point72’s Data Engineering Technology Team As... ...solutions such as cloud computing, data... ...data pipelines and ETL workflows in Databricks... ...or Scala), Delta Lake, and notebook-based... ...preferably Azure or AWS). Strong programming... ...(e.g., Git), CI/CD workflows, and modern...Amazon Web ServiceCloudWork experience placement$130k - $165k
...centered design, data analytics and... ...seeking a Senior Data Engineer to design, build... ...data pipelines, ETL/ELT workflows,... ...), and AWS Glue. Develop and... ...indexes. Develop cloud infrastructure using... ...and enterprise CI/CD pipelines while... ...with modern data lake technologies including...Amazon Web ServiceCloudFull timeTemporary workRemote workWarpply
New York, NY3 days ago$125k - $140k
...Senior Data EngineerEkimetrics is a... ...ResponsibilitiesAs a Senior Data Engineer, you will lead... ...and optimizing ETL solutions that... ..., databases, cloud platforms, file... ...(Delta Lake, Spark, Asset Bundles... ...complete with CI/CD plus experience... ...familiarity with GCP or AWS a plus....Amazon Web ServiceCloudWork at officeFlexible hoursEkimetrics
New York, NY8 hours ago- ...and operating the data integrations... ...This is a hands-on engineering role with real... ...applications, primarily as AWS Glue jobs... ...and operating ETL/ELT pipelines... ...HaveExperience with data lake and large-scale... ...) and CI/CD concepts.Tech Environment... ...Might Work With)Cloud: AWS (EC2, ECS,...Amazon Web ServiceCloudFull timeWork at officeRemote work
Twenty Inc.
New York, NY3 days ago $190k - $250k
...Data ArchitectOwn and drive the technical... ...platforms in a cloud-native environment (Azure, AWS, or GCP).... ...BI consumers.Set engineering standards and best... ...lakehouse), and ETL/ELT architecture... ...stores, plus data lake/lakehouse... ...understanding of CI/CD pipelines, infrastructure...Amazon Web ServiceCloudFull timeTemporary workFlexible hoursNewmark ltd
New York, NY3 days ago- ...growth Digital, Data and AI Transformation... ...“Power of 3”: Engineering & Operations... ....Data Engineer- AWS & Streaming Location... ...scalable ETL/ELT pipelines using... ...reliability, and cost in cloud environments... ...Exposure to CI/CD pipelines, IaC (... ...Familiarity with data lake/lakehouse...Amazon Web ServiceCloud
$90k - $198.5k
...a Forward Deployed Data Engineer, you will design and... ...applications. Build ELT/ETL pipelines using SQL,... ..., hyperscalers, and cloud-native environments.... ...data models, data lakes, lakehouses, and... ...Docker, Kubernetes, Git, CI/CD, and cloud platforms (AWS, Azure, or GCP). ~...Amazon Web ServiceCloudPermanent employmentFull timeWork at officeWorldwideFlexible hoursSAP
New York, NY3 days ago- ...human-centered, data-driven approach... ...a skilled Data Engineer with strong Databricks... ...tools, ETL/ELT processes, data... ...frameworks, and cloud‑based data platforms... ...clusters, Delta Lake, and Spark‑based... ...such as AWS, Azure, or Google... ...Experience with CI/CD pipelines and source...Amazon Web ServiceCloudLocal area
- ...Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted... ...years Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks,... ...and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,) Strong organizational...Amazon Web ServiceCloud
- ...are seeking a skilled AWS Data Engineer to design, build, and optimize... ...on the AWS cloud platform. The ideal candidate... ...and maintain scalable ETL/ELT data pipelines using... ...Build and manage data lakes and data warehouses (e.... ...Hadoop) Experience with CI/CD pipelines and version...Amazon Web ServiceCloudFull timeLocal area
Capgemini
New York, NY29 days ago - ...threats and social engineering by simulating... ...with comprehensive data and automatically... ...implement robust ETL/ELT and AI/ML pipelines... ...Develop and optimise cloud‑based data lakes and warehouses (e.... ...Terraform and CI/CD pipelines for data... ...infra (preferably AWS). Bachelor’s degree...Amazon Web ServiceCloudFull timeWork at officeRemote work
- ...countries. Collaborate with Data Science teams to design,... ...data pipelines, ETL processes, and feature engineering pipelines using AWS (Lambda, S3, Glue, Kinesis... ...NoSQL databases. Utilize CI/CD tools (GitHub, GitHub Actions... ...and SQL issues in Data Lake, Data Warehouse, and...Amazon Web ServiceCloudContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer: Data Lakes, ETL, & Cloud CI/CD. Be the first to apply!
Related searches
- junior data engineer remote New York, NY
- director data engineering New York, NY
- hadoop big data developer New York, NY
- data engineer intern New York, NY
- senior data quality engineer New York, NY
- senior cloud data engineer New York, NY
- data engineer contract New York, NY
- data infrastructure engineer New York, NY
- junior data developer New York, NY
- associate data engineer New York, NY