Data Pipelines Engineer (ETL/ELT) with Spark & Cloud
NovateurIT
An IT consulting company in Kentucky is seeking a Data Pipeline Engineer to design and maintain robust ETL/ELT data pipelines. The ideal candidate will integrate data from various sources, implement data quality checks, and collaborate with cross-functional teams. A Bachelor’s degree in Computer Science or equivalent experience is required. This position offers opportunities in a dynamic and agile work environment. #J-18808-Ljbffr NovateurIT
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Pipelines Engineer (ETL/ELT) with Spark & Cloud in Brooklyn, NY vacancy
- Senior Data Engineer - AI - ETL - Multi Strategy Hedge Fund... ...TC We’re working with a global investment... ...team, owning the pipelines and ETL workflows... ...and optimise ETL/ELT pipelines across... ...with modern cloud data platforms (e... ...such as Dask or Spark. Location & Working...CloudWork at officeRemote work
$100k - $115k
...in Python programming for data engineering and data processing. • Extensive experience with Apache Spark (PySpark) for large-scale data... ...building and maintaining ETL/ELT pipelines for data ingestion and transformation... .... • Familiarity with cloud platforms (AWS, Azure, or...CloudTata Consultancy Services
Jersey City, NJ2 days ago- TechDigital Group is hiring a Data Engineer in Secaucus, New Jersey. In this role, you will design and develop scalable data pipelines on Google Cloud Platform, build and optimize ETL/ELT processes, and collaborate with stakeholders to create robust analytical solutions...Cloud
- ...Job Title: ETL Data Engineer Job location : Jeresy,NJ... ...business requirements for Cloud data platform. •... ...develop scalable data pipelines using modern data stack... ...data reviews. Work with other engineers on the... ...using various ETL and ELT tools • Hands-on experience...CloudFull time
Texas State Library and Archives Commision
Jersey City, NJ1 day ago - ...in New York is seeking an Intermediate Data Engineer to design and manage scalable ETL pipelines for analytics. The role involves working with AWS services and optimizing data processes... ..., and proficiency in PySpark and Apache Spark. This position will require onsite work...Suggested
$64.89k - $173.04k
...Enhancement is seeking a Data Engineer in Delaware to design and implement data pipelines. This full-time role involves building ETL/ELT pipelines, optimizing... ...models, and collaborating with data scientists. The ideal... ...SQL, and experience in cloud environments. The pay...CloudFull time$64.89k - $173.04k
...Career Enhancement is looking for a Data Engineer based in New Jersey to design and implement data pipelines that enhance analytical... ...The role involves collaborating with teams, optimizing data models,... ...in Python and SQL, along with cloud experience. The salary ranges from...Cloud- ...Role: Snowflake + Matillion ETL Developer / Data Engineer Location: New York, NY... ..., high-performance cloud data solutions. The ideal... ...& Dimensions, SCD Type 2) with proven experience in data... ...and develop scalable ETL/ELT pipelines using Matillion ETL and Snowflake...Cloud
Prophecy Technologies
New York, NY4 days ago $160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the... ...hands-on expertise with Databricks and the... ...write code, build pipelines, and architect solutions... ...-level in Apache Spark, including runtime... ...least two major cloud platforms (AWS,... ...experience spans ETL/ELT design, data warehousing...CloudWork experience placementRearc
New York, NY2 days ago- ...Georgia is looking for a qualified individual to analyze data sources and assess cloud services like Azure and AWS for AI-related projects. The... ...options. Successful candidates will have experience with ETL/ELT processes and the ability to communicate technical risks...CloudRemote workFlexible hours
- ...deep expertise in Data Science,... ...experienced Data Engineer to join our data... ...scalable data pipelines, data integration... ...infrastructure on AWS cloud. You will collaborate closely with data scientists... ..., Apache Spark, and SQL to... ...architectures, and ETL/ELT frameworks. ~...CloudLocal area
Tiger Analytics
Jersey City, NJ6 days ago - ...Credit Risk (CCR) Data Integration Engineer to assume end-... ...data integration pipelines across CCR technology... ...Implement robust ETL/ELT solutions for... .... Partner with EM and CRR users... ...experience with Cloud computing and infrastructure... ..., ADF, Kafka, Spark based distributed...CloudPermanent employmentTemporary workFixed term contract
Compu-Vision Consulting
New York, NY5 days ago $100 - $130 per hour
...is looking for a Data Engineer - Databricks to join... ...and managing Cloud databases such as... ...modeling, and experience with data governance in... ...and develop data pipelines keeping security,... ...Experience using Spark, Kafka, Hadoop, or... ...using ETL/ELT tools and technologies...CloudRemote workOpen Systems Technologies
New York, NY1 day ago- ...Studio and AI Engines, the company helps... ...AI journeys. With offices in North... ...required for data integration, storage... ..., DevOps and cloud-based large... ...Developer for Apache Spark ~ Databricks... ...efficient ELT/ETL processes in Azure... ...actions, Azure Pipelines, Jenkins or...CloudFull timeWork experience placementH1bLocal areaRemote work
Fusemachines
New York, NY3 days ago - ...AI Studio and AI Engines, the company helps... ...AI journeys. With offices in North... ...with AI. Senior Data Engineer Are you... ...real-time and batch pipelines, and developing cloud-native data... ...and PySpark/Apache Spark. Data Modeling... ...architectures. ETL/ELT & Orchestration:...CloudH1bLocal area
Fusemachines
New York, NY4 days ago $160k - $220k
...As a Senior Data Engineer at Metropolis, you... ...products that align with our mission. Your... ...develop end-to-end data pipelines and foundational... ...challenges using optimal ETL/ELT patterns for... ...data sets in the cloud ~5+ years of experience... ...Experience with Spark and PySpark...CloudTemporary workWork at officeLocal areaAfternoon shiftMetropolis Corp
New York, NY5 days ago- ...Data Engineer Jersey City, New Jersey, United States... ...Responsibilities: Build and maintain ETL/ELT data pipelines (batch & streaming)... ...BigQuery, and S3 Work with distributed systems such as Spark and Kafka Ensure data... ...big data tools and cloud data platforms Knowledge...Cloud
Glint Tech Solutions LLC
Jersey City, NJ3 days ago - Overview Job Title: Senior Data Engineer (Banking) Location:... ...and develop robust ETL/ELT pipelines using Snowflake, Databricks... .... Collaborate with quantitative analysts,... ...Databricks (Delta Lake, Spark optimization). Proficiency... .... Experience with cloud platforms (AWS/Azure)...CloudContract work
- ...Data Engineering Manager Location: Toronto, Ontario, Canada (Hybrid... ...a hands-on technical leader with deep expertise in Databricks, Spark, and modern cloud data frameworks. What... ...rchitect and implement scalable ETL/ELT pipelines using Spark (Python/Scala),...CloudFull time
Perennial Resources International
New York, NY1 day ago $141.9k - $190.3k
...Senior Data Engineer Technology is at the heart... ...marries technology with creativity to... ...large scale data pipelines that ingest vendor... ...more), land it in cloud storage, and transform... ...maintain scalable ETL/ELT pipelines for acquisition... ...PySpark and/or Spark SQL in production....CloudThe Walt Disney Studios
New York, NY4 days ago$45 - $55 per hour
...FocusKPI is looking for a Data Engineer to join our client's growing... ...build robust, scalable Spark-based ETL/ELT pipelines and data workflows supporting... ..., scalability, and cloud cost management across the... ...Partner cross-functionally with technical and business stakeholders...CloudWork at officeRemote workFocusKPI Inc.
New York, NY3 days ago- ...seeking a Software Engineer to join a high-impact Data Engineering team... ...scalable, cloud-native data solutions... ...data ingestion pipelines, ETL frameworks, and... ...hands‑on experience with AWS Glue and... ...environments. Develop ETL/ELT workflows... .... Optimize Spark and Glue workloads...Cloud
- Overview We are hiring a Data Engineer on behalf of one of... ...data platforms, modern cloud technologies, and... ...and maintain scalable ETL/ELT pipelines for structured and unstructured... .... Collaborate with data analysts, business... ...data technologies like Spark, Hadoop, or Databricks...CloudVisa sponsorship
- ...Job Title : Data Engineer with Mongo DB Job Location... ...data. Data Pipeline Development:... ...and maintaining robust ETL/ELT (Extract, Transform, Load... ...with other systems and cloud services (e.g., GCP, AWS... ...technologies such as Apache Spark, Airflow, Kafka, or...CloudFull time
Centraprise
Jersey City, NJ1 day ago - ...collection of executives, engineers, data scientists, and... ...empowers teams with insights and tools... ...maintain the data pipelines that power our... ...Develop efficient ETL/ELT workflows in Python... ...with Databricks, Spark, or equivalent big... ...Experience with cloud infrastructure (AWS...CloudRemote workFlexible hours
- ...systems, software, and cloud services. The Data Engineer in this role will... ...operate the data pipelines that power... ...will work closely with quantum hardware,... ...Transform, and Load (ETL) processes to... ...and operate ETL/ELT workflows and tooling... ...Trino, or Apache Spark Familiarity...Cloud
IBM
New York, NY9 days ago - ...years of relevant data engineering experience in enterprise... ...delivery, with deep experience in... ...data processing, cloud data warehousing,... ...data platforms and pipelines. These platforms support... ..., DBT cloud, ETL/ELT frameworks, as well... ...such as Python, SQL, Spark (PySpark/Scala)...CloudNight shift
- ...Job Title: Data Engineer Job Summary: We... ...maintaining scalable data pipelines, optimizing data... ...will work closely with data scientists,... ...data pipelines (ETL/ELT) using modern data... ...(APIs, databases, cloud storage, etc.) into... ...(e.g., Kafka, Spark, Flink). Knowledge...CloudRemote workFlexible hours
Adidev Technologies Inc
Jersey City, NJ4 days ago $138k - $181.65k
...roster has an opening with your name on it... ...for a Senior Data Engineer to design and build... ...scientists to deliver data pipelines and platforms that... ...maintain scalable ETL/ELT pipelines to... ...using tools like Spark, dbt or similar... ...~ Experience with cloud-based data platforms...CloudTemporary workLocal areaWorldwideFanDuel
New York, NY5 days ago- ...platform in Mexico, with $500MM in... ...looking for a Senior Data Engineer to help design, build... ..., reliable data pipelines and datasets that... ...Build and maintain ETL/ELT pipelines:... ...Experience working with cloud data warehouses and... ...frameworks such as Spark (or equivalent)....CloudWork at officeRelocation package
Nelo Mobile
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Pipelines Engineer (ETL/ELT) with Spark & Cloud. Be the first to apply!
Related searches
- data engineering intern summer Brooklyn, NY
- senior data integration developer Brooklyn, NY
- data science developer Brooklyn, NY
- senior data center engineer Brooklyn, NY
- software data engineer Brooklyn, NY
- data developer Brooklyn, NY
- remote data engineer Brooklyn, NY
- sr data engineer Brooklyn, NY
- etl data engineer Brooklyn, NY
- junior data engineer remote Brooklyn, NY