Senior PySpark Data Engineer | ETL & Data Lakes
Creative Solutions Services, LLC
Creative Solutions Services, LLC is seeking a Data Engineer to design, build, and optimize ETL data pipelines using PySpark. The ideal candidate will have a Bachelor's degree and at least 7 years of experience in data engineering, with strong proficiency in Python and Apache Spark. You will collaborate with data scientists and stakeholders to deliver high-quality data solutions. Experience with big data technologies, cloud platforms, and version control is preferred. Excellent problem-solving skills are essential. #J-18808-Ljbffr Creative Solutions Services, LLC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior PySpark Data Engineer | ETL & Data Lakes in Rutherford, NJ vacancy
$150k
OTC Markets Group Inc., located in New York, is hiring for the position of AVP, Data Engineer. The successful candidate will design and build scalable ETL pipelines to enhance the organization's data capabilities. Candidates must have over 5 years of experience in relevant...Senior$150k
OTC Markets in New York, NY is seeking a skilled Data Engineer to join their IT Infrastructure team. This role focuses on building and optimizing ETL pipelines, ensuring data quality, and integrating various data sources. Candidates should possess over 5 years of experience...SeniorFlexible hours- Grow your career as an PySpark Data Engineer with an innovative global bank in Rutherford, NJ. Contract... ...concepts, dimensional modeling, and ETL principles. Proficiency in SQL for data... ...) data from various sources into data lakes and data warehouses. Develop and maintain...SuggestedContract workWorldwide3 days per week
- Motion Recruitment Partners LLC is seeking a PySpark Data Engineer for a contract role in Rutherford, NJ. Join a global bank renowned for its innovative approach in financial services. You will utilize technology to design and optimize data pipelines, working with cutting...SeniorContract work
- TekCommands Inc is looking for a Senior AWS Data Engineer based in New Jersey. This hybrid role involves driving efficient data acquisition and delivery while collaborating with cross-functional teams using AWS services such as S3, Glue, and Athena. The ideal candidate...Senior
- Openkyber is looking for a Senior Analytic Data Engineer to join our technical team in Georgia. This critical... ...will have extensive knowledge of ETL architecture, cloud-based platforms like... ...strong programming skills in Python and PySpark. Reporting skills in Power BI or...Senior
- ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly... ...and knowledge of Databricks and Delta Lake will be essential in driving the... ...implement scalable data pipelines and ETL processes using Java, Python, and Spark...Senior
Zortech Solutions
Passaic, NJ3 days ago - ...proprietary AI Studio and AI Engines, the company helps... ...potential with AI. Senior Data Engineer Are you an... ...performance tuning), and PySpark/Apache Spark. Data... ...Warehouse architectures. ETL/ELT & Orchestration:... .... Databricks: Delta Lake, Unity Catalog, Delta...SeniorH1bLocal area
Fusemachines
New York, NY2 days ago - ...ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ...You will implement Python-based ETL/ELT pipelines, orchestrate workflows... ...like Pandas , Polars , PySpark or DuckDB . 2+ years of experience...SeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
Jersey City, NJ1 day ago - ...Data Engineer Location: New York, NY (Onsite) Duration: Full-time... ...Hands-on experience in building ETL using Databricks SaaS... ...architecture. Good knowledge of Lake house architecture. Design... ...Databricks and Apache Spark (PySpark and Scala). Build data ingestion...SeniorFull timeImmediate startRelocation
JConnect Infotech
New York, NY2 days ago - ...building real‑time streaming data solutions that enable... ...telemetry data. While the Senior Data Engineer will support batch data... ...Medallion architecture. Develop ETL/ELT workflows to ingest,... ...pipelines using PySpark, Spark SQL, and Delta Lake, including Spark tuning for...SeniorTemporary workWork at officeRemote workVisa sponsorship
Medical Guardian
New York, NY4 days ago $115k - $155k
...Classification Technology - Engineering & Cloud As an AI/Data Engineer, you will... ...work closely with senior engineers, architects... ...data pipelines (ETL/ELT) Develop solutions... ...scale datasets using PySpark / SQL Deploy and integrate... ...with data lakes and warehouses Experience...SeniorWork at office3 days per weekPGIM
Newark, NJ4 days ago- ...PSEG is looking for a Senior Technology Engineer specializing in AWS Data Lakes in Newark, NJ. The role involves designing, coding, and supporting AWS data lake and analytics services, requiring strong collaboration with business units. Applicants should have extensive...SeniorFull time
PSEG
Newark, NJ1 day ago $106.9k - $176.5k
...world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data... ...including: ~ Implementation of a data lake solution using Databricks, integrating... ...SQL. Experience with data modeling, ETL processes, and data warehousing concepts...SeniorSummer holidayFlexible hoursEY
Secaucus, NJ1 day ago- Capnexus is seeking a highly skilled Senior AWS Data Engineer in New York to lead data architecture and pipeline development. The role involves designing multi-zone enterprise data lakes and building robust data ingestion pipelines. The ideal candidate will have over 5...SeniorFull time
- Tech Mirrors is seeking a Big Data Engineer in New York, NY for a long-term project. Responsibilities include designing and enhancing ETL frameworks, performance tuning, and cloud migration analysis. The ideal candidate boasts over 10 years of experience and strong knowledge...Senior
- An established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This... ...sources into the Azure Databricks platform, implementing ETL processes, and ensuring data quality and integrity. The successful...Senior
- Vortalsoft Inc is seeking a skilled data engineer to develop and maintain data pipelines for their Big Data financial crime solution. The ideal... ...solutions and strong skills in programming, data modeling, and ETL processes. The candidate should possess a Bachelor's degree in...Senior
- Overview Job Title: Senior Data Engineer (Banking) Location: New York City, NY... ...Snowflake, Databricks, Python, PySpark, SQL, Banking Key... ...Responsibilities Design and develop robust ETL/ELT pipelines using Snowflake... ...) and Databricks (Delta Lake, Spark optimization). Proficiency...SeniorContract work
$170k - $190k
...teams harness the power of data and AI technology to... ...more about us. Data Engineering is responsible for the... ...Data Engineer on the Data Lake team at H1, you will... ...and scale distributed ETL/ELT pipelines and large... ...proficiency in Python (PySpark), Java, Scala, or similar...Flexible hours- Senior Data Engineer - AI - ETL - Multi Strategy Hedge Fund - NY - Up to $500k TC We’re working with a global investment firm managing over $30bn AUM, which has invested heavily in modernising its data stack and is continuing to grow. This is a chance to be a core Data...SeniorWork at officeRemote work
- ...Capnexus is looking for a highly skilled Senior AWS Data Engineer to lead data architecture, pipeline... ..., and translate findings into data lake architecture requirements. Design... ...management data sources. Write PySpark and Python ETL code for AWS Glue jobs to transform,...SeniorFull time
- DBI Staffing is seeking a Data Engineer III to design, develop, and maintain data architecture for remote work in the U.S. This role emphasizes advanced T-SQL, ETL processes, and Python scripting to enhance data workflows. The successful candidate will collaborate with...SeniorRemote job
- Adhesives Research is looking for a Data Engineer in Glen Rock, New Jersey. The ideal candidate will design, develop, and maintain scalable data solutions while managing ETL processes and supporting analytics. A Bachelor's degree in Computer Science and 5+ years of relevant...Senior
- ASB Resources is seeking a Data Engineer for the Data & Analytics team in New York. This role is tailored for individuals with 7-10 years of... ...candidate will work extensively with SQL and Python, developing ETL pipelines and ensuring data quality. Familiarity with cloud...Senior
- ...looking for a Sr. Software Developer in New York, NY, to work on ETL tools and Microsoft SQL Server in a hybrid setting. This contract... ...on various visa statuses. The ideal candidate has experience with data flow, documentation, and a solid understanding of Agile...SeniorContract workLocal areaWork visa
- ...build, and optimize scalable data pipelines and ETL/ELT workflows using... ...Architect and manage data lake house solutions leveraging... ...architects, analysts, and engineering teams to define data models... ...Relevant experience and skills, Seniority and performance, Market and...Full timeLocal areaFlexible hours
Capgemini
New York, NY10 hours ago - ...We are looking for a skilled Data Engineer to join our team. The ideal candidate will have experience in building and optimizing data pipelines... ...understanding of data management practices, data warehousing, ETL processes. Required Qualifications: Bachelor's...
E-Solutions
Secaucus, NJ2 days ago - Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation...Senior
$100k - $120k
A leading technology company is seeking a Sr. Azure Data Engineer in Union City, New Jersey. The ideal candidate will have over 10 years of experience in data warehousing and ETL development, with strong skills in Informatica PowerCenter, Azure Data Factory, and SQL solutions...SeniorRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior PySpark Data Engineer | ETL & Data Lakes. Be the first to apply!
Related searches
- senior data center engineer Rutherford, NJ
- data engineer machine learning Rutherford, NJ
- data science developer Rutherford, NJ
- data engineer Rutherford, NJ
- senior cloud data engineer Rutherford, NJ
- data developer Rutherford, NJ
- data engineer analytics Rutherford, NJ
- finance data engineer Rutherford, NJ
- data center engineer Rutherford, NJ
- senior robotics software engineer Rutherford, NJ