Senior Data Engineer: Spark, PySpark & Pipelines
Tata Consultancy Services
Tata Consultancy Services is seeking a data engineer in Jersey City, NJ, to design and maintain scalable data pipelines primarily using Python and Spark. The ideal candidate will have strong expertise in ETL/ELT workflows and a solid understanding of data warehousing principles. Responsibilities include optimizing data processes, collaborating on cloud deployment strategies, and ensuring data security. A Bachelor's degree in Computer Science or a related field is essential, along with a passion for problem-solving and teamwork. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Spark, PySpark & Pipelines in Jersey City, NJ vacancy
- ...Programmers.io is looking for a Data Engineer in Jersey City, NJ. This hybrid... ...(10+ years) in Python and PySpark, strong skills in building scalable data pipelines, and a solid grasp of KYC/AML domains... ...-on experience with tools like Spark, Hadoop, Kafka, and should be...PipelineSenior
programmers.io
Jersey City, NJ4 days ago - ...Design, develop, and maintain scalable data pipelines using Python and Spark. Build and optimize ETL/ELT workflows... ...in Python programming for data engineering and data processing. Extensive experience with Apache Spark (PySpark) for large-scale data processing and...PipelineSenior
Tata Consultancy Services
Jersey City, NJ4 days ago - ...American International Group in Jersey City is seeking a Data Engineer to develop and optimize data pipelines and applications. You'll adhere to high code quality... ...and work with various technologies including PySpark, Informatica, and AWS to enhance data processing and...PipelineSenior
American International Group
Jersey City, NJ12 hours ago - A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing...PipelineFull time
- ...A leading independent jobs platform is seeking an experienced Data Engineer to work remotely. You will design and implement data pipelines while optimizing data flows using technologies like Spark and Kafka. Candidates should have a minimum of 5 years in data engineering...PipelineSeniorRemote work
MBO Partners
New York, NY2 days ago - ...Optomi is seeking a Software Engineer to join a high-impact Data Engineering team responsible for building scalable,... ...you will design and develop data ingestion pipelines and ETL frameworks using AWS services like Glue, PySpark, and EMR. The ideal candidate should have...PipelineSenior
Optomi
New York, NY4 days ago - ...Olik Global is seeking a Senior Data Engineer to join their team in Kentucky. The ideal candidate will have... ...expertise in Informatica PowerCenter/IDQ and PySpark, tasked with designing and optimizing large-scale data pipelines. With a background in the Hadoop ecosystem,...PipelineSenior
Olik Global
Brooklyn, NY3 days ago - ...Beacon Hill Staffing Group, LLC is seeking a Senior Data Engineer to work remotely on a temporary contract basis. The role involves... ...data assets to Databricks Unity Catalog, optimizing pipelines, and building scalable PySpark-based data solutions. The ideal candidate will have...PipelineSeniorContract workTemporary workRemote work
Beacon Hill Staffing Group
New York, NY2 days ago $175.43k - $183.61k
...ICF Olson is hiring Senior Software Engineers to support the Centers for Medicare and Medicaid Services (CMS) in data processing and scoring clinicians effectively. The role... ...emphasizes building data processing pipelines with Spark and collaborating across teams to deliver...PipelineSeniorRemote workICF Olson
New York, NY3 days ago- ...Tech Mirrors is seeking a Senior Data Analyst/Engineer in New York. The role requires proficiency in SQL... ..., extensive experience with PySpark, and knowledge of machine learning concepts... ...will have hands-on experience with data pipelines and analytics, utilizing SQL, PySpark...PipelineSenior
Tech Mirrors
New York, NY3 days ago - ...Systems, Inc. is seeking a highly skilled Senior Data Engineer to design, develop, and maintain... ...engineering technologies, including SQL, Spark, and Scala, along with strong... ...Responsibilities include architecting ETL/ELT pipelines and optimizing data processing infrastructures...PipelineSeniorRemote work
EPAM Systems Inc
New York, NY2 days ago - ...Nityo Infotech is seeking a Data Engineer located in Jersey City, NJ, to... ...design and maintain scalable data pipelines. The role demands 3–6 years... ...expertise in Python and PySpark, along with building ETL/ELT... ...KYC/AML and hands-on skills in Spark, Hadoop, and Kafka are essential...Pipeline
Nityo Infotech
Jersey City, NJ2 days ago - ...Requirements 3–6 years of experience as a Data Engineer with strong Python and PySpark expertise Experience building scalable ETL/ELT pipelines in big data environments Strong... ...Onboarding domains Hands‑on experience with Spark, Hadoop, Kafka, and cloud platforms Solid...Pipeline3 days per week
Nityo Infotech
Jersey City, NJ3 days ago - ...Senior Data Engineer / Data Architect Location: Jersey City, NJ (Hybrid)... ...• Deep understanding of PySpark development principles, including... ...to write optimized, scalable Spark jobs. • Strong grasp of object... ...and implementing data pipelines using PySpark and related big...PipelineSeniorContract work
Lorven Technologies
Jersey City, NJ4 days ago - ...analytics consulting firm is seeking an experienced Data Engineer to design and maintain scalable data pipelines on AWS. You will collaborate with data scientists... ...pipeline construction with Databricks and Apache Spark, and familiarity with modern AI applications. This...PipelineSenior
Tiger Analytics
Jersey City, NJ4 days ago - ...Analytics, LLC is seeking an experienced Data Engineer to join their data team in Jersey City,... ...design, build, and maintain scalable data pipelines on AWS cloud for analytics, machine... ...processing tools such as Databricks and Apache Spark. Join a growing team with significant...PipelineSenior
Tiger Analytics
Jersey City, NJ4 days ago - ...An established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This role involves integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring...PipelineSenior
TechDigital Group
New York, NY3 days ago - ...Senior Data Engineer - Media Org (Hybrid NYC or LA) I’m working on a Senior... ...designing batch and real-time data pipelines, working heavily within a... ...Requirements Strong PySpark and SQL expertise Experience with Databricks or similar Spark-based cloud platforms Experience...PipelineSeniorFull time
LHi Group
New York, NY4 days ago - ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration :... ...CODING + HM Interview. MUST SKILLS : Spark, Scala, Python Technical &... ...experience in scalable data pipeline using Scala, Python, pyspark, Hadoop, Apache Spark, Spark SQL, Kafka...PipelineSeniorLong term contractFull timeWork experience placementFlexible hours
Maintec Technologies
Jersey City, NJ1 day ago - ...consultants bring deep expertise in Data Science, Machine Learning and... ...seeking an experienced Data Engineer to join our data team. In this... ...and maintaining scalable data pipelines, data integration processes,... ...using Databricks, Apache Spark, and SQL to support analytics,...PipelineSeniorLocal area
Tiger Analytics
Jersey City, NJ1 day ago $160k - $210k
...Overview Join to apply for the Senior Data Engineer role at Enigma Technologies,... ...data, through scalable data pipelines and models to the customer... ...(we use Databricks SQL, PySpark, and MLFlow). You\'ll be building... ...Prior experience in Python, Spark and Databricks. About Us At...PipelineSeniorEnigma Technologies
New York, NY4 days ago- ...is an award-winning, AI-First digital engineering and consulting company focused on delivering... ...expertise, disciplined cloud and data engineering practices, and cutting-... ...Databricks implementations - developing data pipelines using PySpark. Experience in Databricks Workspaces,...PipelineSeniorFull time
Quantiphi
Jersey City, NJ4 days ago - ...Overview Job Title: Senior Data Engineer (Banking) Location: New York City,... ...Snowflake, Databricks, Python, PySpark, SQL, Banking Key... ...and develop robust ETL/ELT pipelines using Snowflake, Databricks,... ...and Databricks (Delta Lake, Spark optimization). Proficiency in...PipelineSeniorContract work
Accord Technologies Inc
New York, NY4 days ago - ...Optomi, is seeking a Software Engineer to join a high-impact Data Engineering team... ...developing data ingestion pipelines, ETL frameworks, and large... ...experience with AWS Glue and PySpark, a solid foundation in software... ...SDLC standards. Optimize Spark and Glue workloads for...PipelineSenior
Optomi
New York, NY4 days ago $120.8k - $217.4k
...Acuity Brands is seeking a Senior Data Engineer to join its Atrius Analytics... ...implement scalable data engineering pipelines for ingesting, transforming,... ...using Apache Flink, Apache Spark, and Databricks. Build and... ...such as Python, Java, PySpark, Scala, and R. Qualifications...PipelineSenior6AM City
New York, NY3 days ago$65 - $70 per hour
...Pinnacle Group is looking for a Data Engineer in Jersey City, NJ, who will focus on designing and executing data solutions using AWS, Python, and PySpark. The role emphasizes creating and maintaining data pipelines that support various business objectives. Candidates...PipelineHourly payContract workkozmetickesluzby.vecnakraska.sk - Jobboard
Jersey City, NJ2 days ago- ...for the following position: Senior Data Engineer Job Overview Design, build and... ...modular and scalable data pipelines and data infrastructure leveraging... ...such as Python, Spark and SOL, consuming data sources... ...with SQL, Python, and Spark/PySpark is required. Experience with...PipelineSenior
Cpus Engineering Staffing Solutions Inc.
New York, NY4 days ago - ...minimum of 10+ years of relevant data engineering experience in enterprise... ...-scale data platforms and pipelines. These platforms support... ...languages such as Python, SQL, Spark (PySpark/Scala) and scripting... ...actionable recommendations for senior leadership, technical teams...PipelineSeniorNight shift
Ursa Space Systems Inc
New York, NY4 days ago - ...5+ year's experience in modern data engineering/data warehousing/data lakes technologies... ...(Microsoft Fabric, Databricks, Spark etc..) and programming skills in PySpark and Spark SQL. Be an... ...processing and distribution using pipelines on Azure cloud services. Leads...PipelineSenior
Prophecy Technologies
Newark, NJ1 day ago - ...innovative firm is looking for a talented Big Data Engineer to join their dynamic team. In this role... ...will design and implement scalable data pipelines, develop machine learning models, and... .... Your expertise in tools like Apache Spark, AWS Glue, and various databases will be...PipelineSenior
TechDigital Group
Jersey City, NJ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Spark, PySpark & Pipelines. Be the first to apply!
Related searches
- senior data integration developer Jersey City, NJ
- data engineer contract Jersey City, NJ
- data science developer Jersey City, NJ
- senior data center engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- hadoop big data developer Jersey City, NJ
- data developer Jersey City, NJ
- remote data engineer Jersey City, NJ
- sr data engineer Jersey City, NJ
- big data cloud engineer Jersey City, NJ