Senior Big Data Engineer
PB consulting
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
- Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
- Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
- Develop and optimize complex SQL queries for data processing and analytics.
- Ensure data quality, performance, and reliability across enterprise data platforms.
- Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
- 8+ years of overall IT experience in data engineering or big data development.
- Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
- Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Strong SQL skills with experience writing and optimizing complex queries.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Unix/Linux environments. (Preferred)
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in Cliffside Park, NJ vacancy
- ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop...SeniorBig data
PB consulting
West New York, NJ23 hours ago - ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department... ...Engineering and Machine Learning. Evaluate readiness of new big/fast data capabilities to be used to support critical...SeniorBig dataImmediate start
Cardinal Integrated
Secaucus, NJ3 days ago - ...The Senior Technical Specialist will be responsible for providing... ...1. Develop and implement data processing frameworks using Apache... ...latest trends and advancements in big data technologies. Skill... ...solutions. 4. Knowledge of data engineering concepts and methodologies....SeniorBig data
Omni Inclusive
Jersey City, NJ4 days ago $176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data engineering... ...Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive...SeniorBig dataCiti
Jersey City, NJ3 days ago- ..., we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert‑level...SeniorBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
Jersey City, NJ2 days ago $176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional... ...data platform? We are looking for a Senior Data Engineering Lead to be a player-coach for our talented... ...hands-on experience with modern big data technologies and Data streaming (like...SeniorBig dataFull time- ...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...SeniorBig dataPermanent employmentFull timeH1b
- ...Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level...Big data
InterSources
Weehawken, NJ3 days ago $80k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...SeniorBig dataFull timeRemote workWorldwideFlexible hours- ...and Instagram. Position Description: We are seeking a Senior Data Engineer to join our team and help us build the next generation of... ...understanding of data modeling concepts and practices ~ Big Data Technologies : Spark, Databricks, Structured Streaming...SeniorBig dataRemote workWorldwide
GrabJobs
Jersey City, NJ23 hours ago - ...Experienced, Senior Core Java (Java 8). Fundamental coding needs to be strong. -multi-threading, collections of API, JDBC and knowledge... ...JPA Repository implementation. -Eager and lazy loading in JPA. Big Data technologies and frameworks: preferably Apache Hadoop. Apache...SeniorBig dataFull time
- ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorganChase within the Corporate Sector- Liquidity... ...programming language including Java and/or PythonStrong Big-Data and database skills including Spark, Databricks, and/or...SeniorBig dataFor contractorsWork at office
$121.2k - $181.8k
...: Technology, Applications DevelopmentCompany: CitiSenior Java Big Data Developer with experience in designing and developing Java/J2EE... ...Finance dashboard application that provides sensitive data to senior management. Application involves business process workflow and...SeniorBig dataFull time$140k - $145k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial services and... ...is mandatory. Knowledge of Big Data technologies like Spark and Pyspark... ...without discrimination. Additional Details Seniority level: Mid-Senior level Employment...Big dataFull timeFlexible hoursSynechron
Weehawken, NJ23 hours ago- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ23 hours ago - ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time$169.54k - $175k
...locations across North America.Job DescriptionPosition Purpose:The Data Engineer is responsible for designing, building, and maintaining... ...; and1 year experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.Additional InformationPay...Big dataFlexible hours$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with...Big dataFull timeTemporary workRelocation- ...Street Newark, New Jersey 07068 7 plus years of experience in data engineering, with at least 3 years in technical leadership or lead engineer... ...Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach...Big data
SANS Consulting Services, Inc.
Newark, NJ4 days ago - ...Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using... ...developing Linux, UNIX shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. Experience with...Big data
Cedent Life Talent
Newark, NJ3 days ago - ...Job Description: We are seeking experienced Data Engineers in a contract capacity to join our talented Data Engineering team. In this role... ...modern data warehousing tools like Snowflake or Databricks • Familiarity with distributed systems and big data technologies.Big dataContract work
Argyll Infotech, Inc.
Bronx, NY3 days ago $95k - $150k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of...SeniorPermanent employment- Oracle SQLPLSQL10 years experience with at least 3 years experience as a data analystDelivery focused technofunctional roleGood knowledge of SQL programming preferably with databases such as Oracle ExadataProgramming experience with PythonProgramming experience with Hadoop...Senior
- ...Data Engineer Sunnyvale, CA/Hoboken, NJ (open to relo candidates, just have to be able to relocate asap) 9+ months Contract Work with... ...field) and 6+ years of experience Experience leveraging big data technologies such as Hive, Hadoop, PySpark Experience building...Big dataContract workImmediate startRelocation
My3Tech Inc
Hoboken, NJ3 days ago $60 - $65 per hour
...Job Title: AWS Lead Data Engineer Company: MSC GLOBAL Location: Newark, NJ (Hybrid) Employment Type: Contract Salary: $60-65/hour Experience... .... Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Experience with DevOps practices, CI/CD pipelines...Big dataContract workH1bWork at officeLocal areaSocket
Newark, NJ4 days ago$115k - $155k
Job Classification:Technology - Engineering & CloudAs an AI/Data Engineer, you will design, build, and maintain scalable data and AI solutions supporting... ...on modern cloud platforms. You will work closely with senior engineers, architects, and business stakeholders to...SeniorFull timePart timeWork at office3 days per week- ...Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a right to hire assignment with one of our premier... ...concepts. Experience with ETL tools, data pipeline frameworks, and big data technologies (preferred). Knowledge of Quality Engineering...Big data
Software Guidance & Assistance
Rutherford, NJ23 hours ago $77 - $82 per hour
...immediate contract opportunity for an experienced Data Engineer Responsibilities: Partner with project managers, business stakeholders, and senior managers to translate complex business... ...programming skills. Experience with Big Data ecosystems, including Cloudera and/or...Big dataContract workImmediate startCreative Solutions Services, LLC
Rutherford, NJ23 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
