Senior Big Data Engineer
PB consulting
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
- Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
- Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
- Develop and optimize complex SQL queries for data processing and analytics.
- Ensure data quality, performance, and reliability across enterprise data platforms.
- Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
- 8+ years of overall IT experience in data engineering or big data development.
- Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
- Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Strong SQL skills with experience writing and optimizing complex queries.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Unix/Linux environments. (Preferred)
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in West New York, NJ vacancy
- ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department... ...Engineering and Machine Learning. Evaluate readiness of new big/fast data capabilities to be used to support critical...SeniorBig dataImmediate start
Cardinal Integrated
Secaucus, NJ3 days ago - ...The Senior Technical Specialist will be responsible for providing... ...1. Develop and implement data processing frameworks using Apache... ...latest trends and advancements in big data technologies. Skill... ...solutions. 4. Knowledge of data engineering concepts and methodologies....SeniorBig data
Omni Inclusive
Jersey City, NJ4 days ago $176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data engineering... ...Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive...SeniorBig dataCiti
Jersey City, NJ3 days ago- ..., we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert‑level...SeniorBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
Jersey City, NJ2 days ago $176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional... ...data platform? We are looking for a Senior Data Engineering Lead to be a player-coach for our talented... ...hands-on experience with modern big data technologies and Data streaming (like...SeniorBig dataFull time- We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting... .... Proven experience with ETL/ELT processes, data modeling, and big data frameworks . Demonstrated ability to lead, mentor, and...SeniorBig dataWork at office
- Our Sportsbook Data Team is looking for a Data Engineer to make a difference in the further development of our Data Warehouse solutions, designing and developing... ...be a plus (.NET, Python, R, Scala) Knowledge around Big Data concepts and data streaming architectures will be a...SeniorBig dataLocal area
- ...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...SeniorBig dataPermanent employmentFull timeH1b
- ...Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level...Big data
InterSources
Weehawken, NJ3 days ago $80k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...SeniorBig dataFull timeRemote workWorldwideFlexible hours- ...and Instagram. Position Description: We are seeking a Senior Data Engineer to join our team and help us build the next generation of... ...understanding of data modeling concepts and practices ~ Big Data Technologies : Spark, Databricks, Structured Streaming...SeniorBig dataRemote workWorldwide
GrabJobs
Jersey City, NJ14 hours ago - ...Data Engineer Sunnyvale, CA/Hoboken, NJ (open to relo candidates, just have to be able to relocate asap) 9+ months Contract Work with... ...field) and 6+ years of experience Experience leveraging big data technologies such as Hive, Hadoop, PySpark Experience building...Big dataContract workImmediate startRelocation
My3Tech Inc
Hoboken, NJ3 days ago - ...Experienced, Senior Core Java (Java 8). Fundamental coding needs to be strong. -multi-threading, collections of API, JDBC and knowledge... ...JPA Repository implementation. -Eager and lazy loading in JPA. Big Data technologies and frameworks: preferably Apache Hadoop. Apache...SeniorBig dataFull time
- ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorganChase within the Corporate Sector- Liquidity... ...programming language including Java and/or PythonStrong Big-Data and database skills including Spark, Databricks, and/or...SeniorBig dataFor contractorsWork at office
$121.2k - $181.8k
...: Technology, Applications DevelopmentCompany: CitiSenior Java Big Data Developer with experience in designing and developing Java/J2EE... ...Finance dashboard application that provides sensitive data to senior management. Application involves business process workflow and...SeniorBig dataFull time- ...capabilities, streamlined global operations and extensive big-data analytics, covering everything merchants need to scale worldwide... ...and impact are part of everyday work. ABOUT THE ROLE:As a Senior Software Engineer at Global-e, you will design and deliver the core services...SeniorBig dataWork at officeWorldwide
$140k - $145k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial services and... ...is mandatory. Knowledge of Big Data technologies like Spark and Pyspark... ...without discrimination. Additional Details Seniority level: Mid-Senior level Employment...Big dataFull timeFlexible hoursSynechron
Weehawken, NJ14 hours ago$96k - $186k
......What you'll do...Role summary: As a Senior Data Analyst at Walmart, you will leverage advanced... ...reporting. Leveraging expertise in big data, SQL, Python, and Tableau, they... ...Option 1: Bachelor's degree in Business, Engineering, Statistics, Economics, Analytics, Mathematics...SeniorBig dataFull timeTemporary workPart time$108k - $216k
...a customer and competitive lens. As a Senior Manager, Advanced Analytics in the team,... ...opportunity to leverage the power of technology, big data and analytics to improve the lives of... ...while partnering across Product, Engineering, Marketing, Finance, and Strategy teams....SeniorBig dataFull timeTemporary workPart time- ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ14 hours ago $65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time$169.54k - $175k
...locations across North America.Job DescriptionPosition Purpose:The Data Engineer is responsible for designing, building, and maintaining... ...; and1 year experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.Additional InformationPay...Big dataFlexible hours$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with...Big dataFull timeTemporary workRelocation$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...solutions combine best-in-class localization capabilities, big-data best-practice business intelligence models, streamlined international... ...our growing international family. ABOUT THE ROLE: As a Senior Software Engineer at Global-e, you will design and deliver the core services...SeniorBig dataWork at officeWorldwide
- ...Street Newark, New Jersey 07068 7 plus years of experience in data engineering, with at least 3 years in technical leadership or lead engineer... ...Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach...Big data
SANS Consulting Services, Inc.
Newark, NJ4 days ago - ...Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using... ...developing Linux, UNIX shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. Experience with...Big data
Cedent Life Talent
Newark, NJ3 days ago - Oracle SQLPLSQL10 years experience with at least 3 years experience as a data analystDelivery focused technofunctional roleGood knowledge of SQL programming preferably with databases such as Oracle ExadataProgramming experience with PythonProgramming experience with Hadoop...Senior
- ...Job Description: We are seeking experienced Data Engineers in a contract capacity to join our talented Data Engineering team. In this role... ...modern data warehousing tools like Snowflake or Databricks • Familiarity with distributed systems and big data technologies.Big dataContract work
Argyll Infotech, Inc.
Bronx, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
