Senior Big Data Engineer
PB consulting
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
- Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
- Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
- Develop and optimize complex SQL queries for data processing and analytics.
- Ensure data quality, performance, and reliability across enterprise data platforms.
- Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
- 8+ years of overall IT experience in data engineering or big data development.
- Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
- Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Strong SQL skills with experience writing and optimizing complex queries.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Unix/Linux environments. (Preferred)
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in Middle Village, NY vacancy
- ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop...SeniorBig data
PB consulting
Sunnyside, NY21 hours ago - ...The Senior Technical Specialist will be responsible for providing... ...1. Develop and implement data processing frameworks using Apache... ...latest trends and advancements in big data technologies. Skill... ...solutions. 4. Knowledge of data engineering concepts and methodologies....SeniorBig data
Omni Inclusive
Jersey City, NJ4 days ago $176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data engineering... ...Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive...SeniorBig dataCiti
Jersey City, NJ3 days ago- ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department... ...Engineering and Machine Learning. Evaluate readiness of new big/fast data capabilities to be used to support critical...SeniorBig dataImmediate start
Cardinal Integrated
Secaucus, NJ3 days ago $176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional... ...data platform? We are looking for a Senior Data Engineering Lead to be a player-coach for our talented... ...hands-on experience with modern big data technologies and Data streaming (like...SeniorBig dataFull time- ...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...SeniorBig dataPermanent employmentFull timeH1b
$80k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...SeniorBig dataFull timeRemote workWorldwideFlexible hours- ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorganChase within the Corporate Sector- Liquidity... ...programming language including Java and/or PythonStrong Big-Data and database skills including Spark, Databricks, and/or...SeniorBig dataFor contractorsWork at office
$121.2k - $181.8k
...: Technology, Applications DevelopmentCompany: CitiSenior Java Big Data Developer with experience in designing and developing Java/J2EE... ...Finance dashboard application that provides sensitive data to senior management. Application involves business process workflow and...SeniorBig dataFull time- ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ21 hours ago $82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with...Big dataFull timeTemporary workRelocation$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...About the job Data Engineer Title: Data Engineer Join a forward-thinking and innovative organization that values growth, collaboration... ...and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data...Big data
Glint Tech Solutions LLC
Jersey City, NJ2 days ago - Oracle SQLPLSQL10 years experience with at least 3 years experience as a data analystDelivery focused technofunctional roleGood knowledge of SQL programming preferably with databases such as Oracle ExadataProgramming experience with PythonProgramming experience with Hadoop...Senior
$95k - $150k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of...SeniorPermanent employment- ...Experienced, Senior Core Java (Java 8). Fundamental coding needs to be strong. -multi-threading, collections of API, JDBC and knowledge... ...JPA Repository implementation. -Eager and lazy loading in JPA. Big Data technologies and frameworks: preferably Apache Hadoop. Apache...SeniorBig dataFull time
- ...Data Engineer Sunnyvale, CA/Hoboken, NJ (open to relo candidates, just have to be able to relocate asap) 9+ months Contract Work with... ...field) and 6+ years of experience Experience leveraging big data technologies such as Hive, Hadoop, PySpark Experience building...Big dataContract workImmediate startRelocation
My3Tech Inc
Hoboken, NJ3 days ago $142.32k - $213.48k
...ProfessionalCompany: CitiCiti is looking for a Lead Data Engineer - AI & Distributed Analytics to... ...data systems.Deep expertise in big data frameworks including Apache Iceberg... ...financial wellbeing package reflective of the seniority and strategic importance of the role.Wellbeing...Big dataFull timeWork at officeRemote work- Job ID: 25823899Reference Number: 25-00728Title: Senior Data Engineer (Python)Location: Jersey City, NJPosted Date: 2025-07-02Contact: Mahi MahiContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Advanced Python programming skills...Senior
- We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
- ...Job Title: Lead Data Engineer Location: Jersey City Type: Contract Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities: ~ Lead the design, development, and implementation of data solutions using AWS and Snowflake...Big dataContract workWork experience placement
VBeyond
Jersey City, NJ4 days ago - ...Senior Data Engineer Jersey City, New Jersey, United States Role Overview Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience...Senior
Inizio Partners
Jersey City, NJ3 days ago - ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models...Big data
- Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT processes. Build and... ...in Computer Science, Information Technology, Engineering, or a related field. 4+ years of experience in Data Engineering or Big Data development. Hands-on experience with...Big data
- ...capabilities, streamlined global operations and extensive big-data analytics, covering everything merchants need to scale worldwide... ...and impact are part of everyday work. ABOUT THE ROLE:As a Senior Software Engineer at Global-e, you will design and deliver the core services...SeniorBig dataWork at officeWorldwide
$142.32k - $213.48k
...StatesSalary: $142,320.00 - $213,480.00Category: Technology, Applications Development, ProfessionalCompany: CitiThe Big Data PySpark Lead Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in...Big dataFull time$150k - $165k
...artisans to source the highest quality ingredients - then use smart data, automation, and logistics to deliver them at peak freshness.... ...data platform on Google Cloud and looking for a hands-on Senior Data Engineer to own the transformation layer from raw source data through...SeniorWork at officeLocal areaFreshDirect
Bronx, NY4 days ago- The Senior Advisor, Learner Experience is a strategic change management lead responsible for... ...50 years, Verisk has been the leading data analytics and technology partner to the global... ...for people like you to help us translate big data into big ideas. Join us and create an...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
