Senior Big Data Engineer
PB consulting
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
- Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
- Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
- Develop and optimize complex SQL queries for data processing and analytics.
- Ensure data quality, performance, and reliability across enterprise data platforms.
- Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
- 8+ years of overall IT experience in data engineering or big data development.
- Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
- Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Strong SQL skills with experience writing and optimizing complex queries.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Unix/Linux environments. (Preferred)
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in Maspeth, NY vacancy
- ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop...SeniorBig data
PB consulting
Sunnyside, NY23 hours ago - ...The Senior Technical Specialist will be responsible for providing... ...1. Develop and implement data processing frameworks using Apache... ...latest trends and advancements in big data technologies. Skill... ...solutions. 4. Knowledge of data engineering concepts and methodologies....SeniorBig data
Omni Inclusive
Jersey City, NJ4 days ago $176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data engineering... ...Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive...SeniorBig dataCiti
Jersey City, NJ3 days ago- ...About the job Senior AWS Data Engineer Role Overview: Lead the design, development, and optimization of large-scale, reliable, and... ...Hands-on experience with ETL, distributed compute, and big data frameworks such as Spark, Glue, Hadoop/EMR, Impala, or...SeniorBig data
Inizio Partners
Newark, NJ4 days ago - ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department... ...Engineering and Machine Learning. Evaluate readiness of new big/fast data capabilities to be used to support critical...SeniorBig dataImmediate start
Cardinal Integrated
Secaucus, NJ3 days ago $176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional... ...data platform? We are looking for a Senior Data Engineering Lead to be a player-coach for our talented... ...hands-on experience with modern big data technologies and Data streaming (like...SeniorBig dataFull time- ...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...SeniorBig dataPermanent employmentFull timeH1b
$80k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...SeniorBig dataFull timeRemote workWorldwideFlexible hours- ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorganChase within the Corporate Sector- Liquidity... ...programming language including Java and/or PythonStrong Big-Data and database skills including Spark, Databricks, and/or...SeniorBig dataFor contractorsWork at office
$121.2k - $181.8k
...: Technology, Applications DevelopmentCompany: CitiSenior Java Big Data Developer with experience in designing and developing Java/J2EE... ...Finance dashboard application that provides sensitive data to senior management. Application involves business process workflow and...SeniorBig dataFull time- Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT processes. Build and... ...in Computer Science, Information Technology, Engineering, or a related field. 4+ years of experience in Data Engineering or Big Data development. Hands-on experience with...Big data
- ...clinical, agronomical, and marketing data, driving innovation in life... ...are currently seeking a Data Engineer with a critical thinking and... ...databases and data stores for big datasets with performance... ...varying technical backgrounds & seniority. Nice to have BS/MS degree in...Big dataFlexible hours
- ...ownership, mutual respect, and a passion for collaborating to solve complex customer problems. About the Job Opportunity The Senior Data Engineer plays a leading role in modernizing our enterprise data platform as we transition from legacy systems (DB2, Talend) to a...SeniorLocal area
$150k - $170k
...candidate must have a successful track record in handling complex data pipelines for high transaction volume application and... ...migration from and synchronization with legacy systems. The Senior Data Engineer provides support to the Application database design to aid in...SeniorWork experience placementH1bWork at officeLocal area- Senior Data Engineer Established in 2021, Independence Pet Holdings is a corporate holding company that manages a diverse and broad portfolio of modern pet health brands and services, including insurance, pet education, lost recovery services, and more throughout North...SeniorTemporary workWork at officeRemote workFlexible hours
$135k - $170k
...and ongoing skills training opportunities Employee resource groups Swag, ticket giveaways, and more! About The Role The Senior Data Engineer will own the path from raw transactional and event data to trustworthy, well‑modeled datasets powering BetMGM's analytics, ML...SeniorContract workFor contractorsH1bVisa sponsorshipFlexible hours- ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ23 hours ago $82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with...Big dataFull timeTemporary workRelocation$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...About the job Data Engineer Title: Data Engineer Join a forward-thinking and innovative organization that values growth, collaboration... ...and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data...Big data
Glint Tech Solutions LLC
Jersey City, NJ2 days ago - ...Data Engineer - AWS Location: Newark, NJ. Work Arrangement: 3 days/week hybrid. Final in-person interview required. Employment Type: W2 candidates... .... Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and...Big data3 days per week
PamTen
Newark, NJ4 days ago - ...AWS Data Engineer Data Engineer Job Description for Data Journey USBIE ~ Experience developing and deploying application code using... ...developing Linux, UNIX shell scripts ~ Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. ~ Experience...Big data
Damco
Newark, NJ3 days ago - Oracle SQLPLSQL10 years experience with at least 3 years experience as a data analystDelivery focused technofunctional roleGood knowledge of SQL programming preferably with databases such as Oracle ExadataProgramming experience with PythonProgramming experience with Hadoop...Senior
$165k - $180k
...the limit of your curiosity. Join Team Karsun, and Find Your Next! Summary We are seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building scalable data platforms and incorporating Generative AI into data engineering workflows....SeniorWork experience placementH1bWork at officeLocal area- ...Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using... ...developing Linux, UNIX shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. Experience with...Big data
Cedent Life Talent
Newark, NJ3 days ago $95k - $150k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of...SeniorPermanent employment- ...Experienced, Senior Core Java (Java 8). Fundamental coding needs to be strong. -multi-threading, collections of API, JDBC and knowledge... ...JPA Repository implementation. -Eager and lazy loading in JPA. Big Data technologies and frameworks: preferably Apache Hadoop. Apache...SeniorBig dataFull time
- ...Data Engineer Sunnyvale, CA/Hoboken, NJ (open to relo candidates, just have to be able to relocate asap) 9+ months Contract Work with... ...field) and 6+ years of experience Experience leveraging big data technologies such as Hive, Hadoop, PySpark Experience building...Big dataContract workImmediate startRelocation
My3Tech Inc
Hoboken, NJ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
