Senior Big Data Engineer
PB consulting
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
- Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
- Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
- Develop and optimize complex SQL queries for data processing and analytics.
- Ensure data quality, performance, and reliability across enterprise data platforms.
- Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
- 8+ years of overall IT experience in data engineering or big data development.
- Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
- Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Strong SQL skills with experience writing and optimizing complex queries.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Unix/Linux environments. (Preferred)
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in Edgewater, NJ vacancy
- ...The Senior Technical Specialist will be responsible for providing... ...1. Develop and implement data processing frameworks using Apache... ...latest trends and advancements in big data technologies. Skill... ...solutions. 4. Knowledge of data engineering concepts and methodologies....SeniorBig data
Omni Inclusive
Jersey City, NJ2 days ago $176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data engineering... ...Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive...SeniorBig dataCiti
Jersey City, NJ1 day ago- ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department... ...Engineering and Machine Learning. Evaluate readiness of new big/fast data capabilities to be used to support critical...SeniorBig dataImmediate start
Cardinal Integrated
Secaucus, NJ1 day ago $176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional... ...data platform? We are looking for a Senior Data Engineering Lead to be a player-coach for our talented... ...hands-on experience with modern big data technologies and Data streaming (like...SeniorBig dataFull time- We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting... .... Proven experience with ETL/ELT processes, data modeling, and big data frameworks . Demonstrated ability to lead, mentor, and...SeniorBig dataWork at office
- ...fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...SeniorBig dataPermanent employmentFull timeH1b
$80k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...SeniorBig dataFull timeRemote workWorldwideFlexible hours- ...and Instagram. Position Description: We are seeking a Senior Data Engineer to join our team and help us build the next generation of... ...understanding of data modeling concepts and practices ~ Big Data Technologies : Spark, Databricks, Structured Streaming...SeniorBig dataRemote workWorldwide
GrabJobs
Newark, NJ4 days ago - ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorganChase within the Corporate Sector- Liquidity... ...programming language including Java and/or PythonStrong Big-Data and database skills including Spark, Databricks, and/or...SeniorBig dataFor contractorsWork at office
$121.2k - $181.8k
...: Technology, Applications DevelopmentCompany: CitiSenior Java Big Data Developer with experience in designing and developing Java/J2EE... ...Finance dashboard application that provides sensitive data to senior management. Application involves business process workflow and...SeniorBig dataFull time- Amiga Informatics is seeking a skilled developer in Jersey City, New Jersey, to focus on technologies such as Spring Boot, Hibernate, and Scala. Candidates with a strong background in functional programming, particularly in the context of Spark, are encouraged to apply...Big data
Amiga Informatics
Jersey City, NJ2 days ago - ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time$140k - $145k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial services and... ...is mandatory. Knowledge of Big Data technologies like Spark and Pyspark... ...without discrimination. Additional Details Seniority level: Mid-Senior level Employment...Big dataFull timeFlexible hours- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ3 days ago $169.54k - $175k
...locations across North America.Job DescriptionPosition Purpose:The Data Engineer is responsible for designing, building, and maintaining... ...; and1 year experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.Additional InformationPay...Big dataFlexible hours$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... ...with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with...Big dataFull timeTemporary workRelocation$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...Title: Data Engineer Join a forward-thinking and innovative organization that values growth, collaboration, and cutting-edge technology. We... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
Glint Tech Solutions
Jersey City, NJ8 hours ago - ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
Compunnel
Jersey City, NJ4 days ago - ...AWS Data Engineer Data Engineer Job Description for Data Journey USBIE ~ Experience developing and deploying application code using... ...developing Linux, UNIX shell scripts ~ Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. ~ Experience...Big data
Damco
Newark, NJ1 day ago - ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models...Big data
TechDigital Group
Jersey City, NJ4 days ago - Oracle SQLPLSQL10 years experience with at least 3 years experience as a data analystDelivery focused technofunctional roleGood knowledge of SQL programming preferably with databases such as Oracle ExadataProgramming experience with PythonProgramming experience with Hadoop...Senior
$95k - $150k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of...SeniorPermanent employment- ...Experienced, Senior Core Java (Java 8). Fundamental coding needs to be strong. -multi-threading, collections of API, JDBC and knowledge... ...JPA Repository implementation. -Eager and lazy loading in JPA. Big Data technologies and frameworks: preferably Apache Hadoop. Apache...SeniorBig dataFull time
$128k - $249k
...important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the... ..., imagination and an entrepreneurial spirit. We come up with big ideas and then roll up our sleeves to get the job done,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$115k - $155k
Job Classification:Technology - Engineering & CloudAs an AI/Data Engineer, you will design, build, and maintain scalable data and AI solutions supporting... ...on modern cloud platforms. You will work closely with senior engineers, architects, and business stakeholders to...SeniorFull timePart timeWork at office3 days per week$104k - $171.6k
Job Classification:Technology - Engineering & CloudAre you interested in building capabilities that enable the organization with innovation... ...leading financial services institutions.Your Team & RoleAs a Senior Data Engineer on the FM Management Reporting team, you will...SeniorFull timePart time- ...About the job AWS Data Engineer Role Overview: Designing, building and maintaining efficient, reusable, and reliable architecture... ...Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and...Big data
Inizio Partners
Newark, NJ5 days ago - ...panelists. Job summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you... ...experience with ETL or ELT processes, data modeling, and big data frameworks. 16. Demonstrated ability to lead, mentor, and...Big dataFor subcontractorWork at officeLocal areaShift work
Omni Inclusive
Newark, NJ5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
