Senior Big Data Engineer
Veriipro
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions. Roles and Responsibilities Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake. Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries. Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation. Develop and optimize complex SQL queries for data processing and analytics. Ensure data quality, performance, and reliability across enterprise data platforms. Collaborate with cross‑functional teams to gather requirements, troubleshoot issues, and deliver data solutions. Required Qualifications 8+ years of overall IT experience in data engineering or big data development. Strong hands‑on experience with Hadoop, Apache Spark, Python, and Snowflake. Experience migrating enterprise data from Hadoop to Snowflake using PySpark. Solid understanding of ETL processes, data integration, and data transformation techniques. Strong SQL skills with experience writing and optimizing complex queries. Excellent analytical, problem‑solving, and communication skills. Experience working in Unix/Linux environments. (Preferred) #J-18808-Ljbffr Veriipro
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in New York, NY vacancy
- ...Senior Analytics Engineer As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with multiple cross... ...Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data...SeniorBig data
Samprasoft
New York, NY5 days ago $175.07k - $325.13k
Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process... ...legacy ad-tech systems, and act as a domain expert in big data engineering, mentoring junior engineers alongside cross...SeniorBig data- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines... ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This...SeniorBig data
$60 - $70 per hour
Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture for our business... ...in data engineering, strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves...SeniorBig dataHourly pay- Vortalsoft Inc is seeking a skilled data engineer to develop and maintain data pipelines for their Big Data financial crime solution. The ideal candidate will have at least 4 years of experience in Big Data solutions and strong skills in programming, data modeling, and...SeniorBig data
- Tech Mirrors is seeking a Big Data Engineer in New York, NY for a long-term project. Responsibilities include designing and enhancing ETL frameworks, performance tuning, and cloud migration analysis. The ideal candidate boasts over 10 years of experience and strong knowledge...SeniorBig data
- A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft... ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...SeniorBig data
- Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise...SeniorBig data
- Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...SeniorBig data
- A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...SeniorBig data
- ...Senior Analytics Engineer At Rockstar Games, we create world-class entertainment experiences. Become part of a team working on some of the... ...software development skills who is passionate about games and big data. This is a full-time, in-office position based out of...SeniorBig dataFull timeWork at office
Rockstar Games
New York, NY5 days ago - A leading technology solutions provider is seeking an EDI Data Engineer to enhance data architectures and pipelines, focusing on healthcare... ...analytics. The ideal candidate will possess extensive experience in big data processing, cloud services, and have a proven track record...SeniorBig data
- ...technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should... ...experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional...SeniorBig data
- A leading tech recruitment agency is seeking an experienced Data Engineer to join their team in New York City. This role involves designing and optimizing data solutions that support crucial business processes. The ideal candidate should have at least 5 years of experience...SeniorBig dataContract work
- Title: Senior Data Engineer Location: Remote Duration: C2H Salary: 1-2Lkhs Per Month Qualifications Bachelor’s or Master’s degree in Computer... ...with cloud platforms with GCP preferred Experience using big data technologies (e.g., Hadoop, Spark) Excellent communication...SeniorBig dataRemote job
- A prominent IT consulting firm is hiring a Senior Azure Data Engineer to develop data solutions in a hybrid setting. The ideal candidate will have strong skills in Azure Data Engineering, Python/Scala, and SQL, with responsibilities including mentoring junior staff and...SeniorBig dataContract work
- ...DESCRIPTION Elevate and drive innovation, data engineering solutions, and serve as a decision maker... ...Experience data products. As a Senior Lead Software Engineering at JPMorgan Chase... ...and size of data. Experience in Big Data technologies handling complex data...SeniorBig dataWork at office
J.P. Morgan
New York, NY15 days ago $250.8k - $286.2k
Capital One is actively seeking a Senior Lead Data Engineer in New York, NY. This position involves collaborating within Agile teams to design and develop innovative solutions using cloud and big data technologies. As a leader, you will guide fellow engineers in tackling...SeniorBig data- Responsibilities: Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements Design and develop data architectures across on‑premise, cloud, and hybrid platforms to ensure scalable data infrastructure...SeniorBig dataWork experience placement
- Capital One is seeking a Senior Lead Data Engineer to join their team in Wilmington, DE. In this role, you will lead teams in creating innovative... ...years of experience in application development. Knowledge in big data technologies and cloud computing is essential. #J-1880...SeniorBig data
$250.8k - $286.2k
Capital One National Association is seeking a Senior Lead Data Engineer to develop and support technical solutions within Agile teams. The ideal candidate... ...have substantial experience in application development and big data technologies, including cloud computing and machine...SeniorBig data- ...are currently requesting resumes for the following position: Senior Data Engineer Job Overview Design, build and productionize modular and scalable... ..., data warehouse design and data solution architecture in a Big Data environment. Experience as a Data Engineer in a Big...SeniorBig data
- Capital One is seeking a Lead Data Engineer in New York, NY to join a team focused on solving complex business problems. The role involves collaborating... ...programming languages like Python and SQL, and leveraging big data technologies such as AWS and Snowflake. The ideal...SeniorBig data
$136.04k - $182.49k
Role Overview Engineering Services designs, builds, and sustains technology that powers DE&E Technology... ..., including Quality Assurance, Data Analytics, Software Development, Broadcast... ...model development. Experience working in big data environments (Hadoop, S3, HBase)....SeniorBig dataWorldwide$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality... ...AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,000 - $21...SeniorBig data- ...City and New York City. About The Role We are looking for a Senior Data Engineer to help design, build, and operate the core data platform that... .../Presto, Redshift, BigQuery, or Snowflake. Familiarity with big data or distributed processing frameworks such as Spark (or...SeniorBig dataWork at officeRelocation package
- ...we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert‑level...SeniorBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Required Skills: Azure Data Engineering: Azure... ...DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT technology...SeniorBig dataContract work
$175.07k - $325.13k
Senior Staff Data Engineer Your New Role The Senior Staff Data Engineer is accountable for designing and delivering data pipelines that process... ...as a domain expert in distributed systems, streaming, and big data engineering. Mentor junior engineers, share best practices...SeniorBig dataTemporary workLocal area$175k - $200k
Senior Data Engineer The Senior Data Engineer is responsible for designing, building, and optimizing enterprise‑scale data pipelines and analytics... ...Azure Synapse Analytics, Azure SQL Database, Cosmos DB) and big data technologies. Experience with semi‑structured/NoSQL...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
Related searches
- data engineer analytics New York, NY
- associate data engineer New York, NY
- junior data developer New York, NY
- data engineer manager New York, NY
- remote data engineer New York, NY
- junior data engineer remote New York, NY
- senior cloud data engineer New York, NY
- data platform engineer New York, NY
- data infrastructure engineer New York, NY
- aws data engineer New York, NY