Big Data Engineer
VeriiPro
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions. Roles and Responsibilities Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake. Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries. Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation. Develop and optimize complex SQL queries for data processing and analytics. Ensure data quality, performance, and reliability across enterprise data platforms. Collaborate with cross‑functional teams to gather requirements, troubleshoot issues, and deliver data solutions. Required Qualifications 8+ years of overall IT experience in data engineering or big data development. Strong hands‑on experience with Hadoop, Apache Spark, Python, and Snowflake. Experience migrating enterprise data from Hadoop to Snowflake using PySpark. Solid understanding of ETL processes, data integration, and data transformation techniques. Strong SQL skills with experience writing and optimizing complex queries. Excellent analytical, problem‑solving, and communication skills. Experience working in Unix/Linux environments. (Preferred) #J-18808-Ljbffr
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
- ...Roku in New York is seeking a Senior Solutions Engineer (Ad Data Ingestion) to own conversions, audiences, and pixels integrations. You’ll partner with clients to ensure healthy data ingestion, quality signals, and reliable measurement for Roku’s advertising platform....Big data
Roku
New York, NY3 hours ago - ...A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...Big data
STEM Xpert
New York, NY2 hours ago - ...T-Mobile seeks a data architect/engineer to design and develop data architectures across on-premise, cloud, and hybrid platforms to support organizational data needs. You will mentor teammates and collaborate with data engineers to deliver data warehousing and analytics...Big data
T-Mobile
New York, NY2 hours ago - ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have hands...Big dataFull timeRelocationVisa sponsorship
AdventInfotech
New York, NY2 hours ago - ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
STEM Xpert
New York, NY4 days ago - ...A leading data-focused energy company in New York is seeking an experienced Data Engineer to design and optimize data pipelines supporting various workflows. The role requires... ...warehousing solutions, and proficiency in big data technologies like Hadoop and Spark. The successful...Big data
Texture
New York, NY2 hours ago $310k - $385k
...Garnerhealth is looking for an execution-focused Data Engineering Manager for their New York City office to lead the Data Platform Team. This... ...ideal candidate will have 5+ years of engineering experience with Big Data, a strong ownership mindset, and expertise in data...Big dataWork at officeFlexible hoursGarnerhealth
New York, NY2 days ago- Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
- ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
Cpus Engineering Staffing Solutions Inc.
New York, NY3 days ago - ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
Saransh
New York, NY3 days ago - ...A leading data solutions firm in New York is seeking an experienced Data Engineer to design, implement, and maintain data pipelines for efficient data flow. The ideal... ...decisions while ensuring data quality. Familiarity with big data technologies and cloud solutions is...Big dataLocal areaRelocation
Yeah! Global
New York, NY2 hours ago - ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience...Big data
Qode
New York, NY2 days ago - ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
Texture
New York, NY3 days ago - ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
Tavily
New York, NY3 days ago - ...Create/manage ETL pipelines for the data lake and Snowflake; automate data analysis/aggregation work. Design, build, and manage... ...Live Coding; onsite may be required. Ideal Candidate: Senior Big Data Engineer with strong PySpark, AWS Glue/EMR, Snowflake, and Python skills...Big dataLive in
BCforward
New York, NY3 days ago - ...platforms (i.e., Azure, GPC, AWS) Experience building automated big data pipelines Experience performing data analysis and data... ...domain knowledge Education Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience...Big data
Inizio Partners Corp
New York, NY3 days ago - Overview We seek a Junior Data Engineer with a passion for developing highly scalable data processing pipelines. The engineer will collaborate... ...and provide domain‑specific insight regarding storage, big data platform services, serverless architecture, RDBMS, DW/DM,...Big data
Unrivaled Metal Buildings
New York, NY2 days ago - ...We are looking for a motivated Junior Data Engineer to join our growing data team. This is an excellent opportunity for candidates with a strong... ...support business requirements. Work with cloud platforms and big data technologies to process large datasets. Required Skills:...Big data
Tech Consulting
New York, NY2 days ago $60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly paySciata
New York, NY3 hours ago- ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial... ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in...Big dataFull timeWork at officeRemote work
Urban SDK
New York, NY3 hours ago - ...build and productionize modular and scalable data pipelines and data infrastructure... ...University in computer science, computer/software engineering or other relevant programs within data... ...and data solution architecture in a Big Data environment. Experience as a Data Engineer...Big dataRemote work
Cpus Engineering Staffing Solutions Inc.
New York, NY3 days ago - ...About The Role We are seeking a talented Data Engineer with hands‑on experience in building scalable data pipelines and modern cloud‑based... ...The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache...Big dataFull timeContract work
TechBlocks
New York, NY3 days ago £75k per year
...Data Engineering Lead - AI focused - required for an AI-First SaaS business, offering Remote Working, paying up to circa £75K + Benefits Working Pattern: This is a Remote First team who regularly get together for collaboration, planning and company events, typically every...Big dataFull timeRemote workApply Recruitment
New York, NY2 days ago$166k - $205k
...benefits using clear incentives and powerful, data-driven insights. Our approach guides... ...role: We are seeking an exceptional Data Engineer III to join our Engineering team, with a high... ...processing, data warehousing, data governance, Big Data, data variance, data privacy, and...Big dataWork at officeWork visaFlexible hours3 days per weekGarner Health
New York, NY3 hours ago- ...and New York City. About The Role We are looking for a Senior Data Engineer to help design, build, and operate the core data platform that... ...Athena/Presto, Redshift, BigQuery, or Snowflake. Familiarity with big data or distributed processing frameworks such as Spark (or...Big dataWork at officeRelocation package
Nelo
New York, NY3 days ago - ...Services, and Fitness & Wellness industries. We are seeking a Senior Data Engineer to join our client’s team and focus on their product. In this... ...and processing financial transactions. Blend of skills in Big Data technologies, database management, data integration tools,...Big dataImmediate start
Hiretruss
New York, NY1 day ago - ...love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert-level...Big dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
New York, NY5 days ago - ...We're looking for a Senior Data Engineer that is innovative, curious, and collaborative to help evolve the data platform that powers our sell... ...web applications that access, visualize, and sometimes update big data stores in a hybrid OLAP and OLTP environment. Bachelor's degree...Big dataWork experience placement
VALID8 Financial
New York, NY2 hours ago $60k - $80k
...consulting and staffing company that places elite engineering talent into high-impact roles at leading... ...on modern technologies across cloud, data, and software disciplines. Our client... ...with Snowflake , Apache Spark , or similar big data technologies Proven experience in...Big dataFull timeContract workRemote workAaratech
New York, NY2 days ago- ...transforming how large-scale energy and IoT data is collected, processed and utilised. As... ...capability, they are seeking an experienced Data Engineer to join a growing engineering team. This... ...of distributed data architectures and big data platforms. Experience optimising...Big dataContract workRemote workFlexible hours
Korn Ferry
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- software data engineer New York, NY
- entry level big data engineer New York, NY
- big data developer New York, NY
- senior data quality engineer New York, NY
- sr data engineer New York, NY
- junior big data engineer New York, NY
- big data cloud engineer New York, NY
- junior data engineer New York, NY
- data platform engineer New York, NY
- associate data engineer New York, NY