Senior Big Data Engineer
Veriipro
We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions. Roles and Responsibilities Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake. Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries. Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation. Develop and optimize complex SQL queries for data processing and analytics. Ensure data quality, performance, and reliability across enterprise data platforms. Collaborate with cross‑functional teams to gather requirements, troubleshoot issues, and deliver data solutions. Required Qualifications 8+ years of overall IT experience in data engineering or big data development. Strong hands‑on experience with Hadoop, Apache Spark, Python, and Snowflake. Experience migrating enterprise data from Hadoop to Snowflake using PySpark. Solid understanding of ETL processes, data integration, and data transformation techniques. Strong SQL skills with experience writing and optimizing complex queries. Excellent analytical, problem‑solving, and communication skills. Experience working in Unix/Linux environments. (Preferred) #J-18808-Ljbffr Veriipro
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in New York, NY vacancy
- A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft... ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...SeniorBig data
£75k per year
...Data Engineering Lead - AI focused - required for an AI-First SaaS business, offering Remote Working, paying up to circa £75K + Benefits Working... ...and impact in the business; an ideal role for an experienced Senior or Lead Data Engineer who wants to work on far more than just...SeniorBig dataFull timeRemote workApply Recruitment
New York, NY1 day ago- Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...SeniorBig data
- Create/manage ETL pipelines for the data lake and Snowflake; automate data analysis/aggregation work. Design, build, and manage... ...with Live Coding; onsite may be required. Ideal Candidate: Senior Big Data Engineer with strong PySpark, AWS Glue/EMR, Snowflake, and Python...SeniorBig dataLive in
$185k
Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is looking for individuals with strong backgrounds in programming to undertake... ...application development At least 3 years of experience in big data technologies At least 1 year of experience with cloud...SeniorBig dataFull timeTemporary workWork at officeWork from homeMonday to FridayFlexible hoursTrepp, LLC
New York, NY1 day ago$120k - $140k
...Opportunity Omni Platform Group (OPG) is currently seeking a senior data engineer to join our technology team. In this role you will build Omni... ...with Python, C++, or other popular language. Experience with big data and/or infrastructure. Bonus for having experience in...SeniorBig dataWork at officeLocal areaImmediate startFlywheel
New York, NY2 days ago- ...are currently requesting resumes for the following position: Senior Data Engineer Job Overview Design, build and productionize modular and scalable... ..., data warehouse design and data solution architecture in a Big Data environment. Experience as a Data Engineer in a Big...SeniorBig data
$136.04k - $182.49k
Role Overview Engineering Services designs, builds, and sustains technology that powers DE&E Technology... ..., including Quality Assurance, Data Analytics, Software Development, Broadcast... ...model development. Experience working in big data environments (Hadoop, S3, HBase)....SeniorBig dataWorldwide$250.8k - $286.2k
Senior Lead Data Engineer What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical... ...experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud...SeniorBig dataFull timePart timeInternshipLocal areaCapital One National Association
New York, NY1 day ago- ...Services, and Fitness & Wellness industries. We are seeking a Senior Data Engineer to join our client’s team and focus on their product. In this... ...and processing financial transactions. Blend of skills in Big Data technologies, database management, data integration tools...SeniorBig dataImmediate start
- ...City and New York City. About The Role We are looking for a Senior Data Engineer to help design, build, and operate the core data platform that... .../Presto, Redshift, BigQuery, or Snowflake. Familiarity with big data or distributed processing frameworks such as Spark (or...SeniorBig dataWork at officeRelocation package
$220k - $245k
...benefits using clear incentives and powerful, data-driven insights. Our approach guides... ...the role: We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is... ...processing, data warehousing, data governance, Big Data, data variance, data privacy, and...SeniorBig dataWork at officeFlexible hours3 days per week$170k - $180k
## Senior Big Data EngineerApplylocations: New York - New Yorktime type: Full timeposted on: Posted Todayjob requisition id: R-01358****Senior Big Data Engineer********New York, NY********Hybrid Schedule (M/F remote, T/W/TH in-office)********U.S. Remote****At Magnite, we...SeniorBig dataWork experience placementWork at officeLocal areaRemote workMonday to FridayMagnite
New York, NY3 days ago$110k - $130k
...decisions through industry-leading proprietary data, technologies and insights. With decades... ...metropolitan areas. Curinos is hiring a Senior Data Engineer I to join our Data Platform team . This... ..., validations). Experience with big data, scaling data processing, and distributed...SeniorBig dataPart timeRemote workWork from homeFlexible hours- Job Title: Senior Data Engineer Department: Digital Reporting To: Manager, Data Engineering Employment Type: Full-Time Overview Audacy is looking... ..., you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights,...SeniorBig dataFull timeLocal area
$160k - $220k
...and problem solvers to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping data products... ...of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems Proficiency in SQL, ETL/...SeniorBig dataTemporary workWork at officeLocal areaAfternoon shift- ...talented people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC...SeniorBig dataFull timeWork at office
- ...days per week Overview We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management... ...of data from a wide variety of data sources using SQL and AWS big data technologies Develop and debug code in PySpark/Spark/Python...SeniorBig dataLocal area3 days per week
$209k - $238.5k
...environment? At Capital One, you'll be part of a big group of makers, breakers, doers and... ...real customer needs. We are seeking Data Engineers who are passionate about marrying data... ...emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity...SeniorBig dataInternshipLocal area$116.5k - $210.1k
...ensures that employees get the same big love we give our customers. All team... ...advanced machine learning, large-scale data processing, and cloud technologies. Our... ...are seeking a creative, and curious Senior Data Science Software Engineer to join our team. In this role, you'...SeniorBig dataFull timeTemporary workPart timeWork experience placementLocal areaFlexible hoursT-Mobile
New York, NY2 days ago$60 - $70 per hour
Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...SeniorBig dataHourly pay$250k - $300k
...A leading global alternative investment firm is seeking a Senior Data Engineer, Proprietary Research to join its New York office. On the... ...data assets. In this role, you will: Develop and support big data processing pipelines including but not limited to ingestion...SeniorBig dataWork at office- We're looking for a Senior Data Engineer that is innovative, curious, and collaborative to help evolve the data platform that powers our sell-side... ...applications that access, visualize, and sometimes update big data stores in a hybrid OLAP and OLTP environment. Bachelor'...SeniorBig dataWork experience placement
- ...visionary talent to help shape the future of our data-driven initiatives. Are you a highly... ...and innovative Data and Machine Learning Engineer ready to make a significant impact? This... ...learning frameworks. Familiarity with big data technologies. Proven experience in...SeniorBig dataFlexible hours
Skill
New York, NY1 hour ago - ...Senior Manager, Data Engineering - New York, 10019, United States of America How we LEAD: We are seeking an experienced and driven Senior Data Engineering... ...Experience with cloud ecosystems (AWS, Azure, or GCP) and big data technologies (Spark, Snowflake, Databricks, etc.)....SeniorBig data
- ...Job Description Job Description Senior Software Engineer – Data Engineering Role Overview Our client, a leading global financial technology... ...where you'll develop scalable software focused on big data, distributed systems, and real-time analytics while partnering...SeniorBig data
- IntegriChain is the data and application backbone for market access... .... Hands-on Snowflake engineering: Design, build, optimize, and... ...pipelines. Data Modeling and Big Data Processing Spearhead logical... ...Comfortable operating as a hands‑on senior individual contributor who can...SeniorBig dataVisa sponsorshipFlexible hours
$153k - $204k
...provisioning and high-reliability operations. About the role: As a Senior Data Engineer you will own and evolve the data lake and analytics stack... ...data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark). ~ Experience...SeniorBig dataPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$130.9k - $220k
...operations to harness Internet of Things (IoT) data to develop actionable insights and... ...the role: Samsara is looking for a Senior Software Engineer I to join our Data Platform team, which... ...and infrastructure tooling across the big data ecosystem. This role is not an analytics...SeniorBig dataFull timeRemote workRelocation packageFlexible hours$118k
...inclusive world.About the Role Capgemini is seeking an experienced Data Engineer to support a strategic Financial Services engagement. This... ...Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal...SeniorFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer New York, NY
- big data engineer New York, NY
- big data developer New York, NY
- remote data engineer New York, NY
- big data devops engineer New York, NY
- finance data engineer New York, NY
- sr information security engineer New York, NY
- junior big data engineer New York, NY
- entry level big data engineer New York, NY
- senior data engineer New York, NY