Big Data Engineer
Purple Drive
Overview: Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum. Ensures data quality, security, and compliance through governance frameworks. Implements orchestration, monitoring, and performance tuning for reliable, cost-efficient operations. Expertise in Hadoop ecosystem (HDFS, Hive, Spark, Kafka) and MPP databases like Greenplum for large-scale data processing and optimization. Collaborates with Data Owners and stakeholders to translate business rules into technical solutions. Delivers curated datasets, lineage, and documentation aligned with SLAs and regulatory standards. Subject matter expert having experiance of interacting with client, understanding the requirement, and guiding the team. Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
- ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have hands...Big dataFull timeRelocationVisa sponsorship
AdventInfotech
New York, NY2 days ago - ...Big Data Engineer Participate as a member of a small team to release the full potential of Big Data in AT&T through a combination of platform technology, collective human intelligence and the vast data resources available to our company. Will provide rich insight into...Big data
Cardinal Integrated
New York, NY13 hours ago - ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...Big dataFull time
Syntricate Technologies
New York, NY14 hours ago - ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: ~ BS degree in computer science, computer engineering or equivalent ~5 – 6 years of experience delivering enterprise software solutions ~ Proficient in Spark, Scala, Python...Big dataRemote work
Zortech Solutions
New York, NY1 day ago - ...Big Data Engineer We are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable data processing systems capable of handling large volumes of structured, semi-structured, and unstructured data. The ideal candidate will build and optimize...Big dataFull timeRemote work
Ova Technologies
New York, NY5 days ago - Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
- ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
- ...Job Title Responsibilities Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple... ...in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information...Big dataWork experience placement
1872 Consulting
New York, NY1 day ago - ...Senior Analytics Engineer As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with multiple... ...report to the Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data...Big data
Samprasoft
New York, NY2 days ago - ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a... ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for...Big data
Cardinal Integrated
New York, NY13 hours ago - ...Senior Big Data Engineer Location: Weehawken, New Jersey, US; New York City, New York, US; Stamford, Connecticut, US Project description ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver: Scalable cost-efficient infrastructure,...Big data
Futran Tech Solutions Pvt. Ltd.
New York, NY1 day ago - ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
Cpus Engineering Staffing Solutions Inc.
New York, NY4 days ago - ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description... ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
Concord IT Systems
New York, NY4 days ago - ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
Texture
New York, NY4 days ago - ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark...Big data
Veriipro
New York, NY4 days ago - ...We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms.... ...The ideal candidate will have experience working with Python and Big Data technologies such as Apache Airflow, Apache Spark, and...Big data
Yochana
New York, NY3 days ago - ...Job Title: AI/ML Data Engineer (Python, GenAI, ML Modeling) Location: New York, NY (Hybrid - 3 Days Onsite) Duration: Contract... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
Georgia IT Inc
New York, NY2 days ago - ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Big dataContract work
Argyle Infotech
New York, NY14 hours ago - ...Job Title: Data Engineer Location: NJ/NYC or Chicago - 3-4 days a week onsite One onsite interview will be required. Preferred... ...Science As a Specialist in Data Science with a focus on Big Data, you will play a critical role in helping our clients...Big data3 days per week
3B Staffing LLC
New York, NY1 day ago - ...Data Engineer Data engineer who has worked on setting up data pipeline in analytics projects. Should have strong knowledge of Python, AWS... ...building, and maintaining data systems and processes using AWS Big Data Platform Demonstrable, hands-on professional Data Analytics...Big data
ClifyX
New York, NY1 day ago - ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
Tavily
New York, NY4 days ago - ...Data Engineer New York, New York, United States About The Job Required Qualifications: ~ Strong in Python with 3+ years hands... ...(i.e., Azure, GPC, AWS) ~ Experience building automated big data pipelines ~ Experience performing data analysis and data...Big data
Inizio Partners
New York, NY4 days ago $100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hr US Citizens... .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience using...Big dataRemote workOpen Systems Technologies
New York, NY3 days ago- ...Data Engineer - AWS New York, New York, United States About the Job Our client provides data-driven, action-oriented solutions to... ...Experience working on Agile projects AWS Solutions Architect or AWS Big Data Certification preferred Ability to thrive in a high-...Big dataContract workWork experience placementImmediate start
Inizio Partners
New York, NY3 days ago - ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial... ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in...Big dataFull timeWork at officeRemote work
Urban SDK
New York, NY2 days ago $60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly paySciata
New York, NY4 days ago- ...About the Role We're looking for a Senior Data Engineer that is innovative, curious, and collaborative to help evolve the data platform... ...web applications that access, visualize, and sometimes update big data stores in a hybrid OLAP and OLTP environment. ~...Big dataWork experience placement
datafuelX Inc.
New York, NY2 days ago - ...A major client of ours has a need for a Lead Data & AI Solutions Engineer for their NY, NY office. This is a contract, hybrid role and will require... ...with AI/advanced machine learning frameworks Familiarity with big data technologies (Spark, Hadoop) Experience setting up new...Big dataContract workWork at office
NESCO Inc
New York, NY5 days ago - ...Our client provides data-driven, action-oriented solutions to business problems through... ...industries. ROLE We are seeking a Databricks Data Engineer. RESPONSIBILITIES Lead and/or assist in... ...Deep understanding of one or more of the big data computing technologies such as...Big data
Inizio Partners Corp
New York, NY15 hours ago $165k - $230k
...Position Summary We're hiring a Senior Data Engineer to own data at truly massive scale. You'll design and run pipelines that clean, enrich... ...run data partnerships. Nice to have ~ Experience with big data, columnar storage formats, vector indexes, and privacy/...Big dataPermanent employmentWork at officeMonday to FridayRaylu, Inc
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote New York, NY
- data engineering intern summer New York, NY
- hadoop big data developer New York, NY
- junior data developer New York, NY
- senior data quality engineer New York, NY
- aws data engineer New York, NY
- associate data engineer New York, NY
- staff data engineer New York, NY
- data engineer New York, NY
- finance data engineer New York, NY