Big Data Engineer
Purple Drive
Overview: Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum. Ensures data quality, security, and compliance through governance frameworks. Implements orchestration, monitoring, and performance tuning for reliable, cost-efficient operations. Expertise in Hadoop ecosystem (HDFS, Hive, Spark, Kafka) and MPP databases like Greenplum for large-scale data processing and optimization. Collaborates with Data Owners and stakeholders to translate business rules into technical solutions. Delivers curated datasets, lineage, and documentation aligned with SLAs and regulatory standards. Subject matter expert having experiance of interacting with client, understanding the requirement, and guiding the team. Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
- ...A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...Big data
STEM Xpert
New York, NY4 days ago - ...Roku in New York is seeking a Senior Solutions Engineer (Ad Data Ingestion) to own conversions, audiences, and pixels integrations. You’ll partner with clients to ensure healthy data ingestion, quality signals, and reliable measurement for Roku’s advertising platform....Big data
Roku
New York, NY4 days ago - ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have hands...Big dataFull timeRelocationVisa sponsorship
AdventInfotech
New York, NY4 days ago - ...Big Data EngineerLocation: Remote/USADuration: 6-12+ MonthsJob Description:BS degree in computer science, computer engineering or equivalent5 – 6 years of experience delivering enterprise software solutionsProficient in Spark, Scala, Python, AWS Cloud technologies3+ years...Big dataRemote work
Zortech Solutions
New York, NY5 days ago - ...Big Data EngineerParticipate as a member of a small team to release the full potential of Big Data in AT&T through a combination of platform technology, collective human intelligence and the vast data resources available to our company. Will provide rich insight into...Big data
Cardinal Integrated
New York, NY5 days ago - ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: ~ BS degree in computer science, computer engineering or equivalent ~5 – 6 years of experience delivering enterprise software solutions ~ Proficient in Spark, Scala, Python...Big dataRemote work
Zortech Solutions
New York, NY4 days ago - ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
STEM Xpert
New York, NY1 day ago - ...Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
VortalSoft
New York, NY5 days ago - Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact... ..., data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
- ...Data EngineerHighly skilled engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks... ...Data Engineering SkillsProficiency in using GCP's big data tools like:BigQuery: For data warehousing and SQL analyticsDataproc...Big data
Omni Inclusive
New York, NY5 days ago - ...Senior AWS Data EngineerLocation: New Jersey - OnsiteDuration: FulltimeJob Description... ...VPC NACLs, and SCPsFamiliar with ETL and big data tool-chains such as those provided by... ...Bachelor’s/Master's degree in computer science/engineering, operations research or related analytics...Big data
Zortech Solutions
New York, NY5 days ago - ...A leading data-focused energy company in New York is seeking an experienced Data Engineer to design and optimize data pipelines supporting various workflows. The role requires... ...warehousing solutions, and proficiency in big data technologies like Hadoop and Spark. The successful...Big data
Texture
New York, NY4 days ago - ...Big Data EngineerWe are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable data processing systems capable of handling large volumes of structured, semi-structured, and unstructured data. The ideal candidate will build and optimize big...Big dataRemote work
Ova Technologies
New York, NY5 days ago - Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will...Big dataWork experience placement
$160k - $220k
...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside... ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to...Big dataWork experience placement$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders... .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience...Big dataRemote work- ...Capital One is seeking a Lead Data Engineer in New York, NY, to drive big data initiatives and cloud-based data solutions. You will collaborate with cross-functional teams to design, implement, test, and optimize data pipelines, ensuring scalable and reliable performance...Big data
Capital One Group
New York, NY3 days ago - ...Job TitleResponsibilitiesBuild reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources.... ...experience in building large scale data pipelines with mainstream big data stack.Strong expertise in extracting useful information from...Big dataWork experience placement
1872 Consulting
New York, NY5 days ago - ...A leading data solutions firm in New York is seeking an experienced Data Engineer to design, implement, and maintain data pipelines for efficient data flow. The ideal... ...decisions while ensuring data quality. Familiarity with big data technologies and cloud solutions is...Big dataLocal areaRelocation
Yeah! Global
New York, NY4 days ago - ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders... ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action...Big data
$170k - $230k
...to follow. If you're energized by shaping data infrastructure from zero to one inside a... ...Self-service reporting that scales spanning Engineering, Science, PM-T, and Design across... ...Preferred qualification - Experience with big data technologies such as: Hadoop, Hive,...Big dataFlexible hours- ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
Saransh
New York, NY1 day ago - ...Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 6+years of experience in data engineering. Extensive hands-on experience with... ...experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead,...Big data
BSL Consulting LLC
New York, NY6 days ago - ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
Cpus Engineering Staffing Solutions Inc.
New York, NY1 day ago $111.4k - $185k
...ve come to the right place.SDS is part of the Sales Intelligence, Technology, & Enablement organization (SITE). We are a big-data focused engineering team that provides unique, pan-Amazon datasets consolidating advertiser, seller, and vendor KPIs, exposed via data...Big dataFlexible hours$132.1k - $178.8k
...Commerce Analytics, supporting major PV investments in 2026. As a Data Engineer, you will work in one of the world's largest and most complex... ...multiple heterogeneous data sources.You will leverage AWS big data technologies including Redshift, EMR/Spark, Andes Data Lake...Big dataWorldwideFlexible hours- ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders.QualificationsYou... ...tools like dbt. You have experience with big data technologies like Hadoop, Spark, or...Big data
Texture Energy
New York, NY5 days ago $50k - $95k
Agency:Hearts & ScienceJob Function:Data and AnalyticsJob Subfunction: Data Science and... ...be reporting to the Senior Director, Data Engineering and be part of Data Engineering Team who... ...pipeline design/development, SQL, AWS Cloud and Big Data Technologies experience. As a Data...Big dataFull timeWork at officeLocal area3 days per week- ...Data Engineer (601/602/603) Must-Have Skills: Strong Python programming (core Python, not just PySpark) Expert-level Apache Spark / PySpark... ...Algorithms Production experience with distributed data processing AWS Big Data services (EMR, Glue) Snowflake Data Lake Control-M Airflow...Big data
VSG Business Solutions
New York, NY18 hours ago $125k - $145k
...What we're buildingOur team runs a range of data and AI projects across the GPS business.A... ...forThis is a hybrid role that spans data engineering, AI product enablement, and platform... ...tuning and engineering across RDBMS and Big Data platforms such as Oracle Exadata, SQL...Big dataFull timeWork at officeFlexible hoursDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data center engineer New York, NY
- senior cloud data engineer New York, NY
- data infrastructure engineer New York, NY
- sr information security engineer New York, NY
- hadoop big data developer New York, NY
- data visualization developer New York, NY
- associate data engineer New York, NY
- remote data engineer New York, NY
- etl data engineer New York, NY
- data engineer analytics New York, NY