Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Purple Drive

Overview:

Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive,

Strong work experience - Agile environment preferred

Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner)

Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum.

Ensures data quality, security, and compliance through governance frameworks.

Implements orchestration, monitoring, and performance tuning for reliable, cost-efficient operations.

Expertise in Hadoop ecosystem (HDFS, Hive, Spark, Kafka) and MPP databases like Greenplum for large-scale data processing and optimization.

Collaborates with Data Owners and stakeholders to translate business rules into technical solutions.

Delivers curated datasets, lineage, and documentation aligned with SLAs and regulatory standards.

Subject matter expert having experiance of interacting with client, understanding the requirement, and guiding the team.

Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
  •  ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have hands... 
    Big data
    Full time
    Relocation
    Visa sponsorship

    AdventInfotech

    New York, NY
    2 days ago
  •  ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms... 
    Big data
    Full time

    Syntricate Technologies

    New York, NY
    19 hours ago
  • Responsibilities Create and maintain data pipelines that transfer data from select location...  ...maintaining security protocols) into our Big Data financial crime solution. Develop,...  ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer... 
    Big data

    Vortalsoft Inc

    New York, NY
    4 days ago
  •  ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are...  ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open... 
    Big data

    Stem Xpert

    New York, NY
    4 days ago
  •  ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a...  ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for... 
    Big data

    Cardinal Integrated

    New York, NY
    18 hours ago
  •  ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various...  ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    4 days ago
  •  ...the energy sector by creating a unified data network. Backed by experienced founders and...  ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are...  ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or... 
    Big data

    Texture

    New York, NY
    4 days ago
  •  ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark... 
    Big data

    Veriipro

    New York, NY
    4 days ago
  •  ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15... 
    Big data
    Contract work

    Argyle Infotech

    New York, NY
    19 hours ago
  •  ...reliably. Join our team to help build the data infrastructure that supports and scales our...  ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible...  .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow.... 
    Big data

    Tavily

    New York, NY
    4 days ago
  •  ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial...  ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in... 
    Big data
    Full time
    Work at office
    Remote work

    Urban SDK

    New York, NY
    2 days ago
  • $60 - $70 per hour

     ...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions...  ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data... 
    Big data
    Hourly pay

    Sciata

    New York, NY
    4 days ago
  • $165k - $230k

     ...Position Summary We're hiring a Senior Data Engineer to own data at truly massive scale. You'll design and run pipelines that clean, enrich...  ...run data partnerships. Nice to have ~ Experience with big data, columnar storage formats, vector indexes, and privacy/... 
    Big data
    Permanent employment
    Work at office
    Monday to Friday

    Raylu, Inc

    New York, NY
    2 days ago
  •  ...A major client of ours has a need for a Lead Data & AI Solutions Engineer for their NY, NY office. This is a contract, hybrid role and will require...  ...with AI/advanced machine learning frameworks Familiarity with big data technologies (Spark, Hadoop) Experience setting up new... 
    Big data
    Contract work
    Work at office

    NESCO Inc

    New York, NY
    13 hours ago
  • $105k - $145k

     ...Data Engineer Opportunity Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work...  ...experience with Python for scripting and automation. Cloud & Big Data Savvy: Hands-on experience with cloud platforms (AWS, GCP,... 
    Big data
    Work at office
    Remote work
    Flexible hours

    Bustle Digital Group

    New York, NY
    18 hours ago
  •  ...Our client provides data-driven, action-oriented solutions to business problems through...  ...industries. ROLE We are seeking a Databricks Data Engineer. RESPONSIBILITIES Lead and/or assist in...  ...Deep understanding of one or more of the big data computing technologies such as... 
    Big data

    Inizio Partners Corp

    New York, NY
    20 hours ago
  • $200k - $220k

     ...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and...  ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-...  ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding... 
    Big data

    Schonfeld

    New York, NY
    4 days ago
  •  ...currently requesting resumes for the following position: Senior Data Engineer Job Overview Design, build and productionize modular and...  ...modeling, data warehouse design and data solution architecture in a Big Data environment. Experience as a Data Engineer in a Big Data environment... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    4 days ago
  • $60k - $80k

     ...consulting and staffing company that places elite engineering talent into high-impact roles at leading...  ...on modern technologies across cloud, data, and software disciplines. Our client...  ...with Snowflake , Apache Spark , or similar big data technologies Proven experience in... 
    Big data
    Full time
    Contract work
    Remote work

    Aaratech

    New York, NY
    3 days ago
  • Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows...  ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg... 
    Big data

    Saransh

    New York, NY
    2 days ago
  •  ...degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent...  ...7+ years of experience in working with data solutions. 3+ years of experience coding...  ...or similar) 1+ years experience with big data technologies like EMR, Hadoop, Spark... 
    Big data

    TechDigital Group

    New York, NY
    4 days ago
  •  ...intelligence across a federated network of data, and interact across the network through...  ...team is looking for talented Data Engineers who are passionate about data and all things...  ...to have, but not required Experience in a big data processing framework such as Spark Experience... 
    Big data

    Altana AI

    New York, NY
    4 days ago
  • $144.77k - $209.11k

     ...Sr. Data Engineer Employment Type: Full-Time, Mid-level. Department: Business Intelligence. CGS is seeking a passionate and driven Data Engineer...  ...data using Python, R, SQL, and SAS. Strong knowledge of big data analysis and storage tools and technologies. Strong understanding... 
    Big data
    Full time
    Flexible hours

    Contact-Government-Services,-LL

    New York, NY
    4 days ago
  •  ...we are. Integrated Technology Strategies is looking to hire a Data Engineer to be a part of our Consulting team. We are looking for someone...  ...implementing scalable ETL and data processing systems to handle the big data ecosystem including data collection, processing, ETL and... 
    Big data
    Flexible hours

    Integrated Technology Strategies

    New York, NY
    3 days ago
  • $136.04k - $182.49k

     ...Role Overview Engineering Services designs, builds, and sustains technology that powers DE&E...  ...technologies, including Quality Assurance, Data Analytics, Software Development, Broadcast...  ...model development. Experience working in big data environments (Hadoop, S3, HBase).... 
    Big data
    Worldwide

    The Walt Disney Company

    New York, NY
    3 days ago
  • Job Title: Data Engineer - MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer...  ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience... 
    Big data

    Olik Global

    New York, NY
    3 days ago
  •  ...Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in...  ...Strong in Git repo and CI/CD deployment process Experience with Big Data - Hadoop, Spark. Job Description: Job Duties: • At... 
    Big data

    ShiftCode Analytics

    New York, NY
    13 hours ago
  • $110k - $130k

     ...decisions through industry-leading proprietary data, technologies and insights. With decades-...  ...areas. Curinos is hiring a Senior Data Engineer I to join our Data Platform team . This...  ...observability, validations). Experience with big data, scaling data processing, and... 
    Big data
    Part time
    Remote work
    Work from home
    Flexible hours

    Curinos

    New York, NY
    3 days ago
  • $166k - $205k

     ...Data Engineer III New York City, New York Garner's mission is to transform the healthcare economy, delivering high-quality and affordable...  ...data processing, data warehousing, data governance, Big Data, data variance, data privacy, and data quality). ~ Expertise... 
    Big data
    Work at office
    Work visa
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    19 hours ago
  • $160k - $220k

     ...solvers to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping data products...  ...years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems ~ Proficiency in SQL, ETL/... 
    Big data
    Temporary work
    Work at office
    Local area
    Afternoon shift

    Metropolis Corp

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!