Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in New York, NY vacancy
  •  ...Principal Data Engineer Full-time Company Description Information Technology Job Description Principal Data Engineer 10+ to 15...  ...thought of spearheading the build-out of a world class enterprise Big Data and Streaming Data architecture charge you up? Do you... 
    Principal
    Big data
    Full time

    Direct Staffing Inc

    New York, NY
    4 days ago
  • $200k - $240k

     ...Principal Data Engineer Boulder, Colorado About Sovrn Every interesting company solves important problems for other people. Sovrn is a...  ...Excellent understanding of real-time streaming and batch pipelines, big data, and data lakes; hands-on experience in distributed... 
    Principal
    Big data
    Temporary work
    Work at office
    Remote work
    Flexible hours

    sovrn

    New York, NY
    4 days ago
  • $180 per hour

     ...the Role We are building an AI-native data platform that powers fraud detection...  ...Fraud Protection. We are hiring a Staff or Principal Data Engineer to own the data platform and data lake...  ...Apache Spark, Apache Flink and modern big-data systems. Proven command of best... 
    Principal
    Big data
    For contractors
    Work at office
    3 days per week

    AppGate Cybersecurity, Inc.

    New York, NY
    a month ago
  • $195k - $290k

     ...cybersecurity starts with you.About the Role:Our Data Platform group at Crowdstrike is unique...  ....In this role, you will be a Principal Engineer within Data Platform, owning - in entirely...  ...DynamoDB, etc.Proven expertise with multiple big data frameworks in general, especially... 
    Principal
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    New York, NY
    1 day ago
  •  ...Join SignalFire’s Talent Network for Principal AI/ML Engineer Roles at VC-Backed Startups This is not...  ...applications Work closely with engineering, data, and product teams to integrate AI/ML...  ...training systems ~ Familiarity with big data tools (Apache Spark, Kafka,... 
    Principal
    Big data
    Full time

    Signal Fire Inc

    New York, NY
    1 day ago
  • Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact...  ..., data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data... 
    Big data

    HAN Staffing

    New York, NY
    1 day ago
  • $250k - $300k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to... 
    Big data
    Work experience placement

    Point72

    New York, NY
    6 hours ago
  •  ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders...  ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action... 
    Big data

    NTT DATA

    New York, NY
    1 day ago
  •  ...Senior Analytics Engineer As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with multiple...  ...report to the Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data... 
    Big data

    Samprasoft

    New York, NY
    5 days ago
  • $100 - $130 per hour

    A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders...  .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience... 
    Big data
    Remote work

    Open Systems Technologies

    New York, NY
    6 hours ago
  • Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy...  ..., you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights, enhance... 
    Big data
    Full time
    Local area

    Audacy

    New York, NY
    3 days ago
  • $106k - $151k

    Build data pipelines, reports, best practices and frameworks that enable analysts and other...  ...across the organization.Use feature engineering to support data needs for ML/AI model development...  ...automation needs.Experience working with big data tools, distributed computing and non... 
    Big data

    Google

    New York, NY
    2 days ago
  • $170k - $230k

     ...to follow. If you're energized by shaping data infrastructure from zero to one inside a...  ...Self-service reporting that scales spanning Engineering, Science, PM-T, and Design across...  ...Preferred qualification - Experience with big data technologies such as: Hadoop, Hive,... 
    Big data
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $111.4k - $185k

     ...ve come to the right place.SDS is part of the Sales Intelligence, Technology, & Enablement organization (SITE). We are a big-data focused engineering team that provides unique, pan-Amazon datasets consolidating advertiser, seller, and vendor KPIs, exposed via data... 
    Big data
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  • $132.1k - $178.8k

     ...Commerce Analytics, supporting major PV investments in 2026. As a Data Engineer, you will work in one of the world's largest and most complex...  ...multiple heterogeneous data sources.You will leverage AWS big data technologies including Redshift, EMR/Spark, Andes Data Lake... 
    Big data
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  • $50k - $95k

    Agency:Hearts & ScienceJob Function:Data and AnalyticsJob Subfunction: Data Science and...  ...be reporting to the Senior Director, Data Engineering and be part of Data Engineering Team who...  ...pipeline design/development, SQL, AWS Cloud and Big Data Technologies experience. As a Data... 
    Big data
    Full time
    Work at office
    Local area
    3 days per week

    Momentum Worldwide

    New York, NY
    2 days ago
  • $198k - $247.5k

     ..., we empower people to transform complex data into clear and actionable insights. With...  ...largest enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s Forward...  ...Cloudera platform Experience with open source big data technologies like Spark, Iceberg, NiFi... 
    Principal
    Big data
    Full time
    Work from home
    Relocation

    Cloudera

    New York, NY
    4 days ago
  •  ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are...  ...true change.Our Data Architecture & Engineering team sees data as the foundation for decision...  ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Engineer... 
    Big data
    Temporary work
    Local area

    Slalom

    New York, NY
    1 day ago
  • $140k - $175k

     ...people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters in Downtown... 
    Big data
    Full time
    Work at office

    Rockstar Games

    New York, NY
    4 days ago
  •  ...3 days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy...  ...of data from a wide variety of data sources using SQL and AWS big data technologiesDevelop and debug code in PySpark/Spark/Python... 
    Big data
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    2 days ago
  • $300k - $400k

     ...go to . Role Description   As a Principal AI/ML Engineer in our AdTech team, you will be a key individual...  ...-time bidding and digital marketing data). You will work closely with...  ...models .   ~ Strong experience with big data and streaming frameworks (e.g., Apache... 
    Principal
    Big data
    Full time

    Zeta Global

    New York, NY
    1 day ago
  •  ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms... 
    Big data
    Full time

    Syntricate Technologies

    New York, NY
    4 days ago
  • $215.2k - $244.7k

     ...This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of...  ...-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation... 
    Big data
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    2 days ago
  • $165k - $230k

     ...Position Summary We're hiring a Senior Data Engineer to own data at truly massive scale. You'll design and run pipelines that clean, enrich...  ...run data partnerships. Nice to have ~ Experience with big data, columnar storage formats, vector indexes, and privacy/... 
    Big data
    Permanent employment
    Work at office
    Monday to Friday

    Raylu, Inc

    New York, NY
    4 days ago
  • $90k - $135.29k

    DescriptionThe Mount Sinai Program for Surgical Intelligence is seeking a Data Engineer to support the development and deployment of data-driven tools...  ...and SOA.Proficiency on installation and configuration of big data software and technologyKnowledge of Hadoop, Spark, Kafka... 
    Big data
    Traineeship
    Local area
    Immediate start
    Flexible hours

    Mount Sinai Health System

    New York, NY
    4 days ago
  • $145.3k - $196.6k

     ...Come join our team in AWS, you’ll help us design and deliver data engineering solutions that enables AWS to expand our operations into new data...  ..., or Business Analytics.- Practical familiarity with AWS Big Data Technologies, encompassing EMR, Athena, EC2, Redshift, IAM... 
    Big data
    Worldwide
    Flexible hours

    AmazonWebServices

    New York, NY
    2 days ago
  •  ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15... 
    Big data
    Contract work

    Argyle Infotech

    New York, NY
    4 days ago
  • $153k - $204k

     ...provisioning and high-reliability operations.About the role:As a Senior Data Engineer you will own and evolve the data lake and analytics stack that...  ...data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark).Experience designing,... 
    Big data
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  •  ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an...  ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable... 
    Big data
    Contract work

    Staffing the Universe

    New York, NY
    4 days ago
  •  ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple...  ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL... 
    Big data
    Remote work
    Home office
    Flexible hours

    Grinteq

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!