Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in New York, NY vacancy
  • $125.6k - $226.6k

     ...Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a...  ...UNSTOPPABLE for our employees! Job Overview We're looking for a Principal Data Engineer who brings strong technical judgment, a product-oriented... 
    Principal
    Big data
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Flexible hours

    T-Mobile

    New York, NY
    2 days ago
  • $195k - $290k

     ...cybersecurity starts with you.About the Role:Our Data Platform group at Crowdstrike is unique...  ....In this role, you will be a Principal Engineer within Data Platform, owning - in entirely...  ...DynamoDB, etc.Proven expertise with multiple big data frameworks in general, especially... 
    Principal
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    New York, NY
    16 hours ago
  • $180 per hour

     ...the Role We are building an AI-native data platform that powers fraud detection...  ...Fraud Protection. We are hiring a Staff or Principal Data Engineer to own the data platform and data lake...  ...Apache Spark, Apache Flink and modern big-data systems. Proven command of best... 
    Principal
    Big data
    For contractors
    Work at office
    3 days per week

    AppGate Cybersecurity, Inc.

    New York, NY
    27 days ago
  • $220k - $245k

     .... About the role: We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is excited about our mission...  ...distributed data processing, data warehousing, data governance, Big Data, data variance, data privacy, and data quality) ~... 
    Big data
    Full time
    Work at office
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    13 hours ago
  • Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact...  ..., data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data... 
    Big data

    HAN Staffing

    New York, NY
    16 hours ago
  • $250k - $300k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to... 
    Big data
    Work experience placement

    Point72

    New York, NY
    4 days ago
  • $233.6k - $350.4k

     ...employees – and aim to leave a positive mark on culture. Principal Machine Learning Engineer, Presentation & Visual Optimization Role Overview:...  ...: Proficiency in Python, PyTorch/TensorFlow , and big-data processing (Spark/Databricks). ~ Leadership:... 
    Principal
    Big data
    Full time
    Shift work

    Paramount

    New York, NY
    1 day ago
  •  ...Join SignalFire’s Talent Network for Principal AI/ML Engineer Roles at VC-Backed Startups This is not...  ...applications Work closely with engineering, data, and product teams to integrate AI/ML...  ...training systems ~ Familiarity with big data tools (Apache Spark, Kafka,... 
    Principal
    Big data
    Full time

    Signal Fire Inc

    New York, NY
    12 hours ago
  •  ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders...  ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action... 
    Big data

    NTT DATA

    New York, NY
    4 days ago
  • $100 - $130 per hour

    A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders...  .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience... 
    Big data
    Remote work

    Open Systems Technologies

    New York, NY
    4 days ago
  •  ...Senior Analytics Engineer As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with multiple...  ...report to the Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data... 
    Big data

    Samprasoft

    New York, NY
    4 days ago
  • Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy...  ..., you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights, enhance... 
    Big data
    Full time
    Local area

    Audacy

    New York, NY
    2 days ago
  • $106k - $151k

    Build data pipelines, reports, best practices and frameworks that enable analysts and other...  ...across the organization.Use feature engineering to support data needs for ML/AI model development...  ...automation needs.Experience working with big data tools, distributed computing and non... 
    Big data

    Google

    New York, NY
    1 day ago
  • $170k - $230k

     ...to follow. If you're energized by shaping data infrastructure from zero to one inside a...  ...Self-service reporting that scales spanning Engineering, Science, PM-T, and Design across...  ...Preferred qualification - Experience with big data technologies such as: Hadoop, Hive,... 
    Big data
    Flexible hours

    Amazon

    New York, NY
    16 hours ago
  • $106.9k - $176.5k

     ...Senior Consultant - Financial Services - Data & Analytics - Data Architecture and EngineeringEY...  ...Management (DPM), Data Architecture and Engineering (DAE), Data Governance and Controls (DGC)...  ..., storage, mining/warehousing, big data analytics, and visualization.Understanding... 
    Big data
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    1 day ago
  • $132.1k - $178.8k

     ...Commerce Analytics, supporting major PV investments in 2026. As a Data Engineer, you will work in one of the world's largest and most complex...  ...multiple heterogeneous data sources.You will leverage AWS big data technologies including Redshift, EMR/Spark, Andes Data Lake... 
    Big data
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  • $111.4k - $185k

     ...ve come to the right place.SDS is part of the Sales Intelligence, Technology, & Enablement organization (SITE). We are a big-data focused engineering team that provides unique, pan-Amazon datasets consolidating advertiser, seller, and vendor KPIs, exposed via data... 
    Big data
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $198k - $247.5k

     ..., we empower people to transform complex data into clear and actionable insights. With...  ...largest enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s Forward...  ...Cloudera platform Experience with open source big data technologies like Spark, Iceberg, NiFi... 
    Principal
    Big data
    Full time
    Work from home
    Relocation

    Cloudera

    New York, NY
    3 days ago
  • $170k - $180k

    Senior Big Data EngineerNew York, NYHybrid Schedule (M/F remote, T/W/TH in-office)U.S. RemoteAt Magnite, we cultivate an environment of...  ...transactions per day!About this team: We are seeking a Senior Big Data Engineer to join our Infrastructure Engineering team. This role is... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday

    Magnite

    New York, NY
    1 day ago
  • $140k - $175k

     ...people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters in Downtown... 
    Big data
    Full time
    Work at office

    Rockstar Games

    New York, NY
    3 days ago
  • $178k - $259k

     ...Analyze customer feedback and performance data to extract critical insights, uncovering...  ...Partner closely with Product Management, Engineering, Sales, and Business Solutions to develop...  ...for AI-driven tooling.Knowledge of SQL and Big Data frameworks to effectively position... 
    Principal
    Big data

    Google

    New York, NY
    4 days ago
  •  ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are...  ...true change.Our Data Architecture & Engineering team sees data as the foundation for decision...  ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Engineer... 
    Big data
    Temporary work
    Local area

    Slalom

    New York, NY
    16 hours ago
  •  ...3 days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy...  ...of data from a wide variety of data sources using SQL and AWS big data technologiesDevelop and debug code in PySpark/Spark/Python... 
    Big data
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    1 day ago
  • $215.2k - $244.7k

     ...This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of...  ...-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation... 
    Big data
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    1 day ago
  • $145.3k - $196.6k

     ...Come join our team in AWS, you’ll help us design and deliver data engineering solutions that enables AWS to expand our operations into new data...  ..., or Business Analytics.- Practical familiarity with AWS Big Data Technologies, encompassing EMR, Athena, EC2, Redshift, IAM... 
    Big data
    Worldwide
    Flexible hours

    AmazonWebServices

    New York, NY
    1 day ago
  • $90k - $135.29k

    DescriptionThe Mount Sinai Program for Surgical Intelligence is seeking a Data Engineer to support the development and deployment of data-driven tools...  ...and SOA.Proficiency on installation and configuration of big data software and technologyKnowledge of Hadoop, Spark, Kafka... 
    Big data
    Traineeship
    Local area
    Immediate start
    Flexible hours

    Mount Sinai Health System

    New York, NY
    3 days ago
  • $153k - $204k

     ...provisioning and high-reliability operations.About the role:As a Senior Data Engineer you will own and evolve the data lake and analytics stack that...  ...data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark).Experience designing,... 
    Big data
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    16 hours ago
  • A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft...  ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    20 hours ago
  •  ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: ~ BS degree in computer science, computer engineering or equivalent ~5 – 6 years of experience delivering enterprise software solutions ~ Proficient in Spark, Scala, Python... 
    Big data
    Remote work

    Zortech Solutions

    New York, NY
    4 days ago
  •  ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple...  ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL... 
    Big data
    Remote work
    Home office
    Flexible hours

    Grinteq

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!