Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in New York, NY vacancy
  • $125.6k - $226.6k

     ...Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a...  ...UNSTOPPABLE for our employees! Job Overview We're looking for a Principal Data Engineer who brings strong technical judgment, a product-oriented... 
    Principal
    Big data
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Flexible hours

    T-Mobile

    New York, NY
    11 hours ago
  • $195k - $290k

     ...cybersecurity starts with you.About the Role:Our Data Platform group at Crowdstrike is unique...  ....In this role, you will be a Principal Engineer within Data Platform, owning - in entirely...  ...DynamoDB, etc.Proven expertise with multiple big data frameworks in general, especially... 
    Principal
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    New York, NY
    3 days ago
  • $180 per hour

     ...the Role We are building an AI-native data platform that powers fraud detection...  ...Fraud Protection. We are hiring a Staff or Principal Data Engineer to own the data platform and data lake...  ...Apache Spark, Apache Flink and modern big-data systems. Proven command of best... 
    Principal
    Big data
    For contractors
    Work at office
    3 days per week

    AppGate Cybersecurity, Inc.

    New York, NY
    25 days ago
  • $106.9k - $176.5k

     ...working world. Senior Consultant - Financial Services - Data & Analytics - Data Architecture and Engineering EY is the only professional services firm with a...  ..., transformation, storage, mining/warehousing, big data analytics, and visualization. Understanding of... 
    Big data
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    New York, NY
    11 hours ago
  • Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact...  ..., data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data... 
    Big data

    HAN Staffing

    New York, NY
    3 days ago
  • $250k - $300k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to... 
    Big data
    Work experience placement

    Point72

    New York, NY
    2 days ago
  •  ...Roku in New York is seeking a Senior Solutions Engineer (Ad Data Ingestion) to own conversions, audiences, and pixels integrations. You’ll partner with clients to ensure healthy data ingestion, quality signals, and reliable measurement for Roku’s advertising platform.... 
    Big data

    Roku

    New York, NY
    1 day ago
  •  ...T-Mobile seeks a data architect/engineer to design and develop data architectures across on-premise, cloud, and hybrid platforms to support organizational data needs. You will mentor teammates and collaborate with data engineers to deliver data warehousing and analytics... 
    Big data

    T-Mobile

    New York, NY
    1 day ago
  •  ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders...  ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action... 
    Big data

    NTT DATA

    New York, NY
    2 days ago
  •  ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various...  ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    4 days ago
  •  ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows...  ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg... 
    Big data

    Saransh

    New York, NY
    4 days ago
  • $160k - $220k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to... 
    Big data
    Work experience placement

    Point72

    New York, NY
    2 days ago
  • $100 - $130 per hour

    A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders...  .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience... 
    Big data
    Remote work

    Open Systems Technologies

    New York, NY
    2 days ago
  • Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy...  ..., you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights, enhance... 
    Big data
    Full time
    Local area

    Audacy

    New York, NY
    14 hours ago
  •  ...location will be considered. * Data Science at Digital Turbine...  ...and better user experiences Principal Data Scientists shape the long...  ...leaders across Product, Engineering, and the business, frequently...  ...JAX) Solid understanding of big data ecosystems (Spark, Hadoop... 
    Principal
    Big data
    Local area

    Socket.dev

    New York, NY
    3 days ago
  • $106k - $151k

    Build data pipelines, reports, best practices and frameworks that enable analysts and other...  ...across the organization.Use feature engineering to support data needs for ML/AI model development...  ...automation needs.Experience working with big data tools, distributed computing and non... 
    Big data

    Google

    New York, NY
    3 days ago
  • $170k - $230k

     ...to follow. If you're energized by shaping data infrastructure from zero to one inside a...  ...Self-service reporting that scales spanning Engineering, Science, PM-T, and Design across...  ...Preferred qualification - Experience with big data technologies such as: Hadoop, Hive,... 
    Big data
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  • $132.1k - $178.8k

     ...Commerce Analytics, supporting major PV investments in 2026. As a Data Engineer, you will work in one of the world's largest and most complex...  ...multiple heterogeneous data sources.You will leverage AWS big data technologies including Redshift, EMR/Spark, Andes Data Lake... 
    Big data
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    14 hours ago
  • $170k - $180k

    Senior Big Data EngineerNew York, NYHybrid Schedule (M/F remote, T/W/TH in-office)U.S. RemoteAt Magnite, we cultivate an environment of...  ...transactions per day!About this team: We are seeking a Senior Big Data Engineer to join our Infrastructure Engineering team. This role is... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday

    Magnite

    New York, NY
    3 days ago
  • $198k - $247.5k

     ..., we empower people to transform complex data into clear and actionable insights. With...  ...largest enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s Forward...  ...Cloudera platform Experience with open source big data technologies like Spark, Iceberg, NiFi... 
    Principal
    Big data
    Full time
    Work from home
    Relocation

    Cloudera

    New York, NY
    1 day ago
  •  ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark... 
    Big data

    VeriiPro

    New York, NY
    1 day ago
  • $140k - $175k

     ...people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters in Downtown... 
    Big data
    Full time
    Work at office

    Rockstar Games

    New York, NY
    1 day ago
  • $178k - $259k

     ...Analyze customer feedback and performance data to extract critical insights, uncovering...  ...Partner closely with Product Management, Engineering, Sales, and Business Solutions to develop...  ...for AI-driven tooling.Knowledge of SQL and Big Data frameworks to effectively position... 
    Principal
    Big data

    Google

    New York, NY
    2 days ago
  •  ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are...  ...true change.Our Data Architecture & Engineering team sees data as the foundation for decision...  ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Engineer... 
    Big data
    Temporary work
    Local area

    Slalom

    New York, NY
    3 days ago
  •  ...3 days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy...  ...of data from a wide variety of data sources using SQL and AWS big data technologiesDevelop and debug code in PySpark/Spark/Python... 
    Big data
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    4 days ago
  •  ...Create/manage ETL pipelines for the data lake and Snowflake; automate data analysis/aggregation work. Design, build, and manage...  ...Live Coding; onsite may be required. Ideal Candidate: Senior Big Data Engineer with strong PySpark, AWS Glue/EMR, Snowflake, and Python skills... 
    Big data
    Live in

    BCforward

    New York, NY
    4 days ago
  • £75k per year

     ...Data Engineering Lead - AI focused - required for an AI-First SaaS business, offering Remote Working, paying up to circa £75K + Benefits Working Pattern: This is a Remote First team who regularly get together for collaboration, planning and company events, typically every... 
    Big data
    Full time
    Remote work

    Apply Recruitment

    New York, NY
    3 days ago
  •  ...A leading data solutions firm in New York is seeking an experienced Data Engineer to design, implement, and maintain data pipelines for efficient data flow. The ideal...  ...decisions while ensuring data quality. Familiarity with big data technologies and cloud solutions is... 
    Big data
    Local area
    Relocation

    Yeah! Global

    New York, NY
    1 day ago
  • $215.2k - $244.7k

     ...This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of...  ...-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation... 
    Big data
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    4 days ago
  •  ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer...  ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience... 
    Big data

    Qode

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!