Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in Albany, NY vacancy
  •  ...Sr. Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing...  ...manipulate data (Python, R, SQL, SAS). ~ Strong knowledge of big data analysis and storage tools and technologies. ~ Strong... 
    Big data
    Full time
    Flexible hours

    Contact Government Services LLC

    Albany, NY
    3 days ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...languages such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus-... 
    Big data
    Full time
    H1b

    PwC

    Albany, NY
    4 days ago
  • Overview CGS is seeking a passionate and driven Sr. Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform...  ...Python, R, SQL, SAS for manipulating data. Strong knowledge of big data analysis and storage tools and technologies. Solid... 
    Big data
    Flexible hours

    Cgsfederal

    Albany, NY
    1 day ago
  • $80.6k - $100.75k

     ...streaming radio and podcasting, which bring data, targeting and attribution to all forms of...  .... What You'll Do: As an Analytics Engineer you will derive impactful insights from data...  ...with AWS Experience with Spark and the big data ecosystem Experience using Git and... 
    Big data
    Full time
    Flexible hours

    iHeartMedia

    Albany, NY
    3 days ago
  • $126.2k - $264.1k

     ...ourselves on revolutionizing the way health data is captured, analyzed, and transformed...  ...Collaborating with cross-functional teams like Engineering, Data Science, Marketing, Sales, and...  ...: Experience with data warehousing, big data, machine learning Experience with... 
    Principal
    Big data
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    19 hours ago
  •  ...a premier Google Cloud partner helping organizations modernize data ecosystems, build real-time analytics capabilities, and responsibly...  ...Foundation Models, and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data Engineering, Analytics, or... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    19 hours ago
  • $97.17k - $126.32k

     ...individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.About the Role:The Data Engineer designs, develops, and maintains NYSTEC’s enterprise data platform and data integration solutions. This role builds scalable, secure... 
    Full time
    Local area
    Visa sponsorship

    New York State Technology Enterprise Corporation (NYSTEC)

    Albany, NY
    19 hours ago
  • $100k - $110k

    The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that... 
    Full time
    Work from home
    Home office

    Excelsior University

    Albany, NY
    2 days ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a... 
    Work experience placement
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Albany, NY
    4 days ago
  • $117.6k - $161.7k

     ...Become a part of our caring community The Senior Data Scientist uses advanced analytics, machine learning, and predictive modeling...  ...techniques such as NLP or deep learning. Experience working with big data technologies such as Spark or PySpark. Experience... 
    Big data
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    Humana

    Albany, NY
    1 day ago
  •  ...combine our strength in technology and leadership in cloud, AI and data with unmatched industry experience, functional expertise, and...  ...Open AI, Anthropic, AWS, Azure, Google Cloud).You have knowledge of big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    4 days ago
  • $165.56k - $188.09k

     ...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who strive for more, and the company's values - Act Sustainably, Celebrate the Wins, Fight on Together, Love Athletes and Stand for... 
    Local area
    Remote work
    Relocation

    Under Armour

    Albany, NY
    19 hours ago
  • $170k - $215k

     ...Senior Data Scientist Company: Norstella Location: Remote, United States Date...  ...in collaboration with content and product engineering teams Implement rigorous testing and evaluation...  ..., data retrieval) Experience with Big Data tools like Apache Spark, Hadoop, or... 
    Big data
    Full time
    Contract work
    Temporary work
    Work experience placement
    Local area
    Remote work
    Flexible hours

    Norstella

    Albany, NY
    2 days ago
  • $74.1k - $148.3k

     ...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly...  ...form the digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader,... 
    Temporary work
    Live in
    Local area
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    Oracle

    Albany, NY
    4 days ago
  •  ...Data Engineer Note: 2 to 4 years of healthcare experience is must Location: Albany but Remote (Prefer candidates from Albany, the candidate need to be available to visit client location on need basis) Duration: 4-6 Months (Possibility of extension) Role Overview... 
    Remote work

    Kaav Inc.

    Albany, NY
    2 days ago
  •  ...project management, and communication skills. Troubleshooting skills Previous information technology experience. Prior data center, server, or network engineer experience – especially with Cisco IOS or NX-OS platforms – is preferred. COVID-19 vaccination #J-18808-Ljbffr... 
    Work at office
    Relocation
    Relocation package

    Epic

    Albany, NY
    19 hours ago
  • $64.89k - $173.04k

     ...something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary The Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data... 
    Hourly pay
    Full time
    Temporary work
    Local area

    CVS Health

    Albany, NY
    1 day ago
  • Apple in New York, NY is seeking a Data Engineer to develop and apply quantitative analytics for the Tasks group. You will harness data science methods to identify process gaps and deliver impactful, data-driven improvements across the supply chain. You’ll use Snowflake... 

    Apple

    Albany, NY
    1 day ago
  • $124k - $280k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision... 
    H1b

    PwC

    Albany, NY
    2 days ago
  • $65k

    Position Overview We are seeking a motivated Data Engineer to join our Data Engineering team. The ideal candidate will have exposure in Python...  ...and data warehouse architectures (e.g., Snowflake, Databricks, Big query etc.) Knowledge of containerization and CI/CD pipelines... 
    Hourly pay
    Temporary work
    Work at office
    Relocation

    Cognizant

    Albany, NY
    1 day ago
  • $296.3k - $423.9k

     ...a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  ...Collaborate closely with teamsworking on: data, perception,simulation, safety... 
    Principal
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Albany, NY
    3 days ago
  •  ...Regeneron Pharmaceuticals, Inc. seeks a Principal IT Applications Analyst to support their Digital Fusion program. This role involves configuring, implementing, and maintaining Oracle Fusion applications while collaborating with various departments like Supply Chain and... 
    Principal

    Regeneron Pharmaceuticals

    Albany, NY
    4 days ago
  •  ...Senior Data Platform Engineer Anywhere Type: Contract-to-Hire Category: Data Industry: Manufacturing Workplace Type: Remote...  ...Terraform, Azure Key Vault, managed identities and service principals, ADLS Gen2, Databricks, Spark, PySpark, Delta Lake, Kafka,... 
    Hourly pay
    Contract work
    Local area
    Remote work

    Eliassen Group

    Albany, NY
    19 hours ago
  •  ...Equal Opportunity / Aff… PROFESSIONAL EMPLOYMENT OPPORTUNITY POSTING #: 063 DATE OF POSTING: August 13, 2026 POSITION: Assistant Principal, Full-Time Probationary EFFECTIVE DATE: September 8, 2026 ASSIGNMENT: Troy Middle School REPORTS TO: Building Principal QUALIFICATIONS... 
    Principal
    Full time
    Contract work

    Troy City School District

    Albany, NY
    7 hours ago
  • Newmark is seeking an experienced Data Center Operations Engineer to provide operational support for our fast-paced tech campus data center in Albany, NY. You will maintain mechanical, electrical, security and fire protection systems critical to uptime of servers and mainframes... 
    For contractors

    Newmark

    Albany, NY
    3 days ago
  •  ...Senior Data Engineer – GP Fund Solutions Where Data Meets Decision-Making. We turn numbers into insights that drive client success. Join GP Fund Solutions (GPFS) - a people-first fund administrator serving clients across the US, UK, and EU. We offer a collaborative... 
    Full time
    Trial period

    GP Fund Solutions

    Latham, NY
    a month ago
  •  ...input into, and mentor statistical programmers to provide input into documents produced by other functions (e.g., biostatisticians, data managers, medical writers, etc.) records handling (e.g., Chapter 21 of the US Code of Federal Regulation - Part 11), and electronic... 
    Principal

    Katalyst Healthcares & Life Sciences

    Albany, NY
    4 days ago
  •  ...We are looking to fill a Principal Scientist - Purification Chemist position working as a full-time employee of Parexel FSP on long...  ...companies to meet their long-term staffing needs for scientists and engineers and related professionals in discovery and development of... 
    Principal
    Full time

    PAREXEL

    Albany, NY
    3 days ago
  •  ...use machine learning and Internet-scale data to elevate customer experience, improve efficiency...  ...at Instacart works alongside world-class engineers, data scientists, and product managers to...  ...recommendations, published at IEEE Big Data 2021 (Paper) Enhancing sequence-... 
    Big data
    Remote job
    Permanent employment
    Work experience placement
    Internship
    Work at office
    Work from home
    Flexible hours

    Instacart

    Albany, NY
    3 days ago
  • $169.3k - $304.7k

     ...runtime aspects of the system, including data analytics and attack detection. You'll work...  ...the designs for review Guiding the engineering teams as they work on the detailed designs...  ...distributed systems Bring knowledge of big data analytics, machine learning... 
    Big data
    Work experience placement
    Work at office

    Akamai

    Albany, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!