Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in Albany, NY vacancy
  •  ...Sr. Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing...  ...manipulate data (Python, R, SQL, SAS). ~ Strong knowledge of big data analysis and storage tools and technologies. ~ Strong... 
    Big data
    Full time
    Flexible hours

    Contact Government Services LLC

    Albany, NY
    1 day ago
  • $205k

     ...benefits we offer can be found at Responsibilities The Senior Data Engineer is responsible for designing, developing, and optimizing scalable...  ...patients and providers 5+ years of experience in enterprise big data platform infrastructure development Most recent role must... 
    Big data
    Work experience placement

    Socket

    Albany, NY
    1 day ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...languages such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus-... 
    Big data
    Full time
    H1b

    PwC

    Albany, NY
    2 days ago
  • Overview CGS is seeking a passionate and driven Sr. Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform...  ...Python, R, SQL, SAS for manipulating data. Strong knowledge of big data analysis and storage tools and technologies. Solid... 
    Big data
    Flexible hours

    Cgsfederal

    Albany, NY
    4 days ago
  • $80.6k - $100.75k

     ...streaming radio and podcasting, which bring data, targeting and attribution to all forms of...  .... What You'll Do: As an Analytics Engineer you will derive impactful insights from data...  ...with AWS Experience with Spark and the big data ecosystem Experience using Git and... 
    Big data
    Full time
    Flexible hours

    iHeartMedia

    Albany, NY
    1 day ago
  • $126.2k - $264.1k

     ...ourselves on revolutionizing the way health data is captured, analyzed, and transformed...  ...Collaborating with cross-functional teams like Engineering, Data Science, Marketing, Sales, and...  ...: Experience with data warehousing, big data, machine learning Experience with... 
    Principal
    Big data
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    3 days ago
  • $97.17k - $126.32k

     ...individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.About the Role:The Data Engineer designs, develops, and maintains NYSTEC’s enterprise data platform and data integration solutions. This role builds scalable, secure... 
    Full time
    Local area
    Visa sponsorship

    New York State Technology Enterprise Corporation (NYSTEC)

    Albany, NY
    3 days ago
  • $100k - $110k

    The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that... 
    Full time
    Work from home
    Home office

    Excelsior University

    Albany, NY
    7 hours ago
  • $140k - $160k

     ...in the efforts to design, develop, and maintain databases and data integration (ETL) systems to support business applications and...  ...Proficiency in programming languages is commonly used in data engineering, such as Python or Java Our Company: Carrington Mortgage... 
    Work experience placement
    Remote work
    Work from home

    Carrington

    Albany, NY
    1 day ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a... 
    Work experience placement
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Albany, NY
    2 days ago
  • A leading government services company based in Albany, NY, is seeking an experienced CommVault Systems Engineer. The ideal candidate will have extensive knowledge in backup and recovery solutions tailored for federal clients. Responsibilities include designing, deploying... 

    CGS Federal (Contact Government Services)

    Albany, NY
    3 days ago
  •  ...Senior Data Engineer Anywhere Type: Contract-to-Hire Category: Data Industry: Manufacturing Workplace Type: Remote Reference ID: JN -072026-107976 Date Posted: 07/20/2026 Shortcut: Description Recommended Jobs Description: Remote... 
    Hourly pay
    Permanent employment
    Contract work
    Local area
    Immediate start
    Remote work

    Eliassen Group

    Albany, NY
    2 days ago
  •  ...combine our strength in technology and leadership in cloud, AI and data with unmatched industry experience, functional expertise, and...  ...Open AI, Anthropic, AWS, Azure, Google Cloud).You have knowledge of big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    2 days ago
  • $74.1k - $148.3k

     ...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly...  ...form the digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader,... 
    Temporary work
    Live in
    Local area
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    Oracle

    Albany, NY
    5 days ago
  •  ...Accenture is seeking an AI Engineer to build and integrate AI applications using OpenAI, Anthropic, and cloud platforms like AWS Bedrock, Azure OpenAI, and Vertex AI. You will implement RAG, orchestration, evaluation, and guardrails across APIs and pipelines, and deploy... 

    Accenture

    Albany, NY
    1 day ago
  •  ...Vendors of Commercial Off the Shelf (COTS) products, and IT teams to determine and design application and system requirements. • Design data infrastructure to extract and organize data for authorized individuals to access. • Identify internal and external data sources,... 

    Mindlance

    Albany, NY
    1 day ago
  •  ...Data Engineer Location: Delmar, NY, 12054 Duration: 2- 3 years Contract Requirements: ~60 months experience in database administration, including schema creation, schema management, table creation, user management, and security. ~60 months experience in designing... 
    Contract work

    InterSources

    Delmar, NY
    16 hours ago
  •  ...project management, and communication skills. Troubleshooting skills Previous information technology experience. Prior data center, server, or network engineer experience – especially with Cisco IOS or NX-OS platforms – is preferred. COVID-19 vaccination #J-18808-Ljbffr... 
    Work at office
    Relocation
    Relocation package

    Epic

    Albany, NY
    1 day ago
  •  ...Data Engineer Note: 2 to 4 years of healthcare experience is must Location: Albany but Remote (Prefer candidates from Albany, the candidate need to be available to visit client location on need basis) Duration: 4-6 Months (Possibility of extension) Role Overview... 
    Remote work

    Kaav Inc.

    Albany, NY
    5 days ago
  • Apple in New York, NY is seeking a Data Engineer to develop and apply quantitative analytics for the Tasks group. You will harness data science methods to identify process gaps and deliver impactful, data-driven improvements across the supply chain. You’ll use Snowflake... 

    Apple

    Albany, NY
    4 days ago
  • $124k - $280k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision... 
    H1b

    PwC

    Albany, NY
    2 days ago
  • $69.7k - $112.8k

    ASM Research, An Accenture Federal Services Company, seeks a Performance Analyst, Mid, in Albany, New York. This role monitors and analyzes enterprise IT systems to ensure service levels are met. Responsibilities include designing performance dashboards, conducting root...
    Remote work

    ASM Research, An Accenture Federal Services Company

    Albany, NY
    1 day ago
  • $97.17k - $126.32k

     ...independent and vendor-neutral, focusing on helping clients succeed so that individuals and teams flourish. This role is focused on the data engineering function and collaboration with the Business Intelligence team and stakeholders. Compensation : The target base salary range... 

    NYSTEC

    Albany, NY
    2 days ago
  • $296.3k - $423.9k

     ...a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  ...Collaborate closely with teamsworking on: data, perception,simulation, safety... 
    Principal
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Albany, NY
    1 day ago
  •  ...Continental United States . If you are passionate about real-world data, advanced analytics, and delivering meaningful insights, we...  ...event, cross-sectional, and longitudinal data Experience with big data analytical platforms Deep understanding of observational... 
    Big data
    Remote work
    Flexible hours

    PAREXEL

    Albany, NY
    5 days ago
  •  ...CVS Health is seeking a Principal Software Development Engineer to lead architecture initiatives across cloud, data, and AI-driven platforms. You will drive scalable, secure, and user-centric software solutions enabling AI-powered consumer experiences across health journeys... 
    Principal

    Stryker

    Albany, NY
    1 day ago
  •  ...Regeneron Pharmaceuticals, Inc. seeks a Principal IT Applications Analyst to support their Digital Fusion program. This role involves configuring, implementing, and maintaining Oracle Fusion applications while collaborating with various departments like Supply Chain and... 
    Principal

    Regeneron Pharmaceuticals

    Albany, NY
    2 days ago
  •  ...Senior Data Platform Engineer Anywhere Type: Contract-to-Hire Category: Data Industry: Manufacturing Workplace Type: Remote...  ...Terraform, Azure Key Vault, managed identities and service principals, ADLS Gen2, Databricks, Spark, PySpark, Delta Lake, Kafka,... 
    Hourly pay
    Contract work
    Local area
    Remote work

    Eliassen Group

    Albany, NY
    3 days ago
  • $126.2k - $264.1k

     ...Organizational Effectiveness Lead business operations programs for Engineering & Infrastructure organizations in partnership with CIO-office...  ...(QBRs), staff meetings, and leadership updates. Provide data-driven insights and recommendations to support strategic... 
    Temporary work
    Work at office
    Flexible hours

    Oracle

    Albany, NY
    3 days ago
  •  ...GP Fund Solutions seeks a Senior Data Engineer to help build and optimize data warehouses and move toward a lakehouse architecture. You will develop Snowflake pipelines, write high-performance SQL, and implement dbt models across layers. Join a collaborative, growth-oriented... 
    Trial period

    GP Fund Solutions, LLC

    Latham, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!