Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in Albany, NY vacancy
  • Sr. Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data...  ...to manipulate data (Python, R, SQL, SAS). Strong knowledge of big data analysis and storage tools and technologies. Strong... 
    Big data
    Full time
    Flexible hours

    Contact Government Services LLC

    Albany, NY
    5 days ago
  • Discover your exciting roleThe Principal Mechanical Engineer DTC (Data Centers) serves as Exentec’s senior technical authority for mission-critical mechanical infrastructure, providing expertise in cooling, thermal management, controls, and facility systems that support... 
    Principal
    Full time
    Local area

    Exyte

    Albany, NY
    17 days ago
  • $114.5k - $154.58k

     ...they're doing! Job Description Summary: We're looking for a Principal Sales Engineer who is not only passionate about technology but thrives on...  ...Responsibilities : Engage with prospective clients to understand their data integration challenges, especially around migrating from... 
    Principal
    Full time
    Remote work
    Worldwide

    Rocket Software

    Albany, NY
    5 days ago
  • $165.56k - $188.09k

     ...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who strive for more, and the company's values - Act Sustainably, Celebrate the Wins, Fight on Together, Love Athletes and Stand for... 
    Suggested
    Local area
    Remote work
    Relocation

    Under Armour

    Albany, NY
    3 days ago
  • Apple in New York, NY is seeking a Data Engineer to develop and apply quantitative analytics for the Tasks group. You will harness data science methods to identify process gaps and deliver impactful, data-driven improvements across the supply chain. You’ll use Snowflake... 
    Suggested

    Apple

    Albany, NY
    4 days ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a... 
    Full time
    Work experience placement
    Remote work
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Albany, NY
    3 days ago
  • $105k

    A day in the life: At Hertz, our senior data scientists are responsible developing and...  ...insights. You will work closely with data engineers, analysts, software developers and...  ...of intensive experience with cloud-based Big Data, ML and Analytics technologies, preferably... 
    Big data
    Worldwide

    The Hertz Corporation

    Albany, NY
    3 days ago
  • Data Engineer Note: 2 to 4 years of healthcare experience is must Location: Albany but Remote (Prefer candidates from Albany, the candidate need to be available to visit client location on need basis) Duration: 4-6 Months (Possibility of extension) Role Overview We are... 
    Remote work

    Kaav Inc.

    Albany, NY
    5 days ago
  • $100k - $110k

    The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that... 
    Full time
    Work from home
    Home office

    Excelsior University

    Albany, NY
    2 days ago
  • $85k - $113k

     ...curious, analytical, and technically driven Data Scientist to join our growing Analytics &...  ...stakeholders, BI Analysts and Data Engineers on defining and building data sets to be...  ...methodologies in analyzing data. Apply methods for big data analysis to reveal patterns, trends,... 
    Big data
    Weekly pay
    Work at office
    Remote work
    Flexible hours

    Help At Home

    Albany, NY
    3 days ago
  • $124k - $280k

    At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision... 
    H1b

    PwC

    Albany, NY
    5 days ago
  • $106.61k - $284.28k

     ...community at a time. POSITION SUMMARY At CVS Health, protecting customer, patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise privacy engineering and data protection... 
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    CVS Health

    Albany, NY
    3 days ago
  • $80k - $150k

     ...executive decision-making. The ideal candidatde possesses strong data visualization skills, experience working with large and complex datasets...  ..., and performance optimization.Skill and ability to work with big data and navigate data warehouse(s) and retrieving, combining,... 
    Big data
    Full time
    Work at office
    Flexible hours
    Shift work

    KeyBank

    Albany, NY
    4 days ago
  • Newmark Group, Inc. is seeking an experienced Data Center Operations Engineer to support a critical data center environment. Responsibilities include maintaining and repairing mechanical, electrical, security and fire protection systems to ensure continuous uptime and regulatory... 

    Newmark Group

    Albany, NY
    6 days ago
  • Newmark is seeking an experienced Data Center Operations Engineer to provide operational support for our fast-paced tech campus data center in Albany, NY. You will maintain mechanical, electrical, security and fire protection systems critical to uptime of servers and mainframes... 
    For contractors

    Newmark

    Albany, NY
    6 days ago
  • $296.3k - $423.9k

     ...a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  ...Collaborate closely with teamsworking on: data, perception,simulation, safety... 
    Principal
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Albany, NY
    5 days ago
  •  ...activates enterprise intelligence by unifying data, knowledge and business context to achieve...  ...What You'll Do As a Sr. Staff Software Engineer on the Database Query Optimization team at...  ...and deliver the next generation of big data analytics solutions. Specifically, you... 
    Big data
    Permanent employment
    Flexible hours

    Teradata

    Albany, NY
    5 days ago
  • $166.35k - $195.7k

     ...surges.”learn more about working at Coinbase. We're hiring a Principal Recruiter to join our Core Recruiting team within People...  ...strategies and a strong candidate and interviewer experience Drive data integrity and use pipeline analytics to inform hiring... 
    Principal
    Local area

    Coinbase

    Albany, NY
    2 days ago
  •  ...Senior Data Engineer – GP Fund Solutions Where Data Meets Decision-Making. We turn numbers into insights that drive client success. Join GP Fund Solutions (GPFS) - a people-first fund administrator serving clients across the US, UK, and EU. We offer a collaborative... 
    Full time
    Trial period

    GP Fund Solutions

    Latham, NY
    more than 2 months ago
  • $146.3k - $306.4k

     ...senior leadership role that requires strong technical depth, sound engineering judgment, and the ability to lead teams through growth,...  ...Lead and develop a team of electrical engineers supporting OCI's data center design initiatives. Provide technical and organizational... 
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    1 day ago
  • $126.2k - $264.1k

     ...workflows. Creates infrastructure and frameworks to monitor the performance of machine learning models in deployment. Evaluates potential data quality, security, and/or privacy issues and their impacts on modeling. Provides troubleshooting and debugging support. Addresses... 
    Principal
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Albany, NY
    3 days ago
  • $143k - $193.05k

     ...Infrastructure Modernization business unit is seeking a Senior Principal Software Engineer to serve as a visionary and hands-on technical leader for...  ...their critical infrastructure, business processes, and data. We help extend the value of these assets, enabling our customers... 
    Principal
    Full time
    Remote work
    Worldwide

    Rocket Software

    Albany, NY
    5 days ago
  • $169.8k - $355.4k

     ...will have an opportunity to work with teams of applied scientists and engineers to deliver high quality computer vision models and services that delights our customers with the confidence that their data are safe and protected. Your Opportunity We are seeking a visionary... 
    Principal
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    3 days ago
  •  ...Responsibilities: Lead data management activities as a program-level lead data manager in support of Alnylam clinical studies. Lead database build activities including leading cross-functional review of eCRF content, review of edit check specifications, and perform... 
    Principal
    Work experience placement
    Local area
    Flexible hours

    Katalyst Healthcares and Life Sciences

    Albany, NY
    4 days ago
  • $102.3k - $209.5k

     ...operation of mission-critical mechanical systems supporting OCI data centers. This role owns mechanical maintenance execution,...  ...maintenance completion, and corrective action closure. Partner with engineering, commissioning, and deployment teams on retrofits, upgrades,... 
    Temporary work
    For contractors
    Flexible hours

    Oracle

    Albany, NY
    5 days ago
  •  ...a premier Google Cloud partner helping organizations modernize data ecosystems, build real-time analytics capabilities, and responsibly...  ...Foundation Models, and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data Engineering, Analytics, or... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    4 days ago
  • $109.64k - $145.27k

     ...individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.About the Role:As a principal consultant – business analyst in the Technology Strategy practice area, you will support practice and service delivery goals by helping... 
    Principal
    Full time
    Local area
    Visa sponsorship

    New York State Enterprise (NYSTEC)

    Albany, NY
    13 hours ago
  •  ...% Remote Job Description: We are seeking an experienced Principal Quality Engineer to provide technical leadership in quality engineering, regulatory...  ...quality issues. Analyze quality metrics and statistical data to identify trends and implement data-driven process... 
    Principal
    Remote work

    Katalyst HealthCares & Life Sciences

    Albany, NY
    3 days ago
  • $132.1k - $237.9k

     ...solve problems? Join our Global Network Engineering team The Network Engineering team is...  .... Partner with the best As a Principal Network Engineer you will lead efforts in...  ...will address complex issues in routing, data center fabrics, and automation to ensure... 
    Principal
    Work experience placement

    Akamai

    Albany, NY
    5 days ago
  •  ...validation, inspection, and audit readiness Strong cross-functional collaboration and communication skills This Role Requires BS/BA in Engineering, Chemistry, or Life Sciences and 8+ years of relevant experience Experience in utility and facility qualification/validation The... 
    Principal
    Local area

    Scorpion Therapeutics

    East Greenbush, NY
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!