Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Big Data Engineer

NTT Data

Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will influence all architecture decisions.You will build reusable code, with the ability to scale with very large data volumes.Everything you build will need to scale and perform.As a Principal member on the team you will also mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.)You will architect and drive the build out of next generation data platform.General ResponsibilitiesBuild and lead high-performing, agile teams focused on Data Engineering.Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data.Overall accountability for ensuring teams adopt established data management frameworks to prevent data lakes from becoming data swamps.Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projectsAs a hands-on engineer, you will influence all architecture decisions.As a Principal member on the team you will also mentor junior/senior engineers on the teamJob Functions:Provide technical leadership to build and implement data and big data solutionsArticulate pros and cons of various technologies, platforms and tools.Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc.Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera).Deep technical Expertise in Hadoop eco system components.Experience designing, developing and implementing online-machine learning libraries.Minimum Experience: 10+ years of Data Engineering experience8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing5+ years of experience in Hadoop MapReduce, Hive, Pig, Spark, and Yarn4 years of business experience leading analyses and initiatives with track record of business impactCloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ yearTravel: Need localsDegree: Bachelors in Computer Science or equivalent work experienceDesirable Skills:Hadoop/Cloud Developer CertificationExperience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clustersExposure to cloud infrastructurePosting Date:Department: -

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Big Data Engineer in Albany, NY vacancy
  •  ...Overview CGS is seeking a passionate and driven Sr. Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform...  ...Python, R, SQL, SAS for manipulating data. Strong knowledge of big data analysis and storage tools and technologies. Solid... 
    Big data
    Flexible hours

    Cgsfederal

    Albany, NY
    1 day ago
  •  ...Sr. Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer...  ...to manipulate data (Python, R, SQL, SAS). Strong knowledge of big data analysis and storage tools and technologies. Strong... 
    Big data
    Full time
    Flexible hours

    Contact Government Services, LLC

    Albany, NY
    5 days ago
  • $205k

     ...benefits we offer can be found at Responsibilities The Senior Data Engineer is responsible for designing, developing, and optimizing scalable...  ...patients and providers 5+ years of experience in enterprise big data platform infrastructure development Most recent role must... 
    Big data
    Work experience placement

    Socket

    Albany, NY
    3 days ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...languages such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus-... 
    Big data
    Full time
    H1b

    PwC

    Albany, NY
    4 days ago
  • $80.6k - $100.75k

     ...streaming radio and podcasting, which bring data, targeting and attribution to all forms of...  ...of data. What You’ll Do: As an Analytics Engineer you will derive impactful insights from...  ...Experience with AWS Experience with Spark and the big data ecosystem Experience using Git and... 
    Big data
    Full time
    Flexible hours

    iHeartMedia

    Albany, NY
    1 day ago
  • $126.2k - $264.1k

     ...Job Description Data Center Facility Lead Principal Engineers are essential to driving data center growth and advancing liquid-to-chip solutions. As our facility engineering operations expand, the need for senior engineering expertise remains critical to providing technical... 
    Principal
    Contract work
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Albany, NY
    2 days ago
  • $126.2k - $264.1k

     ...ourselves on revolutionizing the way health data is captured, analyzed, and transformed...  ...Collaborating with cross-functional teams like Engineering, Data Science, Marketing, Sales, and...  ...: Experience with data warehousing, big data, machine learning Experience with... 
    Principal
    Big data
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    5 days ago
  •  ...A leading government services company based in Albany, NY, is seeking an experienced CommVault Systems Engineer. The ideal candidate will have extensive knowledge in backup and recovery solutions tailored for federal clients. Responsibilities include designing, deploying... 

    CGS Federal (Contact Government Services)

    Albany, NY
    5 days ago
  • $100k - $110k

    The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that... 
    Full time
    Work from home
    Home office

    Excelsior University

    Albany, NY
    2 days ago
  • $97.17k - $126.32k

     ...individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.About the Role:The Data Engineer designs, develops, and maintains NYSTEC’s enterprise data platform and data integration solutions. This role builds scalable, secure... 
    Full time
    Local area
    Visa sponsorship

    New York State Technology Enterprise Corporation (NYSTEC)

    Albany, NY
    13 hours ago
  •  ...CGS Federal (Contact Government Services) is seeking a Data Engineer to support a growing Data Analytics and BI platform for federal clients. The role focuses on building data pipelines, ETL processes, and data provisioning to consumers, within an Agile environment. The... 

    CGS Federal (Contact Government Services)

    Albany, NY
    1 day ago
  •  ...Apple in New York, NY is seeking a Data Engineer to develop and apply quantitative analytics for the Tasks group. You will harness data science methods to identify process gaps and deliver impactful, data-driven improvements across the supply chain. You’ll use Snowflake... 

    Apple

    Albany, NY
    18 hours ago
  • What you’ll do: Designs, develops, and optimizes data integration processes, ETL workflows, and data platforms, leading the creation...  .... Proficiency in programming languages commonly used in data engineering, such as Python or Java. What We Offer: Comprehensive healthcare... 
    Work experience placement

    Carrington

    Albany, NY
    1 day ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a... 
    Work experience placement
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Albany, NY
    17 hours ago
  • $91.4k - $187k

     ...Job Description Deploys physical plant cabling systems. Coordinates infrastructure implementation efforts for Oracle data centers. Collaborates with Program Management teams to ensure project deliverables are completed on time. Collaborates with vendors to deliver... 
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Albany, NY
    2 days ago
  •  ...combine our strength in technology and leadership in cloud, AI and data with unmatched industry experience, functional expertise, and...  ...Open AI, Anthropic, AWS, Azure, Google Cloud).You have knowledge of big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    4 days ago
  •  ...project management, and communication skills. Troubleshooting skills Previous information technology experience. Prior data center, server, or network engineer experience – especially with Cisco IOS or NX-OS platforms – is preferred. COVID-19 vaccination #J-18808-Ljbffr... 
    Work at office
    Relocation
    Relocation package

    Epic!

    Albany, NY
    2 days ago
  • $99k - $232k

     ...At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at... 
    H1b

    PVH (Tommy Hilfiger/Calvin Klein)

    Albany, NY
    10 minutes ago
  • $74.1k - $148.3k

     ...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly...  ...form the digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader,... 
    Temporary work
    Live in
    Local area
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    Oracle

    Albany, NY
    2 days ago
  •  ...Accenture is seeking an AI Engineer to build and integrate AI applications using OpenAI, Anthropic, and cloud platforms like AWS Bedrock, Azure OpenAI, and Vertex AI. You will implement RAG, orchestration, evaluation, and guardrails across APIs and pipelines, and deploy... 

    Accenture

    Albany, NY
    3 days ago
  • $64.89k - $173.04k

     ...something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary The Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data... 
    Hourly pay
    Full time
    Temporary work
    Local area

    CVS Health

    Albany, NY
    1 day ago
  •  ...Vendors of Commercial Off the Shelf (COTS) products, and IT teams to determine and design application and system requirements. • Design data infrastructure to extract and organize data for authorized individuals to access. • Identify internal and external data sources,... 

    Mindlance

    Albany, NY
    3 days ago
  • $85k - $113k

     ...curious, analytical, and technically driven Data Scientist to join our growing Analytics...  ...stakeholders, BI Analysts and Data Engineers on defining and building data sets to be...  ...in analyzing data. Apply methods for big data analysis to reveal patterns, trends,... 
    Big data
    Weekly pay
    Work at office
    Remote work
    Flexible hours

    Help At Home

    Albany, NY
    5 days ago
  • $124k - $280k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision... 
    H1b

    PwC

    Albany, NY
    2 days ago
  • $69.7k - $112.8k

    ASM Research, An Accenture Federal Services Company, seeks a Performance Analyst, Mid, in Albany, New York. This role monitors and analyzes enterprise IT systems to ensure service levels are met. Responsibilities include designing performance dashboards, conducting root...
    Remote work

    ASM Research, An Accenture Federal Services Company

    Albany, NY
    3 days ago
  • $165.56k - $188.09k

    Sr. Data Analytics Engineer Purpose of Role Provide quality and performant data modeling and visualizations solutions to our cross functional business units which represent the mantra, “Business First; Technology Second.” As part of a results‑oriented team, participate... 
    Local area
    Remote work
    Relocation

    Under Armour, Inc.

    Albany, NY
    1 day ago
  • $97.17k - $126.32k

     ...independent and vendor-neutral, focusing on helping clients succeed so that individuals and teams flourish. This role is focused on the data engineering function and collaboration with the Business Intelligence team and stakeholders. Compensation : The target base salary range... 

    NYSTEC

    Albany, NY
    4 days ago
  • $65k

    Position Overview We are seeking a motivated Data Engineer to join our Data Engineering team. The ideal candidate will have exposure in Python...  ...and data warehouse architectures (e.g., Snowflake, Databricks, Big query etc.) Knowledge of containerization and CI/CD pipelines... 
    Hourly pay
    Temporary work
    Work at office
    Relocation

    Cognizant

    Albany, NY
    3 days ago
  • $91.4k - $187k

     ...Description As a Facilities Technician - Mechanical, you will provide engineering ownership for the reliability, efficiency, and lifecycle...  ...-critical mechanical and HVAC systems supporting hyperscale data centers. This role sets technical direction, resolves high-impact... 
    Temporary work
    Flexible hours

    Oracle

    Albany, NY
    2 days ago
  • $296.3k - $423.9k

     ...a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  ...Collaborate closely with teamsworking on: data, perception,simulation, safety... 
    Principal
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Albany, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Big Data Engineer. Be the first to apply!