Principal Data Engineer

Job Title

Designs and crafts modern data and information delivery and analytics platforms in the Cloud, using Snowflake, Redshift, AWS, Azure, and Python. Builds scalable and robust data solutions. Supports compensation-related data solutions for global clients, using Cloud-native data warehousing and Extract, Load, Transform (ELT) integration tools (Informatica and Snaplogic). Works closely with engineers and business Subject Matter Expert (SMEs) to build and release solutions, using Agile methodologies, Continuous Integration and Continuous Delivery/Deployment (CI/CD) pipelines, and DevOps concepts. Performs information delivery and analytics, using Business Intelligence tools (Oracle Analytics Server (OAS), Power BI, or Tableau). Uses business knowledge to translate the vision for divisional initiatives into business solutions by developing complex or multiple software applications and conducts studies of alternatives. Analyzes and recommends changes in project development policies, procedures, standards, and strategies to development experts and management.

Primary Responsibilities

• Participates in data architecture design teams.
• Defines and implements application-level data architecture.
• Develops data applications on complex projects, components, and subsystems for the division.
• Recommends data testing tools and methodologies and reviews and validates test plans.
• Responsible for QA readiness of software deliverables.
• Develops comprehensive documentation for multiple applications or subsystems.
• Establishes full project life cycle plans for complex projects across multiple platforms.
• Responsible for meeting project goals on-time and on-budget.
• Advises on risk assessment and risk management strategies for projects.
• Plans and coordinates project schedules and assignments for multiple projects.
• Acts as a primary liaison for business units to resolve various project/technology issues.
• Provides technology solutions to daily issues and technical evaluation estimates on technology
• Advises senior management on technical strategy.
• Mentors junior team members.
• Performs independent and complex technical and functional analysis for multiple projects supporting several divisional initiatives.
• Develops original and creative technical solutions to on-going development efforts.

Education and Experience

Bachelor's degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) building and supporting scalable data warehousing and reporting platforms in a financial services environment.

Or, alternatively, Master's degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation) building and supporting scalable data warehousing and reporting platforms in a financial services environment.

Skills and Knowledge

Candidate must also possess:

• Demonstrated Expertise ("DE") implementing Cloud technologies within a financial services environment; delivering real time reports with actionable insights to stakeholders using advanced BI tools -- Oracle Analytics Server (OAS), Oracle Business Intelligence (OBIEE), and PowerBI; and creating dynamic, user-driven reports for multidimensional data analysis and online analytical processing (OLAP), using Hyperion Interactive Reporting.
• DE building and maintaining Extract, Transform, Load (ETL) pipelines using Snowflake, Python, SnapLogic, and Informatica; developing SQL scripts and stored procedures to process large datasets in relational environments; and improving data workflows and data availability for business operations using Informatica and PL/SQL.
• DE designing and developing data pipelines for data warehouses (ETL from VSAM and DB2), using Informatica and zNFS within Agile frameworks (Scrum and Kanban), in a financial services domain; integrating the data pipelines with PL/SQL and UNIX Shell scripting; creating batch jobs using Control-M and Informatica servers; and identifying bottlenecks in ETL packages and implementing optimal solutions.
• DE applying DevOps principles throughout the software development life cycle (SDLC); building and promoting CI/CD pipelines using Jenkins, Jenkins Core, Stash, Bitbucket, and GitHub to automate deployments; and improving system reliability and supporting continuous delivery of data engineering solutions, using Cloud platforms (AWS, Azure, IBM uDeploy, and Ansible).