Principal Data Engineer

ETL Reporting And Analytics Solutions Designer

Designs and develops Extract, Transform, Load (ETL) reporting and analytics solutions using ETL tools (Informatica and Snaplogic). Develops innovative solutions to support scalable, secure, and high-performance data environments. Maintains enterprise data warehouse using RMDS (Snowflake and PostgreSQL), Cloud platforms and services (AWS -- IAM, EC2, S3, Lambda, and RDS), and data manipulation languages and frameworks (Java, Python, and Jason). Develops sophisticated Continuous Integration/Continuous Delivery (CI/CD) pipeline using Maven, Jenkins, Stash, Ansible, and Docker. Writes SQL and stored procedures on relational databases. Performs debugging, analyzing and production support application development based on Jira stories in an Agile environment.

Primary Responsibilities:

• Designs and develops complex data integration solutions.
• Implements innovative solutions for financial advisors using the latest technology in a collaborative and engaging environment.
• Independently designs, develops, and implements data integration solutions using best practices across both cloud-based and traditional infrastructure technologies.
• Delivers data centric data integration solutions with transformation logic to be consumed by customers.
• Performs software configuration management, test automation, version control, and static code analysis.
• Integrates data with end-to-end development activities.
• Creates, updates, and maintains technical documentation for software-based projects and products.
• Solves production issues.
• Interacts with business partners to understand business requirements and assist in generation of technical requirements.
• Participates in architecture, technical design, and product implementation discussions.
• Develops and implements advanced data engineering frameworks.
• Advises senior leadership on data infrastructure and technology solutions.
• Mentors junior engineers.
• Performs independent and complex technical and functional analysis for multiple divisional initiatives.

Education and Experience:

Bachelor's degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing, building and supporting scalable data pipelines for large scale ETL, real-time, batch systems and reporting platforms in a financial services environment.

Or, alternatively, Master's degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation) designing, building and supporting scalable data pipelines for large scale ETL, real-time, batch systems and reporting platforms in a financial services environment.

Skills and Knowledge:

Candidate must also possess:

· Demonstrated Expertise designing and developing data pipelines for data warehouses (ETL), using Python within Agile frameworks (Scrum), in a financial services domain; integrating the data pipelines with PL/SQL; creating batch jobs using schedulers; and identifying bottlenecks in ETL packages.

· Demonstrated Expertise building and maintaining ETL pipelines using Python; developing SQL scripts or stored procedures to process large datasets in relational environments; and improving data workflows and data availability for business operations using PL/SQL with databases (Oracle, Postgres or Snowflake).

· Demonstrated Expertise applying DevOps principles throughout the software development life cycle (SDLC); and building and promoting CI/CD pipelines using Jenkins, and Bitbucket or GitHub to automate deployments.

· Demonstrated Expertise improving system reliability and supporting continuous delivery of data engineering solutions, using Cloud platforms -- AWS or GCP; delivering real time reports with actionable insights to stakeholders.