Principal Data Engineer

Key Responsibilities of Principal Data Engineer:

• Guide the team towards successful project delivery
• Provide technical leadership and key decision making
• Work with and mentor individual team members to meet professional goals
• Continuous effort to automate and increase team efficiency
• Maintain high standards of software quality via code review, testing, automation standardization, and tooling
• Collaborate directly with both developers and business stakeholders
• Provide estimates and risk-reducing spike stories
• Assist in collection and documentation of requirements from business
• Assist in planning deployments and migrations
• Prepare status updates and run the daily standup
• Analyze data problems and provide solutions
• Assess opportunities for improvements and optimization

Required Qualifications of the Principal Data Engineer:

• Masters Degree or equivalent work experience
• Minimum 12 years of experience working with open source databases
• Minimum 10 years of experience working with ETL and related data pipeline technologies.
• Highly proficient in open source SQL systems, particularly MySQL and PostgreSQL
• Proficiency in multiple scripting languages, including Python and Ruby
• Demonstrable experience with cloud-based ETL tools, including EMR,
• Expertise with distributed data stores, with demonstrable experience using Redshift and with optimizing query performance
• Deep understanding of data structures and schema design
• Prior work with AWS ecosystem, particularly RDS, SQS and SNS, StepFunctions, CDK)
• Exceptional analytical, organizational, interpersonal, and communication (both oral and written) skills
• Self-motivated, driven, resourceful, and able to get things done
• Enjoy working in fast-paced, collaborative, Agile environments
• Ability to adapt and learn quickly is a fundamental necessity

Benefits:

• 401(k)
• Dental Insurance
• Health insurance
• Health savings account
• Paid time off
• Professional development assistance
• Vision insurance