Principal Data Engineer

Principal Data Engineer Job Description Template

Our company is looking for a Principal Data Engineer to join our team.

Responsibilities:

  • Identify and drive new solutions to enhance the development cycle to increase development productivity;
  • End to end ownership of ETL data pipelines, from ingestion of data to consumption by business intelligence and advanced analytics teams;
  • Evolve existing tools and framework to support new scalability requirements as well new functionality needed;
  • Lead the construction and maintenance of an automated, scalable, resilient, and self-healing data platform;
  • Challenge yourself to learn and grow;
  • Design and build automated, self-service data capabilities, freeing teams to focus on customer features and analysis;
  • Work with the team to identify and resolve technical debt to improve the team’s throughput;
  • Mentor and lead peer developers in adopting best practices craftsmanship.

Requirements:

  • Experience with Data Management and Data Governance processes and standards;
  • Exceptional expertise of system design and application architecture for data platforms;
  • Extensive knowledge in fine tuning SQL, understanding optimizers, and execution plans;
  • Extensive experience architecting complex data models to handle millions of transactions;
  • Experience with Google Analytics, Kubernetes, Java Spring, Apache Airflow, or Snowflake is a plus;
  • 8+ years experience building data pipelines;
  • Strong communication skills;
  • AWS data products (Data pipelines, Redshift, Pinpoint, S3, etc);
  • Experience in application design and Implementation using agile practices & TDD;
  • 8+ years experience programming in Python or Java;
  • Exceptional track record of designing and implementing highly scalable, distributed application systems;
  • Experience with recognized industry patterns, methodologies, and techniques;
  • At least 4-5 years of experience in Scala/Java or Python programming.