Sr. Data Engineer

Sr. Data EngineerResponsibilities:Build resilient production ETL pipelines with data observabilityDeploy solutions to production using CICD best practices and infrastructure automationBuild data ingestion jobs using Python from multiple types of data sources - including APIs, relational and NoSQL databasesWork closely with business and technical partners to refine pipeline requirements and design data models to support business objectivesIntegrate new capabilities into the architecture, including streaming data, new monitoring tools, etc.Help establish and follow a data driven operations culture within the data teamHelp establish standard practices for building out scalable solutions, mentor other team membersHelp with proof-of-concept implementations for new technologies being tested for the data platformEnsure data is secure and in compliance with GDPR, CCPA, Data Privacy, and data retention policiesTriage and debug production data issuesThe individual will need the following skills:BS degree in Computer Science or a related technical field, or equivalent practical experienceProven domain expertise in at least one area (such as Sales & Marketing, Supply Chain, Finance, Data Science, Analytics)5+ years of building mid to large scale data systems4+ years of using AWS ecosystem tools preferred, including Redshift, S3, EMR, Lambda, Kinesis, ECS, Glue and/or another cloud providers equivalent stack4+ years of experience building ETL pipelines and working with Cloud Data Warehouses (such as Redshift, Snowflake, Azure SQL Data Warehouse, BigQuery)Experience working with a streaming platform such as KafkaExperience working with Big Data frameworks such as Apache Spark or FlinkExperience using Infrastructure as Code tools (Terraform, CloudFormation)5+ years of experience writing and optimizing SQL. Experience with data modeling for data warehouses4+ years of experience working with Python. Professional experience with at least one other programming language (Java, Scala, Go, Ruby, Javascript)3+ years of experience with ETL tools Informatica, DataStage, SSIS, AbInitio, Talend, Matillion)Experience working with orchestration tools(Airflow, Luigi, Apache Nifi, Step Functions, etc.)