Software Engineer - Data

Data EngineerWe are seeking a highly experienced Engineer to join our team and own the development of a tiered data architecture for our data. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data integration and enable the delivery of high-quality insights to our leadership and business stakeholders.Skills Required: Apache Spark, SQL, git, Programming Language (Python, Java, Scala) Nice to have: Understanding of Design Patterns, Able to discuss tradeoffs between RDBMS vs Distributed StorageKey Qualifications:Proven experience in data engineering, data architecture, or a related fieldExperience in building and deploying tiered data architecture for analytics data is a plusStrong understanding of data modeling, data warehousing, and ETL conceptsProficiency in SQL and experience with at least one major data analytics platform, such as Hadoop or SparkExperience with data orchestration tools like Airflow is a nice to haveExcellent problem-solving and analytical skills, and the ability to work well under tight deadlinesExcellent interpersonal skills and the ability to collaborate effectively with cross-functional teamsDescription:Design and implement a tiered data architecture that integrates analytics data from multiple sources in an efficient and effective manner.Develop data models and mapping rules to transform raw data into actionable insights and reports.Collaborate with the analytics and business teams to understand their requirements and deliver solutions that meet their needs.Ensure data quality and accuracy by developing data validation and reconciliation processes.Play an active role in the development and maintenance of user documentation, including data models, mapping rules, and data dictionaries.Collaborate with multi-functional teams to define and implement data governance policies and standards.Stay informed about the latest developments in data analytics and data management technologies and recommend new tools and methodologies to improve the semantic layer.