Lead AWS Data Engineer

Job Description Job Title: Lead AWS Data Engineer Location: Miami, Florida or Irving, Texas (Hybrid) Duration: Contract to Hire A Career that Empowers You to Build Your Future The Lead Data Engineer is responsible for overseeing the data engineering team and driving the strategic direction of data initiatives. The role involves managing projects, ensuring the scalability of data solutions, and collaborating with stakeholders to meet organizational goals. Your Responsibilities on the Team Leadand manage the data engineering team, including project planning, resourceallocation, and performance management. Developand enforce data engineering standards, processes, and best practices,ensuring consistency and quality across all data projects. Collaboratewith stakeholders, including business leaders, data scientists, and ITteams, to understand and prioritize data-related business needs andtranslate them into actionable technical requirements. Ensuredata solutions are scalable, secure, and aligned with the long-term goalsof the organization, considering both current and future data needs. Drivethe adoption of new technologies, tools, and methodologies that improvethe efficiency, reliability, and scalability of data engineeringpractices. Overseethe development and maintenance of comprehensive data documentation,including data architecture diagrams, process flows, and technicalspecifications. Managethe team's technical debt, ensuring that legacy systems are modernized andthat new solutions are built with maintainability and scalability in mind. Providetechnical leadership in the resolution of complex data issues, guiding theteam in troubleshooting and problem-solving efforts Knowledge Extensiveexperience with data pipeline orchestration tools (e.g., Apache Airflow,Luigi) and data integration platforms (e.g., Apache NiFi, Glue). Strongleadership and project management skills, with experience leadingcross-functional teams and managing multiple projects simultaneously. Expertisein cloud data platforms (AWS) and big data ecosystems, with a focus onoptimizing cost, performance, and scalability. Proficientin advanced data modeling, including the design of enterprise datawarehouses, data lakes, and data marts. In-depthknowledge of data governance practices, including data cataloging, datalineage, and data quality management. Experiencewith enterprise data management frameworks, such as Master Data Management(MDM) and metadata management. Advancedskills in programming and scripting languages (e.g., Python, Java, Scala)for developing and automating data workflows. Experiencewith real-time data processing and event-driven architectures, leveragingtools such as Apache Kafka, Spark Streaming, and AWS Lambda. Your Toolbox Bachelor'sor Master's degree in Computer Science, Information Technology, or arelated field. 7-10years of experience in data engineering, with significant leadership andproject management experience. AWS,Snowflake, Azure AWSGlue, AWS AppFlow, Prefect, dbt, S3, Qlik SQL,Python, Java Exceptionalability to influence and engage senior leaders with data-driven insights. Expertin resolving complex, high-stakes problems with innovative solutions. Leadswith a collaborative spirit, driving team success through shared goals. Setsthe standard for integrity within the organization, fostering a culture oftrust and ethical behavior. Demonstratesunwavering resilience in the face of adversity, guiding the team throughchallenges. Actsas a change agent, leading transformative initiatives that drive businesssuccess. Leadsand coordinates efforts across multiple departments, ensuring alignmentwith organizational goals. Providesvisionary leadership, inspiring and developing future leaders within theorganization. Establishesa culture of accountability, ensuring that all team members meet theircommitments and deliver high-quality work. Skill Set 7-10 years of experience in data engineering, with significant leadership and project management experience. AWS, Snowflake, Azure AWS Glue, AWS AppFlow, Prefect, dbt, S3, Qlik SQL, Python, Java 3Core Systems