Senior Data Engineer

JobID: 53340

Senior Data Engineer

Pay
$175,000+ annually

Location
(Remote optional with a preference for East Coast candidates)

Summary
Seeking a Senior Data Engineer to join the technology and engineering team. This position involves designing, developing, and maintaining a scalable data warehouse infrastructure to support benefits administration software for unions. The role requires close collaboration with analysts and stakeholders to optimize data architecture, create secure data pipelines, and enable advanced analytics. The ideal candidate will have extensive experience in data engineering, data warehousing, and ELT processes, with a focus on building reliable and high-performance data systems. This is a remote opportunity within a financially stable, innovatively driven company with over 40 years of market presence.

Requirements

• 5+ years of experience in data engineering, modeling, governance, management, and ELT on large-scale platforms
• 3+ years of hands-on experience with Databricks, including Delta Live Tables and Unity Catalog
• 3+ years of experience with analytical SQL (ANSI SQL, T-SQL, Spark SQL)
• Strong Python programming skills for data engineering
• Practical knowledge of data quality, observability practices, and orchestration tools
• Familiarity with integrating data solutions with AI and machine learning models
• Experience with version control systems like Git preferred
• Knowledge of streaming and ingestion tools such as Kafka, Kinesis, or Debezium is a plus
• Hands-on experience with tools like dbt, Airflow, Terraform, Power BI, and others is advantageous
• Bachelor's degree in Computer Science, Information Technology, or related field; Master's degree preferred

Responsibilities

• Design, develop, and maintain a scalable data warehouse/lakehouse environment
• Build and implement ELT pipelines for high-quality data ingestion and transformation, utilizing best practices like "pipelines as code"
• Ensure data security, compliance, and governance, including role-based access controls and encryption
• Optimize data workflows and storage for cost efficiency and performance
• Collaborate with engineers, analysts, and stakeholders to refine data needs, providing technical mentorship and documentation
• Develop testing frameworks, enforce data contracts, and establish observability standards including lineage tracking and incident response procedures
• Monitor and troubleshoot data workflows, resolving automation and data issues
• Provide technical guidance, leadership, and skill development within the team
• Contribute within an Agile-Scrum environment and produce comprehensive technical documentation
• Serve as a trusted expert on organizational data domains, processes, and best practices

#Dice #ZR-Pro #LI-TS1 #LI-Remote