Senior Data Engineer

Senior Data EngineerWe are seeking a Senior Data Engineer to help design, build, and support modern cloud-based data platforms and analytics solutions. This individual will play a key role in developing scalable, secure, and reliable data capabilities while contributing to both new platform initiatives and ongoing operational excellence.This position combines hands-on engineering, solution design, technical leadership, and production support responsibilities. The ideal candidate brings a strong background in cloud data engineering, modern data architectures, automation, and platform optimization.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines, transformation processes, and reusable data assets.Build and support data integration solutions across batch, near real-time, and streaming workloads.Develop reusable frameworks, automation, and platform components that improve engineering efficiency and solution quality.Lead technical design efforts for complex projects and provide guidance through implementation and deployment.Partner with architecture, engineering, and business stakeholders to deliver scalable, secure, and well-governed solutions.Establish and promote engineering standards, best practices, and code quality measures.Implement data quality, monitoring, metadata, lineage, and security capabilities.Build and maintain CI/CD pipelines, automated testing frameworks, and deployment processes.Support platform observability, performance tuning, reliability improvements, and cost optimization initiatives.Participate in production support activities, incident response, troubleshooting, and root cause analysis.Maintain technical documentation, operational procedures, and knowledge-sharing materials.Contribute to roadmap planning, solution estimation, technology evaluations, and modernization initiatives.Mentor team members and provide technical leadership across projects.EducationBachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related discipline.Experience8+ years of experience in data engineering, analytics engineering, or data platform development.Experience designing and implementing cloud-based data solutions.Experience building large-scale data integration and transformation processes.Experience leading technical initiatives and delivering production-ready solutions.Experience supporting enterprise production environments and operational processes.Experience working within regulated or compliance-driven environments is a plus.Technical SkillsAdvanced proficiency in SQL, Python, PySpark, and Spark performance optimization.Strong experience with Azure Databricks, Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.Experience with modern cloud data platforms and lakehouse architectures.Experience developing scalable ETL/ELT processes and data pipelines.Knowledge of data modeling, data warehousing concepts, and analytics-focused data structures.Experience with source control, CI/CD practices, automated testing, and deployment automation.Experience implementing data governance, quality, monitoring, and security controls.Strong troubleshooting, analytical, and problem-solving abilities.Excellent communication and collaboration skills with both technical and non-technical stakeholders.Experience with business intelligence, master data management, streaming technologies, infrastructure automation, or AI-enabled solutions is a plus.Relevant cloud or data engineering certifications are preferred.Addison Group is an Equal Opportunity Employer. Addison Group provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran, in accordance with applicable federal, state, and local laws. Reasonable accommodation is available for qualified individuals with disabilities upon request.