Data Engineer

Senior Data Engineer Location: Frisco, TX Experience: 8+ Years Domain: Finance / Revenue / Billing / Data & Intelligence Job Summary We are seeking a highly experienced Senior Data Engineer to join the Data & Intelligence team supporting T-Mobile Finance / RDMP . The ideal candidate will have strong expertise in designing and developing enterprise-scale data platforms and pipelines across Snowflake, Databricks, PySpark, Python, Advanced SQL, and Azure . The candidate will provide technical leadership across data engineering, real-time processing, data quality, DevOps, security, governance, and finance/revenue data integration. Strong experience with billing, revenue, GL, Opex, reconciliation, and financial reporting data is highly preferred. Key Responsibilities Data Pipeline Development Architect, design, and oversee development of enterprise-scale ELT/ETL pipelines for finance and revenue data, including billing, revenue, GL, and Opex. Define standards for batch, incremental, CDC, watermarking, and event-driven ingestion patterns. Design idempotent, fault-tolerant, highly scalable, and production-ready pipelines. Establish frameworks for error handling, retry strategies, dead-letter queues, and operational resiliency. Provide technical leadership for high-volume, multi-source data integration. Platform & Tooling Lead architecture and adoption of Snowflake and Databricks for large-scale data processing and analytics. Establish best practices for: Snowflake: Snowpipe, Streams, Tasks, query optimization, and cost efficiency. Databricks: PySpark, Delta Live Tables, Unity Catalog, and job optimization. dbt: Modular design, testing frameworks, CI/CD integration, and reusable components. Establish and govern orchestration frameworks using Airflow and/or Azure Data Factory . Define DAG standards, dependencies, monitoring, and operational best practices. Evaluate and drive platform and tooling standardization across engineering teams. Cloud Infrastructure Architect and optimize cloud-native data platforms on Azure , including: ADLS Gen2 Event Hub Azure Data Factory Key Vault Define standards for Infrastructure as Code using Terraform and/or Bicep . Drive cloud cost optimization through compute sizing, storage design, partitioning, and workload isolation. Ensure data platforms are scalable, secure, resilient, and production-ready. Languages & Data Processing Provide technical leadership in Advanced SQL, Python, and PySpark . Develop and optimize complex transformations and distributed data processing workloads. Guide engineering teams on reusable frameworks, coding standards, and performance optimization. Provide oversight for Spark, Scala where applicable, and automation scripting. Streaming & Real-Time Data Architect real-time and near-real-time data processing solutions using Kafka, Azure Event Hub, and Spark Structured Streaming . Define standards for stateful processing, watermarking, checkpointing, and fault tolerance. Lead real-time finance and revenue use cases such as: Reconciliation Anomaly detection Operational reporting Data monitoring Data Quality & Testing Establish enterprise frameworks for data quality, validation, testing, and observability. Define standards for automated unit, integration, and regression testing. Implement data validation for completeness, accuracy, consistency, and freshness. Utilize dbt tests, Great Expectations, and custom data quality frameworks . Establish SLA monitoring, alerting, and data freshness tracking across pipelines. Drive proactive data quality and governance practices. Data Modeling Interpret and implement architect-defined enterprise data models, including Star Schema, Snowflake Schema, and Data Vault . Provide guidance on: SCD Type 1 and Type 2 Partitioning Clustering Performance optimization Collaborate with data architects to evolve scalable and reusable data models. Support semantic layer enablement for analytics and reporting. DevOps & Engineering Practices Define and enforce CI/CD standards for data engineering using GitHub Actions and/or Azure DevOps . Establish code quality, versioning, branching, pull request, and deployment standards. Standardize environment promotion across Dev QA Production . Establish reusable frameworks, templates, and engineering best practices. Drive continuous improvement and engineering excellence across teams. Security & Governance Lead implementation of enterprise-grade security and governance controls. Implement and govern: RBAC Row-level and column-level security PII and CPNI compliance TISS-310 controls Define standards for secrets management and secure pipeline development. Ensure data lineage, auditability, security, and compliance readiness. Finance Domain Expertise Apply strong understanding of finance and revenue data domains, including: Billing and revenue systems General Ledger (GL) Financial reporting Revenue recognition Revenue reconciliation Period-end close processes Guide engineering teams in accurately implementing finance-related business logic. Ensure high data integrity and reliability for regulated financial data. Required Skills 8+ years of experience in Data Engineering . Strong hands-on experience with Snowflake and Databricks . Expert-level PySpark, Python, and Advanced SQL skills. Strong experience designing enterprise-scale ETL/ELT pipelines . Experience with Azure data services , particularly ADLS Gen2, ADF, Event Hub, and Key Vault. Experience with Kafka and/or Event Hub and Spark Structured Streaming. Strong experience with dbt and/or Airflow . Experience with Terraform and/or Bicep . Strong understanding of CI/CD and DevOps practices . Experience with data quality, observability, testing, and governance. Strong understanding of enterprise data modeling and SCD methodologies. Excellent troubleshooting, performance tuning, and production support experience. Preferred Qualifications Experience working with telecom, finance, revenue, billing, or GL data . Experience with large-scale financial data platforms. Experience with revenue reconciliation and revenue recognition processes. Experience with CPNI/PII compliance and TISS-310 . Experience establishing enterprise data engineering standards and reusable frameworks. Strong technical leadership and architecture experience. Soft Skills Strong technical leadership and decision-making abilities. Ability to act as a technical escalation point across engineering teams. Excellent collaboration skills with architects, product managers, analysts, and business stakeholders. Ability to communicate complex technical concepts clearly to technical and non-technical audiences. Strong problem-solving and incident management skills. Experience leading incident reviews and driving continuous improvement. #J-18808-Ljbffr