Data Solutions Engineer - On-site, Durham, NC

Job Summary:The Data Engineer designs, builds, and operates reliable, scalable data pipelines on PowerSecure’s Azure data platform to enable trusted analytics and selfservice BI. This role partners with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver highquality data using Azure Data Factory, Databricks (PySpark/Spark SQL), and Delta Lake (including Delta Live Tables). Responsibilities include batch/stream ingestion, data transformation (ELT), orchestration, data quality enforcement, and operational support.Minimum Qualifications: (Education, Experience, Knowledge, and Skills):2+ years of handson data engineering (or comparable software engineering with significant data work)2+ years building pipelines on Azure and Databricks (or equivalent cloud + Spark)Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentalsBachelor’s degree in MIS, Computer Science, Engineering, or equivalent experienceProficiency with SQL and Python (PySpark), including performance tuning on large datasetsExperience with Azure Databricks, Delta Lake, Delta Live Tables (DLT), Azure Data Factory (or Fabric Data Pipelines), ADLS Gen2, and Azure DevOps/Git for CI/CDWorking knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and securityFamiliarity with data ingestion patterns (files, APIs, JDBC), schema evolution, CDC, and deletion detection patternsUnderstanding of dimensional modeling to produce analyticsready datasets for Power BIExposure to orchestration/monitoring, cost optimization, alerting, and runbookdriven operationsData pipeline design (batch & streaming), DLT expectations for data quality, and robust error handlingSource control, branching strategies, and CI/CD for data assets (notebooks, jobs, workflows)Practical understanding of privacy, security, and RBAC in cloud data platformsExcellent communication, documentation, and crossfunctional collaboration skillsAnalytical mindset; bias toward automation and measurable reliabilityApplicants must be legally authorized to work in the United States and should not require now, or in the future, sponsorship for employment visa sponsorship.Job Duties and Responsibilities:Design, implement, and support endtoend ELT pipelines (ingest → transform → publish) in Databricks/ADFImplement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooksBuild curated, analyticsready Delta tables using dimensional modeling for consumption by BI DevelopersImplement CDC and deletionflag patterns; manage schema drift and partitioning/ZOrdering strategiesOperationalize jobs with monitoring, logging, alerting; participate in an oncall rotation as neededPartner with the Data Architect to align designs with standards for governance, security, and cost efficiencyDocument pipelines, data contracts, and SLAs; continuously improve performance and reliabilityWorking Conditions:This position is hybrid. You will be required to be in office some during the week.Occasional,travel may be required for training or meetings.Must be able to work flexible hours to accommodate different time zones (Central/Eastern/Mountain/Pacific), if necessary.Be flexible for after-hours tasks, as needed.About UsPowerSecure, a Southern Company subsidiary, is a leading provider of innovative energy solutions to electric utilities and their industrial, institutional, and commercial customers.Join Our Power Team!We invest in high-value and cost-effective benefits for our employees. Our benefits package includes:Medical, dental, vision and life insurance coverageCompetitive pay and a matching 401 (k) planVacation, Company Holidays, Paid Time Off (PTO- personal and sick days)Flexible spending accounts/Health savings accountWellness Incentive ProgramsEmployee Referral ProgramTuition ReimbursementThe above statements are intended to describe the general nature and level of work being performed by individuals assigned to this position. They are not intended to be an exhaustive list of all responsibilities, duties, and skills required. Management reserves the right to assign or reassign duties and responsibilities at any time, based on business needs.PowerSecure is an equal opportunity employer where an applicant's qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by lawJob SummaryRequisition Number: DATAE003394Job Category: Technology OrganizationSchedule: Full-Time