Data Platform Engineer

Responsibilities

• Administer Azure Databricks, Unity Catalog, workspace and metastore configuration, cluster policies, compute cost management, and chargeback reporting.
• Build self-service provisioning workflows, templates, access patterns, and platform automation for domain-owned data products.
• Serve as DBA for Lakebase and PostgreSQL, including provisioning, user and role management, performance tuning, upgrades, backups, point-in-time recovery, and disaster response.
• Build and maintain Azure Infrastructure-as-Code for networking, private endpoints, Entra ID app registrations, service principals, and Key Vault.
• Implement access governance including Unity Catalog grants, OBO authentication, ABAC, row-level security, data masking, and role-based access.
• Operate audit, lineage, sensitivity classification, observability, alerting, SLOs, backup validation, disaster recovery testing, and reliability controls.
• Support CI/CD for notebooks, jobs, DLT pipelines, dbt projects, Databricks Asset Bundles, and Lakebase schema migrations.
• Maintain GitHub and GitHub Actions integrations, advise domain teams during project kickoffs, troubleshoot platform issues, and produce KPI and roadmap reporting.

Requirements

• At least 4 years of platform or infrastructure engineering experience supporting a data or analytics organization.
• Deep hands-on experience with Databricks, Unity Catalog, Delta Lake, Azure, Entra ID, networking, Key Vault, and Terraform or Bicep.
• Hands-on PostgreSQL administration experience covering roles, connections, query and index tuning, backups, restore, point-in-time recovery, and HA/DR.
• Experience with identity and access architecture, including service principals and OBO authorization patterns.
• Practical experience building and maintaining CI/CD pipelines with GitHub Actions and/or Azure DevOps.
• Proficiency with Python or another scripting language for platform automation and tooling.
• Experience using AI tools such as GitHub Copilot, ChatGPT, or Claude to accelerate engineering work.
• Experience with infrastructure lifecycle management, disaster recovery, and regulated environments involving HIPAA and/or SOC 2.
• Strong candidates may have experience with data mesh, Databricks Lakebase or other cloud-native PostgreSQL services, psql, pgAdmin, migration frameworks, Azure SQL Database, OLTP-to-lakehouse integrations, Datadog, OpenTelemetry, Databricks Asset Bundles, DLT, dbt, and relevant certifications.

Benefits

• Medical, dental, and vision insurance.
• Short- and long-term disability insurance and life insurance.
• 401k with company match.
• Flexible time off and paid parental leave.
• Hybrid work in the Dallas, Texas office at least 3 days per week; no overnight on-call rotation, with occasional availability for scheduled deployments and major incidents.