Database Administrator - Data Governance

Job Description

This is a hands on data engineering role with database administration and governance ownership. You will build and operate the pipelines that move data into our platform, model it so the business can trust the numbers, implement the governance and access controls that protect it, and support the production databases underneath it all.

\n

\n

Our environment includes PostgreSQL, Amazon Redshift, API based sources, and flat files in S3. You will work across development, QA, and production environments alongside Development, Operations, and Data Engineering. This is a role for someone who has personally built and debugged these systems, not only designed or overseen them.

\n

\n

WHAT YOU WILL OWN

\n

Data integration and incremental loading

\n

\n
• Build and maintain batch and incremental pipelines in Python and PySpark across Postgres, Redshift, API based sources, and flat files in S3
\n
• Implement change data capture, including identifying changed records where source systems provide no reliable modification timestamp, using log based CDC, hash comparison, or snapshot differencing
\n
• Design idempotent pipelines that restart cleanly after partial loads, with checkpoint management and duplicate prevention
\n
• Build source to target reconciliation that isolates missing records, duplicates, and rejected rows, and pinpoints where a count mismatch occurred
\n

\n

\n

Data modeling

\n

\n
• Design and maintain dimensional models, defining fact table grain explicitly and preventing double counting across transaction and line level measures
\n
• Implement slowly changing dimensions, Type 1 and Type 2, including surrogate keys, effective dating, and retention of historical customer and product records
\n
• Design logical and physical models that support both analytics and operational reporting
\n

\n

\n

Data governance and security

\n

\n
• Implement data governance controls covering classification, lineage, data quality, and retention
\n
• Build a PII classification system to identify, tag, and protect sensitive data
\n
• Design and manage the data access layer, including users, roles, and permissions, with encryption, auditing, and compliance requirements
\n

\n

\n

Database administration and production support

\n

\n
• Administer production database environments for performance, reliability, availability, and security
\n
• Troubleshoot production issues, including failed loads, data discrepancies, capacity constraints, and performance bottlenecks
\n
• Tune queries, indexes, and configurations; manage backup, recovery, replication, and disaster recovery
\n
• Diagnose and resolve PySpark performance problems including data skew, partitioning, shuffle behavior, broadcast joins, and execution plan analysis
\n

\n

\n

Reporting and automation

\n

\n
• Automate data engineering and operational processes in Python
\n
• Build and maintain dashboards and reports in Power BI, Tableau, or similar tools
\n
• Partner with Development, QA, and Operations on deployments, schema changes, and incident response
\n

\n

\n

WHAT YOU BRING

\n

\n
• 5+ years in data engineering, ETL development, or data warehouse engineering, with recent hands on implementation work
\n
• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or equivalent experience
\n
• Expert level Python for pipelines, automation, and operational tooling; production PySpark experience required
\n
• Demonstrated experience implementing change data capture and incremental loading strategies, including cases where no reliable timestamp exists
\n
• Demonstrated experience implementing slowly changing dimensions, surrogate keys, and dimensional models, and able to explain grain using real columns and keys from your own work
\n
• Experience building reconciliation and data quality validation between source systems and targets
\n
• Advanced SQL, including complex queries, query optimization, indexing, and execution plan analysis
\n
• Strong working knowledge of relational databases, particularly PostgreSQL and Redshift, including schema design and performance tuning
\n
• Hands on data governance implementation experience, including access controls, classification, and lineage
\n
• Experience supporting production database environments, including troubleshooting and incident response
\n
• Experience building dashboards and reports in Power BI, Tableau, or a comparable tool
\n
• Ability to explain your own production implementations in detail, including what broke, what you changed, and why
\n

\n

\n

PREFERRED

\n

\n
• Experience with AWS data services such as S3, Glue, and Lambda; equivalent experience on other cloud platforms is welcome, as PySpark and modeling skills transfer
\n
• Experience migrating legacy ETL workloads, for example Informatica or SSIS, to modern cloud platforms
\n
• Experience with governance tooling such as Unity Catalog, Purview, Collibra, or Alation
\n
• Background in a data intensive industry; energy sector experience is not required
\n

\n