Platform Engineer with Cloud Expertise

Salary: $123,000 - 163,000 per year Requirements:

• Over 5 years of experience in data engineering or platform engineering, with a minimum of 2-3 years specifically in Databricks administration
• In-depth knowledge of Unity Catalog, cluster policies, Delta Lake, Spark, workspace setup, and job management
• Proven track record implementing RBAC and ABAC in Databricks or similar environments
• Experience in cost optimization, monitoring, billing logs, and governance of computing resources
• Proficient in Python/PySpark and SQL; familiar with DLT, Airflow, or Databricks Workflows
• Excellent communication skills with the ability to set standards and influence teams effectively

• Oversee the administration of Databricks workspaces, clusters, jobs, Unity Catalog, compute policies, and platform guidelines
• Implement and maintain Role-Based Access Control (RBAC) and Attribute-Based Access Control (ABAC) for secure data access
• Define and uphold data ingestion standards, naming conventions, schema regulations, Delta Lake design methodologies, and data quality expectations
• Establish platform-wide standards for ingestion pipelines, Delta architecture, data lineage, versioning, and validation processes
• Collaborate with data engineering teams to enhance patterns and ensure consistency across the platform
• Manage permissions for workspaces and catalogs, including row/column-level policies and attribute-based filtering
• Work closely with security teams to ensure compliance with data protection standards
• Set cost thresholds, alerts, compute policies, and usage dashboards to manage expenses effectively
• Monitor costs associated with jobs and clusters, identify anomalies, and recommend optimization strategies
• Ensure platform reliability through automated testing frameworks, CI/CD templates, and code governance practices
• Define best practices for building on the platform, including ingestion, Delta conventions, CI/CD, observability, and AI/ML methodologies

• AI
• Airflow
• CI/CD
• Databricks
• Python
• PySpark
• RBAC
• SQL
• Security
• Spark
• Unity
• GameDev
• AWS
• Azure
• Cloud
• DevOps
• GitHub
• LESS

More:

We are a dynamic firm based in Houston, TX, looking to hire an experienced Platform Engineer to join our team. In this hybrid role, you will have the chance to work 2 days onsite and contribute to a shared Databricks platform that supports multiple analytics and AI teams. We offer a competitive compensation package, inclusive of comprehensive benefits such as medical, dental, vision insurance, 401(k), and paid time off for eligible employees. Our workplace promotes inclusivity and equal opportunity for all applicants.

last updated 39 week of 2026