Data Platform Engineer

Job Description

Job Description

ComResource is looking for a Data Platform Engineer.

Responsibilities:

• Design and implement Dataiku Project Standards to act as a production readiness linter, ensuring all projects meet naming, metadata, and security requirements.
• Develop custom Dataiku plugins and API integrations to automate Tier 1 and Tier 2 data quality checks, blocking promotion to production if standards are not met.
• Partner with Information Security to integrate tokenization and field-level encryption directly into Dataiku visual recipes and Python code-based workflows.
• Build and maintain the promotion path where ad-hoc Dataiku prototypes are hardened and, where necessary, refactored into DBT for long-term enterprise use.
• Integrate Dataiku monitoring with ServiceNow to automate incident creation for pipeline failures or data quality drift.
• Serve as the technical steward for non-technical business units, providing approved templates and secure data products.

Essentials:

• Hands-on experience with Dataiku DSS.
• Proficiency in Python and SQL.
• Experience working in Linux/Unix environments.
• Experience building governance-as-code layers and automated data quality frameworks.
• Ability to bridge the gap between rapid prototyping and production-grade engineering.

Desired:

• Experience with Snowflake, Terraform, GitHub, and REST APIs.

Req ID: AM127734720