Senior Data Engineer

At SCP Health what you do matters

As part of the SCP Health team you have an opportunity to make a difference. At our core we work to bring hospitals and healers together in the pursuit of clinical effectiveness. With a portfolio of over 8 million patients 7500 providers 30 states and 400 healthcare facilities SCP Health is a leader in clinical practice management spanning the entire continuum of care including emergency medicine hospital medicine wellness telemedicine intensive care and ambulatory care.

Why you will love working here:

- Strong track record of providing excellent work/life balance.

- Comprehensive benefits package and competitive compensation.

- Commitment to fostering an inclusive culture of belonging and empowerment through our core values - collaboration courage agility and respect.

Responsibilities:

• Platform architecture & technical direction: Define and evolve reference architectures and standards for ingestion transformation orchestration and serving layers (Snowflake dbt and adjacent tooling); lead design reviews and set guardrails that enable teams to deliver scalable secure observable and maintainable solutions.
• Highest-impact data products (ownership & service levels): Own end-to-end delivery and operational excellence for the most critical datasets and pipelines that support revenue cycle physician scheduling billing and performance monitoring; define SLAs/SLOs error budgets (where applicable) and support models for sustained reliability.
• Complex integrations & facility onboarding at scale: Lead strategy and implementation for complex multi-facility integrations (EHR extracts HL7 FHIR APIs flat files) including backfills reconciliation and long-term maintainability; establish repeatable onboarding playbooks and reusable patterns adopted across teams.
• Medallion lifecycle standards & governance leadership: Own and enforce platform-wide conventions across Bronze/Silver/Gold layers (naming modeling testing documentation lineage certification); drive alignment on canonical definitions and patterns to reduce ambiguity and rework across domains.
• Operational ownership & major-incident leadership: Serve as an escalation point for major incidents impacting critical pipelines or multiple domains; lead triage coordinate cross-team resolution run blameless post-incident reviews and drive systemic fixes (alerting runbooks resilience patterns and backlog priorities) to prevent recurrence.
• Performance reliability & FinOps leadership: Lead Snowflake performance and cost optimization initiatives (warehouse/workload design scheduling resource monitors query tuning); establish team practices and decision frameworks that balance reliability latency and consumption and communicate tradeoffs and drivers to stakeholders.
• Governance security & compliance architecture: Architect and implement HIPAA-aligned controls for PHI/PII (least-privilege RBAC masking row/column policies auditing secure sharing); partner with Security/Compliance on access patterns periodic reviews audits and remediation for platform-level controls.
• Data quality strategy testing & observability: Define and operationalize platform-level data quality strategy (tests reconciliation anomaly detection freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and data products and guide teams toward consistent adoption.
• Cross-team technical leadership: Lead technical discovery with stakeholders; clarify ambiguous requirements; propose implementation options; and align on definitions acceptance criteria change impacts and rollout plans across multiple teams and initiatives.
• Mentorship & technical bar-raising: Mentor Data Engineers IIII through coaching pairing and feedback; raise the engineering bar via code/design reviews reusable libraries/macros documentation standards and pragmatic guidance on tradeoffs.
• Release engineering & SDLC improvements: Lead improvements to data CI/CD and release practices (testing gates automated checks environment promotion release strategy rollback planning) that reduce defects and improve delivery predictability across teams.
• Technical roadmap partnership: Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap identify systemic risks and dependencies and propose investments that improve scalability reliability governance and team velocity.

Knowledge Skills and Abilities:

• Expert SQL & data engineering craft: Expert-level ability to design optimize and troubleshoot complex SQL workloads; diagnose performance at the query and system level; and define scalable patterns for data access and transformation.
• Snowflake platform leadership: Deep expertise with Snowflake architecture and operations including workload strategy governance controls performance tuning cost optimization and operational monitoring; ability to set standards and coach others using usage and query analytics.
• dbt proficiency & platform conventions: Advanced proficiency with dbt project organization macros testing and documentation strategy incremental modeling and environment promotion; ability to define enforce and evolve conventions that scale across teams.
• Data modeling & domain architecture: Ability to define canonical models and data products across domains (e.g. dimensional/domain-oriented) manage change over time (SCDs) and drive alignment on definitions that reduce ambiguity across the organization.
• Reliability & operations leadership: Define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems for critical issues; and drive systemic improvements through problem management.
• Integration patterns & scalable onboarding: Advanced knowledge of batch and near-real-time patterns (watermarking CDC replay/backfill strategy idempotency) APIs and authentication and semi-structured/columnar formats (JSON Parquet); ability to build reusable onboarding patterns adopted across multiple facilities and domains.
• Governance security & privacy: HIPAA-aligned design for PHI/PII least-privilege access models masking and row/column policies auditability and secure sharing; ability to partner with Security/Compliance to design controls and lead remediation when gaps are found.
• Influence & enablement: Lead discovery and design reviews make pragmatic tradeoffs and influence without authority; drive adoption through enablement (documentation office hours templates) clear communication and consistent standards.
• Strategic thinking & platform roadmap: Identify systemic issues and investment opportunities articulate multi-quarter technical plans evaluate build vs. buy tradeoffs and sequence work to reduce risk and increase long-term leverage.
• Executive-ready communication: Communicate clearly with technical and non-technical partners align on definitions and expectations and provide transparent status risk and tradeoff updates for cross-team initiatives.

EDUCATION (Required and/or Preferred):

• Bachelors degree (BA/BS) in MIS Computer Science or a related field; or equivalent combination of education and experience.

FIELD OF STUDY:

• Degree preferred in MIS Computer Science or business discipline with appropriate exposure to information technology concepts processes and systems.

WORK EXPERIENCE/QUALIFICATIONS:

• 8 years of progressive professional experience in Data Engineering Analytics Engineering or a related technical role including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
• 4 years of hands-on experience building and operating solutions within the Snowflake ecosystem including performance tuning and practical cost management.
• Experience in Healthcare Revenue Cycle (RCM) and/or integrating clinical data feeds is strongly preferred; experience working with PHI/PII and regulated data is expected.
• Experience working in an Agile/Scrum environment including technical leadership across initiatives (design reviews estimation delivery coordination) and mentoring other engineers through implementation and support.

CERTIFICATES AND LICENSES:

• Relevant certification or license in Data Analytics Cloud or Security is a plus.
• SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
• dbt Analytics Engineering Certification (preferred) with demonstrated experience operating dbt in production.
• HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).

WORK ENVIRONMENT AND PHYSICAL DEMANDS:

• Professional setting.
• Continuous sitting.
• Continuous oral & written communication and listening skills.
• Continuous computer use.
• Occasional bending kneeling lifting pulling & pushing up to 10 pounds.
• Minimum travel when applicable.
• Job requires a high level of mental awareness.

PRIMARY LOCATION:

• Lafayette LA (Corporate HQ)

SECONDARY LOCATION(S):

• Atlanta GA
• Dallas TX

Pay Range:

This range represents the anticipated base salary for this role. Actual compensation will be determined based on experience qualifications and internal equity considerations.

-

We offer a comprehensive benefits package designed to support your health financial well-being and work-life balance including medical dental vision insurance a 401(k) plan with a company match paid time off and holidays professional development support and employee wellness resources.

Visit our website for further information. name: corp-guest

Password: weheal

Required Experience:

Senior IC