Databricks Data Engineer

Job Title: Data Architect

Location(s): St. Louis, MO; Chicago, IL; Richardson, TX; Phoenix, AZ; Tampa, FL; Indianapolis, IN; Hartford, CT

Work Model: Hybrid

Security Clearance: Visa Independent (Green Card holder or US Citizen)

Must Haves

• Visa Independent: Green Card holder or US Citizen
• 6-8+ years of enterprise-scale data architecture experience
• Demonstrated hands-on implementation experience (not just design)
• Architectural thinking and design patterns knowledge
• Experience designing solutions for multiple technology stacks
• Strong leadership and stakeholder management skills
• Excellent communication and presentation abilities
• Ability to work hybrid, flexible location from list above

Description / Responsibilities / Skills

Overview

• Lead design and delivery of comprehensive data platform architectures leveraging Databricks, Snowflake, Delta Lake, and cloud platforms (AWS/Azure).
• Senior architectural role combining deep hands-on expertise across multiple data technologies.
• Design scalable, secure, and cost-optimized solutions for enterprise health insurance operations.

Key Responsibilities

• Establish data architecture standards, best practices, and frameworks
• Lead design of Databricks and Snowflake integrated ecosystems
• Architect Unified Data Platforms (UDP) and modern data stacks
• Design cloud infrastructure on AWS or Azure for data workloads
• Develop data governance, security, and compliance frameworks
• Establish cost optimization strategies across data platforms

Deliverables

• Lead technical strategy and platform modernization initiatives
• Mentor and guide data engineering teams
• Conduct architecture reviews and optimization assessments
• Support cloud migrations and complex data transformations

Experience & Skill Set Requirements

Required Skills & Experience

• Deep expertise in at least 3 of: Databricks, Snowflake, Delta Lake, Python, PySpark
• Advanced SQL and data warehouse design patterns (dimensional modeling, star schemas)
• Cloud platform expertise: AWS or Azure (architecture and optimization)
• Experience designing Unified Data Platform (UDP) and modern data stack architectures
• Python and PySpark for data engineering framework development
• Experience with both batch and streaming data architectures
• Data governance, security, and compliance framework design
• Git and CI/CD pipeline expertise

Nice-to-Have

• Healthcare or insurance industry experience
• Certifications: Databricks, Snowflake, AWS Solutions Architect, Azure Data Engineer
• Experience leading data platform transformation or modernization projects
• Knowledge of data governance tools and metadata management
• ML/AI pipeline architecture experience
• Enterprise data mesh or data fabric architecture experience
• Experience with Fivetran, dbt, or similar modern data tools
• Published architecture patterns or thought leadership