Data Engineer / Data Architect (Pharma / biotech domain)

Data Engineer / Data Architect

Location: Westlake, CA (Hybrid/Onsite)

Type: Contract-to-Hire

We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.

Key Responsibilities

• Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
• Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
• Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
• Support AI/ML initiatives, advanced analytics, and data-driven applications.
• Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
• Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
• Optimize cloud data infrastructure performance, scalability, and cost efficiency.

Required Competencies & Skills

• Experience with Azure Cloud (Databricks, DevOps, DataFactory)
• Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
• Strong hands-on python, pyspark, and SQL skills
• Direct experience with building and leveraging API integrations in ETL pipeline development
• Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
• Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
• Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities

Preferred Competencies & Skills

• Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
• Familiarity with tools and practices in the Martech and Adtech landscape
• Knowledge of Consumer, Patient, or HCP data ecosystems
• Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
• Experience with custom-built or third-party Customer Data Platforms (CDP)
• Experience with marketing automation tools

Working Conditions

• General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.