Data Engineer / Data Architect (Pharma / biotech domain)
Diligente Technologies
Data Engineer / Data Architect
Location: Westlake, CA (Hybrid/Onsite)
Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
- Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
- Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
- Support AI/ML initiatives, advanced analytics, and data-driven applications.
- Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
- Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
- Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Competencies & Skills
- Experience with Azure Cloud (Databricks, DevOps, DataFactory)
- Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
- Strong hands-on python, pyspark, and SQL skills
- Direct experience with building and leveraging API integrations in ETL pipeline development
- Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
- Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
- Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities
Preferred Competencies & Skills
- Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
- Familiarity with tools and practices in the Martech and Adtech landscape
- Knowledge of Consumer, Patient, or HCP data ecosystems
- Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
- Experience with custom-built or third-party Customer Data Platforms (CDP)
- Experience with marketing automation tools
Working Conditions
- General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer / Data Architect (Pharma / biotech domain) in San Mateo, CA vacancy
- ...companies to build the foundational data layer that will power the next... ...who brings a wealth of "big pharma" clinical experience to the... ...life sciences field. Domain Expertise: Extensive experience... ...most exciting intersection in biotech today: AI and drug discovery....SuggestedFor contractors
Oakwell Hampton Group
San Mateo, CA2 days ago $180k - $230k
...The Data team leverages data from our autonomous vehicles and operations to determine... ...generate valuable insights by data scientists, engineers, and business users Establish robust... ...'s relevant years of experience, domain knowledge, and interview performance. The...SuggestedTemporary workRelocation packageZoox
Foster, CA2 days ago$123k - $190.9k
...Senior Data Engineer As a Senior Data Engineer, you will play a critical role in designing and delivering scalable, high-quality data... ...and scalable data pipelines and data products in a variety of domains. Data Integration: Develop and maintain data lakes by acquiring...SuggestedWork experience placementWork at officeLocal areaFlexible hoursVisa
San Mateo, CA4 days ago- ...Job Title: AWS Data Engineer Location: Foster City, CA/Raleigh, NC || Onsite... ...Lambda, Glue ~ AWS Certified Solution Architect - Professional OR AWS Certified Solution... ...Lifesciences (Commercial, Managed Markets domains) ~ Excellent communication skills...SuggestedContract workWork experience placement
Texas State Library and Archives Commision
San Mateo, CA2 days ago $185.86k - $221.38k
...more civil shared experiences for everyone. As an Analytics Data Engineer within the Finance team, you will be a key player in shaping... ...the Finance and the Data Engineering teams. You will use your domain knowledge of finance to understand their data requirements, translate...SuggestedFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA1 day ago$175k - $210k
...Av Safety Software Data Engineer The Av Safety Software Data Engineer will play a critical role in supporting Zoox's safety data reporting... ...not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed...Temporary workRelocation packageZoox
San Mateo, CA2 days ago$243.29k - $295.25k
...experiences for everyone. As a Senior Software Engineer on the Foundation AI organization, you... ...on architecture, you will be the architect of the data flywheel that makes VideoGen and 3DGen... ...AI, particularly in creative domains like 3D/4D content. A Bachelor's degree...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA4 days ago$178k - $194.75k
...the intersection of chemistry, engineering, computation, and biology to... ...and forward-thinking Senior Data Science, Biology to join our... ...drive critical insights for our biotech research and development... ...modern AI paradigms to these domains. Their strong foundation in bioinformatics...Summer holidayEikon Therapeutics
Millbrae, CA1 day ago$217.6k - $348.3k
...you. Job Description The Chief Data Architect - Finance Technology is responsible for... ...trusted, and self-service access across domains. The role requires close partnership... ...and programs Collaborate with engineering teams and partners to ensure high-quality...Work experience placementWork at officeLocal areaVisa
Foster, CA5 days ago$176.75k - $252.5k
...to modernize our enterprise data ecosystem. This modernization... ...seeking a Lead Systems & Data Architect with deep hands-on technical... ...at the intersection of data engineering, cloud infrastructure, analytics... ...data mesh, lakehouse, and domain-oriented data product concepts...Full timeLocal areaFlexible hoursRingCentral
Belmont, CA2 days ago- ...Looking for Junior Data Engineer with 1-2 years of experience Data Engineering & ETL Design, build, and maintain scalable data... ...to support analytics and reporting Collaborate with data architects and business stakeholders to translate requirements into logical...
NextPhase.ai
San Mateo, CA3 days ago - ...Data Engineer Ready for a new challenge? Join Guidewire as a Data Engineer! We are building a new team to take advantage of our market... ...product managers, data scientists, other data analysts, architects to solve problems, develop innovative approaches, and provide...
Guidewire
San Mateo, CA3 days ago $140k - $160k
...-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup... ...into our analytics infrastructure Architect and maintain our multi-cloud data... ...Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience ~...Work at officeChartmetric
San Mateo, CA1 day ago- ...Senior Data Engineer Foster City, California, United States Senior Data Engineer Role: ~10+ years hands on experience in software development. ~ Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns ~ Multi-threaded...
Inizio Partners
San Mateo, CA4 days ago $160k - $190k
...Senior Data Engineer The Streaming Data Platform team builds and operates large-scale, real-time stream processing systems using modern open-source technologies. We design pipelines that power analytics, reporting, and downstream product use cases by delivering high...Full timeTemporary workWork at officeRemote workWorldwideMonday to FridayFlexible hoursFanatics
San Mateo, CA2 days ago$72 per hour
...Technical Service Data Engineer Our client, a leader in the autonomous vehicle industry, is seeking a Data Engineer to join their team. As a Data Engineer, you will be part of the Repair & Overhaul Department supporting engineering and shop floor operations. The ideal...Weekly payTemporary workFlexible hoursShift workManpower
San Mateo, CA4 days ago- ...Data Engineer Location: San Mateo, California Employment Type: Full Time Job Overview Revvo's purpose is to monitor and maximize the life of tires. Our Data Engineers create scalable solutions enabling real-time analytics on our datasets. What You Do...Full time
Revvo
San Mateo, CA4 days ago $140k - $210k
...Senior Data Engineer San Mateo, CA United States Who We Are Verkada is transforming how organizations protect their people and places with an integrated, privacy-sensitive AI-powered platform that includes solutions for video security, access control, air quality...Full timeWork at officeWork visaFlexible hoursShift workVerkada
San Mateo, CA4 days ago$130k - $180k
...Sr. Data Engineer Location: Las Vegas, NV or San Mateo, CA About Slickdeals: We believe shopping should feel like winning. That's why 10 million people come to Slickdeals to swap tips, upvote the best finds, and share the thrill of a great deal. Together, our...Work at officeVisa sponsorship3 days per weekSlickdeals
San Mateo, CA29 days ago- ...and challenging projects supporting the US Navy- Serco has a great opportunity for you! Serco has an exciting opportunity for a Data Engineer/Scientist to support U.S. Navy's Team Submarine Program Offices at the Washington Navy Yard in Washington, DC! This position...Full timeContract workPart timeInternshipWork at officeLocal areaFlexible hours
Serco
Burlingame, CA1 day ago - ...AV Safety Data Engineer (Contract) The Safety Strategy & Operations team is responsible for developing and implementing safety processes from comprehensive safety planning and risk management to operational safety in the field, data analysis, and regulatory reporting,...Contract work
Vertex Sigma Software
Foster, CA5 days ago - ...About Us GridCARE solves data center developers' most urgent bottleneck - immediate... ...startup, we are seeking a skilled Data Engineer to help develop data-driven solutions... ...Collaborate with software engineers and domain experts to streamline data processes and...Immediate start
GridCARE
Redwood City, CA5 days ago $123k - $190.9k
...06-12-2026 Job Description The Data and Artificial Intelligence Platform (DAP... ...Service (DaaS) team consists of skilled data engineers focused on building data pipelines to... ...with the agile team, user community, architects, and support teams to understand requirements...Work experience placementWork at officeLocal areaFree visaVisa
Foster, CA5 days ago$180k - $350k
...thrive, please visit us here! Helping restaurants thrive, not just survive. What we're looking for We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base. You'll play...Tarro
San Mateo, CA1 day ago- ...Senior Consultant Data Engineer As a Senior Consultant Data Engineer, you'll join our Value Added Services – Digital Marketing & Engagement... ...real value. You'll analyze business requirements and architect highly secure, robust, and scalable solutions. You'll...Work experience placementWork at officeLocal areaImmediate start
Visa
San Mateo, CA4 days ago $146.2k - $233.7k
...Staff Data Engineer As a Staff Data Engineer, you'll join our Value Added Services – Digital Marketing & Engagement organization. You... ...with product management. Analyze business requirements to architect highly secure, robust, and scalable solutions. Lead internal...Work experience placementWork at officeLocal areaImmediate startVisa
San Mateo, CA4 days ago$124k - $186k
...Guidewire Data Engineer You will join Guidewire's Product organization, working at the intersection of data, AI, and cloud infrastructure... ...world's P&C insurers do business. What You'll Do Architect, automate, and maintain production-grade data infrastructure...Full timePart timeWorldwideFlexible hoursGuidewire
San Mateo, CA4 days ago$160k - $210k
...Our fleet produces a continuous stream of data, and we're looking for a senior IC to own... ...: for customers, partners, operations, engineering, and leadership. You'll be the bridge between... ..., fleet management, automotive, or any domain where diverse physical devices produce...Full timeTemporary workFlexible hoursAgtonomy
South San Francisco, CA4 days ago- ...Description Job Description As a Data Scientist on the Behavior... ...with scalable software engineering. You will design the mathematical... ...statistics miss. ~ Architect Scenario-Based Metrics: Own... ...relevant years of experience, domain knowledge, and interview performance...Temporary workRelocation package
Zoox
Foster, CA6 days ago $195k - $350k
...ML Engineer San Mateo, CA (Hybrid) About Eve Eve is redefining legal technology for... ...someone who wants to own the full stack — from data curation and fine-tuning to evaluation... ...: Fine-tune models on high-quality, domain-specific data (code, natural language, product...Temporary workWork at officeLocal areaFlexible hoursEVE Inc
San Mateo, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer / Data Architect (Pharma / biotech domain). Be the first to apply!
Related searches
- senior data center engineer San Mateo, CA
- data science developer San Mateo, CA
- etl data engineer San Mateo, CA
- data engineer San Mateo, CA
- senior data engineer San Mateo, CA
- senior cloud data engineer San Mateo, CA
- senior data integration developer San Mateo, CA
- aws data engineer San Mateo, CA
- sr information security engineer San Mateo, CA
- senior data quality engineer San Mateo, CA