Data Engineer / Data Architect (Pharma / biotech domain)
Diligente Technologies
Data Engineer / Data Architect
Location: Westlake, CA (Hybrid/Onsite)
Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
- Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
- Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
- Support AI/ML initiatives, advanced analytics, and data-driven applications.
- Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
- Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
- Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Competencies & Skills
- Experience with Azure Cloud (Databricks, DevOps, DataFactory)
- Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
- Strong hands-on python, pyspark, and SQL skills
- Direct experience with building and leveraging API integrations in ETL pipeline development
- Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
- Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
- Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities
Preferred Competencies & Skills
- Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
- Familiarity with tools and practices in the Martech and Adtech landscape
- Knowledge of Consumer, Patient, or HCP data ecosystems
- Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
- Experience with custom-built or third-party Customer Data Platforms (CDP)
- Experience with marketing automation tools
Working Conditions
- General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer / Data Architect (Pharma / biotech domain) in Santa Clara, CA vacancy
- ...Data Engineer / Data Architect Location: Westlake, CA (Hybrid/Onsite) Type: Contract-to-Hire We are seeking a highly skilled Data... ...with Azure Cloud (Databricks, DevOps, DataFactory) Pharma / biotech domain experience, specifically within the commercial data space...SuggestedContract workWork at office
Diligente Technologies
Sunnyvale, CA1 day ago $45 - $48 per hour
...per hour on W2 Job Summary: We are seeking a Senior Data Engineer & Platform Architect to design, develop, and oversee a contemporary data platform... ...engineering, manufacturing, analytics, and finance domains. Champion platform reliability and best practices,...SuggestedHourly payContract workAkraya
Sunnyvale, CA2 days ago- ...companies to build the foundational data layer that will power the next... ...who brings a wealth of "big pharma" clinical experience to the... ...life sciences field. Domain Expertise: Extensive experience... ...most exciting intersection in biotech today: AI and drug discovery....SuggestedFor contractors
Oakwell Hampton Group
Sunnyvale, CA4 days ago - ...you’ll do… Position Summary... The Catalog Data Science team at Walmart plays a pivotal... ...GenAI, Machine Learning, Deep Learning, and Engineering. We tackle complex problems spanning... ...architectures — CNNs, Transformers, and domain‑specific variants Proven ability to build...Suggested
- A technology company based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The...Suggested
$23 per hour
...Quest Global delivers world-class end-to-end engineering solutions by leveraging our deep industry... ...ML systems . Collaborating with data scientists and engineers to select, collect... ...new knowledge into ongoing projects. Domain: Demand and supply planning #...Hourly payTemporary workWork experience placementQuEST Global
Sunnyvale, CA4 days ago$173.5k - $331.05k
...Senior Data Engineer & Architect Location: San Jose, CA Job Type: Full-Time Reporting to: Senior Manager, Data & Analytics Platform Engineering About the Role The Adobe Experience Platform (AEP) Product Success Engineering team is hiring a Senior...Full timeTemporary workLocal areaWorldwideAdobe
San Jose, CA5 days ago- ...Sr. Data Engineer Do you get excited when you see Data? Constantly looking for value in... ...provisioning pipeline process across different domains. ~ Collaborate with DBA, other... ...levels ~ Work with technical leads and architects to implement new standards, new...
Professional Recruiters
Santa Clara, CA4 days ago $210.75k - $230k
...Assess and analyze the source system and data set expectation for data extracts. Apply... ...client to centralize various data domains: Create/ Modify a generic, meta-data driven... ...Computer Science, Computer Science and Engineering, Computer Engineering, or related field....RelocationWinWire
Santa Clara, CA3 days ago- ...for your reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position is no... ...- 8+ Years of experinece Mandatory if Applicable Domain Experience (If any ) - Retail preferably Past client experience...
Texas State Library and Archives Commision
Sunnyvale, CA3 days ago $184k - $287.5k
...NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node... ...the way up to large multi-node NVLink domain rack architectures. These designs have become... ...We are searching for a highly motivated engineer to lead performance benchmarking and...$100k - $155k
...future of cybersecurity starts with you. About the Role We are seeking a seasoned Data Engineer with expertise in Go To Market domain to join our team. You will be responsible for architecting and building robust data frameworks that empower Operational Data Store /...Remote jobFull timeWork at officeLocal area$116k - $193k
...Analytics Engineer – People Data At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity... ...data warehouses specifically for HR and People Analytics domains. Suggested Skills: Design and Systems Thinking...For contractorsWork experience placementWork at officeFlexible hoursLinkedIn
Sunnyvale, CA2 days ago$210.75k - $230k
Data Engineer Job ID : DEKN26 Job Location: WinWire Technologies, Inc., 5201 Great America Pkwy., Suite 259, Santa Clara, CA 95054; and various... ...a common warehouse enabling client to centralize various data domains: Create/Modify a generic, metadata-driven Azure Data Factory...Relocation$208k - $333.5k
The connectivity engineer translates product reference architectures and logical network diagrams... ...requirements: hardware selection, fault domain, network architecture. Develop new... ...Hyperscale Cloud Provider, large‑scale enterprise data center, or High‑Performance Computing (...- Join to apply for the Junior Data Annotation Engineer (Remote) role at Jobright.ai Join to apply for the Junior Data Annotation Engineer (Remote... ...operation improvement initiatives across various data domains. Qualifications: Required: • Bachelor's degree with 3+ years...Remote jobFull time
- ...Senior Analytics Engineer, GTM Santa Clara, California We're in an unbelievably exciting... ...tech and are fundamentally reshaping the data storage industry. Here, you lead with... ...semantic and metrics layers supporting GTM domains including pipeline, forecasting, quota,...Flexible hours
Pure Storage
Santa Clara, CA2 days ago - ...Description POSITON DESCRIPTION We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based... ..., Delta Lake strategies, medallion architecture, and domain-driven design principles. Establish and enforce data...
Q-Cells
Santa Clara, CA2 days ago $94.43k - $202.75k
...currently seeking a Senior Associate, Data Engineer for our Consulting practice. Responsibilities... ..., across multiple, diverse domains; communicate results and educate others... ...experience as a cloud data lake/warehouse architect, designer, developer, data scientist, or...Local areaVisa sponsorship$22 - $29 per hour
...Full time Remote: No Job Description: AI and Data Engineer Company: Hitachi America, Ltd. Division: Business Innovation... ...Hitachi generates value from integrating data, technology and domain knowledge to solve customer and social challenges. Revenues...Hourly payPermanent employmentFull timeTemporary workWork at officeRemote workWorldwideHitachi
Santa Clara, CA1 day ago$274.3k
SAP Belgium NV/SA is looking for a Senior Data Engineer in Palo Alto, California. In this role, you will define and drive enterprise scale data engineering strategies and architectures vital for business analytics and AI, ensuring alignment with customer needs. Your responsibilities...$180k
About the Role About Uber Cloud Engineering The Cloud Engineering team provides technical management... ...keep Uber’s products running About Uber Data Center Management, Data Center... ...center sites (25% to 50%) Technical Deep Domain Experience Structured Cabling & Networking...Full timeFor contractorsWork at officeRemote workFlexible hours$73.4k - $129.26k
...advanced capabilities to our customers, we are proud to be at the forefront of cutting‑edge technology and engineering. Space Focus Space is a critical domain, connecting our technologies, our security and our humanity. While others view space as a destination, we see...Full timeWork experience placementWeekend work- ...predictive models. Develop ML algorithms to analyze historical data to make predictions. Run tests, performing statistical analysis... ...discipline (e.g., Statistics, Computer Science, Math, Physics, Engineering), or equivalent practical experience. 3+ years of experience in...
TechDigital Group
Sunnyvale, CA4 days ago - A leading technology company in Sunnyvale is seeking a skilled professional to design and develop machine learning systems. The ideal candidate will have a Bachelor's degree in a quantitative discipline and at least three years of experience in analytics. Strong skills...
TechDigital Group
Sunnyvale, CA3 days ago - ...Position Title: Data Architect Hire Type: Full Time Only Job Description Experience... ...and technical solutions. Interface with engineers and analysts to understand data needs and... ...Familiarity with the CRM or related domain data architectures and issues. Experience...Full time
Next Level Business Services, Inc.
Sunnyvale, CA3 days ago - A leading technology company based in Santa Clara, California, is seeking a Staff Machine Learning Engineer to enhance AI features across Apple products. The ideal candidate will have extensive experience in machine learning, particularly in reinforcement learning and...
- A pioneering tech company in Mountain View seeks an early Software Engineer to drive the development of innovative data platforms for AI agents. You will design and maintain ETL processes, manage core data models, and partner with engineering teams to ensure data quality...
- ...TITLE: ML Data Infrastructure Engineer LOCATION: Sunnyvale CA or Remote Duration: 12+ Months Rate: DOE Key skills - GCP ML Infrastructure, BigQuery, Dataflow, Airflow ( Cloud composer), Vertext AI , Datapipeline, ML Training Role Overview: We're seeking...Remote work
Redolent
Sunnyvale, CA4 days ago - ...Job Title 7+ years of software engineering experience, with 3+ years in ML serving/infrastructure. Strong expertise in container orchestration (Kubernetes) and cloud platforms. Experience with model serving technologies (TensorFlow Serving, Triton, KServe). Deep knowledge...
Tranzeal
Sunnyvale, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer / Data Architect (Pharma / biotech domain). Be the first to apply!
Related searches
- senior data center engineer Santa Clara, CA
- data science developer Santa Clara, CA
- etl data engineer Santa Clara, CA
- entry level big data engineer Santa Clara, CA
- data engineer Santa Clara, CA
- big data cloud engineer Santa Clara, CA
- junior big data engineer Santa Clara, CA
- remote data engineer Santa Clara, CA
- senior data engineer Santa Clara, CA
- senior cloud data engineer Santa Clara, CA