Principal Data Engineer
$80 - $85 per hourBayrock Labs
About BayRock Labs At BayRock Labs, we pioneer innovative tech solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product development, leveraging cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive culture fosters professional growth and work-life balance. Join us to work on ground-breaking projects and be part of a team that values excellence, integrity, and innovation. Together, let's redefine what's possible in technology. We are looking for a highly skilled Senior Data Engineer / Data Architect with deep hands-on expertise in Azure, Databricks, PySpark, Python, SQL, and modern data warehousing . This role is ideal for someone who has built large-scale data platforms, designed enterprise-grade architectures, and delivered high-quality data products in cloud environments. Core Technical Expertise Azure Cloud Platform
- ADLS Gen2, ADF, Synapse, Azure SQL, Key Vault, App Services
- Cloud-native architecture design, scalability, and cost optimization
- Security & governance: RBAC, Managed Identity, Private Endpoints
- End-to-end development on Azure Databricks
- Lakehouse architecture implementation
- Delta Live Tables (DLT), Unity Catalog
- Performance tuning, cluster optimization
- CI/CD for Databricks workloads
- Apache Spark with advanced PySpark transformations
- Structured Streaming & batch data pipelines
- Delta Lake architecture & optimization
- Python for automation, data engineering, and orchestration
- PySpark for distributed data processing
- SQL for complex query optimization and analytics engineering
- Enterprise Data Warehouse (EDW) architecture
- Dimensional modeling (Star/Snowflake)
- Data Vault 2.0 modeling
- Metadata-driven ingestion frameworks
- Change Data Capture (CDC) implementation
- Medallion architecture (Bronze/Silver/Gold)
- Data lineage, governance, cataloging
- Master Data Management (MDM)
- Design and delivery of scalable data products
- Business-aligned semantic layer design
- KPI frameworks & enterprise reporting enablement
- Integration of ERP, SaaS, and operational systems
- Hybrid Lakehouse + EDW architectures
- CI/CD pipelines (Azure DevOps, GitHub Actions, Bitbucket)
- Infrastructure as Code (Terraform, ARM templates)
- Automated testing (unit, integration, data quality)
- Monitoring, logging, and observability
- Agile/Scrum delivery
- Principal-level solution architecture design
- Cross-functional stakeholder collaboration
- Technical roadmap planning and execution
- Guidance on data governance frameworks (GDPR, SOX)
- Cloud cost optimization strategies
- Migration from legacy EDWs (Teradata, Oracle, SQL Server) to Lakehouse
- 5-10+ years of hands-on experience in data engineering or data architecture
- Strong expertise in Azure + Databricks ecosystem
- Proven experience building scalable, secure, high-performance data platforms
- Ability to lead design discussions, influence architecture decisions, and mentor teams
- Strong problem-solving mindset and passion for modern data engineering
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Data Engineer in Milpitas, CA vacancy
$143k - $286k
...yearType: Full time / Regular/PermanentCompany: Sam's ClubBusiness Segment: Home OfficePosition Summary...What you'll do...Principal Data Engineer - Agentic Data PlatformsThe MissionAs a Principal Data Engineer, you are the enterprise-scale technical authority responsible...SuggestedFull timeTemporary workPart time$267.8k - $288.56k
...robotics, mobility, healthcare, energy and data centers. With revenue of more than $11... ...: Analog Devices, Inc. Job Title: Principal Data EngineerJob Requisition: 1010.1323.... ...distributed computing frameworks, and modern data engineering tools for efficient data processing,...SuggestedPermanent employmentFull timeWork at officeRemote workWork from homeDay shift2 days per week$180k - $200k
...downstream teams and tools depend on Build and maintain curated data models for product usage, customer adoption, account health,... ...as a bottleneck Required ~6+ years in analytics engineering, data engineering, or similar, with real ownership of production...SuggestedFull timeLocal areaImmediate startShift work$249k
...careers and have the flexibility, benefits, and support to do their best work. Join us and build for travelers everywhere.Principal Data & AI Engineer, Reporting and InsightsIntroduction to the Team: Our Technology team partners across Expedia Group to create innovative...SuggestedFull timeWork at office$206.3k - $388k
ABOUT THE ROLE We’re looking for a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Adobe Firefly’s multimodal foundation models (image, video, audio). In this role, you’ll sit at the intersection of data engineering...SuggestedFull timeTemporary workLocal areaWorldwide- Principal IT Data Engineer- Finance Palo Alto Networks Santa Clara, CA Our Mission At Palo Alto Networks®, we're united by a shared mission-to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with...Full timeWork at officeVisa sponsorshipWork visa
Palo Alto Networks
Santa Clara, CA24 days ago $184k - $368k
...OpportunityAre you a visionary leader with a passion for transforming data into actionable insights, and a track record of building and... ...teams? If so, joining our team as a Senior Manager, Analytics Engineering at Nutanix will allow you to make a meaningful impact by...Work at officeRemote workRelocation package3 days per week$219k - $351k
...every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an... ...for our employees, customers, partners, and communities.Principal Engineer, Architecture & Performance Research Engineer for Data Center...Work at officeFlexible hoursShift work- Company: Tredence Inc.Position Title: Manager - Data EngineeringLocation: 1900 Camden Ave., Suite 66, San Jose, CA 95124Position Responsibilities... ...: Master’s degree (or foreign equivalent) in Electrical Engineering, or a related field, PLUS one (1) year of experience in the job...Remote work
- ...critical care through our rapid seizure detection technology, come join the movement!Position Overview:The Director of Data Architecture & Engineering will play a central role in ensuring Ceribell’s systems and data architecture support the organization’s strategic objectives...Local areaRemote work
$220k - $245k
Title: Sr Data Engineering Manager This position is based in our Campbell, California offices. This position is on-site, full-time.Why Imperative Care?Do you want to make a real impact on patients?As part of our team at Imperative Care, you can help elevate care for patients...Full timeContract workWork experience placement- Company: Tredence Inc. Position Title: Senior Manager - Data Engineering Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Lead the architecture, design, and development of Power BI solutions, including data models, reports, dashboards...Remote work
$211k - $347k
...performed both from home and from a LinkedIn office on select days, as determined by the business needs of the team. LinkedIn's Data Center Engineering organization is responsible for the strategy, design, construction, deployment, operations, and continuous evolution of the...Contract workFor contractorsWork at officeFlexible hours$184k
Sr. Director, Data Science & Data Engineering - SearchWe exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever...Temporary workFlexible hours- ...of tomorrow with advanced photonic technologies that enable AI, data centers, telecom, industrial, and sensing applications. As AI... ...of R&D, manufacturing, and sales locations.Senior Manager, Data Engineering Responsibility Architect and implement scalable cloud-based lakehouse...Full time
- Senior Director - Data Engineering Location - Remote Role OverviewThe Director / Senior Director of Data Engineering is a dual-mandate role: you are both a hands-on technical leader and a trusted client advisor. You will work alongside our Sales and Solutions teams to...Remote work
- ...guidance and support to create groundbreaking solutions that will transform and inspire the industry.As a Senior Director of Data Engineering at JPMorganChase within the Commercial and Investment Bank Operations, you lead multiple aspects of data management, manage the...
- A leading financial technology firm is seeking a Principal Software Engineer, Data Engineering, to drive strategic transformation and define foundational technology for high-scale data products. This role involves significant hands-on development, architectural leadership...
- ...Data & Analytics Engineer Our Information Services (ISS) department is looking for an outstanding Data & Analytics Engineer with 5+ years of experience working with data and is passionate about technology & architecture, loves hands-on development and wants to help...Local area
Netpace
Milpitas, CA3 days ago $83.98 - $111.27 per hour
...discovered. Day - 08 Hour (United States of America) Stanford Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to our mission of leveraging data to drive clinical innovation,...Hourly payFull timeStanford Health Care
Palo Alto, CA3 days ago$275k - $382k
...robotics automation technical solutions for data center hardware required for AI2... ...within AI2, to meet the business needs.Lead engineering execution and provide technical leadership... ...billions of Google users worldwide. As Principal Engineer, you will define the strategic...Remote workWorldwideFlexible hours- ...Director, Data Engineering Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure...
MasterCard
Mountain View, CA5 days ago $174k
...Coupang Search and Discovery Data Science, Analytics, and Data Engineering Team We exist to wow our customers. We know we're doing the right thing when we hear our customers say, "How did I ever live without Coupang?" Born out of an obsession to make shopping, eating...Temporary workFlexible hoursCoupang
Mountain View, CA2 days ago- ...Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s... ...Job Description We are seeking a Senior Staff AI/ML Engineer to lead the design, development, and deployment of advanced AI/...Full timeTemporary workRemote workFlexible hoursShift work
Sandisk
Milpitas, CA20 days ago $366k - $400k
...entire lifecycle of a live event — from discovery and planning to participation and lasting memories — we are seeking a proven data engineering leader to help build the platforms and pipelines that power that future. This is a unique opportunity to shape the data...Local areaWorldwideFlexible hours$168k - $258.75k
...Senior Technical Program Manager (TPM) to join NVIDIA’s Server Engineering Operations Team. You will be the cross-section between execution... ...to help us take on more of these unique opportunities in data-center solutions.What you will be doing:The Technical Program Manager...Full time- Payactiv, a FinTech company, seeks a Data and Analytics Engineer to own and support reporting, analytics, dashboards, and data requests. You will manage Snowflake-based workflows, ensure data accuracy, and translate business questions into outputs for stakeholder use. You...
$218k - $323.95k
...ourselves, each other, and our communities.Job Summary:This role is the technical authority for Venmo’s data platform infrastructure and performance engineering. The Principal Engineer sets the technology vision, defines architectural direction, and provides deep technical...Full timeWork at officeLocal areaImmediate startFlexible hours$130k - $165k
...finances, and regain flexibility to pay for things on their own schedule. What you will do… Payactiv is seeking a hands-on Data and Analytics Engineer to own and support our business reporting, analytics, dashboarding, and marketing/operational data request workflows....Work at office- ...Head of Data Engineering About the Company Ambitious education company Industry Primary/Secondary Education Type Privately Held Founded 2020 Employees 201-500 About the Role The Company is seeking a Head of Data Engineering to spearhead...Remote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Data Engineer. Be the first to apply!
Related searches
- principal developer Milpitas, CA
- hotel chief engineer Milpitas, CA
- director software engineering Milpitas, CA
- principal engineer Milpitas, CA
- engineering director Milpitas, CA
- data center chief engineer Milpitas, CA
- general engineer Milpitas, CA
- chief engineer Milpitas, CA
- senior principal cloud computing engineer Milpitas, CA
- principal Milpitas, CA