Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Cloud Data Platform Lead: BigQuery & Streaming Pipelines

EGEN , Inc. Defunct

Egen is seeking a Lead Data Engineer in Emeryville, California. This role involves architecting and optimizing cloud-native data platforms on Google Cloud, focusing on BigQuery, and driving data quality practices. The ideal candidate has over 7 years of data engineering experience, expertise in building pipelines, and a strong background in data governance. Egen offers comprehensive health insurance and paid leave among other benefits. #J-18808-Ljbffr EGEN , Inc. Defunct

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Cloud Data Platform Lead: BigQuery & Streaming Pipelines in Emeryville, CA vacancy
  • $150k - $250k

     ...capability for leading robotics companies...  ...hiring a Sr Data Engineer / Data...  ...petabyte-scale data pipelines that ingest...  ..., on-prem, and cloud environments,...  ...environments Build streaming and batch...  ...discoverability across the platform Drive data...  .../Redshift, GCP BigQuery/Dataflow, or... 
    Platform
    Pipeline
    Cloud
    Full time
    Contract work

    Garuda Ventures

    San Francisco, CA
    2 days ago
  • A leading cloud cost management company is seeking a Distinguished Architect to drive the architecture of its data platform. This role involves designing real-time streaming data pipelines and collaborating with various engineering teams to shape the overall engineering... 
    Platform
    Pipeline
    Cloud
    Remote job

    CloudZero

    San Francisco, CA
    1 day ago
  •  ...Francisco, is looking for an experienced Data Engineer to join their team. This...  ...with the CTO to maintain data pipelines while ensuring data quality. Candidates...  ...experience and strong skills in Python, BigQuery, and Google Cloud Platform. Benefits include fully covered... 
    Platform
    Pipeline
    Cloud

    Neon Redwood

    San Francisco, CA
    5 days ago
  • Python Test Lead San Francisco, CA Contract Key Responsibilities...  ...build, and maintain scalable cloud data architectures and automated...  ...to implement end-to-end data pipelines and workflows. Ensure automation...  ...processes for cloud data platforms. Provide technical leadership... 
    Platform
    Pipeline
    Cloud
    Contract work

    US Staffing Inc

    San Francisco, CA
    5 days ago
  •  ...workflow intelligence platform that helps...  ...with B2B SaaS, data, analytics,...  ...PTO) Remote Work Lead Windows Developer...  ...with CI/CD pipelines and automated testing...  ...warehouse (BigQuery, Snowflake, Redshift...  ..., and cloud‑based data operations...  ...real‑time or streaming data architectures... 
    Platform
    Pipeline
    Cloud
    Full time
    Contract work
    Part time
    Remote work
    Flexible hours

    SCALIS

    Oakland, CA
    20 hours ago
  •  ...Ltd. is seeking an experienced Data Engineer located in Walnut Creek...  ...The successful candidate will lead the design, development, and maintenance of ETL pipelines, collaborate with teams to create...  .... A robust understanding of cloud platforms such as AWS or Azure is essential... 
    Platform
    Pipeline
    Cloud

    Gravity Engineering Services Pvt Ltd.

    Walnut Creek, CA
    4 days ago
  • $300 per month

     ...across energy, manufacturing, data center construction, and cloud services. If you want to...  ...’re looking for a Senior Streaming Software Engineer to join...  ...the real‑time data platforms that power metrics, logs,...  ...work on large‑scale data pipelines and distributed systems that... 
    Platform
    Pipeline
    Cloud
    Temporary work

    Crusoe Energy Systems

    San Francisco, CA
    5 days ago
  •  ...and pioneer in industry cloud, helping life sciences...  ...Link builds connected data applications to improve...  ...Data Operations Hiring Lead, you will develop a seamless...  ...Sciences, this is your platform to scale something...  ...talent enters the training pipeline. Monitor & Optimize... 
    Platform
    Pipeline
    Cloud
    Freelance
    Work at office
    Local area
    Remote work
    Work from home

    Veeva Systems, Inc.

    San Francisco, CA
    3 days ago
  •  ...highly skilled AWS Data Architect with...  ...maintain scalable data pipelines and analytics...  ...and enterprise data platform implementation 6 years...  ...understanding of cloud-native data...  ...of experience in leading data engineering teams...  ...architectures, including streaming frameworks and... 
    Platform
    Pipeline
    Cloud

    WinWire

    Alameda, CA
    4 days ago
  • $182.75k - $247.25k

     ...want to supercharge our data capability to better...  ...The Onyx Research Data Platform organization represents...  ...‑end data services and pipelines. They apply standardized...  ...responsible for building and leading a scrum team of world‑...  ...engineering experience Cloud experience Experience... 
    Platform
    Pipeline
    Cloud
    Local area

    GlaxoSmithKline

    San Francisco, CA
    5 days ago
  •  ...images) and/or IoT data inputs Deep...  ...familiarity with cloud environments (...  ...experience leading or mentoring small...  ...Databricks, or BigQuery (Desirable) Background...  ...with CI/CD pipelines, observability...  ..., CV/ML, and platform engineering teams...  ...complex data streams and large‑scale... 
    Platform
    Pipeline
    Cloud
    For contractors
    Work at office

    Doxel.ai

    San Francisco, CA
    3 days ago
  • $165k - $205k

     ...passionate and skilled Data Engineer to join...  ...: Build datasets, pipelines, and other solutions...  ...might work on: BI Platform Infrastructure, Airflow, BigQuery Tuning, Customer Facing...  ..., CI/CD, Data Streaming Infrastructure. Who...  ...means required: Google Cloud Platform, BigQuery,... 
    Platform
    Pipeline
    Cloud

    jobr.pro

    San Francisco, CA
    4 days ago
  •  ...Redwood Neon Redwood is a data services consulting company...  ...understanding of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies...  ..., and maintain data pipelines, ETL processes, and data warehousing...  ...‑time data processing and streaming technologies (e.g., Kafka,... 
    Platform
    Pipeline
    Cloud
    Full time
    Work experience placement

    Neon Redwood

    San Francisco, CA
    4 days ago
  •  ...About the team The Data team at Trustly...  ...owning the data platform that underpins our...  ...while building and leading the engineering,...  ...architecture, streaming and batch pipelines, data cataloging,...  ...data architecture: cloud data warehouses (Snowflake, BigQuery, Redshift), data... 
    Platform
    Pipeline
    Cloud
    Work at office
    Worldwide
    Home office
    Flexible hours

    Trustly

    San Francisco, CA
    3 days ago
  •  ...Architect / Technical Lead – GIS Modernization (Hybrid...  ...that enables GIS platforms to support critical utility...  ...CIP) Oversee CI/CD pipelines and deployment...  ...frameworks Experience with cloud platforms (AWS, Azure,...  ...Knowledge of event-driven and streaming architectures MuleSoft... 
    Platform
    Pipeline
    Cloud
    Full time
    Temporary work
    2 days per week
    3 days per week

    Astreya

    Oakland, CA
    4 days ago
  • $200k - $400k

     ...Decagon is the leading conversational AI platform empowering every...  ...Decagon: networking, data, ML serving,...  ...The foundational cloud stack—networking...  .... Data Infra: Streaming/batch data platforms...  ...critical data pipelines and storage...  ...across ClickHouse, BigQuery, or similar. Partner... 
    Platform
    Pipeline
    Cloud
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    5 days ago
  •  ...is seeking experienced Data Engineers to design, develop...  ...large‑scale data pipelines (Azure, AWS, GCP) Develop...  ...infrastructure and cloud deployments Collaborate...  ...SQL Server, Snowflake, BigQuery, Apache Spark) Proficiency...  ...databases, and cloud platforms Experience with... 
    Platform
    Pipeline
    Cloud

    Object Computing, Inc.

    Emeryville, CA
    4 days ago
  •  ...comes out every day. Our platform ingests, comprehends,...  ...media, and internet data at scale—across text,...  ...for real workflows: RAG pipelines, embeddings, prompt...  ...there. Experience with cloud infrastructure,...  ...Spark, Kafka, Flink, BigQuery, streaming pipelines, ETL at scale... 
    Platform
    Pipeline
    Cloud

    Clipbook

    San Francisco, CA
    5 days ago
  • What You'll Do Lead Legibility and Eligibility Audits...  .... Assess whether client data is structured enough for...  ...deploy production data pipelines (batch and streaming) across cloud environments. Eliminate...  ...experience with cloud data platforms (BigQuery, Snowflake, Redshift)... 
    Platform
    Pipeline
    Cloud

    Your AI Department

    San Francisco, CA
    3 days ago
  • $110.93k - $166.4k

     ...Overview The Data Engineer designs, builds, and supports the data pipelines, integrations, and curated datasets...  ...across enterprise platforms, including Salesforce,...  ...Fabric, or equivalent cloud data platforms. Experience...  .... Experience with streaming or event‑driven integrations... 
    Platform
    Pipeline
    Cloud

    Wolff/Lang/Christopher Architects, Inc.

    Berkeley, CA
    1 day ago
  • Senior Data Engineer (1043) - DataSF - Office...  ...robust data pipelines and reliable data...  ...Responsibilities Platform Administration: Manage...  ...; support both streaming and batch processes...  ...developing on managed cloud data platforms such as Snowflake, BigQuery, or Databricks.... 
    Platform
    Pipeline
    Cloud
    Permanent employment
    Full time
    Traineeship
    Work at office

    City-and-County-of-SAN-Francisc

    San Francisco, CA
    4 days ago
  •  ...will be expected to: Lead a small to medium...  ...least one of the main cloud providers (AWS, Azure...  ...of our clients’ data platform solutions. Lead a delivery...  ..., Snowflake, Google BigQuery) Advanced Object‑...  ...experience developing data pipelines: batch and/or streaming. Experience with... 
    Platform
    Pipeline
    Cloud
    Temporary work
    Local area

    Slalom

    San Francisco, CA
    2 days ago
  • Data Engineer II - QuantumBlack, AI by McKinsey...  ...modern data platforms that power advanced...  ...scalable pipelines, manage secure and...  ...outcomes. Develop a streaming data platform to integrate...  ...experience with cloud platforms such as...  ...such as Snowflake, BigQuery, Redshift, and... 
    Platform
    Pipeline
    Cloud
    Apprenticeship

    McKinsey & Company

    San Francisco, CA
    2 days ago
  •  ...Amplitude is the leading AI analytics platform, helping over 4,...  ...for product, data, and marketing teams...  ..., caching, and cloud infrastructure—...  ...Middleware, Data Pipeline, and other...  ...columnar storage, streaming or batch data processing...  ..., Presto/Trino, BigQuery, Snowflake, or... 
    Platform
    Pipeline
    Cloud
    Worldwide
    Home office
    Flexible hours

    Amplitude

    San Francisco, CA
    4 days ago
  •  ...experienced Senior Data Architect as...  ...data mesh platform. Reporting to the...  ...expertise in modern cloud architectures...  ...Athena), GCP (BigQuery, VertexAI), or...  ...Capability to lead the entire data...  ...fundamentals and stream processing using...  ...multiple data pipelines into a centralized... 
    Platform
    Pipeline
    Cloud
    Work at office
    Local area
    Flexible hours

    URA

    San Francisco, CA
    4 days ago
  • $300 per month

     ...On-site Department Cloud Engineering Crusoe...  ...as a Senior Data Engineer, an early...  ...foundational data platform infrastructure that...  ...go beyond building pipelines—you'll design and...  ...warehouses, data lakes, streaming systems, and ETL/...  ...) data services (BigQuery, Dataflow, Pub/Sub... 
    Platform
    Pipeline
    Cloud
    Full time
    Temporary work

    Epoch Biodesign

    San Francisco, CA
    2 days ago
  •  ...development at a leading Healthcare IT Group...  ...design, development of platform and solutions for...  ...related complex data problems. ~7+...  ...Experience with CICD pipeline, Containerization,...  ...event driven and Cloud native...  ...managing multiple work streams and projects at one... 
    Platform
    Pipeline
    Cloud
    Immediate start

    Samprasoft

    Oakland, CA
    7 hours ago
  • $60 per hour

     ...fastest‑growing AI data business in...  ...Infrastructure & Platform team. This team powers...  ...AI, including data pipelines, feature stores, training...  ...and operating cloud infrastructure on...  ...platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines. Practical... 
    Platform
    Pipeline
    Cloud
    Full time
    Work at office
    Flexible hours

    TrulyHired

    San Francisco, CA
    2 days ago
  • $150.57k - $188.22k

     ...to make access to data as simple and reliable...  ...is building data pipelines to power the...  ...ll Use: Fivetran, BigQuery, Looker, SFDC, Demandbase...  ...on cost-per-lead, cost-per-opportunity...  ...working with cloud data warehouses (Snowflake...  ...automation platforms (Marketo preferred... 
    Platform
    Pipeline
    Cloud
    Full time
    Work at office
    Remote work

    dbt Labs

    Oakland, CA
    7 hours ago
  • $150k - $236k

     ...Backend Engineer, Platform & Data Ingestion Scale Clinical...  .... By scaling OCR pipelines to extract...  ...process high‑volume streams of clinical data and...  ...peer engineers. Lead the charge in...  ...Databricks, Snowflake, BigQuery, etc.) data...  ...reactive principles, and cloud integrations (AWS... 
    Platform
    Pipeline
    Cloud
    Work visa
    Flexible hours

    Verana Health

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Cloud Data Platform Lead: BigQuery & Streaming Pipelines. Be the first to apply!