Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer (Snowflake | Databricks | Kafka | Airflow | dbt)

Full-time

Trianz

We are seeking a **Senior Data Engineer** to design, build, and scale modern cloud-native data platforms supporting real-time analytics, enterprise reporting, and high-volume streaming workloads. This role requires strong hands-on expertise in **Snowflake, Databricks, Spark, Kafka, Airflow, and dbt**, along with proven experience building reliable pipelines handling **multi-TB datasets and millions/billions of events per day**.

You will partner with engineering, product, analytics, and business teams to deliver scalable pipelines, optimize performance, improve cost efficiency, and implement DataOps best practices across cloud environments (AWS/GCP).

* Design and build scalable batch + streaming data pipelines using **Kafka, Spark Structured Streaming, Databricks, and Snowflake**
* Develop and optimize ELT workflows using **dbt** and orchestration frameworks like **Airflow**
* Build enterprise-grade data models (star schema, dimensional modeling) for analytics and BI workloads
* Optimize Snowflake performance using clustering, workload isolation, materialized views, and query tuning
* Implement automated testing and validation frameworks using **Great Expectations, pytest, and unit testing**
* Implement CI/CD for data pipelines using **GitHub Actions / GitLab / Jenkins**
* Support cloud migrations from legacy systems into AWS/GCP cloud-native architectures
* Build metadata, lineage, and governance frameworks (IAM, encryption, audit logging, catalog tools like Amundsen)
* Improve data reliability through SLA monitoring, observability, schema enforcement, and pipeline alerting
* Partner with analytics teams to enable self-service dashboards in **Tableau, Power BI, Looker**
* Mentor junior engineers and contribute to architecture reviews and platform best practices
* 7+ years of experience as a **Data Engineer / Senior Data Engineer**
* Strong expertise in **SQL, Python, and PySpark**
* Hands-on experience with **Snowflake** and/or **Databricks**
* Strong experience with **Apache Spark (batch + streaming)**
* Proven experience building real-time pipelines using **Kafka** (Confluent is a plus)
* Experience with workflow orchestration using **Airflow**
* Experience with dbt and modern ELT modeling practices
* Strong knowledge of cloud data services in **AWS and/or GCP**
* Strong performance tuning experience (Spark + Snowflake + Redshift/BigQuery)
* Familiarity with CI/CD and Infrastructure-as-Code tools (Terraform is a plus)
* Experience processing **billions of events/day** or multi-terabyte datasets
* Experience with healthcare or regulated environments (**HIPAA, HITECH**)
* Experience with data governance frameworks (**SOC 2, GDPR**)
* Familiarity with Redshift, BigQuery, Delta Lake, EMR, Glue, Kinesis
* Experience implementing observability and monitoring for data pipelines
* Experience building fraud detection or near real-time analytics systems 

Snowflake, Databricks, Spark, Kafka, Airflow, dbt, Python, SQL, AWS (S3, Glue, Kinesis, EMR, Lambda), GCP, Terraform, GitHub Actions/GitLab/Jenkins, Great Expectations, Tableau/Power BI/Looker

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (Snowflake | Databricks | Kafka | Airflow | dbt) in Santa Clara, CA vacancy
  • $150k - $300k

     ...seeking aSenior Manager of Data Engineering to lead the evolution of...  ...: Working knowledge of Kafka, Kinesis, or Pulsar for...  ...-on experience with Snowflake, BigQuery, Redshift, or Databricks ~ Data Pipelines: Proficiency with Apache Airflow, dbt, or similar orchestration... 
    Databricks
    Senior
    Hourly pay
    Work experience placement
    Local area
    Flexible hours

    GEICO

    Palo Alto, CA
    1 day ago
  •  ...+ years of experience in a Data Engineer role, to join our growing team...  ...and tools such as Databricks, Snowflake Minimum of 5+ years of hands...  ...tools such as Spark-streaming, Kafka-stream, Flink, etc...  ...Workflow management tools such as Airflow, Apache Nifi, etc Good understanding... 
    Databricks
    Senior

    A5 Labs

    San Jose, CA
    1 day ago
  •  ...We are looking for a skilled Data Engineer with strong expertise in Snowflake and AI/ML technologies. The ideal...  ...Experience with ETL/ELT tools (e.g., Airflow, Informatica, dbt) • Hands-on experience with...  ...big data technologies (Spark, Kafka is a plus) Preferred Skills:... 
    Suggested

    VBeyond

    Sunnyvale, CA
    8 days ago
  •  ...Consultant, Analytics Engineering to join our growing...  ...the intersection of data engineering and...  ...engineers and analysts on dbt, modeling patterns,...  ...-specific tuning (Snowflake preferred; Databricks, BigQuery, or Redshift...  ...(dbt Cloud, Airflow, Dagster, Prefect, or... 
    Databricks
    Senior

    IBM Computing

    Santa Clara, CA
    23 hours ago
  • $184k - $287.5k

    ## Senior Data Engineer - Financial Transactions & AutomationApplylocations: US, CA, Santa Clara...  ...: Architect event-driven pipelines (Kafka) and develop new data models that ensure...  ...robust ETL/ELT pipelines using Databricks and dbt to manage large-scale Delta Lake or Apache... 
    Databricks
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $83.98 - $111.27 per hour

    Senior Manager, Data Engineering page is loaded## Senior Manager, Data Engineeringremote...  ...solutions (e.g., Databricks). + Define and...  ...(Databricks, Snowflake, BigQuery, Redshift)...  ...technologies (e.g., Spark, Kafka) and workflow...  ...orchestration tools (e.g., Airflow).* Expert-level SQL... 
    Databricks
    Senior

    Stanford Health Care - ValleyCare

    Palo Alto, CA
    4 days ago
  •  ...9-1 Job Title: Data Engineer Location: San Jose...  ...and hands-on Senior Data Engineer with...  ...data technologies, Databricks, PySpark, and large...  ...orchestration using Airflow / Astronomer....  ...Client Fabric Snowflake dbt Delta Lake Kafka / Event Hub streaming... 
    Databricks
    Local area
    Immediate start

    Artech

    San Jose, CA
    4 days ago
  •  ...Role - Data Engineer (AI/ML Focus) Location - Sunnyvale...  ...using tools like Apache Spark, Airflow, and Kafka to support AI and ML...  ...like S3, Redshift, Glue, or Databricks. Key Skills and...  ...Apache Spark, Kafka, Airflow, dbt, and Vector Databases (Pinecone... 
    Databricks

    Diverse Lynx

    Sunnyvale, CA
    1 day ago
  • $139k - $257.55k

     ...About the Role We are looking for a Senior Data Engineer to join our Data & Analytics...  ...Proficiency in unified data platforms like Databricks, Snowflake. ~ Proficiency in SQL and at least...  ...data transformation framework (e.g., dbt, Spark, Dataflow). ~ Hands-on experience... 
    Databricks
    Senior
    Temporary work
    Local area
    Worldwide

    Adobe

    San Jose, CA
    1 day ago
  •  ...experienced and highly skilled Contract Data Engineer. This role is focused on building...  ...candidate will work hands-on with Databricks, Snowflake, and/or relational databases,...  ...specific ETL/orchestration tools (e.g., Airflow, Fivetran, dbt). Familiarity with... 
    Databricks
    Contract work
    Work experience placement
    Immediate start
    Remote work

    Artech

    Sunnyvale, CA
    2 days ago
  •  ...Request ID: 86841-1 Title: Snowflake Data Engineer Locations : Sunnyvale, CA (5x/ week onsite...  ...such as Pandas, PyParsing, and Airflow. Strong understanding of Snowflake...  ...processing. Engineer Snowpipe and Kafka to Snowflake streaming ingestion pipelines... 
    Contract work
    Work experience placement
    Immediate start

    Artech

    Sunnyvale, CA
    4 days ago
  •  ...team: Our Heads of AI, Engineering, and Product bring...  ...We are looking for a Senior Data Engineer (AI Platform...  ...streaming systems (e.g., Kafka, Flink, Spark...  ...Milvus, Pinecone, Databricks Vector Search, FAISS...  ...Databricks, BigQuery, Snowflake Kubernetes, Ray (nice... 
    Databricks
    Senior

    Kai Cyber, Inc.

    San Jose, CA
    1 day ago
  • $160k - $200k

    Senior Data Engineer - Data Foundations page is loaded## Senior Data Engineer - Data Foundationslocations...  ....* Build ETL / ELT workflows in Databricks and ensure SLA-driven freshness and...  ...such as **Databricks Workflows**, dbt, Airflow, or similar.* Familiarity with external... 
    Databricks
    Senior

    Arlo Technologies, Inc.

    Milpitas, CA
    2 days ago
  •  ...TITLE: ML Data Infrastructure Engineer LOCATION: Sunnyvale CA or Remote Duration...  ..., BigQuery, Dataflow, Airflow ( Cloud composer), Vertext...  ...Experience with streaming systems (Kafka, Kinesis) • Experience...  ...• Experience with dbt or similar data transformation... 
    Senior
    Remote work

    Redolent

    Sunnyvale, CA
    4 days ago
  •  ...challenges around the world. We are seeking a Senior Data Engineer - Data Platform & Analytics (Snowflake, Kafka, React) on a contract basis to support our...  ...tools (Kafka, AWS, Spark/Flink, Airflow or alternatives, DBT, Terraform, CI/CD) Proficiency in React.js,... 
    Senior
    Contract work
    For contractors
    Remote work
    Flexible hours
    1 day per week

    BBG Ventures, LLC

    Sunnyvale, CA
    23 hours ago
  • $146.6k - $150k

    Job Summary As a Data Engineer II, you will design...  ...solutions such as Snowflake, BigQuery, Redshift...  ...experience with Databricks, AWS Glue, and transformation...  ...such as dbt, Dataform, or Databricks...  ...platforms such as Kafka, Kinesis, or...  ...orchestration tools such as Airflow, Dagster, or... 
    Databricks
    Apprenticeship

    McKinsey & Company

    Palo Alto, CA
    2 days ago
  • $129.4k - $212.3k

    # Senior Data Engineer## General MotorsPublished 28 Mar 2026## Role Highlights### Languages usedPythonSCALASQL###...  ...data streaming in Kubernetes and Kafka.\\+ Experience with cloud platforms...  ...file formats.\\+ Experience with Databricks, Snowflake, or similar platforms.\\+ Experience... 
    Databricks
    Senior
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Towards AI, Inc.

    Mountain View, CA
    4 days ago
  • $133k - $254k

     ...managing urban transportation operating system. Our AI Data Pipeline Engineers build up the core data processing pipelines and...  ...with data pipeline job orchestration with Databricks Workflows or Apache Airflow, as well as integrating data pipelines with machine... 
    Databricks
    Senior
    Full time
    Work experience placement

    42dot Inc.

    Sunnyvale, CA
    3 days ago
  • $203.3k - $305.6k

     ...Description The AI Data Engineer builds and maintains...  .../ELT processes using dbt, Fivetran, or similar...  ...cloud data platforms (Snowflake, Databricks, BigQuery, or similar...  ...tools (dbt, Fivetran, Airflow, or similar) Experience...  ...data architectures (Kafka or similar)... 
    Databricks
    Relocation package

    Apple Inc.

    Cupertino, CA
    4 days ago
  • $150k - $209k

     ...global enterprises like Snowflake, T-Mobile, and Pure...  ...SentinelOne, Databricks, and Google Cloud, and...  ...We work closely with Engineering, QE, and Customer Support...  ...build and maintain data infrastructure in...  ...ScyllaDB, Databricks, Kafka, Sentry, Dagster, Airflow, Vault, Consul, Kong... 
    Databricks
    Senior
    Remote job
    Work experience placement
    Work from home
    Flexible hours
    Shift work

    Obsidian Security

    Palo Alto, CA
    more than 2 months ago
  •  ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data architectures...  ...Hands-on experience with Spark, Kafka, and Airflow (or similar). ~ Strong...  ...on-call. ~ Experience with Snowflake, Databricks, Trino, OLAP/NRT systems, Superset... 
    Databricks

    Apolis

    Cupertino, CA
    4 days ago
  • $94.43k - $202.75k

    KPMG Careers is looking for a Senior Associate, Data Engineer, to join their Consulting practice in Santa Clara, California. The role involves technical...  ...and leading implementation of data solutions using Databricks. Candidates should have at least three years of... 
    Databricks
    Senior

    KPMG Careers

    Santa Clara, CA
    3 days ago
  • $159.2k - $301.6k

     ...The Opportunity Adobe is looking for a Senior Data Engineer - Data Products & AI to join our Adobe Unified Platform team, where...  ...with modern data platforms and tools, particularly Databricks, Azure, and Airflow, with a demonstrated ability to harness their full capabilities... 
    Databricks
    Senior
    Temporary work
    Local area
    Worldwide

    Adobe

    San Jose, CA
    3 days ago
  •  ...The Analytics Engineer will support data, automation, and AI initiatives focused on Revenue Cycle Management...  ..., production-grade data models using dbt in a modern cloud-based lakehouse...  ...with distributed data platforms such as Databricks, Spark, or equivalent. - Advanced... 
    Databricks
    Senior

    Insight Global

    San Jose, CA
    2 days ago
  •  ...Role: Data Engineer 3 Location: Hybrid, Santa Clara, CA Visa...  ...formats using tools like Snowflake, DBT, or Python. • Collaboration...  ...and frameworks such as Apache Airflow (DBT - Nice to Have) •...  ...data processing tools (e.g., Kafka, Spark) and batch data processing... 

    InterSources

    Santa Clara, CA
    1 day ago
  • $94.43k - $202.75k

     ...career at The Lighthouse. KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice. Responsibilities:...  ...workstream for implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, reporting and... 
    Databricks
    Senior
    Local area
    Visa sponsorship

    KPMG

    Santa Clara, CA
    18 hours ago
  • $77k - $202k

     ...Specialty/Competency: Data, Analytics & AI Industry/...  ...people in data and analytics engineering focus on leveraging...  ...architecture strategies. As a Senior Associate you analyze complex...  ...Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate]... 
    Databricks
    Senior
    Full time
    H1b

    PwC

    San Jose, CA
    3 days ago
  • $188.6k - $271.4k

     ...of patients worldwide. We’re a team of engineers, clinicians, and innovators united by one...  ...Function of Position We are seeking a Senior Data Engineer to join the software team...  ...Experience with managed platforms such as Databricks Knowledge of data quality, lineage, and... 
    Databricks
    Senior
    Local area
    Worldwide
    Shift work

    Intuitive Surgical, Inc.

    Sunnyvale, CA
    2 days ago
  •  ...Job Title: Senior Data Steward Analyst Location: Cupertino, CA - Onsite (Contract)...  ...Experience with data pipelines and platforms (Airflow, dbt, Spark or similar). Hands-on...  ...frameworks (DAMA-DMBOK). Cloud data platforms (Snowflake, Databricks, BigQuery).... 
    Databricks
    Senior
    Contract work

    eTeam

    Cupertino, CA
    3 days ago
  •  ...update from client for this data engineer role / Request-ID: 13145-1 _...  ...client UST. Looking for Senior Data Engineer with Spark, Scala...  ...Automate workflows using Apache Airflow. • Create data pipelines...  ...Apache Spark, Scala, Apache Kafka. • Provide ongoing maintenance... 
    Senior

    Texas State Library and Archives Commision

    Sunnyvale, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer (Snowflake | Databricks | Kafka | Airflow | dbt). Be the first to apply!