Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Pipeline Engineer

$150k - $250k
Full-time

cylake-inc

Your Impact

Join a small team building the next generation of cybersecurity products from the ground up. Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team. You will have the opportunity to grow your career and skills along with the company from the very start.

Role Overview

Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.

Required Experience

  • A proven track record of success architecting, building, and running large-scale data systems (PB scale)

  • Experience with both batch and real-time processing architectures

  • Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.

  • Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.

  • Understanding and experience with data transformation solutions

  • Excellent programming experience with Python

  • Strong communication and documentation skills

  • Experience with CSP data platforms is a plus

  • Understanding of data lineage, quality, and governance tooling is a plus

We offer competitive compensation and a comprehensive benefits package designed to support our employees’ health, well-being, and long-term success. The expected salary range for this position is $150,000 – $250,000 per year. Within this range, individual pay is determined based on job-related factors including skills, experience, qualifications, and internal equity. Most candidates can expect an offer within the range listed above. Your recruiter will provide additional details on compensation and benefits to qualified candidates during the hiring process.

We’re committed to building a diverse, inclusive workplace where everyone can do their best work. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. If you require a reasonable accommodation during the application or interview process, please let us know — we’re happy to support you.

This position requires access to information protected under U.S. export control laws and regulations, including the Export Administration Regulations (EAR) and the International Traffic in Arms Regulations (ITAR). Any offer of employment will be conditioned on authorization to receive software or technology controlled under these laws and regulations without sponsorship for an export license.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Pipeline Engineer in Sunnyvale, CA vacancy
  • $133k - $254k

     ...where everything is connected and moves autonomously through a self-managing urban transportation operating system. Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We... 
    Suggested
    Full time
    Work experience placement

    42dot

    Sunnyvale, CA
    5 days ago
  • $140k - $224.25k

    We are hiring a Senior Machine Learning Data Pipeline Engineer to invent and build the next generation of data pipelines for end-to-end autonomous driving foundation models. You will develop scalable pipelines and agentic workflows that help DNN teams proactively identify... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...Job Description Job Description Data Pipeline Engineer Updated Job Description Years of Experience 8 years of software development in data modeling, database design & optimization, scalable data pipelines for image/video (multimedia) data, and full-stack... 
    Suggested

    Mindlance

    Sunnyvale, CA
    22 days ago
  • Zipporin is seeking a talented Data Pipeline Automation Engineer to join our growing data platform team in San Jose, CA (hybrid). In this role, you will design, build, and optimize automated, mission-critical data pipelines that support analytics, machine learning, and... 
    Suggested
    Temporary work

    Zipporin

    San Jose, CA
    10 days ago
  • $170.6k

     ...The Role and Impact As an AI Software Engineering PhD Intern, you will contribute to the design...  ...for designing and implementing data-driven solutions that optimize tool capacity...  ...-You will build robust cloud-based ETL pipelines, develop predictive models, deliver actionable... 
    Suggested
    Internship
    Local area
    Immediate start
    Worldwide
    Shift work

    Intel

    Santa Clara, CA
    3 days ago
  • $206.3k - $388k

    ABOUT THE ROLEWe're looking for a Principal ML Engineer to drive down cost per asset and drive up throughput across the ML pipelines behind Adobe's multimodal foundation models...  ...billions of raw assets into training-ready data, making it faster and cheaper without... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    3 days ago
  • $106k - $198k

     ..., USA Posted: 2026-09-23 Job Family: Technical Professional - Engineers Pay Type: Salary Founded in 1919, KJ has always looked to the...  ...solutions. Kennedy Jenks is seeking an experienced and proactive Pipeline Engineer for our California office to support water and... 
    Contract work
    Work at office
    Work from home
    2 days per week

    Kennedy Jenks

    Santa Clara, CA
    2 days ago
  •  ...that quantify driving performance, the pipelines that compute them at fleet scale, the analysis...  ...on the map that behavior changes — the data and tooling that gate software releases,...  ...and LLM-powered automation. We welcome engineers from data engineering, analytics,... 

    PlusAI

    Santa Clara, CA
    9 days ago
  • RESPONSIBILITIES: A client with Kforce is seeking a Data Engineer II to join their team in Mountain View, CA. Responsibilities:...  ...Strong hands-on experience building and maintaining scalable data pipelines using SQL, PySpark, and Hive in big data environments *... 
    Hourly pay
    Contract work
    Work experience placement

    Kforce Technology Staffing

    Mountain View, CA
    49 minutes ago
  • $72.96k - $115.2k

     ...What this Job Entails The Data Center Engineer III will be heavily involved in the design of the datacenter collocations, infrastructure hardware, and provide technical consultations. The incumbent will build/create all drawings for datacenter POP’s and develop/write... 
    Temporary work
    Work at office
    Flexible hours

    Astreya Partners

    Cupertino, CA
    13 hours ago
  • $184.7k - $324.8k

     ...keep making our products better. Apple Services Engineering's Device Compute Analytics team provides the data foundation for Apple's internal device cloud, which...  ...timely, and easy to explore. You will build the pipelines and table designs that power forecasting, capacity... 
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $115k - $165k

     ...development company delivering cloud, AI, data, and enterprise solutions across the...  ...professional growth. Job Title: Data Engineer Location: Remote Position Type:...  ...Responsibilities ~ Develop and maintain data pipelines, transformations, reports, models, or... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Sunnyvale, CA
    4 days ago
  • $135k - $180k

     ...teams. Responsibilities Create and maintain optimal data processing pipeline architecture Build the infrastructure required for optimal...  ...sets Work with stakeholders including the Executive, Engineering, and Operation teams to assist with data-related technical... 

    PlusAI, Inc.

    Santa Clara, CA
    5 days ago
  •  ...Data Engineer II Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer II for one of our client. Role: Data Engineer II Location: Santa Clara, CA Duration: Long Term... 

    Rootshell Inc

    Santa Clara, CA
    5 days ago
  •  ...Expertise in SQL: You possess a deep understanding of SQL for data manipulation, querying, and performance optimization across various...  ...in Python: Your Python skills are crucial for building data pipelines, automating tasks, and integrating with various data sources and... 

    Yochana

    Sunnyvale, CA
    5 days ago
  •  ...Role : Senior Data Engineer - GCP Location : Mountain View CA (Onsite) What you'll do Develop and enhance Python...  ...Design, build, and maintain scalable and efficient data pipelines on GCP. Implement robust monitoring, logging, and alerting... 

    United IT Solutions

    Mountain View, CA
    4 days ago
  •  ...Sterling B2B Developer Role: Senior Data Engineer Location: Dallas, TX or Mountain View, CA Duration: Long Term Contract As...  ...Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse, and analytics systems,... 
    Long term contract

    Hermitage Infotech

    Mountain View, CA
    5 days ago
  • $184.7k - $324.8k

     ...Because when advertising is done right, it benefits everyone. The Data Products Engineering team is seeking versatile data engineers to build, extend, and operate the near-real-time and batch pipelines at the heart of Apple Ads, and to help design and improve them as you... 
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • $75 - $85 per hour

     ...Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description: This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations... 
    Full time
    Contract work

    Pinnacle Group

    Cupertino, CA
    5 days ago
  •  ...Job Title: Data Engineer Location: Mountain View, CA & Dallas, TX (Onsite) You Must Have ~ BS in Computer Science/Engineering, relevant technical field, or equivalent practical experience, with specialization in Data Engineering ~ Exp with (Big Data... 
    Local area

    Quantum Technologies USA

    Mountain View, CA
    4 days ago
  •  ...Data Engineer Location: Austin, TX/Sunnyvale, CA Job Description We are seeking an experienced Data Engineer with proven, hands...  ...for automation of migration tasks. ~ Experience with CI/CD pipelines and version control (Git) for schema/code management. ~ Strong... 

    Futran Tech Solutions Pvt. Ltd.

    Sunnyvale, CA
    2 days ago
  •  ...Data EngineerAt Versa Networks, we're revolutionizing the way businesses connect, secure, and optimize...  ....Job SummaryWe're seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In... 

    Versa Networks

    Santa Clara, CA
    1 day ago
  •  ...professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current...  ...responsible for designing, developing, and optimizing data pipelines and ETL processes, building data models, and enabling data-... 

    Rootshell Enterprise Technologies

    Santa Clara, CA
    4 days ago
  •  ...across the U.S. and Asia. GMI Cloud is looking for a Senior Data Engineer to own the data flows behind our AI inference platform. Every...  ...be the technical owner of the data platform: you design the pipelines, define the data models, set the quality bar, and keep long-... 

    GMI Cloud

    Mountain View, CA
    5 days ago
  • $150k

     ...foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges...  ..., LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies.... 

    Institute of Foundation Models

    Sunnyvale, CA
    5 days ago
  •  ...Responsible for developing, refactoring, and optimizing real-time data processing applications using Apache Flink. Developing,...  ...processing applications using Apache Spark. Migrating real-time data pipelines to isolated Kafka infrastructure and coordinating migration... 
    Contract work

    Motion Recruitment

    Mountain View, CA
    2 days ago
  •  ...Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and...  ...responsible for designing, building, and maintaining scalable data pipelines and systems to support our organization's data needs. This... 
    Full time
    Contract work

    Pinnacle Group

    Sunnyvale, CA
    5 days ago
  •  ...Data EngineerAccenture Flex offers you the flexibility of local fixed-duration project...  ...eliminating the demands to travel.As a Data Engineer you will be responsible for designing,...  ...day activities will include creating data pipelines, ensuring data quality, and implementing... 
    Hourly pay
    Work at office
    Local area
    Flexible hours

    Hackajob

    Mountain View, CA
    5 days ago
  • $143.1k - $186.83k

     ...a legal entity. Responsibilities Atlassian is looking for a Data Engineer to join our Data Engineering team and build world-class data...  ...The data engineering team manages several data models and data pipelines across Atlassian, including finance, growth, product analysis... 
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    3 days ago
  •  ...08 Reference 26-07957 Remote 100% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary: We are seeking an experienced...  ...Data Engineer. This role is focused on building robust data pipelines, primarily involving the integration of data from various... 
    Contract work
    Remote work

    Mindlance

    Sunnyvale, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Pipeline Engineer. Be the first to apply!