Data Pipeline Engineer
$150k - $250kcylake-inc
Your Impact
Join a small team building the next generation of cybersecurity products from the ground up. Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team. You will have the opportunity to grow your career and skills along with the company from the very start.
Role Overview
Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.
Required Experience
A proven track record of success architecting, building, and running large-scale data systems (PB scale)
Experience with both batch and real-time processing architectures
Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.
Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.
Understanding and experience with data transformation solutions
Excellent programming experience with Python
Strong communication and documentation skills
Experience with CSP data platforms is a plus
Understanding of data lineage, quality, and governance tooling is a plus
We offer competitive compensation and a comprehensive benefits package designed to support our employees’ health, well-being, and long-term success. The expected salary range for this position is $150,000 – $250,000 per year. Within this range, individual pay is determined based on job-related factors including skills, experience, qualifications, and internal equity. Most candidates can expect an offer within the range listed above. Your recruiter will provide additional details on compensation and benefits to qualified candidates during the hiring process.
We’re committed to building a diverse, inclusive workplace where everyone can do their best work. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. If you require a reasonable accommodation during the application or interview process, please let us know — we’re happy to support you.
This position requires access to information protected under U.S. export control laws and regulations, including the Export Administration Regulations (EAR) and the International Traffic in Arms Regulations (ITAR). Any offer of employment will be conditioned on authorization to receive software or technology controlled under these laws and regulations without sponsorship for an export license.
$133k - $254k
...where everything is connected and moves autonomously through a self-managing urban transportation operating system. Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We...SuggestedFull timeWork experience placement$140k - $224.25k
We are hiring a Senior Machine Learning Data Pipeline Engineer to invent and build the next generation of data pipelines for end-to-end autonomous driving foundation models. You will develop scalable pipelines and agentic workflows that help DNN teams proactively identify...SuggestedFull time- ...Job Description Job Description Data Pipeline Engineer Updated Job Description Years of Experience 8 years of software development in data modeling, database design & optimization, scalable data pipelines for image/video (multimedia) data, and full-stack...Suggested
- Zipporin is seeking a talented Data Pipeline Automation Engineer to join our growing data platform team in San Jose, CA (hybrid). In this role, you will design, build, and optimize automated, mission-critical data pipelines that support analytics, machine learning, and...SuggestedTemporary work
$170.6k
...The Role and Impact As an AI Software Engineering PhD Intern, you will contribute to the design... ...for designing and implementing data-driven solutions that optimize tool capacity... ...-You will build robust cloud-based ETL pipelines, develop predictive models, deliver actionable...SuggestedInternshipLocal areaImmediate startWorldwideShift work$206.3k - $388k
ABOUT THE ROLEWe're looking for a Principal ML Engineer to drive down cost per asset and drive up throughput across the ML pipelines behind Adobe's multimodal foundation models... ...billions of raw assets into training-ready data, making it faster and cheaper without...Full timeTemporary workLocal areaWorldwide$106k - $198k
..., USA Posted: 2026-09-23 Job Family: Technical Professional - Engineers Pay Type: Salary Founded in 1919, KJ has always looked to the... ...solutions. Kennedy Jenks is seeking an experienced and proactive Pipeline Engineer for our California office to support water and...Contract workWork at officeWork from home2 days per week- ...that quantify driving performance, the pipelines that compute them at fleet scale, the analysis... ...on the map that behavior changes — the data and tooling that gate software releases,... ...and LLM-powered automation. We welcome engineers from data engineering, analytics,...
- RESPONSIBILITIES: A client with Kforce is seeking a Data Engineer II to join their team in Mountain View, CA. Responsibilities:... ...Strong hands-on experience building and maintaining scalable data pipelines using SQL, PySpark, and Hive in big data environments *...Hourly payContract workWork experience placement
$72.96k - $115.2k
...What this Job Entails The Data Center Engineer III will be heavily involved in the design of the datacenter collocations, infrastructure hardware, and provide technical consultations. The incumbent will build/create all drawings for datacenter POP’s and develop/write...Temporary workWork at officeFlexible hours$184.7k - $324.8k
...keep making our products better. Apple Services Engineering's Device Compute Analytics team provides the data foundation for Apple's internal device cloud, which... ...timely, and easy to explore. You will build the pipelines and table designs that power forecasting, capacity...Relocation$115k - $165k
...development company delivering cloud, AI, data, and enterprise solutions across the... ...professional growth. Job Title: Data Engineer Location: Remote Position Type:... ...Responsibilities ~ Develop and maintain data pipelines, transformations, reports, models, or...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship$135k - $180k
...teams. Responsibilities Create and maintain optimal data processing pipeline architecture Build the infrastructure required for optimal... ...sets Work with stakeholders including the Executive, Engineering, and Operation teams to assist with data-related technical...- ...Data Engineer II Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer II for one of our client. Role: Data Engineer II Location: Santa Clara, CA Duration: Long Term...
- ...Expertise in SQL: You possess a deep understanding of SQL for data manipulation, querying, and performance optimization across various... ...in Python: Your Python skills are crucial for building data pipelines, automating tasks, and integrating with various data sources and...
- ...Role : Senior Data Engineer - GCP Location : Mountain View CA (Onsite) What you'll do Develop and enhance Python... ...Design, build, and maintain scalable and efficient data pipelines on GCP. Implement robust monitoring, logging, and alerting...
- ...Sterling B2B Developer Role: Senior Data Engineer Location: Dallas, TX or Mountain View, CA Duration: Long Term Contract As... ...Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse, and analytics systems,...Long term contract
$184.7k - $324.8k
...Because when advertising is done right, it benefits everyone. The Data Products Engineering team is seeking versatile data engineers to build, extend, and operate the near-real-time and batch pipelines at the heart of Apple Ads, and to help design and improve them as you...Relocation$75 - $85 per hour
...Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description: This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations...Full timeContract work- ...Job Title: Data Engineer Location: Mountain View, CA & Dallas, TX (Onsite) You Must Have ~ BS in Computer Science/Engineering, relevant technical field, or equivalent practical experience, with specialization in Data Engineering ~ Exp with (Big Data...Local area
- ...Data Engineer Location: Austin, TX/Sunnyvale, CA Job Description We are seeking an experienced Data Engineer with proven, hands... ...for automation of migration tasks. ~ Experience with CI/CD pipelines and version control (Git) for schema/code management. ~ Strong...
- ...Data EngineerAt Versa Networks, we're revolutionizing the way businesses connect, secure, and optimize... ....Job SummaryWe're seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In...
- ...professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current... ...responsible for designing, developing, and optimizing data pipelines and ETL processes, building data models, and enabling data-...
- ...across the U.S. and Asia. GMI Cloud is looking for a Senior Data Engineer to own the data flows behind our AI inference platform. Every... ...be the technical owner of the data platform: you design the pipelines, define the data models, set the quality bar, and keep long-...
$150k
...foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges... ..., LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies....- ...Responsible for developing, refactoring, and optimizing real-time data processing applications using Apache Flink. Developing,... ...processing applications using Apache Spark. Migrating real-time data pipelines to isolated Kafka infrastructure and coordinating migration...Contract work
- ...Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and... ...responsible for designing, building, and maintaining scalable data pipelines and systems to support our organization's data needs. This...Full timeContract work
- ...Data EngineerAccenture Flex offers you the flexibility of local fixed-duration project... ...eliminating the demands to travel.As a Data Engineer you will be responsible for designing,... ...day activities will include creating data pipelines, ensuring data quality, and implementing...Hourly payWork at officeLocal areaFlexible hours
$143.1k - $186.83k
...a legal entity. Responsibilities Atlassian is looking for a Data Engineer to join our Data Engineering team and build world-class data... ...The data engineering team manages several data models and data pipelines across Atlassian, including finance, growth, product analysis...Work at officeLocal area- ...08 Reference 26-07957 Remote 100% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary: We are seeking an experienced... ...Data Engineer. This role is focused on building robust data pipelines, primarily involving the integration of data from various...Contract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Pipeline Engineer. Be the first to apply!
- junior data engineer remote Sunnyvale, CA
- principal data engineer Sunnyvale, CA
- data engineer analytics Sunnyvale, CA
- data science developer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- data center engineer Sunnyvale, CA
- staff data engineer Sunnyvale, CA
- big data cloud engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- remote data engineer Sunnyvale, CA





