Senior Data Engineering Architect - Spark & Cloud Pipelines
Quantum Technologies USA
A technology company based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves collaborating with data scientists to deliver data-driven solutions while ensuring data integrity and quality across systems. This position offers a competitive salary and is inclusive of diverse candidates. #J-18808-Ljbffr Quantum Technologies USA
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineering Architect - Spark & Cloud Pipelines in Sunnyvale, CA vacancy
- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...PipelineCloudSenior
- A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates...PipelineCloudSenior
- Overview We are seeking a talented Senior Data Engineer in India. The right... ...maintain batch or real‑time data pipelines in production. Maintain and... ...and data science teams on cloud platforms (e.g., AWS, Azure,... ...solutions - Databricks, Apache Spark. Experience working with...PipelineCloudSenior
- ...and libraries to support data processing, quality,... ...scalable and efficient data pipelines on GCP. Implement... ...executor framework on Google Cloud Platform Design our... ...to shared Data Engineering tooling & standards to... ...as TensorFlow, Apache Spark, and scikit-learn. Bachelor...PipelineCloudSeniorPermanent employmentContract workLocal area
- ...planning and implementation of data design services,... ...data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect,... ...will design and build data pipelines, data streams, data service... ...: Azure HDInsight with Spark, Azure Stream Analytics,...PipelineCloudSenior
$182k - $242k
CoreWeave is The Essential Cloud for AI™. Built for... .... What You’ll Do The Data Engineering Team builds and... ...design resilient data pipelines, scalable lakehouse systems... ...Role We're seeking a Senior Data Engineer to design... ...processing systems using Spark, Flink, or similar...PipelineCloudSeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$125k - $198.4k
...development, and maintenance of data platforms for... ...technology. The Role Senior Data Engineer to join our Autonomous... ..., manage and own data pipelines to collect, cleanse,... ...functional projects. Use cloud technologies to design... ...as Apache Hadoop, Spark, or Kafka for processing...PipelineCloudSeniorLocal areaFlexible hours$120.75k - $251.25k
...write mobile app code, engineer the servers behind our... ...us process trillions of data points a day, what you... ...working on data engineering pipelines and next‑generation... ...experience with Google Cloud Platform (BiqQuery, Dataproc... ..., Pig, Hive, HBase, Spark, Kafka, Oozie, etc.)...PipelineCloudSeniorWork at officeFlexible hours$172.1k - $305.6k
Senior Data Engineer — Music Services Operations Analytics & Strategy... ...Data Engineer to architect and deploy the robust, AI‑ready data pipelines that serve as the foundation... ...(e.g., PySpark/Spark), modular software design... ...Iceberg, Delta Lake), cloud‑native data systems,...PipelineCloudSeniorRelocation$129.4k - $212.3k
# Senior Data Engineer## General MotorsPublished 28 Mar 2026## Role... ...and maintaining data pipelines, databases and data... ...data infrastructure architects and data consumption... ...distributed data processing (Spark) and container... ....\\+ Experience with cloud platforms Azure preferred...PipelineCloudSeniorContract workH1bLocal areaRemote workRelocationRelocation packageFlexible hours$133k - $254k
...transportation operating system. Our AI Data Pipeline Engineers build up the core data processing... ...deployment, as well as monitoring in the cloud environment. Responsibilities Develop... ...., Delta Lake) Experience with Apache Spark or other big data computing engines Excellent...PipelineCloudSeniorWork experience placement- A technology firm is seeking a skilled Back-End Engineer with a strong focus on data engineering to design and maintain data pipelines and back-end systems. The successful candidate will work with technologies like Spark, Python, and AWS. Responsibilities include writing...PipelineSenior
- Namely is looking for a talented Senior Data Engineer based in California to design, build, and maintain complex data pipelines. The role requires strong SQL skills, proficiency in... ...tools like Airflow, and experience with cloud data solutions. Candidates should have a proven...PipelineCloudSenior
$185k - $230k
Cacheflow is seeking a Senior Data Engineer to enhance our Data Platform team. You'll design and... ...responsibilities include creating data models, pipelines, and promoting best practices for data... ...skills in Python, and excels with cloud data solutions. Salary range is $185,0...PipelineCloudSenior- NVIDIA Gruppe is looking for a Senior Data Engineer in Santa Clara, California. This role involves architecting the financial infrastructure for NVIDIA Cloud Services. You'll play a vital role in creating scalable cloud services integrated with financial systems. The ideal...PipelineCloudSenior
- ...leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services...PipelineCloudSenior
- ...in Mountain View is looking for experienced Data Engineers to optimize data infrastructures for... ...extensive experience with technologies like Google Cloud Platform and Hadoop. This role involves designing effective data pipelines, improving data quality, and supporting...PipelineCloudSenior
- COMFORT SYSTEMS seeks a Senior Data Engineer in Sunnyvale to design and maintain scalable data pipelines for critical business insights. This role requires SQL expertise and familiarity with cloud platforms like Snowflake and Azure. Responsibilities include ensuring data...PipelineCloudSenior
- ...leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and... ...analytical datasets, building robust data pipelines, and collaborating with product managers to...PipelineCloudSeniorRemote job
$129.4k - $212.3k
Towards AI, Inc. is hiring a Senior Data Engineer to join their Marketing Applied Sciences team.... ...involves designing and maintaining data pipelines, collaborating with data scientists,... ...technologies such as Python, SQL, and cloud platforms. Competitive salary range is...PipelineCloudSeniorRemote job- ...protect how people, data, and AI agents... ...connect across email, cloud, and... ...seeking an experienced Senior Architect to lead the design... ...event processing pipelines . This role is critical... ...Data Platform Engineering Architect real‑... ...(e.g., Flink, Spark, Beam) Ensure alignment...PipelineCloudSeniorFlexible hours
- Crusoe in Sunnyvale, CA is seeking a Data Integration Engineer to build data pipelines and integrations for construction-related datasets. This role involves... ...relevant degree and has significant experience with cloud solutions, data modeling, and integration tools. Crusoe...PipelineCloudSenior
$147k - $178k
Epoch Biodesign is seeking a Data Integration Engineer in Sunnyvale, CA to design and maintain scalable data pipelines. You will play a crucial role in data-driven decision-making... ...+ years of experience in data integration, cloud-based data warehousing, and relevant tools...PipelineCloudSenior$174k
...Overview: Ads data platform team... ...build the data engine behind Coupang... ...our ads-serving pipeline. We’re looking... ...Will Do: Architect and scale high... ...Experience working in cloud environments,... ...with Spark, Hive, Redis, Kafka... ...The base pay for Senior Staff position...PipelineCloudSeniorTemporary workFlexible hoursCoupang
Mountain View, CA2 days ago$83.98 - $111.27 per hour
...a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering... ...our enterprise data pipelines and platforms, and for partnering... ...technical roadmap for our cloud-based data platforms (e.g.... ...data technologies (e.g., Spark, Kafka) and workflow...PipelineCloudSeniorHourly payStanford Health Care
Palo Alto, CA2 days ago- ...working world. Technology - Data and Decision Science - Data Engineering - Senior We are seeking a highly... ...with expertise in cloud data engineering, specifically... .... Lead end-to-end data pipeline development, including... ...Databricks and experience with Spark for big data processing....PipelineCloudSenior
- ...We are seeking a **Senior Data Engineer** to design, build, and scale modern cloud-native data platforms supporting real-time... ...expertise in **Snowflake, Databricks, Spark, Kafka, Airflow, and dbt**,... ...experience building reliable pipelines handling **multi-TB datasets and...PipelineCloudSeniorFull time
$175k - $200k
...looking for a motivated Senior Data Engineer to contribute towards... .... Responsibilities Architect, design, develop and... ...end-to-end data pipelines across multiple data... ...Work closely with the cloud service providers to... ...Scala with Databricks/Spark Experience in NoSQL...PipelineCloudSeniorWork experience placement$117k - $234k
Position Summary As a Senior Data Engineer, you will design, develop, and maintain scalable data pipelines and models that support critical business decisions. Leveraging expertise... ...data accessibility and reliability within cloud and big data environments. This role demands...PipelineCloudSenior$179k - $223.8k
...generations. Role Summary We are seeking Senior Data Engineers to play a pivotal role in the... ...you will take ownership of the data pipelines and curation strategies that fuel our... ...distributed data processing frameworks (e.g., Spark, Ray) and cloud infrastructure. Solid understanding...PipelineCloudSeniorFull timeTemporary workPart timeLocal areaShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineering Architect - Spark & Cloud Pipelines. Be the first to apply!
Related searches
- senior cloud data engineer Sunnyvale, CA
- principal data engineer Sunnyvale, CA
- finance data engineer Sunnyvale, CA
- aws data engineer Sunnyvale, CA
- data engineer Sunnyvale, CA
- sr data engineer Sunnyvale, CA
- software data engineer Sunnyvale, CA
- junior data engineer remote Sunnyvale, CA
- remote data engineer Sunnyvale, CA
- data visualization developer Sunnyvale, CA