Senior Data Engineering Architect - Spark & Cloud Pipelines
Quantum Technologies USA
A technology company based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves collaborating with data scientists to deliver data-driven solutions while ensuring data integrity and quality across systems. This position offers a competitive salary and is inclusive of diverse candidates. #J-18808-Ljbffr Quantum Technologies USA
- ...based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves...PipelineCloudSenior
- ...Sr GCP Data Engineer with Spark, Python Bentonville, AR (Day 1 Onsite) Long Term Location: This... ...experience ~ Experience building data pipelines in GCP ~ GCP Dataproc, GCS &... ...areas covering Artificial Intelligence, Cloud Migration, Custom Software Development...PipelineCloudSenior
- JPMorgan Chase & Co. is seeking a Data Architect III in Palo Alto, CA. In this role, you will develop... ...expertise in AWS, Databricks, and data pipeline orchestration to lead projects and... ...PySpark and Scala, and familiarity with cloud technologies. This position ensures a pivotal...PipelineCloudSenior
- ...TITLE: ML Data Infrastructure Engineer LOCATION: Sunnyvale CA or Remote Duration... ..., Dataflow, Airflow ( Cloud composer), Vertext AI , Datapipeline... ...scalable data processing pipelines for ML training and ~... ...) ~ o Dataproc for Spark workloads Deep...PipelineCloudSeniorRemote work
- ...Role : Senior Data Engineer - GCP Location : Mountain View CA (Onsite... ...scalable and efficient data pipelines on GCP. Implement... ...executor framework on Google Cloud Platform Building data... ...such as TensorFlow, Apache Spark, and scikit-learn. Bachelor...PipelineCloudSenior
- ...A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates...PipelineCloudSenior
- ...planning and implementation of data design services,... ...data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect,... ...will design and build data pipelines, data streams, data service... ...: Azure HDInsight with Spark, Azure Stream Analytics,...PipelineCloudSenior
- ...Scala Engineer We are looking for Scala Engineers with experience... ...or streaming jobs. We utilize Spark for batch jobs and Flink for real... ...with infrastructure and data teams to produce complex analysis... ...Knowledge and experience with cloud-based technologies Experience...CloudSenior
- ...Senior Data Engineer (Spark, Python, AWS) Location: Mountain View California (100% Onsite) Duration: 6+ Months Job Description: Skills... ...and real time processing of huge records. Develop data pipelines, deploy & configure components to production. Improve...PipelineSenior
$188.6k - $271.4k
...worldwide. We’re a team of engineers, clinicians, and... ...Position We are seeking a Senior Data Engineer to join the... ...build, and scale data pipelines and datasets that... ...engineering frameworks (e.g., Spark, Flink) Experience... ...Experience with cloud data platforms (AWS or...PipelineCloudSeniorLocal areaWorldwideShift work$133k - $254k
...transportation operating system. Our AI Data Pipeline Engineers build up the core data processing... ...deployment, as well as monitoring in the cloud environment. Responsibilities Develop high... ...g., Delta Lake) Experience with Apache Spark or other big data computing engines Excellent...PipelineCloudSeniorWork experience placement- ...A technology firm is seeking a skilled Back-End Engineer with a strong focus on data engineering to design and maintain data pipelines and back-end systems. The successful candidate will work with technologies like Spark, Python, and AWS. Responsibilities include writing...PipelineSenior
- ...Summary... The Catalog Data Science team at... ...Learning, and Engineering. We tackle complex... ...model services and pipelines, and pushing the boundaries... ...at Walmart. As a Senior Data Scientist (... ...frameworks (Ray, Spark) Experience... ...at least one major cloud platform (GCP, Azure...PipelineCloudSenior
$125k - $198.4k
...development, and maintenance of data platforms for... ...technology. The Role Senior Data Engineer to join our Autonomous... ..., manage and own data pipelines to collect, cleanse,... ...functional projects. Use cloud technologies to design... ...as Apache Hadoop, Spark, or Kafka for processing...PipelineCloudSeniorLocal areaFlexible hours$120.75k - $251.25k
...write mobile app code, engineer the servers behind our... ...us process trillions of data points a day, what you... ...working on data engineering pipelines and next‑generation... ...experience with Google Cloud Platform (BiqQuery, Dataproc... ..., Pig, Hive, HBase, Spark, Kafka, Oozie, etc.)...PipelineCloudSeniorWork at officeFlexible hours$129.4k - $212.3k
# Senior Data Engineer## General MotorsPublished 28 Mar 2026## Role... ...and maintaining data pipelines, databases and data... ...data infrastructure architects and data consumption... ...distributed data processing (Spark) and container... ....\\+ Experience with cloud platforms Azure preferred...PipelineCloudSeniorContract workH1bLocal areaRemote workRelocationRelocation packageFlexible hours- ...NVIDIA Gruppe is looking for a Senior Data Engineer in Santa Clara, California. This role involves architecting the financial infrastructure for NVIDIA Cloud Services. You'll play a vital role in creating scalable cloud services integrated with financial systems. The...PipelineCloudSenior
$143k - $286k
...dashboards or static pipelines; we are building... ...experience. As the Senior Engineering Manager for Agentic Data, you will be at the... ...managing a team; you are architecting the bridge between... ...Streams, Flink, or Spark Streaming).... ...LlamaIndex, CrewAI). Cloud Scale Mastery: Proven...PipelineCloudSeniorPermanent employmentFull timeTemporary workPart timeFlexible hours- ...protect how people, data, and AI agents... ...connect across email, cloud, and... ...seeking an experienced Senior Architect to lead the design... ...event processing pipelines . This role is critical... ...Data Platform Engineering Architect real‑... ...frameworks (e.g., Flink, Spark, Beam) Ensure...PipelineCloudSeniorFlexible hours
- ...leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and... ...analytical datasets, building robust data pipelines, and collaborating with product managers to...PipelineCloudSeniorRemote work
- ...world. We are seeking a Senior Data Engineer - Data Platform &... ...needs. Responsibilities Architect, develop, and maintain scalable data pipelines for real‑time and batch... ...and contracts across cloud and edge/manufacturing... ...orchestration tools (Kafka, AWS, Spark/Flink, Airflow or...PipelineCloudSeniorContract workFor contractorsRemote workFlexible hours1 day per week
- ...California, is seeking an architect for enterprise-scale CMDB... ...15 years of software engineering experience and deep expertise in designing data-intensive backend systems and ETL pipelines. This role includes responsibilities... ..., CI/CD, Kubernetes, and cloud platforms is essential to...PipelineCloudSenior
- ...Overview: We are seeking an experienced Senior Data Engineer with at least 8 years of industry... ..., and manage robust, scalable data pipelines and workflows using Python and Snowflake... ...applications. ~ Experience with cloud platforms (e.g., AWS, Azure, GCP) for...PipelineCloudSenior
$254k - $349.25k
...protect how people, data, and AI agents... ...connect across email, cloud, and... ...an experienced Senior Architect to lead the design... ...event processing pipelines . This role is... ...Data Platform Engineering Architect real... ...frameworks (e.g., Flink, Spark, Beam) Ensure alignment...PipelineCloudSeniorFlexible hours$60 - $65 per hour
...Skills: SQL (advanced), Big Data technologies (advanced), Data pipeline development (advanced),... ...an experienced Data Engineer to design, build, and maintain... ...such as Hadoop, Hive, Spark, or similar distributed processing... ...data pipelines in cloud and enterprise environments...PipelineCloudSeniorHourly payContract work- ...Inc. in Mountain View is seeking a Senior Data Engineer to architect and build scalable systems that fuel... ...ontologies, develop high-reliability data pipelines, and optimize existing... ...candidate has strong experience in SQL, cloud services, and building ETL/ELT systems...PipelineCloudSeniorFlexible hours
- ...in Mountain View is looking for experienced Data Engineers to optimize data infrastructures for... ...extensive experience with technologies like Google Cloud Platform and Hadoop. This role involves designing effective data pipelines, improving data quality, and supporting...PipelineCloudSenior
- ...leading AI lab is seeking a deeply experienced Data Architect to own the data practice. This role focuses on... ...+ years in data architecture, strong skills in cloud technologies, and ability to design scalable data pipelines. If you are passionate about data quality and leading...PipelineCloudSenior
- ...leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services...PipelineCloudSenior
- ...applications in the world? iCloud Data organization enables... ...for exceptional data engineers who have a strong... ...adaptable and scalable data pipelines to process structured... ...working with Spark and other distributed data... ...Conceptually familiar with AWS cloud resources (S3, EC2, RDS...PipelineCloudSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineering Architect - Spark & Cloud Pipelines. Be the first to apply!
- senior data center engineer Sunnyvale, CA
- data engineer manager Sunnyvale, CA
- data science developer Sunnyvale, CA
- etl data engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- data engineer Sunnyvale, CA
- big data cloud engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- remote data engineer Sunnyvale, CA
- senior data engineer Sunnyvale, CA

