Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineering Architect - Spark & Cloud Pipelines

Quantum Technologies USA

A technology company based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves collaborating with data scientists to deliver data-driven solutions while ensuring data integrity and quality across systems. This position offers a competitive salary and is inclusive of diverse candidates. #J-18808-Ljbffr Quantum Technologies USA

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineering Architect - Spark & Cloud Pipelines in Sunnyvale, CA vacancy
  •  ...based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves... 
    Pipeline
    Cloud
    Senior

    Quantum Technologies USA

    Sunnyvale, CA
    1 day ago
  •  ...Sr GCP Data Engineer with Spark, Python Bentonville, AR (Day 1 Onsite) Long Term Location: This...  ...experience ~ Experience building data pipelines in GCP ~ GCP Dataproc, GCS &...  ...areas covering Artificial Intelligence, Cloud Migration, Custom Software Development... 
    Pipeline
    Cloud
    Senior

    InterSources

    Sunnyvale, CA
    4 days ago
  • JPMorgan Chase & Co. is seeking a Data Architect III in Palo Alto, CA. In this role, you will develop...  ...expertise in AWS, Databricks, and data pipeline orchestration to lead projects and...  ...PySpark and Scala, and familiarity with cloud technologies. This position ensures a pivotal... 
    Pipeline
    Cloud
    Senior

    JPMorgan Chase & Co.

    Palo Alto, CA
    17 hours ago
  •  ...TITLE: ML Data Infrastructure Engineer LOCATION: Sunnyvale CA or Remote Duration...  ..., Dataflow, Airflow ( Cloud composer), Vertext AI , Datapipeline...  ...scalable data processing pipelines for ML training and ~...  ...) ~ o Dataproc for Spark workloads Deep... 
    Pipeline
    Cloud
    Senior
    Remote work

    Redolent

    Sunnyvale, CA
    2 days ago
  •  ...Role : Senior Data Engineer - GCP Location : Mountain View CA (Onsite...  ...scalable and efficient data pipelines on GCP. Implement...  ...executor framework on Google Cloud Platform Building data...  ...such as TensorFlow, Apache Spark, and scikit-learn. Bachelor... 
    Pipeline
    Cloud
    Senior

    United IT Solutions

    Mountain View, CA
    3 days ago
  •  ...A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates... 
    Pipeline
    Cloud
    Senior

    Cloud Analytics Technologies, LLC

    Sunnyvale, CA
    1 day ago
  •  ...planning and implementation of data design services,...  ...data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect,...  ...will design and build data pipelines, data streams, data service...  ...: Azure HDInsight with Spark, Azure Stream Analytics,... 
    Pipeline
    Cloud
    Senior

    NutaNXT Technologies

    Santa Clara, CA
    17 hours ago
  •  ...Scala Engineer We are looking for Scala Engineers with experience...  ...or streaming jobs. We utilize Spark for batch jobs and Flink for real...  ...with infrastructure and data teams to produce complex analysis...  ...Knowledge and experience with cloud-based technologies Experience... 
    Cloud
    Senior

    Omega Solutions Inc

    Mountain View, CA
    4 days ago
  •  ...Senior Data Engineer (Spark, Python, AWS) Location: Mountain View California (100% Onsite) Duration: 6+ Months Job Description: Skills...  ...and real time processing of huge records. Develop data pipelines, deploy & configure components to production. Improve... 
    Pipeline
    Senior

    Zortech Solutions

    Mountain View, CA
    4 days ago
  • $188.6k - $271.4k

     ...worldwide. We’re a team of engineers, clinicians, and...  ...Position We are seeking a Senior Data Engineer to join the...  ...build, and scale data pipelines and datasets that...  ...engineering frameworks (e.g., Spark, Flink) Experience...  ...Experience with cloud data platforms (AWS or... 
    Pipeline
    Cloud
    Senior
    Local area
    Worldwide
    Shift work

    Intuitive Surgical, Inc.

    Sunnyvale, CA
    17 hours ago
  • $133k - $254k

     ...transportation operating system. Our AI Data Pipeline Engineers build up the core data processing...  ...deployment, as well as monitoring in the cloud environment. Responsibilities Develop high...  ...g., Delta Lake) Experience with Apache Spark or other big data computing engines Excellent... 
    Pipeline
    Cloud
    Senior
    Work experience placement

    42dot

    Sunnyvale, CA
    1 day ago
  •  ...A technology firm is seeking a skilled Back-End Engineer with a strong focus on data engineering to design and maintain data pipelines and back-end systems. The successful candidate will work with technologies like Spark, Python, and AWS. Responsibilities include writing... 
    Pipeline
    Senior

    Robotics Technologies LLC

    Sunnyvale, CA
    1 day ago
  •  ...Summary... The Catalog Data Science team at...  ...Learning, and Engineering. We tackle complex...  ...model services and pipelines, and pushing the boundaries...  ...at Walmart. As a Senior Data Scientist (...  ...frameworks (Ray, Spark) Experience...  ...at least one major cloud platform (GCP, Azure... 
    Pipeline
    Cloud
    Senior

    Walmart

    Sunnyvale, CA
    17 hours ago
  • $125k - $198.4k

     ...development, and maintenance of data platforms for...  ...technology. The Role Senior Data Engineer to join our Autonomous...  ..., manage and own data pipelines to collect, cleanse,...  ...functional projects. Use cloud technologies to design...  ...as Apache Hadoop, Spark, or Kafka for processing... 
    Pipeline
    Cloud
    Senior
    Local area
    Flexible hours

    General Motors

    Mountain View, CA
    8 hours ago
  • $120.75k - $251.25k

     ...write mobile app code, engineer the servers behind our...  ...us process trillions of data points a day, what you...  ...working on data engineering pipelines and next‑generation...  ...experience with Google Cloud Platform (BiqQuery, Dataproc...  ..., Pig, Hive, HBase, Spark, Kafka, Oozie, etc.)... 
    Pipeline
    Cloud
    Senior
    Work at office
    Flexible hours

    Yahoo Holdings Inc.

    Mountain View, CA
    3 days ago
  • $129.4k - $212.3k

    # Senior Data Engineer## General MotorsPublished 28 Mar 2026## Role...  ...and maintaining data pipelines, databases and data...  ...data infrastructure architects and data consumption...  ...distributed data processing (Spark) and container...  ....\\+ Experience with cloud platforms Azure preferred... 
    Pipeline
    Cloud
    Senior
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Towards AI, Inc.

    Mountain View, CA
    2 days ago
  •  ...NVIDIA Gruppe is looking for a Senior Data Engineer in Santa Clara, California. This role involves architecting the financial infrastructure for NVIDIA Cloud Services. You'll play a vital role in creating scalable cloud services integrated with financial systems. The... 
    Pipeline
    Cloud
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $143k - $286k

     ...dashboards or static pipelines; we are building...  ...experience. As the Senior Engineering Manager for Agentic Data, you will be at the...  ...managing a team; you are architecting the bridge between...  ...Streams, Flink, or Spark Streaming)....  ...LlamaIndex, CrewAI). Cloud Scale Mastery: Proven... 
    Pipeline
    Cloud
    Senior
    Permanent employment
    Full time
    Temporary work
    Part time
    Flexible hours

    Walmart

    Sunnyvale, CA
    1 day ago
  •  ...protect how people, data, and AI agents...  ...connect across email, cloud, and...  ...seeking an experienced Senior Architect to lead the design...  ...event processing pipelines . This role is critical...  ...Data Platform Engineering Architect real‑...  ...frameworks (e.g., Flink, Spark, Beam) Ensure... 
    Pipeline
    Cloud
    Senior
    Flexible hours

    Proofpoint

    Sunnyvale, CA
    1 day ago
  •  ...leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and...  ...analytical datasets, building robust data pipelines, and collaborating with product managers to... 
    Pipeline
    Cloud
    Senior
    Remote work

    Global Channel Management

    Santa Clara, CA
    2 days ago
  •  ...world. We are seeking a Senior Data Engineer - Data Platform &...  ...needs. Responsibilities Architect, develop, and maintain scalable data pipelines for real‑time and batch...  ...and contracts across cloud and edge/manufacturing...  ...orchestration tools (Kafka, AWS, Spark/Flink, Airflow or... 
    Pipeline
    Cloud
    Senior
    Contract work
    For contractors
    Remote work
    Flexible hours
    1 day per week

    BBG Ventures, LLC

    Sunnyvale, CA
    3 days ago
  •  ...California, is seeking an architect for enterprise-scale CMDB...  ...15 years of software engineering experience and deep expertise in designing data-intensive backend systems and ETL pipelines. This role includes responsibilities...  ..., CI/CD, Kubernetes, and cloud platforms is essential to... 
    Pipeline
    Cloud
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    17 hours ago
  •  ...Overview: We are seeking an experienced Senior Data Engineer with at least 8 years of industry...  ..., and manage robust, scalable data pipelines and workflows using Python and Snowflake...  ...applications. ~ Experience with cloud platforms (e.g., AWS, Azure, GCP) for... 
    Pipeline
    Cloud
    Senior

    E-Solutions

    Sunnyvale, CA
    2 days ago
  • $254k - $349.25k

     ...protect how people, data, and AI agents...  ...connect across email, cloud, and...  ...an experienced Senior Architect to lead the design...  ...event processing pipelines . This role is...  ...Data Platform Engineering Architect real...  ...frameworks (e.g., Flink, Spark, Beam) Ensure alignment... 
    Pipeline
    Cloud
    Senior
    Flexible hours

    Proofpoint

    Sunnyvale, CA
    3 days ago
  • $60 - $65 per hour

     ...Skills: SQL (advanced), Big Data technologies (advanced), Data pipeline development (advanced),...  ...an experienced Data Engineer to design, build, and maintain...  ...such as Hadoop, Hive, Spark, or similar distributed processing...  ...data pipelines in cloud and enterprise environments... 
    Pipeline
    Cloud
    Senior
    Hourly pay
    Contract work

    Akraya

    San Jose, CA
    2 days ago
  •  ...Inc. in Mountain View is seeking a Senior Data Engineer to architect and build scalable systems that fuel...  ...ontologies, develop high-reliability data pipelines, and optimize existing...  ...candidate has strong experience in SQL, cloud services, and building ETL/ELT systems... 
    Pipeline
    Cloud
    Senior
    Flexible hours

    Yahoo Holdings Inc.

    Mountain View, CA
    2 days ago
  •  ...in Mountain View is looking for experienced Data Engineers to optimize data infrastructures for...  ...extensive experience with technologies like Google Cloud Platform and Hadoop. This role involves designing effective data pipelines, improving data quality, and supporting... 
    Pipeline
    Cloud
    Senior

    Yahoo Holdings Inc.

    Mountain View, CA
    2 days ago
  •  ...leading AI lab is seeking a deeply experienced Data Architect to own the data practice. This role focuses on...  ...+ years in data architecture, strong skills in cloud technologies, and ability to design scalable data pipelines. If you are passionate about data quality and leading... 
    Pipeline
    Cloud
    Senior

    Odyssey

    Santa Clara, CA
    1 day ago
  •  ...leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services... 
    Pipeline
    Cloud
    Senior

    Robotics Prcocess Automation, LLC

    Mountain View, CA
    17 hours ago
  •  ...applications in the world? iCloud Data organization enables...  ...for exceptional data engineers who have a strong...  ...adaptable and scalable data pipelines to process structured...  ...working with Spark and other distributed data...  ...Conceptually familiar with AWS cloud resources (S3, EC2, RDS... 
    Pipeline
    Cloud
    Senior

    Apple

    Cupertino, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineering Architect - Spark & Cloud Pipelines. Be the first to apply!