Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Spark Data Engineer: Large-Scale Pipelines & Security

$147.4k - $272.1k

Apple Oakbrook

A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer: Large-Scale Pipelines & Security in Sunnyvale, CA vacancy
  •  ...Architect scalable data systems...  ...cost-efficient scaling Unify advertising...  ...legacy pipelines for real-time optimization...  ..., and secure, explainable production...  ...in software engineering or related...  ...Experience with Spark, Flink, Kafka,...  ...ETL tools and large data sets in the... 
    Pipeline

    Jobtailor

    Sunnyvale, CA
    13 hours ago
  • $96.49k - $144.74k

     ...NTT DATA strives to hire exceptional...  ...seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala...  ...movement at enterprise scale. You will design...  ...and batch data pipelines using Apache...  ...across large-scale data workloads...  ...scale AI, cloud, security, connectivity, data... 
    Pipeline
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    NTT DATA Services

    Cupertino, CA
    10 days ago
  •  ...Purple DriveBig Data Engineer Share Contractual Sunnyvale, CA |...  ...develop, and maintain big data pipelines leveraging Hadoop, Spark, and Kafka.Develop and...  ...2EE backend services for large-scale data processing and...  ...solutions.Ensure data quality, security, and scalability across... 
    Pipeline

    Purple Drive

    Sunnyvale, CA
    1 day ago
  •  ...client Title:Sr. Big Data Engineer Location: Sunnyvale,...  ...development and operations of large-scale data systems...  ...focusing on real-time data pipelines, streaming analytics,...  ...Hive, Kafka, Presto, Spark, just to name a few...  ...Metadata Management, Security, etc.) Experience in... 
    Pipeline

    Redolent Infotech Pvt. Ltd.

    Sunnyvale, CA
    1 day ago
  •  ...Senior Data EngineerLocation: Sunnyvale CA (...  ...Experience building data pipelines in GCP • GCP...  ...with Hadoop, Hive or Spark, Airflow or a workflow...  ...processing, and managing large data sets (multi TB/PB scale). • Exposure to test...  ...:As a Senior Data Engineer, you will • Design... 
    Pipeline

    JConnect Infotech

    Sunnyvale, CA
    19 hours ago
  • $150.4k - $277.6k

     ...seeking an exceptional engineer with a background in large scale software...  ...that drives Apache Spark’s state‑of‑the‑art...  ...critical information security capabilities. Spark...  ...technologies to build data intensive systems,...  ...of production data pipelines at scale 4 Years+ demonstrated... 
    Pipeline

    Apple

    Sunnyvale, CA
    19 hours ago
  • $135k - $180k

     ...and maintain optimal data processing pipeline architecture Build the...  ...the Executive, Engineering, and Operation teams...  ...needs Keep our data secure through multiple data...  ...techniques Experience with large scale data processing, e.g. MapReduce, Spark, Kafka Experience with... 
    Pipeline

    PlusAI, Inc.

    Santa Clara, CA
    3 days ago
  •  ...Internet of Things (IoT) data to develop...  ...their operations at scale. Working at Samsara...  ...seeking a Senior Data Engineer to join our Data...  ...and maintain data pipelines integral to our analytics...  ...to handle large volumes of data. Experience with Spark-based data platforms... 
    Pipeline
    Remote work
    Relocation package

    GrabJobs

    Santa Clara, CA
    1 day ago
  • $65 per hour

     ...are currently looking for a Data Engineer to support our client in Sunnyvale...  ...and enhancement of a large-scale Retail and Marketing Technology...  ...for building scalable data pipelines and distributed applications...  ...including: Hive, Spark, Impala, HBase, Apache Drill... 
    Pipeline
    Long term contract
    Local area

    DRISHTICON

    Sunnyvale, CA
    2 days ago
  •  ...Seattle As a Senior Data Engineer, You Will: Design, develop...  ..., and operationalize large-scale enterprise data...  ...Lambda, RedShift, EMR, Spark, and DynamoDB Analyze...  ...develop, and deploy data pipelines from ingestion to...  ...various information security controls Maintain existing... 
    Pipeline
    Remote work
    Flexible hours
    Shift work

    GrabJobs

    Sunnyvale, CA
    4 days ago
  • $170k - $210k

     ...most comprehensive data and world-class...  ...impact projects at scale. Our culture is rooted...  ...are seeking Data Engineers at all experience...  ..., working with large‑scale advertising...  ...-performance data pipelines for ingestion, transformation...  ...Snowflake, Spark, and SQL... 
    Pipeline
    Hourly pay
    Full time
    Internship

    Relha LLC

    Mountain View, CA
    2 days ago
  • $154.9k - $209.6k

     ...electronics, consumer health, security, and beyond. Aeva is...  ...for a versatile engineer to serve as a critical...  ...lifecycle of our sensor data in the field. You will...  ...grade Python and C++ data pipelines required to ingest, validate...  ...data pipelines at scale. ~Excellent communication... 
    Pipeline
    Flexible hours

    Aeva Inc.

    Mountain View, CA
    more than 2 months ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote...  ...any AI, any data, and any workflow—...  ...operate at massive scale, pushing the...  ...systems, data ingestion pipelines, and Data Lake architectures...  ...and deliver large‑scale distributed...  ...management)Apache Spark (batch & streaming... 
    Pipeline
    Permanent employment
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Santa Clara, CA
    6 days ago
  •  ...by the Illumio AI Security Graph, our breach containment...  ...'s Vision: Our Engineering team is shaping the...  ...architect high-scale distributed systems...  ...process massive data volumes to fuel our...  ...Build and maintain large-scale data pipelines using Apache Spark or Flink to provide... 
    Pipeline
    Immediate start

    Illumio

    Sunnyvale, CA
    3 days ago
  •  ...Cloud Data EngineerLocation: Austin (Monte Sereno, CA) or Cupertino...  ...:Design and Build Data pipeline using Cloud technologies and...  ...Cloud • Hands-on knowledge of Spark cluster-computing framework &...  ...based applications that include large scale compute services, database... 
    Pipeline

    My3Tech Inc

    Cupertino, CA
    19 hours ago
  •  ...transportation on a global scale. The Data Scaling team owns the...  ...scalable systems and pipelines that attempt to 10x...  ...uses existing very large datasets that GM has...  ...impact team of AI/ML engineers, data scientists and...  ..., Pandas, and Apache Spark. Excellent communication... 
    Pipeline
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Mountain View, CA
    11 hours ago
  •  ...applied research in intelligent data analytics, hardware/co-processor acceleration, large scale platform optimization, cloud-...  ...We are leading researchers and engineers from worldwide to create adaptive...  ..., anomaly detection in security control, acceleration in telecommunication... 
    For contractors
    Worldwide

    Netpace

    Santa Clara, CA
    19 hours ago
  •  ...edge solutions at scale, impacting millions...  ...drive value from data at Walmart ScaleInteract...  ...with Walmart engineering teams across...  ...Engineering, complex data pipeline developmentDesign,...  ...that process large volume of data; focusing...  ..., Metadata Management, Security, etc.... 
    Pipeline
    Worldwide

    Software Technology Inc

    Sunnyvale, CA
    12 hours ago
  •  ...Role: Snowflake Data Engineer Location: Santa Cla, CA (5 days Onsite) Job Description Data Engineer...  ...Snowflake and Databricks , including building and optimizing large-scale data pipelines. Strong understanding of data architecture... 
    Pipeline

    Inficare

    Santa Clara, CA
    2 days ago
  • $187k - $198k

     ...metrics driven company and data is foundational to all key...  ...We are looking for a Data Engineer to build and maintain...  ...grow. Build scalable data pipelines using Python, Spark and Airflow to move data from...  ...building and maintaining large-scale data pipelines using open... 
    Pipeline
    Work at office
    Shift work

    I did my part and supported the Regular Toilet

    Menlo Park, CA
    1 day ago
  •  ...Machine Learning Data Engineer – RemoteBright Vision Technologies is...  ...Engineer to build and operate the large-scale data systems that power...  ...AI training and evaluation pipelines. The role combines deep data...  ...processing frameworks such as Spark, Ray, or Beam.Hands-on experience... 
    Pipeline
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Palo Alto, CA
    4 days ago
  •  ...Senior Lead Data EngineerLocation: San Jose, CA 95125 Hybrid(Locals)Key Responsibilities...  ..., construct, test and maintain ELT pipelines using Hadoop and Spark SQLManage and optimize the...  ..., Yarn) and Apache Spark, Scala for large scale data processingGood knowledge in Python... 
    Pipeline
    Local area

    Argyle Infotech

    San Jose, CA
    12 hours ago
  • $75 - $80 per hour

     ...and maintain robust, scalable data pipelines and complex ETL workflows....  ...years of experience in Data Engineering. Bachelor’s degree in Computer...  ...Big Data applications using Spark and Kafka. Solid...  ...who partner with us for our scale, full-stack capabilities and... 
    Pipeline
    Contract work
    Temporary work
    Work experience placement

    TEKsystems

    Sunnyvale, CA
    13 hours ago
  • $175k - $215k

     ...Staff Data EngineerArcher is an aerospace company...  ...industry. As a Staff Data Engineer on the AI Platform...  ...infrastructure that powers large-scale model training and...  .... You will own the pipelines, storage systems, and...  ...with tools like Apache Spark, Flink, Airflow, dbt,... 
    Pipeline
    Internship
    Night shift

    Archer

    San Jose, CA
    2 days ago
  • $80 - $85 per hour

     ...a leading product engineering firm based in Silicon...  ...in AI, ML, and data analytics. Our collaborative...  ...who has built large-scale data platforms,...  ...optimization Security & governance: RBAC...  ...Apache Spark with advanced PySpark...  ...Streaming & batch data pipelines Delta Lake architecture... 
    Pipeline
    Hourly pay

    Bayrock Labs

    Milpitas, CA
    3 days ago
  •  ...About the role The Data and Test Flywheel Engineer will be a key member of Applied...  ...at the intersection of large-scale data engineering and machine...  ...large-scale data processing pipelines (ETL) for ingesting and...  ...knowledge of data frameworks (Spark, Airflow, Kafka, etc.).... 
    Pipeline
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    19 hours ago
  •  ...and implement distributed data pipelines processing large volumes of advertising events...  .... Optimize Apache Spark workloads, including partitioning...  .... Collaborate with engineers, product teams, data scientists...  ...building and operating large-scale data pipelines with Apache... 
    Pipeline
    Full time
    Contract work

    Apple

    Cupertino, CA
    6 days ago
  •  ...driving performance, the pipelines that compute them at fleet scale, the analysis that...  ...changes — the data and tooling that gate...  ...primarily in Python across large-scale data...  ...automation. We welcome engineers from data engineering...  ...processing such as Apache Spark, and workflow... 
    Pipeline

    PlusAI

    Santa Clara, CA
    2 days ago
  •  ...Senior AI Data Science Engineer Advancing embodied AI in robotic surgery requires...  ...and designing systems that scale. Roles and...  ...Architect data models and build pipelines that process and integrate surgical...  ...frameworks (e.g., Spark, Airflow, or similar). Track... 
    Pipeline

    Intuitive

    Sunnyvale, CA
    11 hours ago
  • $150k - $220k

     ...businesses connect, secure, and optimize...  ...a highly skilled Data Engineer to design, build,...  ...production-grade data pipelines that process and transform...  ...Dask or Apache Spark. Maintain...  ...data pipelines at scale. ~ Containerization...  ...Apache Spark for large-scale data processing... 
    Pipeline
    Work at office
    Remote work
    Flexible hours

    Versa Networks

    Santa Clara, CA
    20 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!