Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple Oakbrook
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr Apple
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer: Large-Scale Pipelines & Security in Sunnyvale, CA vacancy
- Samsung Ads in Mountain View, CA is seeking a Sr Data Engineer to join the Performance & Reach engineering... .... You will contribute to scalable data pipelines for ingestion, transformation, and analytics across large-scale advertising datasets to support reporting, billing...Pipeline
$96.49k - $144.74k
...NTT DATA strives to hire exceptional... ...seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala... ...movement at enterprise scale. You will design... ...and batch data pipelines using Apache... ...across large-scale data workloads... ...scale AI, cloud, security, connectivity, data...PipelineTemporary workWork experience placementWork at officeRemote workFlexible hoursNTT DATA Services
Cupertino, CA4 days ago$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI... ...performance, the pipelines that compute them at fleet scale, the analysis that turns... ...in Python across large-scale data processing, geospatial... ...such as Apache Spark, and workflow orchestration...PipelineFull time$75 - $80 per hour
We are seeking a talented Data Engineer to design, build, and maintain scalable... ...on developing enterprise-scale data pipelines, optimizing cloud-based data platforms... .... Experience developing large-scale distributed data applications using Spark and Kafka is highly preferred....PipelineContract workTemporary workWork experience placement$180k - $258.75k
...efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the... ...workflows. This includes large-scale ingestion pipelines, structured feature stores, labeling... ...frameworks (e.g., Apache Spark, Flyte, Union).Strong...PipelineFull timeLocal areaShift work- ...Data EngineerLocation: Onsite - 3 days/week (Raleigh,... ...hands-on experience in SQL, Spark, and Scala, and data pipeline toolsExperience in data... ...building and maintaining large-scale data pipelines with a focus... ...systems, feature engineering, GenAI, RAG, or other AI-...Pipeline3 days per week
Apolis
Cupertino, CA3 days ago $140k - $215k
...ve redefined modern security with the world’s most... .... We work on large scale distributed systems,... ...exceptional Senior Data Scientist to join our... ...architecture, including data pipelines, feature engineering, model development,... ...:Python, Go, SQL, Spark, Kafka, S3, Iceberg,...PipelineFull timeWork experience placementWork at officeLocal area2 days per week$202.5k - $274k
...Platform as a Staff Software Engineer in Data. You will join an... ...technologies like Python, PySpark, Spark, SQL, Data Bricks, Big... ...Kafka, to build enterprise scale data engineering pipelines and features for our QuickBooks... ...to size work of medium to large complexity and manage...PipelineWorldwide- ...Data EngineerA Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive... ...RequiredOozie, Airflow, MapReduce, Spark – Good to...Pipeline
InterSources
Santa Clara, CA3 days ago - ...Unity Technologies seeks a Machine Learning Engineer to join the Offline Infrastructure team, focusing on large-scale data pipelines and distributed model training. You will... ...production, offering exposure to PyTorch, Spark, and orchestration tools. Strong Python skills...Pipeline
Unity Technologies
Mountain View, CA1 day ago - ...Senior GCP Data EngineerLocation: Sunnyvale CA Duration:... ...platform with Hadoop, Hive or Spark, Airflow or a workflow... ...processing, and managing large data sets (multi TB/PB scale).Exposure to test driven development... ...Airflow.Create data pipelines using Apache Hive, Apache...Pipeline
JConnect Infotech
Sunnyvale, CA3 days ago - ...maintain scalable data processing pipelines and workflows... ...frameworks such as Apache Spark, PySpark, and... ..., and integrate large datasets from... ...practices for data security, access control,... ...scientists, analysts, and engineers to support... ...experience with large-scale data platform...Pipeline
Jobtailor
Santa Clara, CA3 days ago $110k - $220k
...summary:At Walmart, data is at the heart of... ...week. As a Staff Data Engineer, you'll be a... ...data platforms and pipelines that power [Customer... ...operate at petabyte scale, set the technical... ...Own architecture for large-scale streaming data... ...frameworks such as Spark, Flink, or Beam.Strong...PipelineFull timeTemporary workPart timeWorldwide$143k - $286k
...you'll do...Principal Data Engineer - Agentic Data PlatformsThe... ...are the enterprise-scale technical authority... ...agents, copilots, and large-scale analytics to operate... ..., real-time feature pipelines, vector indexing, and... ...streaming systems (Kafka, Spark Structured Streaming,...PipelineFull timeTemporary workPart time- ...Data Pipeline EngineerByteDance is a technology company operating a range of content platforms... ..., System and Application Management, Large-scale Asset Management, Front-desk Service, Audio... ...such as Kafka Streaming, Flink, Spark.Familiar with big data open-source tools...Pipeline
Adapt Talent
Mountain View, CA3 days ago $75 - $105 per hour
...Data Engineer, GenAI Data SystemsInsight Global is looking... ...just traditional data pipeline development.This role... ...ETL/ELT pipelines for large, complex datasets.Strong... ...with Databricks, Spark, Delta Lake, or similar... ...Azure, or GCP) and large-scale storage systems.Proficiency...PipelineInsight Global
Santa Clara, CA3 days ago$147.4k - $272.1k
...seeking an exceptional engineer with a background in large scale software... ...that drives Apache Spark’s state-of-the art... ...critical information security capabilities. Spark... ...technologies to build data intensive systems,... ...of production data pipelines at scale Demonstrated...PipelineRelocationApple
Sunnyvale, CA1 day ago$251k - $310k
...Tech Lead Manager, Data EngineerWaymo is... ...grow a team of data engineers responsible for... ...and associated data pipelines.Define and drive the... ..., governance, security, and performance optimization... ..., with a focus on large-scale data systems.... ...systems (e.g., Spark, Flume, Kafka,...PipelineFull timeRemote workWaymo
Mountain View, CA3 days ago- ...Data EngineerWe are seeking a skilled Data Application Engineer to design, build, and maintain data... ...applications and pipelines that enable... ...tools (e.g., Kafka, Spark) and batch data processing... ...Solutions, Cyber Security Services, etc. We... ...enabling them to scale with flexibility,...Pipeline
InterSources
Santa Clara, CA3 days ago $150k
...Data Engineer Specializing In Natural Language Processing (NLP)We are... ...Language Processing (NLP) and large-scale data processing, you will... ...refinement, and robust data pipelines, primarily leveraging Python... ...processing frameworks (e.g., AWS, Spark, Kafka, Kubernetes)....PipelineVisa sponsorshipInstitute of Foundation Models
Sunnyvale, CA3 days ago$184.7k - $324.8k
...learning researchers, engineers, and data scientists? Together,... ...scalable data pipelines, data platforms, and... ...build, and optimize large-scale batch and streaming data... ...best practices for data security, access control, and... ...Dataflow (Apache Beam), and Spark-based processing (...PipelineWorldwideRelocationApple
Cupertino, CA2 days ago$170k - $210k
...Sr Data Engineer – Samsung AdsSamsung Ads is a fast-growing... ...-impact projects at scale. Our culture is rooted... ...product lines, working with large-scale advertising... ...high-performance data pipelines for ingestion, transformation... ...including Snowflake, Spark, and SQL• Experience...PipelineHourly payFull timeInternshipSamsung
Mountain View, CA4 days ago- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Pipeline
- ...Lead Data EngineerWe are seeking a... ...strategic Lead Data Engineer with strong... ...driving enterprise-scale data platforms... ...of large-scale distributed... ...performance data pipelines using PySpark and... ...performance tuning, security, governance,... ...of PySpark and Spark SQL.Strong hands...Pipeline
Diverse Lynx
Sunnyvale, CA3 days ago $160k - $220k
...Lead Data EngineerLocation: Santa Clara,... ...seeking a Lead Data Engineer to architect,... ...of scalable data pipelines supporting ingestion... ...experience leading large-scale data platform initiatives... ...; experience with Spark or distributed... ...enterprise data security and compliance frameworks...PipelineQ-Cells
Santa Clara, CA3 days ago- ...client Title:Sr. Big Data Engineer Location: Sunnyvale,... ...development and operations of large-scale data systems... ...focusing on real-time data pipelines, streaming analytics,... ...Hive, Kafka, Presto, Spark, just to name a few... ...Metadata Management, Security, etc.) Experience in...Pipeline
$135k - $180k
...and maintain optimal data processing pipeline architecture Build the... ...the Executive, Engineering, and Operation teams... ...needs Keep our data secure through multiple data... ...techniques Experience with large scale data processing, e.g. MapReduce, Spark, Kafka Experience...Pipeline$150.4k - $225.3k
...Health team builds the pipelines and infrastructure... ...turn raw motion data from Apple devices... ...their device, engineers and scientists on... ...sense of that data at scale. As a member of... ...our products, run large-scale analyses that... ...frameworks such as Apache Spark. Comfort...PipelineRelocationApple
Cupertino, CA3 days ago$150k - $220k
...businesses connect, secure, and optimize... ...a highly skilled Data Engineer to design, build,... ...production-grade data pipelines that process and transform... ...Dask or Apache Spark. Maintain... ...data pipelines at scale. ~ Containerization... ...Apache Spark for large-scale data processing...PipelineWork at officeRemote workFlexible hoursVersa Networks
Santa Clara, CA9 days ago$224k - $356.5k
...a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in... ...running massive scale workloads for ETL,... ...training and inference pipelines, spanning many... ...cost of running very large Apache Spark applications...PipelineFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
Related searches
- data engineer analytics Sunnyvale, CA
- senior cloud data engineer Sunnyvale, CA
- data center engineer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- sr data engineer Sunnyvale, CA
- data engineer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- data visualization developer Sunnyvale, CA
- data engineer contract Sunnyvale, CA
- junior data engineer remote Sunnyvale, CA