Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer: Large-Scale Pipelines & Security in Sunnyvale, CA vacancy
- ...Bright Vision Technologies is seeking a Machine Learning Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines. The role combines deep data engineering expertise with a strong understanding of AI workloads, focusing on...PipelineRemote work
Bright Vision Technologies
Santa Clara, CA9 hours ago - ...Vision Technologies is seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. This remote... ...candidate has 6+ years of experience, strong Spark, Hive, and SQL skills, and hands-on...PipelineRemote jobFull time
- Odyssey is seeking a data engineer to build and curate large-scale multimodal datasets for world-model training. You will work across video, robotics, and... ...audio, turning research questions into robust data pipelines and processing signals that improve model learning. You...Pipeline
- ...in Cupertino, CA is seeking a senior software and data engineer to build and operate large-scale ML data pipelines. You will acquire, annotate, and ensure quality... ...teams; experience with Iceberg, BigQuery, Airflow, Spark is valuable. Competitive base pay and...Pipeline
- ...California-based AI company seeking an expert ML engineer to scale large models and build robust data pipelines for training and evaluation. You will design and run... ..., curate multi-modal training data, and leverage Spark and Ray for distributed processing in a high-growth...Pipeline
- ...Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Back-End Big Data Engineer (Java, Hadoop, Hive) for a 6+ month contract. Primary... ...building scalable Java applications and big data pipelines using Hive, Hadoop, and Spark. Strong experience with workflow tools like Azkaban/...PipelineContract work
- Bright Vision Technologies is seeking a seasoned Big Data Engineer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will... ...workloads in production. The role requires strong Spark expertise, Hadoop components, SQL, Python or...PipelineRemote job
- ...a future where security has no categories... ...at the scale and speed the enterprise... ...Heads of AI, Engineering, and Product... ...is hiring a Sr. Data Engineer to join... ...optimize the data pipelines and... ...optimized for large‑scale, high‑throughput... ...Flink, Kafka, Spark, or similar stream...Pipeline
$118.66k - $259.2k
...over time. As a Data Engineer, leverage machine... ...crimes. Analyze large datasets, develop... ...and operate large-scale end-to-end distributed... ...integrity of data pipelines to provide a... ...frameworks (e.g., Spark, Flink). ~ Bachelor... ...joy. U.S. Data Security (USDS) is a TikTok...PipelineWork at office3 days per weekTikTok
San Jose, CA16 hours ago- ...protect how people, data, and AI agents... ...100, 10,000 large enterprises,... ...people to work securely and confidently... ...of enterprise-scale distributed systems... ...processing pipelines.This role is critical... ...(e.g., Flink, Spark, Beam)Ensure... ...CollaborationPartner with engineering, product,...PipelineFull timeRemote workFlexible hours
$272k - $431.25k
...next generation of AI and industrial-scale breakthroughs. As a Security Data Engineer within our Infrastructure Security... ...of our security control plane—the pipelines, lake, and analytics that turn... ...Enablement: A track record of making large, messy datasets genuinely useful—...PipelineFull timeRemote work$168k - $270.25k
...organization is seeking an experienced data engineering professional for the... ...custom visualizations for large-scale data analysis.This role will... ...to design data models, data pipelines, curated analytics layers,... ...Athena, Glue, Redshift, EMR, Spark, Databricks, Delta Lake, or...PipelineFull time$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering... ...and maintain optimal data processing pipeline architectureBuild the... ...reporting needsKeep our data secure through multiple data... ...with large scale data processing, e.g. MapReduce, Spark, KafkaExperience with...PipelineFull time$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI... ...performance, the pipelines that compute them at fleet scale, the analysis that turns... ...in Python across large-scale data processing, geospatial... ...such as Apache Spark, and workflow orchestration...PipelineFull time$180k - $258.75k
...efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the... ...workflows. This includes large-scale ingestion pipelines, structured feature stores, labeling... ...frameworks (e.g., Apache Spark, Flyte, Union).Strong...PipelineFull timeLocal areaShift work$140k - $215k
...ve redefined modern security with the world’s most... .... We work on large scale distributed systems,... ...exceptional Senior Data Scientist to join our... ...architecture, including data pipelines, feature engineering, model development,... ...:Python, Go, SQL, Spark, Kafka, S3, Iceberg,...PipelineFull timeWork experience placementWork at officeLocal area2 days per week$202.5k - $274k
...Platform as a Staff Software Engineer in Data. You will join an... ...technologies like Python, PySpark, Spark, SQL, Data Bricks, Big... ...Kafka, to build enterprise scale data engineering pipelines and features for our QuickBooks... ...to size work of medium to large complexity and manage...PipelineWorldwide- ...Senior Data EngineerLocation: Sunnyvale CA (... ...Experience building data pipelines in GCP • GCP... ...with Hadoop, Hive or Spark, Airflow or a workflow... ...processing, and managing large data sets (multi TB/PB scale). • Exposure to test... ...:As a Senior Data Engineer, you will • Design...Pipeline
JConnect Infotech
Sunnyvale, CA3 days ago $143k - $286k
...you'll do...Principal Data Engineer - Agentic Data PlatformsThe... ...are the enterprise-scale technical authority... ...agents, copilots, and large-scale analytics to operate... ..., real-time feature pipelines, vector indexing, and... ...streaming systems (Kafka, Spark Structured Streaming,...PipelineFull timeTemporary workPart time$150.4k - $277.6k
...seeking an exceptional engineer with a background in large scale software... ...that drives Apache Spark’s state‑of‑the‑art... ...critical information security capabilities. Spark... ...technologies to build data intensive systems,... ...of production data pipelines at scale 4 Years+ demonstrated...PipelineApple
Sunnyvale, CA3 days ago$100k - $150k
...Big Data Engineer – Remote Bright Vision Technologies is a technology consulting and... ...Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop... ...hands‑on expertise with Apache Spark (Scala, Python, or Java) in production...PipelineFull timeH1bLocal areaRemote workVisa sponsorshipSocket
Sunnyvale, CA3 days ago- ...Machine Learning Data Engineer – RemoteBright Vision Technologies is... ...Engineer to build and operate the large-scale data systems that power... ...AI training and evaluation pipelines. The role combines deep data... ...processing frameworks such as Spark, Ray, or Beam.Hands-on experience...PipelineFull timeH1bLocal areaImmediate startRemote workVisa sponsorship
Bright Vision Technologies
Santa Clara, CA3 days ago $65 per hour
...are currently looking for a Data Engineer to support our client in Sunnyvale... ...and enhancement of a large-scale Retail and Marketing Technology... ...for building scalable data pipelines and distributed applications... ...including: Hive, Spark, Impala, HBase, Apache Drill...PipelineLong term contractLocal areaDRISHTICON
Sunnyvale, CA5 days ago- ...Data EngineerWe are seeking a skilled Data Application Engineer to design, build, and maintain data... ...applications and pipelines that enable... ...tools (e.g., Kafka, Spark) and batch data processing... ...Solutions, Cyber Security Services, etc. We... ...enabling them to scale with flexibility,...Pipeline
InterSources
Santa Clara, CA3 days ago $128.25k - $266.88k
...Senior Data Engineer (Finance) Yahoo Mail is the ultimate... ...lakehouses, high-performance pipelines, and the analytics... ...on complexity and scale. You don't just build... ...Performance: Improve existing large-scale data... ...their best selves, they spark discovery, innovation...PipelineWork at officeFlexible hoursYahoo Holdings Inc. in
Mountain View, CA2 days ago- ...Data Engineering LeadLead the architecture, design, and implementation of large-scale distributed data platforms.Build and... ...high-performance data pipelines using PySpark and... ...performance tuning, security, governance, and observability... ...of PySpark and Spark SQL.Strong hands-on...Pipeline
Veridic Solutions
Sunnyvale, CA3 days ago $160k - $220k
...Lead Data EngineerLocation: Santa Clara,... ...seeking a Lead Data Engineer to architect,... ...of scalable data pipelines supporting ingestion... ...experience leading large-scale data platform initiatives... ...; experience with Spark or distributed... ...enterprise data security and compliance frameworks...PipelineQ-Cells
Santa Clara, CA3 days ago$251k - $310k
...Tech Lead Manager, Data EngineerWaymo is... ...grow a team of data engineers responsible for... ...and associated data pipelines.Define and drive the... ..., governance, security, and performance optimization... ..., with a focus on large-scale data systems.... ...systems (e.g., Spark, Flume, Kafka,...PipelineFull timeRemote workWaymo
Mountain View, CA2 days ago- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Pipeline
- Apple is seeking a senior data engineer to design and maintain a massive... .... You will build end-to-end pipelines, craft analytics schemas,... ...customers. The role requires strong Spark, Kafka, Airflow, AWS, and... ..., plus experience with large-scale data lakes and modern data tooling...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
Related searches
- junior data engineer remote Sunnyvale, CA
- director data engineering Sunnyvale, CA
- hadoop big data developer Sunnyvale, CA
- senior data quality engineer Sunnyvale, CA
- senior cloud data engineer Sunnyvale, CA
- data engineer contract Sunnyvale, CA
- data infrastructure engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- data science developer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA