Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr
- ...personalized, and secure, PayPal empowers consumers... ...-sided network at scale that connects... ...Inc. seeks Staff Data Engineer in San Jose, CA... ...maintain robust data pipelines and ETL processes... ...accommodating large volumes of data. Ensure... ...data using Spark and Hadoop (4 years...PipelineFull timeWork at officeLocal areaImmediate startRemote workWorldwideFlexible hours
- ...a future where security has no categories... ...at the scale and speed the enterprise... ...Heads of AI, Engineering, and Product... ...is hiring a Sr. Data Engineer to join... ...optimize the data pipelines and... ...optimized for large‑scale, high‑throughput... ...Flink, Kafka, Spark, or similar stream...Pipeline
$150.4k - $277.6k
...seeking an exceptional engineer with a background in large scale software... ...that drives Apache Spark’s state‑of‑the‑art... ...critical information security capabilities. Spark... ...technologies to build data intensive systems,... ...of production data pipelines at scale 4 Years+ demonstrated...Pipeline$65 per hour
...are currently looking for a Data Engineer to support our client in Sunnyvale... ...and enhancement of a large-scale Retail and Marketing Technology... ...for building scalable data pipelines and distributed applications... ...including: Hive, Spark, Impala, HBase, Apache Drill...PipelineLong term contractLocal area$129.3k - $225.3k
...talented and dedicated big data engineer to join our Data... ...analytics at big data scale. Our team provides the... ...high‑volume processing pipeline. You'll work with talented... ...producer/consumer, Spark Structured Streaming... ...Managing and monitoring large scale data collection...PipelineRelocation$135k - $180k
...and maintain optimal data processing pipeline architecture Build the... ...the Executive, Engineering, and Operation teams... ...needs Keep our data secure through multiple data... ...techniques Experience with large scale data processing, e.g. MapReduce, Spark, Kafka Experience with...Pipeline- ...protect how people, data, and AI agents... ...100, 10,000 large enterprises,... ...people to work securely and confidently... ...of enterprise-scale distributed systems... ...processing pipelines.This role is critical... ...(e.g., Flink, Spark, Beam)Ensure... ...CollaborationPartner with engineering, product,...PipelineFull timePart timeRemote workFlexible hours
- ...and strategic Lead Data Engineer with strong... ...driving enterprise-scale data platforms that... ...implementation of large-scale distributed... ...-performance data pipelines using PySpark and... ...performance tuning, security, governance, and observability... ...of PySpark and Spark SQL. Strong hands-...Pipeline
$90k - $180k
Overview International Data Management (IDM)... ...powers enterprise‑scale data platforms... ...Build and scale data pipelines : Design and... ...data pipelines using Spark (Scala/PySpark), Airflow... ...Develop AI‑driven engineering solutions : Build... ...and enhance large‑scale data platform...PipelineTemporary work$154.9k - $209.6k
...electronics, consumer health, security, and beyond. Aeva is... ...for a versatile engineer to serve as a critical... ...lifecycle of our sensor data in the field. You will... ...grade Python and C++ data pipelines required to ingest, validate... ...data pipelines at scale. Excellent communication...PipelineFlexible hours$181.1k - $272.1k
...passion for using data to drive... ...a Senior Data Engineer to join our App... ...products, including pipelines, analytical outputs... ...the App Store scale. You will... ...pipelines using Spark, Flink, Cassandra... ...Contribute to large-scale quantitative... ...learning, secure multi-party computation...PipelineRelocation$170k - $210k
## Sr. Data EngineerApplyremote type: On-sitelocations... ...Summary**Sr Data Engineer - Samsung Ads About... ...impact projects at scale. Our culture is... ..., working with large-scale advertising... ...high-performance data pipelines for ingestion,... ...including Snowflake, Spark, and SQL • Experience...PipelineHourly payFull timeInternship$180k - $270k
...Human Interactive Driving, Large Behavioral Models, and Robotics... ...are looking for a Senior Data Engineer to design and build the... ...workflows. This includes large-scale ingestion pipelines, structured feature stores,... ...frameworks (e.g., Apache Spark, Flyte, Union). Strong knowledge...PipelineLocal areaShift work- Lead Data Engineer We are seeking a Lead Data Engineer to... ...of scalable data pipelines supporting ingestion,... ...Proven experience leading large‑scale data platform... ...Python; experience with Spark or distributed processing... ...enterprise data security and compliance frameworks...Pipeline
$272k - $431.25k
...next generation of AI and industrial-scale breakthroughs. As a Security Data Engineer within our Infrastructure Security... ...of our security control plane—the pipelines, lake, and analytics that turn... ...Enablement: A track record of making large, messy datasets genuinely useful—...PipelineFull timePart timeRemote work$143k - $286k
...dashboards or static pipelines; we are building the... .... As the Senior Engineering Manager for Agentic Data, you will be at the... ...that make petabyte-scale data accessible to reasoning... ...and operating large-scale, distributed,... ...Streams, Flink, or Spark Streaming). • Semantic...PipelinePermanent employmentFull timeTemporary workPart timeFlexible hours- ...by the Illumio AI Security Graph, our breach containment... ...Team's Vision: Our Engineering team is shaping the... ...architect high‑scale distributed systems... ...process massive data volumes to fuel our... ...Build and maintain large‑scale data pipelines using Apache Spark or Flink to provide...PipelineImmediate start
$187k - $198k
...metrics driven company and data is foundational to all key... ...We are looking for a Data Engineer to build and maintain... ...grow. Build scalable data pipelines using Python, Spark and Airflow to move data from... ...building and maintaining large-scale data pipelines using open...PipelineWork at officeShift work- ...Toyota Research Institute find a Data Engineer to design and build the data... ...and maintain scalable data pipelines for structured, semi-... ...external stakeholders to support secure data access, governance, and... ...across heterogeneous and large-scale data sources. Strong proficiency...PipelineOngoing contractFull timeContract workTemporary workLocal areaVisa sponsorshipFlexible hoursShift work2 days per week
$69.01 per hour
...Digital Global Digital Commerce Data Engineer 1 (Contract) Location: San... ...optimizing scalable data pipelines that enable experimentation,... ...role is heavily focused on large-scale data engineering, SQL-driven... ...technologies such as Hadoop, Hive, Spark, or similar distributed...PipelineHourly payContract work$272k - $431.25k
...for a Machine Learning (ML) Engineer to join the GPU accelerated Apache Spark team. Apache Spark is the most popular data processing engine in data centers for running large scale workloads for ETL, SQL, and... ...training and inference pipelines, spanning many domains and...PipelineFull timePart time- Senior Data Engineer We are looking for a Senior Data Engineer... ...data platforms and pipelines (batch/stream) that... ..., dbt, Airflow, Spark, and cloud data warehouses... ...of data security, access control, and... ...(Kafka, Kinesis) or large‑scale unstructured data storage...PipelineWork at office
$101.6k - $175.2k
...As a Senior Analytics Engineer, you will play a critical... ...advancing Ensemble’s data, automation, and AI... ...models and transformation pipelines using dbt within a... ...Delta Lake tables and Spark workloads for performance... ...experience optimizing large-scale data transformations....PipelineTemporary workWork at officeLocal areaRemote work$182k - $242k
...enables innovators to build and scale AI with confidence. Trusted... ...at . What You’ll Do The Data Engineering Team builds and operates the... .... We design resilient data pipelines, scalable lakehouse systems,... ...data processing systems using Spark, Flink, or similar...PipelinePermanent employmentTemporary workCasual workWork at officeFlexible hours$148.75k - $361k
...to build and monetize large audiences, and provide... ...The mission of Roku's Data Engineering team is to develop a world... ...develop scalable data pipelines to capturing different... ...daily and a petabyte-scale data warehouse. By... ...MapReduce), Hive, Kafka, Spark, Airflow, and Presto/...PipelineWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$100k - $150k
...Big Data Engineer – Remote Bright Vision Technologies is a technology consulting... ...Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop... ...hands-on expertise with Apache Spark (Scala, Python, or Java) in production...PipelineFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...world-class researchers, data scientists, and engineers, tackling the most fundamental... ...Processing (NLP) and large-scale data processing, you will... ...refinement, and robust data pipelines, primarily leveraging Python... ...frameworks (e.g., AWS, Spark, Kafka, Kubernetes). Excellent...PipelineVisa sponsorship
$100k - $150k
...Machine Learning Data Engineer – Remote Bright Vision Technologies... ...Engineer to build and operate the large-scale data systems that power... ...AI training and evaluation pipelines. The role combines deep data... ...processing frameworks such as Spark, Ray, or Beam. Hands-on...PipelineFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...Gemini web and mobile apps. The data we produce is key in... ...to take on the challenge to scale our infrastructure to keep... ...performing senior and junior engineers to deliver datasets at scale... ...debugging, and supporting large-scale data pipelines Interest in data and data...PipelineFull time
$101.6k - $175.2k
...As a Senior Analytics Engineer, you will play a critical... ...advancing Ensemble’s data, automation, and AI... ...models and transformation pipelines using dbt within a... ...Delta Lake tables and Spark workloads for performance... ...experience optimizing large-scale data transformations....PipelineTemporary workWork at officeLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
- big data cloud engineer Sunnyvale, CA
- big data engineer Sunnyvale, CA
- big data developer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- finance data engineer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- senior data engineer Sunnyvale, CA
- data developer Sunnyvale, CA




