Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple Oakbrook
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr Apple
$150k - $250k
Cylake Inc. is hiring a Data Architect in Sunnyvale, California... ...architecture for petabyte-scale analytics. The role... ...architecting end-to-end data pipelines and requires experience with large-scale data systems, batch... ...like Apache Kafka and Spark. You will receive competitive...Pipeline$153k - $222k
Decisive Point in Sunnyvale, California, is seeking a data engine team member to design and build large-scale data platforms. The role requires a Bachelor's... ...and requires knowledge of technologies like Apache Spark and Kubernetes. The compensation package includes a...Pipeline$179k - $223.8k
...We are seeking Senior Data Engineers to play a pivotal role... ...the development of our Large Driving Model (LDM).... ...ownership of the data pipelines and curation strategies... ...and analysis of large-scale training sets to improve... ...frameworks (e.g., Spark, Ray) and cloud infrastructure...PipelineFull timeTemporary workPart timeLocal areaShift work- ...protect how people, data, and AI agents... ...100, 10,000 large enterprises,... ...people to work securely and confidently... ...of enterprise‑scale distributed systems... ...processing pipelines . This role is... ...Data Platform Engineering Architect real‑... ...(e.g., Flink, Spark, Beam) Ensure alignment...PipelineFlexible hours
$147.4k - $272.1k
...seeking an exceptional engineer with a background in large scale software... ...that drives Apache Spark’s state-of-the art... ...critical information security capabilities. Spark... ...technologies to build data intensive systems,... ...of production data pipelines at scale Demonstrated...PipelineRelocation$181.1k - $272.1k
...passion for using data to drive... ...a Senior Data Engineer to join our App... ...products, including pipelines, analytical outputs... ...the App Store scale. You will... ...pipelines using Spark, Flink, Cassandra... ...Contribute to large-scale quantitative... ...learning, secure multi-party computation...PipelineRelocation$170k - $210k
## Sr. Data EngineerApplyremote type: On-sitelocations... ...Summary**Sr Data Engineer – Samsung Ads About... ...impact projects at scale. Our culture is... ..., working with large-scale advertising... ...high-performance data pipelines for ingestion,... ...including Snowflake, Spark, and SQL • Experience...PipelineHourly payFull timeInternship- ...We are seeking a Lead Data Engineer to architect, build,... ...optimization of scalable data pipelines supporting ingestion,... ...experience leading large‑scale data platform... ...Python; experience with Spark or distributed... ...implementing enterprise data security and compliance...Pipeline
- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Pipeline
$150k - $250k
...a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible... ...end-to-end data pipelines from ingestion through transformation... ..., building, and running large-scale data systems (PB... ...- Apache Kafka, Spark, Flink, etc....Pipeline$135k - $180k
...and maintain optimal data processing pipeline architecture Build the... ...the Executive, Engineering, and Operation teams... ...needs Keep our data secure through multiple data... ...techniques Experience with large scale data processing, e.g. MapReduce, Spark, Kafka Experience...Pipeline$65 per hour
...are currently looking for a Data Engineer to support our client in Sunnyvale... ...and enhancement of a large-scale Retail and Marketing Technology... ...for building scalable data pipelines and distributed applications... ...including: Hive, Spark, Impala, HBase, Apache Drill...PipelineLong term contractLocal area$125k - $198.4k
...maintenance of data platforms for autonomous... ...Senior Data Engineer to join our... ...manage and own data pipelines to collect,... ...reliability (quality, security) and regulatory... ..., test, and scale data systems in... ...Apache Hadoop, Spark, or Kafka for processing large datasets. Experience...PipelineLocal areaFlexible hours$120.75k - $251.25k
...write mobile app code, engineer the servers behind... ...trillions of data points a day, what... ...learning, at global scale. Consumer Monetization... ...on data engineering pipelines and next‑generation... ...query processing, large‑scale stream processing... ...Pig, Hive, HBase, Spark, Kafka, Oozie, etc....PipelineWork at officeFlexible hours$100k - $155k
...and we've redefined modern security with the world's most advanced... ...We are seeking a seasoned Data Engineer with expertise in Go To Market... ...similar Data Lakes. Build, scale, and maintain automated... ...accuracy, and integrity across all pipelines. Act as a technical partner...PipelineRemote jobFull timeWork at officeLocal area- ...by the Illumio AI Security Graph, our breach containment... ...Team's Vision: Our Engineering team is shaping the... ...architect high‑scale distributed systems... ...process massive data volumes to fuel our... ...Build and maintain large‑scale data pipelines using Apache Spark or Flink to provide...PipelineImmediate start
$150k - $200k
Decisive Point is seeking a Data and Test Flywheel Engineer to work in Sunnyvale, California. This role involves building systems that connect vehicle... ...in Python, and knowledge of data frameworks like Spark and Kafka. The compensation ranges from $150,000 to $200,0...Pipeline$133k - $254k
...transportation operating system. Our AI Data Pipeline Engineers build up the core data... ...scalable data pipeline for large‑scale dataset (millions of scenes... ...) Experience with Apache Spark or other big data computing... ...experience implementing security measures to protect data...PipelineWork experience placement$150k - $200k
...commitments. About the role The Data and Test Flywheel Engineer will be a key member of... ...at the intersection of large-scale data engineering and machine... ...‑scale data processing pipelines (ETL) for ingesting and curating... ...of data frameworks (Spark, Airflow, Kafka, etc.). Experience...PipelineFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- ...of transportation on a global scale. The Data Scaling team owns the Data... ...builds scalable systems and pipelines that attempt to 10x the data... ...The team uses existing very large datasets that GM has access to... ...like NumPy, Pandas, and Apache Spark. Excellent communication skills...PipelineLocal areaRemote workRelocationRelocation packageFlexible hours
- A technology firm is seeking a skilled Back-End Engineer with a strong focus on data engineering to design and maintain data pipelines and back-end systems. The successful candidate will work with technologies like Spark, Python, and AWS. Responsibilities include writing...Pipeline
$140k - $215k
...ve redefined modern security with the world’s most... .... We work on large scale distributed systems... ...exceptional Senior Data Scientist to join our... ...architecture, including data pipelines, feature engineering, model development,... ...: Python, Go, SQL, Spark, Kafka, S3, Iceberg,...PipelineFull timeWork experience placementWork at officeLocal area2 days per week- ...based in Sunnyvale, California, seeks a skilled Back-End Engineer to design and maintain scalable data pipelines. The ideal candidate will have over 5 years of experience in back-end development and proficiency in Spark, Python, Scala, and Java. The role also involves...Pipeline
$69.01 per hour
...Digital Global Digital Commerce Data Engineer 1 (Contract) Location: San... ...optimizing scalable data pipelines that enable experimentation,... ...role is heavily focused on large-scale data engineering, SQL-driven... ...technologies such as Hadoop, Hive, Spark, or similar distributed...PipelineHourly payContract work$188.6k - $271.4k
...worldwide. We’re a team of engineers, clinicians, and innovators... ...Position We are seeking a Senior Data Engineer to join the... ...candidate will design, build, and scale data pipelines and datasets that power APIs... ...frameworks (e.g., Spark, Flink) Experience with managed...PipelineLocal areaWorldwideShift work$187k - $198k
...Senior Software Engineer, Data Engineering Join us in building the future of finance... ...use cases grow. Build scalable data pipelines using Python, Spark and Airflow to move data from different... ...Expert at building and maintaining large‑scale data pipelines using open source...PipelineWork at officeShift work$182k - $242k
...enables innovators to build and scale AI with confidence. Trusted... ...at . What You’ll Do The Data Engineering Team builds and operates the... ...CoreWeave. We design resilient data pipelines, scalable lakehouse systems,... ...processing systems using Spark, Flink, or similar...PipelinePermanent employmentTemporary workCasual workWork at officeFlexible hours$180k - $270k
...Human Interactive Driving, Large Behavioral Models, and Robotics... ...are looking for a Senior Data Engineer to design and build the... ...workflows. This includes large-scale ingestion pipelines, structured feature stores,... ...frameworks (e.g., Apache Spark, Flyte, Union). Strong knowledge...PipelineLocal areaShift work$189k - $300k
...transportation on a global scale. The Data Scaling team owns the... ...scalable systems and pipelines that attempt to 10x... ...team uses existing very large datasets that GM has... ...‑impact team of AI/ML engineers, data scientists and engineers... ..., Pandas, and Apache Spark. Strong communication...PipelineLocal areaRemote workRelocationRelocation packageFlexible hours- ...Description The Analytics Engineer will support data, automation, and AI initiatives... ...models and transformation pipelines using dbt in a distributed... ...such as Databricks, Spark, or equivalent. Advanced SQL... ...experience working with large-scale data transformations. Solid...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
- remote data engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- data engineer Sunnyvale, CA
- software data engineer Sunnyvale, CA
- big data cloud engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- director data engineering Sunnyvale, CA
- principal data engineer Sunnyvale, CA

