Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple Oakbrook
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr
- ...Architect scalable data systems... ...cost-efficient scaling Unify advertising... ...legacy pipelines for real-time optimization... ..., and secure, explainable production... ...in software engineering or related... ...Experience with Spark, Flink, Kafka,... ...ETL tools and large data sets in the...Pipeline
$96.49k - $144.74k
...NTT DATA strives to hire exceptional... ...seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala... ...movement at enterprise scale. You will design... ...and batch data pipelines using Apache... ...across large-scale data workloads... ...scale AI, cloud, security, connectivity, data...PipelineTemporary workWork experience placementWork at officeRemote workFlexible hours- ...Purple DriveBig Data Engineer Share Contractual Sunnyvale, CA |... ...develop, and maintain big data pipelines leveraging Hadoop, Spark, and Kafka.Develop and... ...2EE backend services for large-scale data processing and... ...solutions.Ensure data quality, security, and scalability across...Pipeline
- ...client Title:Sr. Big Data Engineer Location: Sunnyvale,... ...development and operations of large-scale data systems... ...focusing on real-time data pipelines, streaming analytics,... ...Hive, Kafka, Presto, Spark, just to name a few... ...Metadata Management, Security, etc.) Experience in...Pipeline
- ...Senior Data EngineerLocation: Sunnyvale CA (... ...Experience building data pipelines in GCP • GCP... ...with Hadoop, Hive or Spark, Airflow or a workflow... ...processing, and managing large data sets (multi TB/PB scale). • Exposure to test... ...:As a Senior Data Engineer, you will • Design...Pipeline
$150.4k - $277.6k
...seeking an exceptional engineer with a background in large scale software... ...that drives Apache Spark’s state‑of‑the‑art... ...critical information security capabilities. Spark... ...technologies to build data intensive systems,... ...of production data pipelines at scale 4 Years+ demonstrated...Pipeline$135k - $180k
...and maintain optimal data processing pipeline architecture Build the... ...the Executive, Engineering, and Operation teams... ...needs Keep our data secure through multiple data... ...techniques Experience with large scale data processing, e.g. MapReduce, Spark, Kafka Experience with...Pipeline- ...Internet of Things (IoT) data to develop... ...their operations at scale. Working at Samsara... ...seeking a Senior Data Engineer to join our Data... ...and maintain data pipelines integral to our analytics... ...to handle large volumes of data. Experience with Spark-based data platforms...PipelineRemote workRelocation package
$65 per hour
...are currently looking for a Data Engineer to support our client in Sunnyvale... ...and enhancement of a large-scale Retail and Marketing Technology... ...for building scalable data pipelines and distributed applications... ...including: Hive, Spark, Impala, HBase, Apache Drill...PipelineLong term contractLocal area- ...Seattle As a Senior Data Engineer, You Will: Design, develop... ..., and operationalize large-scale enterprise data... ...Lambda, RedShift, EMR, Spark, and DynamoDB Analyze... ...develop, and deploy data pipelines from ingestion to... ...various information security controls Maintain existing...PipelineRemote workFlexible hoursShift work
$170k - $210k
...most comprehensive data and world-class... ...impact projects at scale. Our culture is rooted... ...are seeking Data Engineers at all experience... ..., working with large‑scale advertising... ...-performance data pipelines for ingestion, transformation... ...Snowflake, Spark, and SQL...PipelineHourly payFull timeInternship$154.9k - $209.6k
...electronics, consumer health, security, and beyond. Aeva is... ...for a versatile engineer to serve as a critical... ...lifecycle of our sensor data in the field. You will... ...grade Python and C++ data pipelines required to ingest, validate... ...data pipelines at scale. ~Excellent communication...PipelineFlexible hours$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote... ...any AI, any data, and any workflow—... ...operate at massive scale, pushing the... ...systems, data ingestion pipelines, and Data Lake architectures... ...and deliver large‑scale distributed... ...management)Apache Spark (batch & streaming...PipelinePermanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week- ...by the Illumio AI Security Graph, our breach containment... ...'s Vision: Our Engineering team is shaping the... ...architect high-scale distributed systems... ...process massive data volumes to fuel our... ...Build and maintain large-scale data pipelines using Apache Spark or Flink to provide...PipelineImmediate start
- ...Cloud Data EngineerLocation: Austin (Monte Sereno, CA) or Cupertino... ...:Design and Build Data pipeline using Cloud technologies and... ...Cloud • Hands-on knowledge of Spark cluster-computing framework &... ...based applications that include large scale compute services, database...Pipeline
- ...transportation on a global scale. The Data Scaling team owns the... ...scalable systems and pipelines that attempt to 10x... ...uses existing very large datasets that GM has... ...impact team of AI/ML engineers, data scientists and... ..., Pandas, and Apache Spark. Excellent communication...PipelineFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours
- ...applied research in intelligent data analytics, hardware/co-processor acceleration, large scale platform optimization, cloud-... ...We are leading researchers and engineers from worldwide to create adaptive... ..., anomaly detection in security control, acceleration in telecommunication...For contractorsWorldwide
- ...edge solutions at scale, impacting millions... ...drive value from data at Walmart ScaleInteract... ...with Walmart engineering teams across... ...Engineering, complex data pipeline developmentDesign,... ...that process large volume of data; focusing... ..., Metadata Management, Security, etc....PipelineWorldwide
- ...Role: Snowflake Data Engineer Location: Santa Cla, CA (5 days Onsite) Job Description Data Engineer... ...Snowflake and Databricks , including building and optimizing large-scale data pipelines. Strong understanding of data architecture...Pipeline
$187k - $198k
...metrics driven company and data is foundational to all key... ...We are looking for a Data Engineer to build and maintain... ...grow. Build scalable data pipelines using Python, Spark and Airflow to move data from... ...building and maintaining large-scale data pipelines using open...PipelineWork at officeShift work- ...Machine Learning Data Engineer – RemoteBright Vision Technologies is... ...Engineer to build and operate the large-scale data systems that power... ...AI training and evaluation pipelines. The role combines deep data... ...processing frameworks such as Spark, Ray, or Beam.Hands-on experience...PipelineH1bLocal areaImmediate startRemote workVisa sponsorship
- ...Senior Lead Data EngineerLocation: San Jose, CA 95125 Hybrid(Locals)Key Responsibilities... ..., construct, test and maintain ELT pipelines using Hadoop and Spark SQLManage and optimize the... ..., Yarn) and Apache Spark, Scala for large scale data processingGood knowledge in Python...PipelineLocal area
$75 - $80 per hour
...and maintain robust, scalable data pipelines and complex ETL workflows.... ...years of experience in Data Engineering. Bachelor’s degree in Computer... ...Big Data applications using Spark and Kafka. Solid... ...who partner with us for our scale, full-stack capabilities and...PipelineContract workTemporary workWork experience placement$175k - $215k
...Staff Data EngineerArcher is an aerospace company... ...industry. As a Staff Data Engineer on the AI Platform... ...infrastructure that powers large-scale model training and... .... You will own the pipelines, storage systems, and... ...with tools like Apache Spark, Flink, Airflow, dbt,...PipelineInternshipNight shift$80 - $85 per hour
...a leading product engineering firm based in Silicon... ...in AI, ML, and data analytics. Our collaborative... ...who has built large-scale data platforms,... ...optimization Security & governance: RBAC... ...Apache Spark with advanced PySpark... ...Streaming & batch data pipelines Delta Lake architecture...PipelineHourly pay- ...About the role The Data and Test Flywheel Engineer will be a key member of Applied... ...at the intersection of large-scale data engineering and machine... ...large-scale data processing pipelines (ETL) for ingesting and... ...knowledge of data frameworks (Spark, Airflow, Kafka, etc.)....PipelineFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
- ...and implement distributed data pipelines processing large volumes of advertising events... .... Optimize Apache Spark workloads, including partitioning... .... Collaborate with engineers, product teams, data scientists... ...building and operating large-scale data pipelines with Apache...PipelineFull timeContract work
- ...driving performance, the pipelines that compute them at fleet scale, the analysis that... ...changes — the data and tooling that gate... ...primarily in Python across large-scale data... ...automation. We welcome engineers from data engineering... ...processing such as Apache Spark, and workflow...Pipeline
- ...Senior AI Data Science Engineer Advancing embodied AI in robotic surgery requires... ...and designing systems that scale. Roles and... ...Architect data models and build pipelines that process and integrate surgical... ...frameworks (e.g., Spark, Airflow, or similar). Track...Pipeline
$150k - $220k
...businesses connect, secure, and optimize... ...a highly skilled Data Engineer to design, build,... ...production-grade data pipelines that process and transform... ...Dask or Apache Spark. Maintain... ...data pipelines at scale. ~ Containerization... ...Apache Spark for large-scale data processing...PipelineWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
- aws data engineer Sunnyvale, CA
- data science developer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- senior data engineer Sunnyvale, CA
- data engineer machine learning Sunnyvale, CA
- junior data engineer remote Sunnyvale, CA
- data center engineer Sunnyvale, CA
- data developer Sunnyvale, CA
- senior data center engineer Sunnyvale, CA
- big data developer Sunnyvale, CA



