Spark Data Engineer: Large-Scale Pipelines & Security
$147.4k - $272.1kApple Oakbrook
A leading technology company located in Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering team. The role involves supporting and developing mission-critical information security capabilities while utilizing state-of-the-art technologies. Candidates should have strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between $147,400 and $272,100, complemented by various employee benefits including stock options and comprehensive healthcare coverage. #J-18808-Ljbffr Apple
- Bright Vision Technologies is seeking a Machine Learning Data Engineer to build and operate large-scale data systems powering AI training and evaluation pipelines. The role combines deep data engineering expertise with a strong understanding of AI workloads, focusing on...PipelineRemote job
- ...Vision Technologies is seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. This remote... ...candidate has 6+ years of experience, strong Spark, Hive, and SQL skills, and hands-on...PipelineRemote jobFull time
- ...in Cupertino, CA is seeking a senior software and data engineer to build and operate large-scale ML data pipelines. You will acquire, annotate, and ensure quality... ...teams; experience with Iceberg, BigQuery, Airflow, Spark is valuable. Competitive base pay and...Pipeline
- ...California-based AI company seeking an expert ML engineer to scale large models and build robust data pipelines for training and evaluation. You will design and run... ..., curate multi-modal training data, and leverage Spark and Ray for distributed processing in a high-growth...Pipeline
- ...Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Back-End Big Data Engineer (Java, Hadoop, Hive) for a 6+ month contract. Primary... ...building scalable Java applications and big data pipelines using Hive, Hadoop, and Spark. Strong experience with workflow tools like Azkaban/...PipelineContract work
- ...a future where security has no categories... ...at the scale and speed the enterprise... ...Heads of AI, Engineering, and Product... ...is hiring a Sr. Data Engineer to join... ...optimize the data pipelines and... ...optimized for large-scale, high-throughput... ...Flink, Kafka, Spark, or similar stream...Pipeline
- Bright Vision Technologies is seeking a seasoned Big Data Engineer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will... ...workloads in production. The role requires strong Spark expertise, Hadoop components, SQL, Python or...PipelineRemote job
- ...protect how people, data, and AI agents... ...100, 10,000 large enterprises,... ...people to work securely and confidently... ...of enterprise-scale distributed systems... ...processing pipelines.This role is critical... ...(e.g., Flink, Spark, Beam)Ensure... ...CollaborationPartner with engineering, product,...PipelineFull timeRemote workFlexible hours
$272k - $431.25k
...next generation of AI and industrial-scale breakthroughs. As a Security Data Engineer within our Infrastructure Security... ...of our security control plane—the pipelines, lake, and analytics that turn... ...Enablement: A track record of making large, messy datasets genuinely useful—...PipelineFull timeRemote work$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering... ...and maintain optimal data processing pipeline architectureBuild the... ...reporting needsKeep our data secure through multiple data... ...with large scale data processing, e.g. MapReduce, Spark, KafkaExperience with...PipelineFull time$168k - $270.25k
...organization is seeking an experienced data engineering professional for the... ...custom visualizations for large-scale data analysis.This role will... ...to design data models, data pipelines, curated analytics layers,... ...Athena, Glue, Redshift, EMR, Spark, Databricks, Delta Lake, or...PipelineFull time$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI... ...performance, the pipelines that compute them at fleet scale, the analysis that turns... ...in Python across large-scale data processing, geospatial... ...such as Apache Spark, and workflow orchestration...PipelineFull time$180k - $258.75k
...efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the... ...workflows. This includes large-scale ingestion pipelines, structured feature stores, labeling... ...frameworks (e.g., Apache Spark, Flyte, Union).Strong...PipelineFull timeLocal areaShift work$140k - $215k
...ve redefined modern security with the world’s most... .... We work on large scale distributed systems,... ...exceptional Senior Data Scientist to join our... ...architecture, including data pipelines, feature engineering, model development,... ...:Python, Go, SQL, Spark, Kafka, S3, Iceberg,...PipelineFull timeWork experience placementWork at officeLocal area2 days per week$202.5k - $274k
...Platform as a Staff Software Engineer in Data. You will join an... ...technologies like Python, PySpark, Spark, SQL, Data Bricks, Big... ...Kafka, to build enterprise scale data engineering pipelines and features for our QuickBooks... ...to size work of medium to large complexity and manage...PipelineWorldwide$143k - $286k
...you'll do...Principal Data Engineer - Agentic Data PlatformsThe... ...are the enterprise-scale technical authority... ...agents, copilots, and large-scale analytics to operate... ..., real-time feature pipelines, vector indexing, and... ...streaming systems (Kafka, Spark Structured Streaming,...PipelineFull timeTemporary workPart time$150k - $220k
...businesses connect, secure, and optimize... ...a highly skilled Data Engineer to design, build,... ...production-grade data pipelines that process and transform... ...Dask or Apache Spark. Maintain... ...data pipelines at scale. ~ Containerization... ...Apache Spark for large-scale data processing...PipelineWork at officeRemote workFlexible hours$154.9k - $209.6k
...electronics, consumer health, security, and beyond. Aeva is... ...for a versatile engineer to serve as a critical... ...lifecycle of our sensor data in the field. You will... ...grade Python and C++ data pipelines required to ingest, validate... ...data pipelines at scale. ~Excellent communication...PipelineFlexible hours- ...world-class researchers, data scientists, and engineers, tackling the most fundamental... ...Processing (NLP) and large-scale data processing, you will... ...refinement, and robust data pipelines, primarily leveraging Python... ...frameworks (e.g., AWS, Spark, Kafka, Kubernetes). Excellent...PipelineVisa sponsorship
$170k - $210k
...Sr Data Engineer – Samsung Ads Samsung Ads is a fast-growing... ...-impact projects at scale. Our culture is rooted... ...lines, working with large-scale advertising... ...high-performance data pipelines for ingestion, transformation... ...including Snowflake, Spark, and SQL •...PipelineHourly payFull timeInternship- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Pipeline
$150.4k - $225.3k
...Health team builds the pipelines and infrastructure... ...turn raw motion data from Apple devices... ...their device, engineers and scientists on... ...sense of that data at scale. As a member of... ...our products, run large-scale analyses that... ...frameworks such as Apache Spark. Comfort...PipelineRelocation$200k - $260k
...got real-time data infrastructure... ...environments - at fleet scale. RADAR is... ...to work on a large, unsolved,... ...for a Staff Data Engineer to help build and... ...reliable data pipelines (batch and streaming... ...SQL or Apache Spark, and comfort... ...onboarding, security, and compliance...PipelineImmediate startFlexible hours- Apple is seeking a senior data engineer to design and maintain a massive... .... You will build end-to-end pipelines, craft analytics schemas,... ...customers. The role requires strong Spark, Kafka, Airflow, AWS, and... ..., plus experience with large-scale data lakes and modern data tooling...Pipeline
$207k - $275k
...innovators to build and scale AI with confidence.... ...What You'll Do: The Data Engineering Team builds and... ...design resilient data pipelines, scalable lakehouse systems... ...designing and operating large-scale lakehouse or... ...StarRocks, ClickHouse, Trino, Spark, Flink, or Kafka....PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$225k
...deploy 750 megawatts of scale, transforming key... ...and optimize scalable data pipeline architectures for multi... ...SQL, Tableau, Hive, and Spark to forecast hardware failure... ...system reliability.Engineer telemetry ingestion,... ...failures using large-scale statistical and...Pipeline- ...maintain scalable data processing pipelines and workflows... ...frameworks such as Apache Spark, PySpark, and... ..., and integrate large datasets from... ...practices for data security, access control,... ...scientists, analysts, and engineers to support... ...experience with large-scale data platform...Pipeline
- ...client Title:Sr. Big Data Engineer Location: Sunnyvale,... ...development and operations of large-scale data systems... ...focusing on real-time data pipelines, streaming analytics,... ...Hive, Kafka, Presto, Spark, just to name a few... ...Metadata Management, Security, etc.) Experience in...Pipeline
- ...experiences—from AI and data centers, to PCs, gaming... ...Machine Learning Engineer to join our Models and... ...distributed training of large models on a large number... ...training generative AI at scale.THE PERSON:The ideal candidate... ...distributed training pipelines, be knowledgeable in...Pipeline
- ...looking for a skilled Senior Data Engineer to join our engineering team... ...maintaining scalable data pipelines, data platforms, and data integration... ...designing and building large-scale batch and streaming data... ...Dataflow (Apache Beam), and Spark-based processing (Dataproc or...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer: Large-Scale Pipelines & Security. Be the first to apply!
- aws data engineer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- big data developer Sunnyvale, CA
- software data engineer Sunnyvale, CA
- data center engineer Sunnyvale, CA
- big data cloud engineer Sunnyvale, CA
- director data engineering Sunnyvale, CA
- hadoop big data developer Sunnyvale, CA
- big data engineer Sunnyvale, CA
- senior data integration developer Sunnyvale, CA


