Data DevOps Engineer: Spark & Kafka for ML Pipelines
Maxonic Inc.
Maxonic Inc. in Santa Clara, CA invites applications for a Data Infrastructure Engineer to design and maintain data pipelines for ML/AI products. The role is hybrid, with four days on-site, and requires living within 30 miles of Santa Clara. Ideal candidates have 4–8 years of experience, strong Apache Spark and Kafka expertise, plus experience with DevOps tooling and Python/Scala/Java. No relocation; please apply with your resume to View email address on click.appcast.io. #J-18808-Ljbffr Maxonic Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data DevOps Engineer: Spark & Kafka for ML Pipelines in Santa Clara, CA vacancy
- ...Experience in setting up multitenant Spark & Kafka clusters. Experience in... .... Responsibilities Work on data pipeline on various ML/AI products . Interface with DevOps teams to build out the pipelines... ...Data Scientists and Software engineers to implement new features....PipelineLocal areaRelocation
- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Pipeline
- ...are seeking a Lead Data Engineer to architect,... ...of scalable data pipelines supporting ingestion... ...CI/CD automation, DevOps integration, testing... ...; experience with Spark or distributed processing... ...architectures (Kafka, Event Hub,... ...science workflows, or ML pipelines. Experience...Pipeline
Q-Cells
Santa Clara, CA3 days ago - ...Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...Pipeline
Compunnel
Sunnyvale, CA3 days ago - ...lasting impact. A Build Engineering AI & Data Engineer is more... ...that accelerate pipeline creation, code... ...frameworks (e.g., Kafka/Confluent). Enable... ...Experience with AI/ML frameworks such as... .... Experience with Spark, Kafka, or distributed... .... Exposure to DevOps/MLOps practices (CI...Pipeline
IBM Computing
San Jose, CA2 days ago $144k - $270.25k
...pride ourselves on data-driven decision-making... ...excellent Sr. Data engineer with extensive data... ...and sophisticated ML/AI training with... ...Build streaming data pipelines for collecting &... ...Experience working with Spark and Trino compute... ...applications with kafka etc Strong interpersonal...Pipeline$90k - $180k
...our International Data Organization within... ...As part of our Data Engineering team, you will contribute... ...scalable data pipelines that drive key... ...automation using AI/ML techniques to optimize... ...as Hadoop, Apache Spark, Apache Hive, and cloud... ...systems such as Kafka or equivalent streaming...PipelineFull timeTemporary workPart timeWorldwideHome officeFlexible hours$143k - $286k
...dashboards or static pipelines; we are building the... .... As the Senior Engineering Manager for Agentic Data, you will be at the... ...feeds our agents using Kafka to build low-latency... ...engineers, bridging AI/ML Research, Product,... ...Kafka Streams, Flink, Spark Streaming)....PipelinePermanent employment$120k - $145k
...investing in leading-edge data and analytics... ...& Generative AI Engineer plays a central role... ...Data Integration & Pipeline Engineering Support... ...support analytics, ML, and GenAI use cases... ...with Databricks (Spark, Delta Lake) or Snowflake... ...technologies (Kafka, Kinesis, or equivalent...Pipeline- We're seeking an AI Data and Python Tools Engineer to develop and deploy intelligent tools that... ...frameworks Design and streamline data pipelines, train and validate ML models, and implement robust... ...with big data technologies (Spark, Kafka, or similar streaming platforms)...PipelineFull timeRelocation packageMonday to Friday
$125k - $222k
...autonomy. About The Role The Data and Test Flywheel Engineer will be a key member of... ...You’ll work closely with ML engineers and system... ...large-scale data processing pipelines (ETL) for ingesting and curating... ...of data frameworks ( Spark, Airflow, Kafka, etc.). Experience...PipelineFull timeFor contractorsFor subcontractor- ...skilled and strategic Lead Data Engineer with strong expertise... ...enable analytics, AI/ML, and business intelligence... ...high‑performance data pipelines using PySpark and... ...knowledge of PySpark and Spark SQL. Strong hands‑on experience... ...to CI/CD, Git, DevOps, and Infrastructure as...Pipeline
programmers.io
Sunnyvale, CA1 day ago $147.4k - $272.1k
...seeking an exceptional engineer with a background in large... ...that drives Apache Spark’s state-of-the art features... ...technologies to build data intensive systems,... ...implementation of production data pipelines at scale Demonstrated... ...Familiarity with ML/AI workflows and feature...PipelineRelocationApple
Sunnyvale, CA4 days ago- ...Job Description The Analytics Engineer will support data, automation, and AI... ...data models and transformation pipelines using dbt in a distributed data... ...-based systems. Exposure to ML feature engineering or AI-enabled... ...such as Databricks, Spark, or equivalent. Advanced SQL...Pipeline
Insight Global
San Jose, CA3 days ago - Senior Data Engineer We are looking for a Senior Data Engineer... ...data platforms and pipelines (batch/stream) that feed... ...Prefect, dbt, Airflow, Spark, and cloud data warehouses... .... Partner with ML/Research to provision high... ...time streaming systems (Kafka, Kinesis) or large‑scale...PipelineWork at office
- xAI in Palo Alto is seeking a software engineer for the Data Platform team. You will design, build... ...powering data movement and real-time ML pipelines, handling trillions of events daily... ...and scalability. You will work with Kafka, Spark, Flink, Trino, and Hadoop in production...Pipeline
$168k - $270.25k
...organization is seeking an experienced data engineering professional for the position... .... Optimize data pipelines and analytics datasets for correctness... .... Interest in applied AI/ML and how trusted data... ...Athena, Glue, Redshift, EMR, Spark, Databricks, Delta Lake, or similar...Pipeline- Procorp in Sunnyvale, CA is seeking an AI/ML Data Engineer to design and implement data pipelines for AI/ML workloads. The role emphasizes Snowflake, Python/Scala... .... You will work with SQL/NoSQL databases, Hadoop/Spark, ETL tools, and Tableau to deliver scalable data solutions...PipelineWork at office
- ...Sam’s Club division seeks a Senior Engineering Manager for Agentic Data to evolve a massive data ecosystem... ...agents. You will build streaming pipelines with Kafka for up-to-the-second member context... ...cross-functional team bridging AI/ML, product, and platform engineering...Pipeline
$212k - $318.4k
...Description As a Machine Learning Data Platform Engineer, you'll design and build the... ...share, process, and consume ML datasets with enterprise-... ...ML training and evaluation pipelines. You\'ll collaborate with... ...technologies (Apache Iceberg, Spark, S3, distributed systems),...PipelineRelocation$133k - $254k
...transportation operating system. Our AI Data Pipeline Engineers build up the core data processing... ...high‑performance data serving SDKs for ML model training / evaluation. The data pipelines... ...g., Delta Lake) Experience with Apache Spark or other big data computing engines...PipelineWork experience placement42dot
Sunnyvale, CA3 days ago$210.9k - $316.9k
...our work building our data infrastructure as needed... ...mentoring promising junior engineers, as well as setting a... ...large-scale ETL/ELT pipelines (batching and/or streaming... ...such as Hadoop, Spark, and Flink Deep experience... ...Deep Understanding of ML Processes, Operations,...PipelineRelocation- ...needs, we are looking for a Data Engineer Job Title: Data Engineer Job... ...maintain production-grade data pipelines that process and transform... ...transformations using Dask or Apache Spark. Maintain training data... ...models and schemas for AI/ML continuous training use cases...Pipeline
$254.5k - $344k
Principal Software Engineer, Data Engineering Join to apply for... ...real-time analytics pipelines. Efficiency: Define and... ...technologies:, Hadoop, Kafka, Columnar Databases, and... ...) and Scala for Spark streaming/applications.... ...Notebooks, SageMaker. AI/ML: Background in AI skills...PipelineWork experience placement- MPower Plus is seeking a Spark/Scala Engineer for a full‑time role in Sunnyvale, CA. The ideal candidate... ...Go, along with knowledge of distributed data systems and Data Lake technologies such... ..., cloud platforms, Airflow, and AI/ML technologies. This position is vital for...Full time
$153k - $222k
...looking for infrastructure engineers with expertise in scaling open‑source data infrastructure to join the Data & ML infra group. This role... ...features to tune processing pipeline for fast data ingestion and... ...source data technologies (Spark, Kafka, Hudi, Flyte, etc.). Experience...PipelineFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- ...Do Architect, build, and optimize our data processing systems to ensure reliability... ...degree in Computer Science, Aerospace Engineering, Data Analytics, or a related field At... ...Led development of real‑time data pipelines using Kafka or related technologies Expertise with...PipelineLocal area
Archer
San Jose, CA3 days ago - ...an experienced candidate for a role requiring expertise in Java, Spark, and Hadoop, with a minimum of 2 years in distributed systems.... ...developing large-scale applications and requires strong knowledge in data modeling and machine learning algorithms. The role offers a...Contract work
$182k - $242k
...more at . What You’ll Do The Data Engineering Team builds and operates the... .... We design resilient data pipelines, scalable lakehouse systems,... ...processing systems using Spark, Flink, or similar technologies... ...‑driven architectures using Kafka, AutoMQ, Pulsar, or similar...PipelinePermanent employmentTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA1 day ago$148.75k - $361k
...About the team The mission of Roku's Data Engineering team is to develop a world‑class big data... ...data models & develop scalable data pipelines to capture different business metrics... ...Hadoop (HDFS, YARN, MapReduce), Hive, Kafka, Spark, Airflow, and Presto/Trino Deep expertise...PipelineWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hoursRoku
San Jose, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data DevOps Engineer: Spark & Kafka for ML Pipelines. Be the first to apply!
Related searches
- data engineer analytics Santa Clara, CA
- junior data engineer remote Santa Clara, CA
- senior cloud data engineer Santa Clara, CA
- data platform engineer Santa Clara, CA
- data infrastructure engineer Santa Clara, CA
- aws data engineer Santa Clara, CA
- director data engineering Santa Clara, CA
- senior data integration developer Santa Clara, CA
- data engineer machine learning Santa Clara, CA
- data center engineer Santa Clara, CA