Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines
Compunnel, Inc.
Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel, Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...Amazon Web ServicePipelineSeniorBig dataFull timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CAa month ago$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...Amazon Web ServicePipelineSeniorBig dataFull timeWork experience placementImmediate start$100k - $120k
...Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including... ...Write SQL and Python for data ingestion, transformation,... ...Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent... ...similar. An OLAP / MPP engine: StarRocks, Doris,...Amazon Web ServicePipelineBig dataLocal areaWorldwideTP-Link Systems Inc.
Irvine, CA6 days ago- ...RESPONSIBILITIES Own a component of the data platform end to end - its pipelines, tables, quality checks,... ...and build ETL on EMR (Spark) and Airflow, and data... ...own, and choose the right engine for a workload (StarRocks... .... Comfortable on AWS (S3 with Parquet / ORC and...Amazon Web ServicePipelineBig dataLocal areaWorldwide
- ...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...Amazon Web ServicePipelineSeniorContract workInterim role
Platinum Resource Group
Newport Beach, CA6 days ago $120k - $180k
Job Description Senior Data Engineer We are seeking a hands‑on Senior Data Engineer... ...batch and streaming pipelines, modernize legacy ETL workloads... ...with Databricks, Apache Spark, PySpark, SQL, Python, dbt,... ...with cloud data services on AWS, Azure, or Google Cloud. Working...Amazon Web ServicePipelineSenior$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...Amazon Web ServicePipelineSeniorFull timeWork experience placementImmediate startShift workAnduril Industries
Costa Mesa, CAa month ago$150k - $200k
Senior Data Engineer Gibson Dunn is a leading global law firm,... ...reliable, automated ETL/ELT pipelines to ingest, transform,... ...modeling (star and snowflake schemas), data... ...data platforms (e.g., AWS, Azure, Google Cloud,... ...frameworks (e.g., Apache Spark). Familiarity with...Amazon Web ServicePipelineSeniorLocal areaFlexible hours$124k - $280k
...PwC, our people in data and analytics engineering focus on leveraging... ...and implementing data pipelines, data integration, and... ...needs. As a Senior Manager you lead large... ...Cloud Platforms [e.g., AWS Solutions Architect,... ...Engineer Associate, Snowflake Core, Snowflake Architect...Amazon Web ServicePipelineSeniorH1b$96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...Amazon Web ServicePipelineSeniorFull timeLocal areaHyundai Autoever America
Irvine, CAa month ago- ...Senior Data EngineerRequired Skills & Experience... ...7+ years of Data Engineering experience delivering... ...including PySpark/Spark. Strong experience... ...preferably within AWS. Hands-on... ...experience with: AWS Glue, Snowflake, DBT, Apache... ...end-to-end ETL/ELT pipelines in production environments...Amazon Web ServicePipelineContract workRemote work
Insight Global
Irvine, CA1 hour ago - Data Engineer We believe technological and cultural change starts when the... ...scalable, and reliable data pipelines that ingest and process data... ...data sets using components of a big data software ecosystem.... ...database storage infrastructures in AWS cloud. Troubleshoot and...Amazon Web ServicePipelineBig dataWork at officeWork from home
$150k - $175k
...contributions. ABOUT THE ROLE The Senior, Data Engineer is responsible for designing, building,... ...'ll own the architecture of our data pipelines end-to-end — from ingestion through transformation... ...of our Databricks environment on AWS. This role requires someone who can...Amazon Web ServicePipelineSeniorTaxRise
Irvine, CA6 days ago- ...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...Amazon Web ServicePipelineTemporary workFlexible hours
Planet DDS
Irvine, CAmore than 2 months ago - ...Big Data EngineerExperian12+ month contractRemote - HQ in Costa Mesa, CA• BS degree in computer science, computer engineering or equivalent• 5 – 6 years of experience delivering enterprise... ...solutions• Proficient in Spark, Scala, Python, AWS Cloud technologies• 3+ years...Amazon Web ServiceBig data
My3Tech Inc
Costa Mesa, CA5 days ago - ...Consulting Partner - Data Engineering & Modern Data... ...on experience with Spark/PySpark and SQL.... ...as Databricks or Snowflake. Experience with... ...data platforms and pipelines. The Consulting... ...Serve as the senior technical advisor... ...engineering Cloud AWS, Azure and/or GCP...Amazon Web ServicePipelineFull time
Siri InfoSolutions Inc
Irvine, CA3 days ago $146k - $194k
...ABOUT THE JOB As a Software Engineer, Data Engineering on the Maritime Digital Production... ..., Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with cloud platforms and services (e.g., AWS, Azure, GCP). Strong problem-...Amazon Web ServiceBig dataFull timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA1 day ago$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...Amazon Web ServicePipelineSeniorPermanent employmentFull timeWork at officeWorldwideFlexible hoursSAP
Newport Beach, CAmore than 2 months ago- ...Overview We are seeking a Data Engineer to support enterprise... ...maintaining reliable data pipelines, transforming business-... ...tools such as Databricks, Spark, Azure Data Factory, ADLS, Snowflake, SQL Server, DBT,... ...reporting Exposure to Azure, AWS, or GCP cloud ecosystems...Amazon Web ServicePipeline
Veritas Search Group
Tustin, CA3 days ago $115k - $170k
...Data Engineer Opportunity At FieldAI In Irvine FieldAI's Irvine team... ...Engineer to build reliable data pipelines and infrastructure for... ...with cloud infrastructure on AWS, including object storage, compute... ...warehouse systems such as Redshift, Snowflake, BigQuery, Databricks, or...Amazon Web ServicePipelineLocal areaField AI
Irvine, CA1 day ago- Data Engineer Our client is seeking a highly skilled and experienced Data... ...maintaining scalable data pipelines using airflow and build Kafka... ...multi-cloud native technologies, AWS, Azure, GCP. Collaborating... ...such as Kafka, Hadoop, Airflow, Spark, SQL, etc. 5. Proficiency in...Amazon Web ServicePipelineInternship
$146k - $194k
...Software Engineer, Data Engineering Anduril Industries is a defense technology company... ...Python, Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with cloud platforms and services (e.g., AWS, Azure, GCP). Strong problem-...Amazon Web ServiceBig dataFull timeWork experience placementImmediate startRelocation packageAnduril Industries
Costa Mesa, CA1 day ago- Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...Pipeline
LTM
Irvine, CAa month ago $205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...Amazon Web ServicePipelineBig dataFull timeWork at officeFlexible hoursPimco
Newport Beach, CAa month ago$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...Amazon Web ServicePipelineSeniorBig dataFull timeTemporary workWorldwideIngram Micro
Irvine, CAa month ago- ...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...Amazon Web ServicePipelineBig dataFull timeWork experience placementLocal areaFlexible hours
CoreLogic
Irvine, CAa month ago - .... We go beyond typical data-driven(1) approaches or... ...problem list that drives our engineering roadmap. About the... ...will collaborate with pipeline and analytics engineers... ...with a major cloud ( AWS or GCP ), Kubernetes... ...platforms specifically (Spark/Databricks clusters,...Amazon Web ServicePipelineWork at officeFlexible hours
FieldAI
Irvine, CA5 days ago - ...RESPONSIBILITIES: Leverage geo-spatial data and tools to analyze,... ...Work with various database and big data technologies like... ...completion. Create and modify CI/CD pipelines using Jenkins, Docker, KF, Kubernetes... ...cloud platforms like GCP, AWS, or Azure, deploying, managing...Amazon Web ServicePipelineSeniorBig dataFull timeLocal areaRemote workFlexible hours
- ...Antech is building a new Data Engineering team, reporting under... ...Azure-centric data pipelines to ensure efficient data... ...Python, Java, JSON, Spark and SQL queries for better... ...and Sysmex MOLIS is a big plus. AI/ML Experience... ...(Oracle Cloud, AWS) to maintain scalability...Amazon Web ServicePipelineWork at office
- ...place. We go beyond typical data-driven approaches or pure transformer... ..., combining rigorous engineering with learning systems proven... ...quality. Develop reliable pipelines for transforming raw robot data... ...such as S3, Airflow/Dagster, Spark/Ray, Kubernetes, Parquet, or...PipelineSeniorLocal area
FieldAI
Irvine, CA6 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines. Be the first to apply!
Related searches
- aws data engineer Costa Mesa, CA
- data engineer machine learning Costa Mesa, CA
- data science developer Costa Mesa, CA
- senior data engineer Costa Mesa, CA
- finance data engineer Costa Mesa, CA
- data engineer analytics Costa Mesa, CA
- senior data integration developer Costa Mesa, CA
- junior data engineer remote Costa Mesa, CA
- data center engineer Costa Mesa, CA
- data engineer Costa Mesa, CA