Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines

Compunnel, Inc.

Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel, Inc.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy

Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
3 days ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
a month ago
Senior Data Engineer
$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
2 days ago
Big Data Engineer
...RESPONSIBILITIES Own a component of the data platform end to end - its pipelines, tables, quality checks,... ...and build ETL on EMR (Spark) and Airflow, and data... ...own, and choose the right engine for a workload (StarRocks... .... Comfortable on AWS (S3 with Parquet / ORC and...
Amazon Web Service
Pipeline
Big data
Local area
Worldwide
Socket.dev
Irvine, CA
5 days ago
Big Data Engineer
$100k - $120k
...Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including... ...Write SQL and Python for data ingestion, transformation,... ...Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent... ...similar. An OLAP / MPP engine: StarRocks, Doris,...
Amazon Web Service
Pipeline
Big data
Local area
Worldwide
TP-Link Systems Inc.
Irvine, CA
6 days ago
Sr Data Engineer
$130.33k - $195.5k
Sr Data Engineer (Finance) Alignment Health is breaking... ...committed to serving seniors and those who need it... ...data platform and its pipelines using big data technologies. As... ...to cloud and Hadoop/Spark to make the system grow... ...using Azure or AWS technologies - SQL Server...
Amazon Web Service
Pipeline
Senior
Big data
Immediate start
Alignment Healthcare USA, LLC in
Orange, CA
3 days ago
Senior Data Engineer (Newport Beach, CA): 26-00156
...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
6 days ago
Senior Data Engineer
$120k - $180k
Job Description Senior Data Engineer We are seeking a hands‑on Senior Data Engineer... ...batch and streaming pipelines, modernize legacy ETL workloads... ...with Databricks, Apache Spark, PySpark, SQL, Python, dbt,... ...with cloud data services on AWS, Azure, or Google Cloud. Working...
Amazon Web Service
Pipeline
Senior
Tata Consultancy Services
Irvine, CA
3 days ago
Lead Data Engineer
$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...for working on big data compilation projects... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....
Amazon Web Service
Pipeline
Big data
Temporary work
Work experience placement
U.S. Bank
Irvine, CA
6 days ago
Senior Data Engineer
$150k - $200k
Senior Data Engineer Gibson Dunn is a leading global law firm,... ...reliable, automated ETL/ELT pipelines to ingest, transform,... ...modeling (star and snowflake schemas), data... ...data platforms (e.g., AWS, Azure, Google Cloud,... ...frameworks (e.g., Apache Spark). Familiarity with...
Amazon Web Service
Pipeline
Senior
Local area
Flexible hours
Gibson Dunn
Orange, CA
2 days ago
Data Engineer - Senior Manager
$124k - $280k
...PwC, our people in data and analytics engineering focus on leveraging... ...and implementing data pipelines, data integration, and... ...needs. As a Senior Manager you lead large... ...Cloud Platforms [e.g., AWS Solutions Architect,... ...Engineer Associate, Snowflake Core, Snowflake Architect...
Amazon Web Service
Pipeline
Senior
H1b
PwC
Irvine, CA
2 days ago
10607 - Senior Data Engineer (Python)
$96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...
Amazon Web Service
Pipeline
Senior
Full time
Local area
Hyundai Autoever America
Irvine, CA
a month ago
Data Engineer
...Data EngineerWe believe technological and cultural... ...hypothesis.Job PurposeAs a Data Engineer at Nebulaworks, you... ..., and reliable data pipelines that ingest and process... ...using components of a big data software ecosystem... ...storage infrastructures in AWS cloud.Troubleshoot and...
Amazon Web Service
Pipeline
Big data
Work at office
Nebulaworks
Irvine, CA
4 days ago
Data Engineer
...Senior Data EngineerRequired Skills & Experience... ...7+ years of Data Engineering experience delivering... ...including PySpark/Spark. Strong experience... ...preferably within AWS. Hands-on... ...experience with: AWS Glue, Snowflake, DBT, Apache... ...end-to-end ETL/ELT pipelines in production environments...
Amazon Web Service
Pipeline
Contract work
Remote work
Insight Global
Irvine, CA
6 hours ago
Sr. Data Engineer
$145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...
Amazon Web Service
Pipeline
Senior
Immediate start
Flexible hours
MegazoneCloud US
Irvine, CA
2 days ago
Senior, Data Engineer
$150k - $175k
...contributions. ABOUT THE ROLE The Senior, Data Engineer is responsible for designing, building,... ...'ll own the architecture of our data pipelines end-to-end — from ingestion through transformation... ...of our Databricks environment on AWS. This role requires someone who can...
Amazon Web Service
Pipeline
Senior
TaxRise
Irvine, CA
6 days ago
Senior Software Engineer
...RESPONSIBILITIES: Leverage geo-spatial data and tools to analyze,... ...Work with various database and big data technologies like... ...completion. Create and modify CI/CD pipelines using Jenkins, Docker, KF, Kubernetes... ...cloud platforms like GCP, AWS, or Azure, deploying, managing...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Local area
Remote work
Flexible hours
CoreLogic
Irvine, CA
2 days ago
Data Engineer IV
...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...
Amazon Web Service
Pipeline
Temporary work
Flexible hours
Planet DDS
Irvine, CA
more than 2 months ago
Senior Analytics Engineer
$191k - $253k
...operating system that turns thousands of data streams into a realtime, 3D... ...than just dashboards. As a Staff Engineer, you should be a player-coach;... ...control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Work at office
Immediate start
Shift work
Anduril Industries, Inc.
Costa Mesa, CA
2 days ago
Software Engineer, Data Engineering
$146k - $194k
...ABOUT THE JOB As a Software Engineer, Data Engineering on the Maritime Digital Production... ..., Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with cloud platforms and services (e.g., AWS, Azure, GCP). Strong problem-...
Amazon Web Service
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
1 day ago
Data Science Senior Manager
$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...
Amazon Web Service
Pipeline
Senior
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
Newport Beach, CA
more than 2 months ago
Snowflake DBT Data Engineer
Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...
Pipeline
LTM
Irvine, CA
2 days ago
Data Engineer (Hybrid)
...Facebook, Instagram, X and YouTube. Job Description The Data Engineer will design and build scalable data-pipelines across initiatives such as agentic trail design,... ..., Swift/Objective C, or JavaScript Experience with Big Data Management, Master Data Management tools & SQL...
Amazon Web Service
Pipeline
Big data
Temporary work
Local area
Allergan
Irvine, CA
4 days ago
Data Strategy Lead
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...
Amazon Web Service
Pipeline
Big data
Full time
Work at office
Flexible hours
Pimco
Newport Beach, CA
4 days ago
Data Engineer
...Overview We are seeking a Data Engineer to support enterprise... ...maintaining reliable data pipelines, transforming business-... ...tools such as Databricks, Spark, Azure Data Factory, ADLS, Snowflake, SQL Server, DBT,... ...reporting Exposure to Azure, AWS, or GCP cloud ecosystems...
Amazon Web Service
Pipeline
Veritas Search Group
Tustin, CA
3 days ago
Data Engineer
Data Engineer Our client is seeking a highly skilled and experienced Data... ...maintaining scalable data pipelines using airflow and build Kafka... ...multi-cloud native technologies, AWS, Azure, GCP. Collaborating... ...such as Kafka, Hadoop, Airflow, Spark, SQL, etc. 5. Proficiency in...
Amazon Web Service
Pipeline
Internship
My3Tech Inc
Costa Mesa, CA
5 days ago
Principal, AI Engineering
...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
1 day ago
Sr. Manager, Software Development
$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Temporary work
Worldwide
Ingram Micro
Irvine, CA
2 days ago
Sr. Manager, Enterprise Architect - Tax Transformation
$155.63k - $317.88k
...architects to protect data and ensure... ...computer science, engineering, or a related field... ...AgentTechnology Certifications:AWS Certified Solutions... ...and CI/CD pipelines.Experience with serverless... ...warehousing and big data technologies would... ...level employees to senior leaders, we believe...
Amazon Web Service
Pipeline
Senior
Big data
Work at office
Local area
Shift work
Deloitte
Costa Mesa, CA
3 days ago
ConvergeSPORTS - Head Product Manager - Data and Product Engineering (Manager) - Innovation_Delivery_Transformation
$134.5k - $265.1k
...experience with proprietary data, AI-native decision... ...Management, Data Engineering, Data Science,... ...data models, APIs, pipelines, platform services,... ...technologies such as Snowflake, Databricks, AWS, Azure, GCP, Kafka,... ...-level employees to senior leaders, we believe...
Amazon Web Service
Pipeline
Local area
Deloitte
Costa Mesa, CA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines. Be the first to apply!