Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines

Compunnel, Inc.

Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel, Inc.

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy

Senior Data Engineer
$125.1k - $152.9k
...matters most. It's a big ask, but it's one... ...actively seeking a Senior Data Engineer to join our... ...within an existing Snowflake environment hosted on AWS. This role supports... ...support ETL/ELT data pipelines that ingest and transform... ...platforms (e.g., Spark). Experience using...
Amazon Web Service
Pipeline
Senior
Big data
Flexible hours
Pacific Life
Newport Beach, CA
3 days ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
4 days ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Flexible hours
Anduril Industries
Costa Mesa, CA
11 hours ago
Senior Data Engineer
$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
3 days ago
Senior Data Engineer
...SENIOR DATA ENGINEER Location; Newport Beach, CA or Charlotte, NC... ...scalable and reliable data pipelines to support data ingestions (... ...sources such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
4 days ago
Lead Data Engineer
$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...Responsible for working on big data compilation... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....
Amazon Web Service
Pipeline
Big data
Temporary work
Work experience placement
U.S. Bank
Irvine, CA
1 day ago
Senior Big Data Engineer
$150k - $180k
...Responsibilities Develop and maintain the Big Data Platform by performing data cleansing,... ...Data technologies such as Hadoop, Flink, Spark, Hive, HBase, and Airflow, with proven expertise... ...cloud‑based deployments, particularly AWS EMR, with familiarity in other cloud...
Amazon Web Service
Senior
Big data
Local area
Worldwide
TP-Link Systems Inc.
Irvine, CA
4 days ago
Senior Mission Data Platform Engineer
$166k - $220k
...turns thousands of data streams into a... ...Working across product, engineering, sales, logistics,... ...are seeking a Senior Mission Data Platform... ...g., Trino/Presto, AWS Athena),... ...Apache Kafka, Apache Spark).Extensive experience... ...Experience with data pipeline orchestration...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Worldwide
Anduril Industries
Irvine, CA
11 hours ago
10607 - Senior Data Engineer (Python)
$96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...
Amazon Web Service
Pipeline
Senior
Full time
Local area
Hyundai Autoever America
Irvine, CA
18 days ago
Sr. Data Engineer
$145k - $165k
...Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...
Amazon Web Service
Pipeline
Senior
Immediate start
Flexible hours
MegazoneCloud US
Irvine, CA
1 day ago
Data Engineer IV
...enough to own big outcomes. Trust... .... Overview The Data Engineer V will: Design... ...scalable data pipelines, ETL/ELT workflows... ...Collaborate with senior leadership to... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...
Amazon Web Service
Pipeline
Temporary work
Flexible hours
Planet
Irvine, CA
2 days ago
Senior Analytics Engineer
$166k - $220k
...Senior Analytics Engineer Anduril Industries is a defense technology company with... ...that turns thousands of data streams into a realtime, 3D... ...egress frameworks for data pipelines that stitch together various... ...data, we utilize Athena, an AWS serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Shift work
anduril
Costa Mesa, CA
4 days ago
Business Data Analyst
...Description The Data Analyst is responsible... ...for data engineering projects. Performs... ....g., Delta Lake, Snowflake). Knowledge of big data processing frameworks... ...(e.g., Apache Spark, Apache Dataflow)... ...cloud platforms (AWS, Azure, or GCP)... ..., Git) and CI/CD pipelines. The above...
Amazon Web Service
Pipeline
Big data
Temporary work
Work at office
Immediate start
Ascendum KPS
Irvine, CA
1 day ago
Senior Data Product Analyst - Data Management Engineer III
$107.9k - $179.9k
...passionate pioneer in data and technology who... ...As an experienced Senior Data Product... ...- Data Management Engineer III, you will have... ...technologies such as Spark, Airflow, dbt, or equivalent... ..., such as Snowflake, Databricks, Microsoft Azure, AWS, or Google Cloud.Experience...
Amazon Web Service
Senior
Local area
Visa sponsorship
Deloitte
Costa Mesa, CA
2 days ago
Security Data Solutions Engineer
$120k - $202.5k
...forState Street's Cyber Data & Analytics (CyberDNA... ...Data Solutions Engineer to shape the next generation... ...such as Databricks, Snowflake, Kafka, Spark and logging agents... ...including ETL/ELT, streaming pipelines, data lakes, data... ...architectures across AWS, Azure, and Google...
Amazon Web Service
Pipeline
Full time
Temporary work
Work at office
Local area
Flexible hours
Shift work
2 days per week
State Street Bank
Irvine, CA
4 days ago
Sr. Data Engineer
...Sr. Data EngineerLocation: Hybrid, 3x onsite in Costa Mesa, CA Duration:... ...shop.10+ years of experience in data engineering or a related role.Proficiency in AWS services, specifically S3, Glue,... ...Design, build, and manage ETL data pipelines using AWS services such as S3,...
Amazon Web Service
Pipeline
Senior
Group Nine LLC
Costa Mesa, CA
11 hours ago
Big Data Engineer
...Big Data EngineerExperian12+ month contractRemote - HQ in Costa Mesa, CA• BS degree in computer science, computer engineering or equivalent• 5 – 6 years of experience delivering enterprise... ...solutions• Proficient in Spark, Scala, Python, AWS Cloud technologies• 3+ years...
Amazon Web Service
Big data
Software Technology Inc
Costa Mesa, CA
11 hours ago
Data Engineer
...Senior Data EngineerNewport Beach, CA (Remote, prefer... ...(i.e. Azure or AWS) to build solution for... ...best practices into engineering solutionsManage code... ...Databricks, SQLDW or Snowflake, Azure analysis services... ...DO NOT want Big Data, Hadoop, Spark, Python engineers....
Amazon Web Service
Big data
Contract work
Work experience placement
Remote work
Software Technology Inc
Newport Coast, CA
11 hours ago
Data Science Senior Manager
$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...
Amazon Web Service
Pipeline
Senior
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
Newport Beach, CA
more than 2 months ago
Snowflake DBT Data Engineer
Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...
Pipeline
LTM
Irvine, CA
3 days ago
Sr. Database Administrator
$60 - $73 per hour
...CloudFormation. Hybrid Data Orchestration:... ...software deployment pipelines (CI/CD). Security &... ...trails. Performance Engineering: Tune not just SQL queries... ...cloud provider (AWS, Azure, or OCI) and... ...increasingly NoSQL or Big Data solutions (MongoDB, Snowflake, Cassandra). Automation...
Amazon Web Service
Pipeline
Senior
Big data
Hourly pay
Contract work
Bank staff
Local area
Jobot Consulting
Seal Beach, CA
3 days ago
Data Strategy Lead
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...
Amazon Web Service
Pipeline
Big data
Full time
Work at office
Flexible hours
Pimco
Newport Beach, CA
11 hours ago
Senior AI Engineer
...years of experience in software engineering, data engineering, or AI/ML... ...experience building solutions in AWS cloud environments ~ Experience... ...(or similar) and Apache Spark for distributed data processing... ...Kubernetes Experience with CI/CD pipelines and deployment automation...
Amazon Web Service
Pipeline
Senior
ClifyX
Irvine, CA
5 days ago
Data Engineer
...Data EngineerWe are seeking a Data Engineer to support enterprise data transformation... ...maintaining reliable data pipelines, transforming... ...such as Databricks, Spark, Azure Data Factory, ADLS, Snowflake, SQL Server, DBT, Airflow... ...reportingExposure to Azure, AWS, or GCP cloud...
Amazon Web Service
Pipeline
RecruiterPerry
Tustin, CA
11 hours ago
Senior AI Engineer
...Senior AI Engineer We are seeking a Senior AI Engineer to design, build... ...-grade Generative AI and Data Platform on AWS. The role focuses on... ...systems, and governed data pipelines. The ideal candidate will... ...with Databricks and Apache Spark Solid understanding of: Data...
Amazon Web Service
Pipeline
Senior
Cardinal Integrated
Irvine, CA
4 days ago
Sr. Manager, Software Development
$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Temporary work
Worldwide
Ingram Micro
Irvine, CA
3 days ago
Principal, AI Engineering
...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
2 days ago
Sr. Manager, Enterprise Architect - Tax Transformation
$155.63k - $317.88k
...architects to protect data and ensure... ...computer science, engineering, or a related field... ...AgentTechnology Certifications:AWS Certified Solutions... ...and CI/CD pipelines.Experience with serverless... ...warehousing and big data technologies would... ...level employees to senior leaders, we believe...
Amazon Web Service
Pipeline
Senior
Big data
Work at office
Local area
Shift work
Deloitte
Costa Mesa, CA
3 days ago
Senior Software Engineer (Data)
$120k - $180k
WHAT YOU’LL DO As a Senior Software Engineer on Viant’s Data team, you will build and optimize the data systems... ...cloud environment spanning GCP and AWS. This role is ideal for an engineer... ...DAY Design, develop, and deploy data pipelines and backend services in a cloud...
Amazon Web Service
Pipeline
Senior
Work experience placement
Local area
Viant
Irvine, CA
2 days ago
Software Engineer, Data Engineering
$115k - $170k
...Data Engineer Position at FieldAIFieldAI's Irvine team is where embodied... ...Engineer to build reliable data pipelines and infrastructure for... ...with cloud infrastructure on AWS, including object storage, compute... ...systems such as Redshift, Snowflake, BigQuery, Databricks, or Athena...
Amazon Web Service
Pipeline
Local area
Field AI
Irvine, CA
12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines. Be the first to apply!