Senior Big Data Engineer AWS, Spark & Snowflake Pipelines

Compunnel

Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Big Data Engineer AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy

Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
2 days ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Flexible hours
Anduril Industries
Costa Mesa, CA
2 days ago
Senior Specialist - Quality Engineering
Job Title: Senior Specialist - Quality... ...a skilled Data Testing Engineer to validate data... ...for data pipelines.Validate reports... ...Server PostgreSQL Snowflake etc.Handson... ...Factory Databricks AWS Glue or... ....Knowledge of Big Data technologies... ...as Hadoop and Spark.Exposure to GenAI...
Amazon Web Service
Pipeline
Senior
Big data
LTM
Irvine, CA
3 days ago
Data Engineer - Manager
$99k - $232k
...PwC, our people in data and analytics engineering focus on... ...implementing data pipelines, data integration... ...Platforms [e.g., AWS Solutions Architect... ...Engineer Associate, or Snowflake Core, Snowflake... ...Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus...
Amazon Web Service
Pipeline
Big data
Full time
H1b
PwC
Irvine, CA
3 days ago
Principal, Data Engineer
...motivated and self-driven Data Engineer with a strong... ...batch and streaming data pipelines. The ideal candidate brings... ...cloud platforms such as AWS and Google Cloud Platform... ...Kit)Experience with big data and distributed processing... ...such as Hadoop, Spark, and ElasticsearchWorking...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
5 days ago
Senior Data Engineer
$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
1 day ago
Senior Data Engineer: 26-00156
...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
12 days ago
Senior Data Engineer
...SENIOR DATA ENGINEER Location; Newport Beach, CA or Charlotte, NC... ...scalable and reliable data pipelines to support data ingestions (... ...sources such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
2 days ago
Senior Big Data Engineer
$150k - $180k
...Responsibilities Develop and maintain the Big Data Platform by performing data cleansing,... ...Data technologies such as Hadoop, Flink, Spark, Hive, HBase, and Airflow, with proven expertise... ...cloud‑based deployments, particularly AWS EMR, with familiarity in other cloud...
Amazon Web Service
Senior
Big data
Local area
Worldwide
TP-Link Systems Inc.
Irvine, CA
2 days ago
Lead Data Engineer
$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...for working on big data compilation projects... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....
Amazon Web Service
Pipeline
Big data
Temporary work
Work experience placement
U.S. Bank
Irvine, CA
5 days ago
Senior Mission Data Platform Engineer
$166k - $220k
...turns thousands of data streams into a... ...Working across product, engineering, sales, logistics,... ...are seeking a Senior Mission Data Platform... ...g., Trino/Presto, AWS Athena),... ...Apache Kafka, Apache Spark).Extensive experience... ...Experience with data pipeline orchestration...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Worldwide
Anduril Industries
Irvine, CA
3 days ago
10607 - Senior Data Engineer (Python)
$96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...
Amazon Web Service
Pipeline
Senior
Full time
Local area
Hyundai Autoever America
Irvine, CA
6 days ago
Senior Cloud DevOps Engineer
$132.6k - $176.9k
...Senior Cloud DevOps Engineer If you are passionate about making... ...cutting-edge data technology and eager... ...on AWS and GCP. Build... ...related to data pipelines and data processing... ...as Glue, Lambda, Big Query, and Cloud... ...such as Python, Spark, YAML, Bash, MLops...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work at office
Local area
3 days per week
AAA
Costa Mesa, CA
1 day ago
Sr. Data Engineer
$145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...
Amazon Web Service
Pipeline
Senior
Immediate start
Flexible hours
MegazoneCloud US
Irvine, CA
3 days ago
Data Engineer IV
...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...
Amazon Web Service
Pipeline
Temporary work
Flexible hours
Planet DDS
Irvine, CA
more than 2 months ago
Senior Analytics Engineer
...responsible for modeling our internal data into reusable entities that... ...operations, product, and engineering to advocate best practices... ...and egress frameworks for data pipelines that stitch together various... ...data, we utilize Athena, an aws serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Anduril Industries
Costa Mesa, CA
5 days ago
Security Data Solutions Engineer
$120k - $202.5k
...forState Street's Cyber Data & Analytics (CyberDNA... ...Data Solutions Engineer to shape the next generation... ...such as Databricks, Snowflake, Kafka, Spark and logging agents... ...including ETL/ELT, streaming pipelines, data lakes, data... ...architectures across AWS, Azure, and Google...
Amazon Web Service
Pipeline
Full time
Temporary work
Work at office
Local area
Flexible hours
Shift work
2 days per week
State Street Bank
Irvine, CA
2 days ago
Senior Analytics Engineer
$191k - $253k
...operating system that turns thousands of data streams into a realtime, 3D... ...than just dashboards. As a Staff Engineer, you should be a player-coach;... ...control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Work at office
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
1 day ago
Sr. Data Engineer
...Sr. Data Engineer Location: Hybrid, 3x onsite in Costa Mesa, CA Duration: Long Term Contract... ...or a related role. ~ Proficiency in AWS services, specifically S3, Glue, Athena,... ...Design, build, and manage ETL data pipelines using AWS services such as S3, Glue, Athena...
Amazon Web Service
Pipeline
Senior
Long term contract
Group Nine LLC
Costa Mesa, CA
2 days ago
Data Science Senior Manager
$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...
Amazon Web Service
Pipeline
Senior
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
Newport Beach, CA
a month ago
Business Data Analyst
...Description The Data Analyst is responsible... ...for data engineering projects. Performs... ....g., Delta Lake, Snowflake). Knowledge of big data processing frameworks... ...(e.g., Apache Spark, Apache Dataflow)... ...cloud platforms (AWS, Azure, or GCP)... ..., Git) and CI/CD pipelines. The above...
Amazon Web Service
Pipeline
Big data
Temporary work
Work at office
Immediate start
Ascendum KPS
Irvine, CA
3 days ago
Security Data Engineer
$129k - $220k
...that turns thousands of data streams into a realtime... ...for a security data engineer to focus on building visibility... ...cutting edge data pipelines to support all internal... ...data environments (Spark, DuckDB, etc)Strong programming... ...(e.g., Terraform, AWS CDK, Pulumi) in a production...
Amazon Web Service
Pipeline
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
1 day ago
Snowflake DBT Data Engineer
Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...
Pipeline
LTM
Irvine, CA
5 days ago
Sr. Software Engineer, Data Platform
$166k - $220k
...ABOUT THE TEAM As a Senior Data Engineer on the Analytics Team, you will... ...design, build and implement data pipelines and models that enable our... ...data, we utilize Athena, an aws serverless solution that... ...language ~ Experience with Spark, PySpark, SQL and dbt ~ Experience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Relocation package
Anduril Industries
Costa Mesa, CA
1 day ago
Sr. Database Administrator
...CloudFormation. Hybrid Data Orchestration:... ...software deployment pipelines (CI/CD). Security... ...trails. Performance Engineering: Tune not just SQL... ...cloud provider (AWS, Azure, or OCI) and... ...increasingly NoSQL or Big Data solutions (MongoDB, Snowflake, Cassandra). Automation...
Amazon Web Service
Pipeline
Senior
Big data
Contract work
Local area
Jobot
Seal Beach, CA
2 days ago
Data Strategy Lead
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...
Amazon Web Service
Pipeline
Big data
Full time
Work at office
Flexible hours
Pimco
Newport Beach, CA
3 days ago
Senior AI Engineer
...years of experience in software engineering, data engineering, or AI/ML... ...experience building solutions in AWS cloud environments ~ Experience... ...(or similar) and Apache Spark for distributed data processing... ...Kubernetes Experience with CI/CD pipelines and deployment automation...
Amazon Web Service
Pipeline
Senior
ClifyX
Irvine, CA
2 days ago
Sr. Manager, Software Development
$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Temporary work
Worldwide
Ingram Micro
Irvine, CA
1 day ago
Principal, AI Engineering
...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
4 days ago
Senior AI Engineer
...Senior AI Engineer We are seeking a Senior AI Engineer to design, build... ...-grade Generative AI and Data Platform on AWS. The role focuses on... ...systems, and governed data pipelines. The ideal candidate will... ...with Databricks and Apache Spark Solid understanding of: Data...
Amazon Web Service
Pipeline
Senior
Cardinal Integrated
Irvine, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer AWS, Spark & Snowflake Pipelines. Be the first to apply!