Senior Big Data Engineer AWS, Spark & Snowflake Pipelines

Compunnel

Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Senior Big Data Engineer AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy

Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
3 days ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Flexible hours
Anduril Industries
Costa Mesa, CA
4 days ago
Senior Specialist - Quality Engineering
Job Title: Senior Specialist - Quality... ...a skilled Data Testing Engineer to validate data... ...for data pipelines.Validate reports... ...Server PostgreSQL Snowflake etc.Handson... ...Factory Databricks AWS Glue or... ....Knowledge of Big Data technologies... ...as Hadoop and Spark.Exposure to GenAI...
Amazon Web Service
Pipeline
Senior
Big data
LTM
Irvine, CA
4 days ago
Data Engineer - Manager
$99k - $232k
...PwC, our people in data and analytics engineering focus on... ...implementing data pipelines, data integration... ...Platforms [e.g., AWS Solutions Architect... ...Engineer Associate, or Snowflake Core, Snowflake... ...Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus...
Amazon Web Service
Pipeline
Big data
Full time
H1b
PwC
Irvine, CA
4 days ago
Principal, Data Engineer
...motivated and self-driven Data Engineer with a strong... ...batch and streaming data pipelines. The ideal candidate brings... ...cloud platforms such as AWS and Google Cloud Platform... ...Kit)Experience with big data and distributed processing... ...such as Hadoop, Spark, and ElasticsearchWorking...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
1 day ago
Senior Data Engineer
$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
2 days ago
Senior Data Engineer: 26-00156
...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
13 days ago
Senior Big Data Engineer
$150k - $180k
...Responsibilities Develop and maintain the Big Data Platform by performing data cleansing,... ...Data technologies such as Hadoop, Flink, Spark, Hive, HBase, and Airflow, with proven expertise... ...cloud‑based deployments, particularly AWS EMR, with familiarity in other cloud...
Amazon Web Service
Senior
Big data
Local area
Worldwide
TP-Link Systems Inc.
Irvine, CA
3 days ago
Data Engineer - Senior Manager
$124k - $280k
...PwC, our people in data and analytics engineering focus on leveraging... ...and implementing data pipelines, data integration, and... ...needs. As a Senior Manager you lead large... ...Cloud Platforms [e.g., AWS Solutions Architect,... ...Engineer Associate, Snowflake Core, Snowflake Architect...
Amazon Web Service
Pipeline
Senior
H1b
PwC
Irvine, CA
2 days ago
Lead Data Engineer
$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...for working on big data compilation projects... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....
Amazon Web Service
Pipeline
Big data
Temporary work
Work experience placement
U.S. Bank
Irvine, CA
1 day ago
Senior Mission Data Platform Engineer
$166k - $220k
...turns thousands of data streams into a... ...Working across product, engineering, sales, logistics,... ...are seeking a Senior Mission Data Platform... ...g., Trino/Presto, AWS Athena),... ...Apache Kafka, Apache Spark).Extensive experience... ...Experience with data pipeline orchestration...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Worldwide
Anduril Industries
Irvine, CA
4 days ago
10607 - Senior Data Engineer (Python)
$96.55k - $138.06k
...Description Job Description 10607 – Senior Data Engineer Location: Irvine, CA... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...
Amazon Web Service
Pipeline
Senior
Local area
Hyundai Autoever America
Irvine, CA
7 days ago
Sr. Data Engineer
$145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...
Amazon Web Service
Pipeline
Senior
Immediate start
Flexible hours
MegazoneCloud US
Irvine, CA
2 days ago
Data Engineer IV
...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...
Amazon Web Service
Pipeline
Temporary work
Flexible hours
Planet DDS
Irvine, CA
more than 2 months ago
Security Data Solutions Engineer
$120k - $202.5k
...forState Street's Cyber Data & Analytics (CyberDNA... ...Data Solutions Engineer to shape the next generation... ...such as Databricks, Snowflake, Kafka, Spark and logging agents... ...including ETL/ELT, streaming pipelines, data lakes, data... ...architectures across AWS, Azure, and Google...
Amazon Web Service
Pipeline
Full time
Temporary work
Work at office
Local area
Flexible hours
Shift work
2 days per week
State Street Bank
Irvine, CA
3 days ago
Senior Analytics Engineer
$191k - $253k
...operating system that turns thousands of data streams into a realtime, 3D... ...than just dashboards. As a Staff Engineer, you should be a player-coach;... ...control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Work at office
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
2 days ago
Data Science Senior Manager
$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...
Amazon Web Service
Pipeline
Senior
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
Newport Beach, CA
a month ago
Business Data Analyst
...Description The Data Analyst is responsible... ...for data engineering projects. Performs... ....g., Delta Lake, Snowflake). Knowledge of big data processing frameworks... ...(e.g., Apache Spark, Apache Dataflow)... ...cloud platforms (AWS, Azure, or GCP)... ..., Git) and CI/CD pipelines. The above...
Amazon Web Service
Pipeline
Big data
Temporary work
Work at office
Immediate start
Ascendum KPS
Irvine, CA
4 days ago
Security Data Engineer
$129k - $220k
...that turns thousands of data streams into a realtime... ...for a security data engineer to focus on building visibility... ...cutting edge data pipelines to support all internal... ...data environments (Spark, DuckDB, etc)Strong programming... ...(e.g., Terraform, AWS CDK, Pulumi) in a production...
Amazon Web Service
Pipeline
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
2 days ago
Snowflake DBT Data Engineer
Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...
Pipeline
LTM
Irvine, CA
1 day ago
Sr. Software Engineer, Data Platform
$166k - $220k
...ABOUT THE TEAM As a Senior Data Engineer on the Analytics Team, you will... ...design, build and implement data pipelines and models that enable our... ...data, we utilize Athena, an aws serverless solution that... ...language ~ Experience with Spark, PySpark, SQL and dbt ~ Experience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Relocation package
Anduril Industries
Costa Mesa, CA
14 hours ago
Data Strategy Lead
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...
Amazon Web Service
Pipeline
Big data
Full time
Work at office
Flexible hours
Pimco
Newport Beach, CA
4 days ago
Director of AI Engineering
$143.5k - $205k
...Director Of Ai Engineering The Director of AI... ...mentor a team of data scientists and AI... ...practices for AI/ML pipelines, including model monitoring... ...ADF, Databricks), AWS, Google Cloud, Snowflake. Programming &... ..., Alteryx. Big Data & Infrastructure: Spark, Kubernetes, Kafka...
Amazon Web Service
Pipeline
Big data
Full time
Local area
ABM Industries
Tustin, CA
2 days ago
Principal, AI Engineering
...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
14 hours ago
Sr. Manager, Software Development
$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Temporary work
Worldwide
Ingram Micro
Irvine, CA
2 days ago
Senior Site Reliability Engineer, Data & Analytics
$102.8k - $190.2k
...Battle.net & Online ProductsJob Title:Senior Site Reliability Engineer, Data & AnalyticsRequisition ID:R027436Job... ...-scale data platforms, analytics pipelines, ML training pipelines, and inference... ...systems in cloud environments (GCP, AWS) Your Platform  Best known for iconic...
Amazon Web Service
Pipeline
Senior
Full time
Temporary work
Part time
Local area
Remote work
Relocation package
Blizzard Entertainment
Irvine, CA
14 hours ago
Senior Software Engineer (Data)
$120k - $180k
WHAT YOU’LL DO As a Senior Software Engineer on Viant’s Data team, you will build and optimize the data systems... ...cloud environment spanning GCP and AWS. This role is ideal for an engineer... ...DAY Design, develop, and deploy data pipelines and backend services in a cloud...
Amazon Web Service
Pipeline
Senior
Work experience placement
Local area
Viant
Irvine, CA
1 day ago
Senior Data Engineer — Lead Data Pipelines for Defense Tech
$166k - $220k
Front Door Defense is seeking a Senior Data Engineer in Costa Mesa, California, responsible for designing... ...and implementing scalable data pipelines for defense analytics. The role... ...with proficiency in Python, SQL, and Spark. Compensation ranges from $166,000 to...
Pipeline
Senior
Front Door Defense
Costa Mesa, CA
1 day ago
Sr. Database Administrator
$60 - $73 per hour
...CloudFormation. Hybrid Data Orchestration:... ...software deployment pipelines (CI/CD). Security &... ...trails. Performance Engineering: Tune not just SQL queries... ...cloud provider (AWS, Azure, or OCI) and... ...increasingly NoSQL or Big Data solutions (MongoDB, Snowflake, Cassandra)....
Amazon Web Service
Pipeline
Senior
Big data
Hourly pay
Contract work
Bank staff
Local area
Jobot Consulting
Seal Beach, CA
3 days ago
Data Engineer - Project Delivery Specialist
$102.75k - $171.25k
...environment? As an experienced Data Engineer - Project Delivery... ...cost-effective data pipelines and curated datasets... ...data pipelines on AWS.Design robust ingestion... ...systems into S3 and into Snowflake.Develop transformation... ...-level employees to senior leaders, we believe there...
Amazon Web Service
Pipeline
Local area
Visa sponsorship
Deloitte
Costa Mesa, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer AWS, Spark & Snowflake Pipelines. Be the first to apply!