Senior Big Data Engineer AWS, Spark & Snowflake Pipelines

Compunnel

Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Senior Big Data Engineer AWS, Spark & Snowflake Pipelines in Costa Mesa, CA vacancy

Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
1 day ago
Senior Analytics Engineer, People Data
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...
Amazon Web Service
Pipeline
Senior
Big data
Full time
Work experience placement
Flexible hours
Anduril Industries
Costa Mesa, CA
2 days ago
Sr Databricks Data Engineer
$116.2k - $229.1k
...Deloitte’s AI & Engineering practice and... ...platforms, modernize data environments,... ...modelling. • Pipeline Ownership:... ...integrate new big data and analytics... ...Azure DevOps, AWS Code Pipeline,... ...architecture, Apache Spark, Delta Lake,... ...level employees to senior leaders, we...
Amazon Web Service
Pipeline
Senior
Big data
Local area
Visa sponsorship
Deloitte
Costa Mesa, CA
1 day ago
Remote Sr. Data Engineer
...Description: We are seeking a Senior Data Engineer to join our team and help... ...and implement data pipelines that transform our data into... ...concepts and practices Big Data Technologies : Spark, Databricks, Structured Streaming... ...Cloud Platforms : AWS or Azure and their data...
Amazon Web Service
Pipeline
Senior
Big data
Remote work
Worldwide
GrabJobs
Santa Ana, CA
2 days ago
Senior Big Data Engineer
$150k - $180k
...Responsibilities Develop and maintain the Big Data Platform by performing data cleansing,... ...Data technologies such as Hadoop, Flink, Spark, Hive, HBase, and Airflow, with proven expertise... ...cloud‑based deployments, particularly AWS EMR, with familiarity in other cloud...
Amazon Web Service
Senior
Big data
Local area
Worldwide
TP-Link Systems Inc.
Irvine, CA
4 days ago
Senior Data Engineer
$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
5 days ago
Senior Data Engineer: 26-00156
...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...
Amazon Web Service
Pipeline
Senior
Contract work
Interim role
Platinum Resource Group
Newport Beach, CA
15 days ago
Senior Data Engineer
...Senior Data Engineer Location:- Irvine,CA(Onsite) Duration:- Full Time... ...reliable batch and streaming pipelines, modernize legacy ETL... ...experience with Databricks, Apache Spark, PySpark, SQL, Python, dbt,... ...with cloud data services on AWS, Azure, or Google Cloud....
Amazon Web Service
Pipeline
Senior
Full time
Siri InfoSolutions Inc
Irvine, CA
2 days ago
Lead Data Engineer
$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...for working on big data compilation projects... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....
Amazon Web Service
Pipeline
Big data
Temporary work
Work experience placement
U.S. Bank
Irvine, CA
4 days ago
Senior Data Engineer
$108k - $153k
...inspiring journey. We’re seeking a Senior Data Engineer with strong enterprise... ...governed, production‑grade data pipelines and analytics products using Databricks, Apache Spark, SQL, and CI/CD practices. This... ...experience with cloud platforms (AWS preferred: EC2, S3, Lambda;...
Amazon Web Service
Pipeline
Senior
Relocation package
JobCubby
Irvine, CA
3 days ago
Senior Mission Data Platform Engineer
$166k - $220k
...turns thousands of data streams into a... ...Working across product, engineering, sales, logistics,... ...are seeking a Senior Mission Data Platform... ...g., Trino/Presto, AWS Athena),... ...Apache Kafka, Apache Spark).Extensive experience... ...Experience with data pipeline orchestration...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Immediate start
Worldwide
Anduril Industries
Irvine, CA
2 days ago
10607 - Senior Data Engineer (Python)
$96.55k - $138.06k
...Description Job Description 10607 – Senior Data Engineer Location: Irvine, CA... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...
Amazon Web Service
Pipeline
Senior
Local area
Hyundai Autoever America
Irvine, CA
15 days ago
Remote Sr. Data Engineer
...Description We're looking for a Senior Data Engineer to design and implement AI... ...end to end — from data pipelines through GenAI and agentic workflows... .../LLMOps practices across AWS, Azure, and GCP. You'll own... ...databases, and modern frameworks (Spark, LangChain, Databricks,...
Amazon Web Service
Pipeline
Senior
Remote work
GrabJobs
Costa Mesa, CA
1 day ago
Remote Senior Data Engineer
...highly skilled and experienced Senior Data Engineer to collaborate with us to... ...organization that includes AWS and Azure. Define and enforce... ...Engineering & Infrastructure ELT pipelines using AWS Infrastructure,... ..., Apache Airflow, Snowflake, and dbt. Oversee the design...
Amazon Web Service
Pipeline
Senior
Immediate start
Remote work
Home office
Flexible hours
Shift work
GrabJobs
Garden Grove, CA
2 days ago
Sr. Data Engineer
$145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...
Amazon Web Service
Pipeline
Senior
Immediate start
Flexible hours
MegazoneCloud US
Irvine, CA
2 days ago
Remote Data Engineer
$135k - $155k
...are seeking a driven Data Engineer to support a federal government... ...scalable data pipelines for enterprise-level data... ...Kafka and Apache Spark, supporting both real-... ...Qualifications AWS Data Engineer certification... ...modeling, star/snowflake schemas). Experience...
Amazon Web Service
Pipeline
Permanent employment
Contract work
Remote work
GrabJobs
Costa Mesa, CA
3 days ago
Senior Analytics Engineer
$191k - $253k
...operating system that turns thousands of data streams into a realtime, 3D... ...than just dashboards. As a Staff Engineer, you should be a player-coach;... ...control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows...
Amazon Web Service
Pipeline
Senior
Full time
Work experience placement
Work at office
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
3 days ago
Business Data Analyst
...Description The Data Analyst is responsible... ...for data engineering projects. Performs... ....g., Delta Lake, Snowflake). Knowledge of big data processing frameworks... ...(e.g., Apache Spark, Apache Dataflow)... ...cloud platforms (AWS, Azure, or GCP)... ..., Git) and CI/CD pipelines. The above...
Amazon Web Service
Pipeline
Big data
Temporary work
Work at office
Immediate start
Ascendum KPS
Irvine, CA
3 days ago
Data Engineer IV
...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...
Amazon Web Service
Pipeline
Temporary work
Flexible hours
Planet DDS
Irvine, CA
more than 2 months ago
Security Data Solutions Engineer
$120k - $202.5k
...forState Street's Cyber Data & Analytics (CyberDNA... ...Data Solutions Engineer to shape the next generation... ...such as Databricks, Snowflake, Kafka, Spark and logging agents... ...including ETL/ELT, streaming pipelines, data lakes, data... ...architectures across AWS, Azure, and Google...
Amazon Web Service
Pipeline
Full time
Temporary work
Work at office
Local area
Flexible hours
Shift work
2 days per week
State Street Bank
Irvine, CA
1 day ago
Remote Sr. Data Engineer
$144.77k - $209.11k
...Sr. Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS... ...Complete development efforts across data pipeline to store, manage, store, and provision to... ..., R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies...
Pipeline
Senior
Big data
Full time
Remote work
Flexible hours
GrabJobs
Irvine, CA
2 days ago
Data Engineer II
$76.73k - $127.88k
...environment? As an experienced Data Engineer, you will have the... ...cost-effective data pipelines and curated datasets... ...data pipelines on AWS.Design robust ingestion... ...systems into S3 and into Snowflake.Develop transformation... ...-level employees to senior leaders, we believe there...
Amazon Web Service
Pipeline
Local area
Visa sponsorship
Deloitte
Costa Mesa, CA
2 days ago
Data Science Senior Manager
$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...
Amazon Web Service
Pipeline
Senior
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
Newport Beach, CA
more than 2 months ago
Snowflake DBT Data Engineer
Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...
Pipeline
LTM
Irvine, CA
5 days ago
Sr. Database Administrator
$60 - $73 per hour
...CloudFormation. Hybrid Data Orchestration:... ...software deployment pipelines (CI/CD). Security &... ...trails. Performance Engineering: Tune not just SQL queries... ...cloud provider (AWS, Azure, or OCI) and... ...increasingly NoSQL or Big Data solutions (MongoDB, Snowflake, Cassandra). Automation...
Amazon Web Service
Pipeline
Senior
Big data
Hourly pay
Contract work
Bank staff
Local area
Jobot Consulting
Seal Beach, CA
5 days ago
Director of AI Engineering
$143.5k - $205k
...Director Of Ai Engineering The Director of AI... ...mentor a team of data scientists and AI... ...practices for AI/ML pipelines, including model monitoring... ...ADF, Databricks), AWS, Google Cloud, Snowflake. Programming &... ..., Alteryx. Big Data & Infrastructure: Spark, Kubernetes, Kafka...
Amazon Web Service
Pipeline
Big data
Full time
Local area
ABM Industries
Tustin, CA
5 days ago
Data Strategy Lead
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...
Amazon Web Service
Pipeline
Big data
Full time
Work at office
Flexible hours
Pimco
Newport Beach, CA
2 days ago
Data Engineer
$70 - $80 per hour
...Join to apply for the Data Engineer role at Jobright.ai 2... ...maintaining SQL Server and Snowflake Data Warehouses and... ...Server, MySQL, and AWS RDS environments. • Build and optimize ETL pipeline processes using Snowpipe... ...currently Growth Stage. Seniority level Seniority level...
Amazon Web Service
Pipeline
Full time
Work at office
jobright.com
Irvine, CA
4 days ago
Remote Senior Data Engineer
$175k - $220k
...urgency, and want to matter at scale. As a Senior Data Engineer, you will be tasked with designing and... ...tools like Dagster and dbt to orchestrate data pipelines and define workflows between Planetscale, Tinybird, and Snowflake. Responsibilities: Lead the design...
Pipeline
Senior
Remote work
Home office
Visa sponsorship
Work visa
Flexible hours
GrabJobs
Irvine, CA
3 days ago
Principal, AI Engineering
...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...
Amazon Web Service
Pipeline
Big data
Full time
Work experience placement
Local area
Flexible hours
CoreLogic
Irvine, CA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer AWS, Spark & Snowflake Pipelines. Be the first to apply!