Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines
Compunnel, Inc.
Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines. The ideal candidate will have extensive experience in big data application development, ensuring reliability and performance. Responsibilities include developing microservices architectures and collaborating with cross-functional teams. #J-18808-Ljbffr Compunnel, Inc.
$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...Amazon Web ServicePipelineSeniorBig dataFull timeWork experience placementImmediate start$166k - $220k
...turns thousands of data streams into a... ...data models and pipelines. Your primary... ...advocating for engineering best practices,... ...solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks... ...Experience with big data processing... ...frameworks (e.g., Apache Spark, Flink) and...Amazon Web ServicePipelineSeniorBig dataFull timeWork experience placementImmediate start$166k - $220k
...that turns thousands of data streams into a realtime... ...THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...we utilize Athena, an aws serverless solution that... ...languageExperience with Spark, PySpark, SQL and dbtExperience...Amazon Web ServicePipelineSeniorFull timeWork experience placementImmediate startShift work- ...RESPONSIBILITIES Own a component of the data platform end to end - its pipelines, tables, quality checks,... ...and build ETL on EMR (Spark) and Airflow, and data... ...own, and choose the right engine for a workload (StarRocks... .... Comfortable on AWS (S3 with Parquet / ORC and...Amazon Web ServicePipelineBig dataLocal areaWorldwide
$100k - $120k
...Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including... ...Write SQL and Python for data ingestion, transformation,... ...Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent... ...similar. An OLAP / MPP engine: StarRocks, Doris,...Amazon Web ServicePipelineBig dataLocal areaWorldwide$130.33k - $195.5k
Sr Data Engineer (Finance) Alignment Health is breaking... ...committed to serving seniors and those who need it... ...data platform and its pipelines using big data technologies. As... ...to cloud and Hadoop/Spark to make the system grow... ...using Azure or AWS technologies - SQL Server...Amazon Web ServicePipelineSeniorBig dataImmediate start- ...Description Job Description SENIOR DATA ENGINEER Location; Newport... ...scalable and reliable data pipelines to support data ingestions (... ...such as Flat Files, SQL, AWS RDS, S3 etc. and help centralize the information on Snowflake. Hands on experience in ingestion...Amazon Web ServicePipelineSeniorContract workInterim role
$120k - $180k
Job Description Senior Data Engineer We are seeking a hands‑on Senior Data Engineer... ...batch and streaming pipelines, modernize legacy ETL workloads... ...with Databricks, Apache Spark, PySpark, SQL, Python, dbt,... ...with cloud data services on AWS, Azure, or Google Cloud. Working...Amazon Web ServicePipelineSenior$119.77k - $140.9k
...to apply for the Lead Data Engineer role at U.S. Bank . At... ...for working on big data compilation projects... ...Develop and maintain data pipelines to ingest, process,... ...warehouse solutions (e.g., Snowflake, Amazon Redshift, RDS,... ...technologies (e.g., AWS, Azure, Google Cloud)....Amazon Web ServicePipelineBig dataTemporary workWork experience placement$150k - $200k
Senior Data Engineer Gibson Dunn is a leading global law firm,... ...reliable, automated ETL/ELT pipelines to ingest, transform,... ...modeling (star and snowflake schemas), data... ...data platforms (e.g., AWS, Azure, Google Cloud,... ...frameworks (e.g., Apache Spark). Familiarity with...Amazon Web ServicePipelineSeniorLocal areaFlexible hours$124k - $280k
...PwC, our people in data and analytics engineering focus on leveraging... ...and implementing data pipelines, data integration, and... ...needs. As a Senior Manager you lead large... ...Cloud Platforms [e.g., AWS Solutions Architect,... ...Engineer Associate, Snowflake Core, Snowflake Architect...Amazon Web ServicePipelineSeniorH1b$96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...develop, and optimize modern data pipelines that support analytics, reporting... ...platforms such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data...Amazon Web ServicePipelineSeniorFull timeLocal area- ...Data EngineerWe believe technological and cultural... ...hypothesis.Job PurposeAs a Data Engineer at Nebulaworks, you... ..., and reliable data pipelines that ingest and process... ...using components of a big data software ecosystem... ...storage infrastructures in AWS cloud.Troubleshoot and...Amazon Web ServicePipelineBig dataWork at office
- ...Senior Data EngineerRequired Skills & Experience... ...7+ years of Data Engineering experience delivering... ...including PySpark/Spark. Strong experience... ...preferably within AWS. Hands-on... ...experience with: AWS Glue, Snowflake, DBT, Apache... ...end-to-end ETL/ELT pipelines in production environments...Amazon Web ServicePipelineContract workRemote work
$145k - $165k
Megazone Cloud is looking for a Senior Data Engineer to help lead and define our... ...data wrangling, Databricks or Snowflake , and are a master of Python , SQL , and AWS . What You’ll Do Architect, build... ...data platforms and pipelines on AWS, not just maintain them...Amazon Web ServicePipelineSeniorImmediate startFlexible hours$150k - $175k
...contributions. ABOUT THE ROLE The Senior, Data Engineer is responsible for designing, building,... ...'ll own the architecture of our data pipelines end-to-end — from ingestion through transformation... ...of our Databricks environment on AWS. This role requires someone who can...Amazon Web ServicePipelineSenior- ...RESPONSIBILITIES: Leverage geo-spatial data and tools to analyze,... ...Work with various database and big data technologies like... ...completion. Create and modify CI/CD pipelines using Jenkins, Docker, KF, Kubernetes... ...cloud platforms like GCP, AWS, or Azure, deploying, managing...Amazon Web ServicePipelineSeniorBig dataFull timeLocal areaRemote workFlexible hours
- ...enough to own big outcomes. Trust... ...Overview The Data Engineer IV will design... ...AI-ready data pipelines and ELT workflows... ...with senior leadership to define... ...such as Apache Spark, Airflow, dbt,... ...data platforms (AWS, Azure, or GCP)... ...solutions (Databricks, Snowflake, Redshift,...Amazon Web ServicePipelineTemporary workFlexible hours
$191k - $253k
...operating system that turns thousands of data streams into a realtime, 3D... ...than just dashboards. As a Staff Engineer, you should be a player-coach;... ...control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows...Amazon Web ServicePipelineSeniorFull timeWork experience placementWork at officeImmediate startShift work$146k - $194k
...ABOUT THE JOB As a Software Engineer, Data Engineering on the Maritime Digital Production... ..., Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with cloud platforms and services (e.g., AWS, Azure, GCP). Strong problem-...Amazon Web ServiceBig dataFull timeWork experience placementImmediate start$244.7k
...apply advanced data models, algorithms... ...regularly to senior executive... ...sophisticated Reasoning Engine to automate... ...orchestration pipelines that serve the... ...of Databricks, Snowflake, SAP Datasphere... ...streaming (Kafka, Spark), and data mesh... ...~ Cloud: AWS, GCP, or Azure...Amazon Web ServicePipelineSeniorPermanent employmentFull timeWork at officeWorldwideFlexible hours- Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain... ...project with orchestration tools eg Dagster and establish CICD pipelines eg BitBucket for reliable automated deployment of code...Pipeline
- ...Facebook, Instagram, X and YouTube. Job Description The Data Engineer will design and build scalable data-pipelines across initiatives such as agentic trail design,... ..., Swift/Objective C, or JavaScript Experience with Big Data Management, Master Data Management tools & SQL...Amazon Web ServicePipelineBig dataTemporary workLocal area
$205k - $305k
...DescriptionWe are seeking a Data Strategy Lead for... ...with senior leaders across Technology... ...scalable data pipelines and production workflows... ..., Financial Engineering, or related quantitative... ...platforms and big data technologies such as AWS and Snowflake.Expertise in time...Amazon Web ServicePipelineBig dataFull timeWork at officeFlexible hours- ...Overview We are seeking a Data Engineer to support enterprise... ...maintaining reliable data pipelines, transforming business-... ...tools such as Databricks, Spark, Azure Data Factory, ADLS, Snowflake, SQL Server, DBT,... ...reporting Exposure to Azure, AWS, or GCP cloud ecosystems...Amazon Web ServicePipeline
- Data Engineer Our client is seeking a highly skilled and experienced Data... ...maintaining scalable data pipelines using airflow and build Kafka... ...multi-cloud native technologies, AWS, Azure, GCP. Collaborating... ...such as Kafka, Hadoop, Airflow, Spark, SQL, etc. 5. Proficiency in...Amazon Web ServicePipelineInternship
- ...and self-driven AI Engineer with a strong background... ...Gen AI/Agentic AI data engineering... ..., DataProc (Apache Spark) and orchestration... ...core enterprise data pipelines. Every day, massive... ...Deep GCP expertise (AWS/Azure a plus), paired... ...databases (e.g., Neo4j).Big Data &...Amazon Web ServicePipelineBig dataFull timeWork experience placementLocal areaFlexible hours
$158.9k - $270.1k
...oversees and supervises engineering teams which would... ...for compliance-related data in the U.S. and Canada... ...environment (GCP, Azure, AWS) using cloud-native technologies... ...business intelligence, big data, machine learning,... ...analytics, CI/CD pipelines, infrastructure as codeStrong...Amazon Web ServicePipelineSeniorBig dataFull timeTemporary workWorldwide$155.63k - $317.88k
...architects to protect data and ensure... ...computer science, engineering, or a related field... ...AgentTechnology Certifications:AWS Certified Solutions... ...and CI/CD pipelines.Experience with serverless... ...warehousing and big data technologies would... ...level employees to senior leaders, we believe...Amazon Web ServicePipelineSeniorBig dataWork at officeLocal areaShift work$134.5k - $265.1k
...experience with proprietary data, AI-native decision... ...Management, Data Engineering, Data Science,... ...data models, APIs, pipelines, platform services,... ...technologies such as Snowflake, Databricks, AWS, Azure, GCP, Kafka,... ...-level employees to senior leaders, we believe...Amazon Web ServicePipelineLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer — AWS, Spark & Snowflake Pipelines. Be the first to apply!
- finance data engineer Costa Mesa, CA
- data engineer machine learning Costa Mesa, CA
- senior data quality engineer Costa Mesa, CA
- aws data engineer Costa Mesa, CA
- data center engineer Costa Mesa, CA
- data engineer analytics Costa Mesa, CA
- entry level big data engineer Costa Mesa, CA
- senior data integration developer Costa Mesa, CA
- data developer Costa Mesa, CA
- sr data engineer Costa Mesa, CA



