Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)

Intelliswift - An LTTS Company

Seattle, WA

Job Description

Detailed Job Description

\n 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms

.Excellent expertise in Spark and Java

.Knowledge of Golang is highly desirable

.Good understanding of containerization using Docker and Kubernetes

.Understanding of version control like Git and CI/CD workflow

.Understanding of Parquet/Avro/Hive/Iceberg

.Well experienced in debugging and troubleshooting

.Good Communication and excellent collaboration skills to interact with internal customer

\n Deliverabl \n

es:
\n Help support Data Replication Service (Spark jobs) and develop features/bug fi

xes.Help support SparkCp (a library) in debugging and fixing issues encountered by

DRS.Help support the CDH Migration Tool in debugging and fixing issues encountered by custom

ers.Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportabil

ity.Perform onboarding tasks to help move customer d

ata.Monitor and address user requests and issues as they ar

ise.

Apply

Vacancy posted 23 days ago

Similar jobs that could be interesting for youBased on the Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg) in Seattle, WA vacancy

Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)
...at least 3+ years of experience in large scale data platforms .Excellent expertise in Spark and Java .Knowledge of Golang is highly desirable... ...like Git and CI/CD workflow .Understanding of Parquet/Avro/Hive/Iceberg .Well experienced in debugging and...
Suggested
Full time
Intelliswift - An LTTS Company
Seattle, WA
1 day ago
Staff Software Engineer - Data Ingestion
...addresses.About the roleThe Data Cloud team is building... ...Python, Apache Kafka, Iceberg, Temporal.Create Data... ...and grow your engineering skills in different challenging... ...projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro)Additional...
Suggested
Work at office
3 days per week
Rippling
Seattle, WA
17 hours ago
Staff Software Engineer - Data Cloud
...of truth for employee data, businesses can automate... ...Python, Apache Trino, Iceberg, Temporal. Create Data... ...spacesBuild and grow your engineering skills in different... ...projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro) Additional InformationRippling...
Suggested
Work at office
3 days per week
Rippling
Seattle, WA
1 day ago
Director, Data Engineering
$197.2k - $315.7k
...DescriptionRole Summary:The Director, Data Engineering leads the design, development... ...big data technologies (e.g., Spark, Kafka, Hadoop).Experience in... ...(e.g., Apache Pinot, Apache Iceberg, ClickHouse, Cassandra, Redis... ...schema evolution (Protobuf, Avro).Observability & Reliability:...
Suggested
Full time
Work experience placement
Work at office
Local area
Visa
Bellevue, WA
4 days ago
Staff & Senior Staff Data Platform Engineer - Slack
$197.3k - $365.2k
...build software and analyze data. Slack’s data platform... ...for a Staff or Senior Staff engineer to help build out Agentic... ...languages like Python, Go, Java, or similarBonus points for... ...Technologies We Use:Data: Trino, Spark, Pinot, Hive, Airflow, Iceberg, Spark, Datahub,...
Suggested
Full time
Salesforce
Seattle, WA
1 day ago
Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem
...a crucial role in the data ecosystem of the TikTok... ...computer science, software engineering, or related fields,... ...programming languages such as Java, C++, and Scala, with... .../frameworks (such as Hive, HBase, Kudu, etc.) and... ...formats such as Parquet and ORC is preferred.Req...
Flexible hours
TikTok
Seattle, WA
2 days ago
Senior Data Engineer, AWS Analytics Engineering
$154.6k - $209.1k
The AWS Analytics Engineering (AAE) organization is the analytics backbone... ...— we build and operate the data platform that powers business... ...language, such as Python, Java, Scala, or NodeJS- Experience... ...technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large...
Temporary work
Flexible hours
Amazon
Seattle, WA
17 hours ago
Senior Data Engineer , AWS Infrastructure Supply Chain Intelligence
$154.6k - $209.1k
...running. We support all AWS data centers and all of the servers... ...software, hardware, and network engineers, supply chain specialists,... ...programming language, such as Python, Java, Scala, or NodeJS- Experience... ...such as: Hadoop, Hive, Spark, EMR- Experience operating large...
Flexible hours
Amazon
Bellevue, WA
1 day ago
Data Engineer II, AWS Marketplace and Partner Services
$132.1k - $178.8k
...partner experience worldwide. Data Engineering is a horizontal layer that... ...solutions using technologies such as Spark, EMR, Python, Redshift, Glue,... ...language such as C++, C#, Java, Python, Golang, PowerShell,... ...as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza...
Worldwide
Flexible hours
Amazon
Seattle, WA
17 hours ago
Data Engineer, Marketing Tech BI, Stores Finance Analytics & Insights
$132.1k - $178.8k
...ultimate goal is to build a robust/scalable data infrastructure and automated reporting... ...Intelligence, Product, Finance, Engineering, Privacy, and Legal stakeholders to translate... ...big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with one or more scripting...
Flexible hours
Amazon
Seattle, WA
4 days ago
Data Engineer , PXT EXR-Ops Tech
$101.3k - $160k
Do you love building data pipelines? Are you excited by the opportunity to design tools... ...is part of our company DNA. Data engineers use technology to solve complex problems... ...big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool like,...
Flexible hours
Amazon
Bellevue, WA
4 days ago
Data Engineer, Decision Intelligence Technology
$101.3k - $160k
...direct revenue to the business.We are looking for an excellent Data Engineer who is passionate about data and the insights that large... ...qualification - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool like, Informatica, ODI,...
Worldwide
Flexible hours
AmazonWebServices
Bellevue, WA
7 hours ago
Data Engineer, E-Commerce
As a data engineer in the Data Platform E-Commerce team, you will have the opportunity to build, optimize and grow one of the largest data... ...;• Experience in the Big Data technologies(Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.);• Experience...
TikTok
Seattle, WA
2 days ago
Data Engineer III, Amazon Manufacturing Services (AMS)
$154.6k - $209.1k
...you want to turn manufacturing data into decisions that move... ...will join a small, growing data engineering team that owns the pipelines,... ...programming language, such as Python, Java, Scala, or NodeJS- Experience... ...such as: Hadoop, Hive, Spark, EMR- Experience operating large...
Full time
Temporary work
Seasonal work
Flexible hours
Day shift
Amazon
Bellevue, WA
4 days ago
Data Engineer, Amazon Security Experience
$101.3k - $160k
...Security Experiences (ASE) organization is the data intelligence backbone of Amazon Security... ...infrastructure management scripts. Our engineers work directly with source systems across... ...big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool like,...
Flexible hours
Amazon
Seattle, WA
1 day ago
Data Engineer, Robotics Delivery and Packaging Innovation
$101.3k - $160k
...you interested in building the data foundation that drives... ...Innovation team is looking for a Data Engineer to join us in building and... ...pipelines using SQL, Python, and Spark that support automated reporting... ...technologies such as: Hadoop, Hive, Spark, EMR- Experience with...
Flexible hours
Amazon
Bellevue, WA
2 days ago
Software Development Engineer, Reporting Data Platform
$143.7k - $194.4k
...architecture — making it the data foundation for AI-... ...depend on.We need an engineer who wants to own that... .... Core technologies: Java, Python, TypeScript (AWS CDK), Apache Spark on EMR, Apache Iceberg — plus EKS, DynamoDB,... ..., Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/...
Internship
Flexible hours
Amazon
Seattle, WA
17 hours ago
Senior Software Engineer, Data Engineering
$143.8k - $211.5k
...the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including... ...of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink...
Hourly pay
Work at office
Local area
Remote work
Flexible hours
Doordash
Seattle, WA
3 days ago
Azure Data Engineer with strong Spark
Responsibilities Data Engineering experience primarily on Spark. Experience on Azure cloud with knowledge of Azure DevOps (CI/CD & Infrastructure as Code), ADF, ADW, and Power BI. Apache NiFi is a plus. Power BI: Understand business requirements to set functional specifications...
Full time
Shift work
The Dignify Solutions, LLC
Bellevue, WA
5 hours ago
Sr Data Engineer
$148.7k - $199.4k
...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all... ....Strong skills in Python, Java and SQL with expert level skill... ...pipelines (e.g., Kafka, Flink, Spark, Kinesis).Experience with embedding...
Disney Interactive
Seattle, WA
3 days ago
Data Engineer, WW Ops Finance S&A
$132.1k - $178.8k
...you passionate about standardizing data platforms and automating data engineering to drive analytics and reporting? Do... ...and ETL pipelines using Python, Spark, SQL, and AWS services (S3, Glue, Redshift... ...language, such as Python, Java, Scala, or NodeJS- Knowledge of distributed...
Worldwide
Flexible hours
Amazon
Bellevue, WA
1 day ago
Data Engineer II, WW Ops Finance S&A
$132.1k - $178.8k
...at weekly and monthly granularity.As a Data Engineer on this team, you will build and scale the... ...and data solutions using Python, SQL, Spark, and AWS services (S3, Glue, Redshift, Airflow... ...programming language, such as Python, Java, Scala, or NodeJS- Knowledge of...
Flexible hours
Day shift
Amazon
Bellevue, WA
4 days ago
Geospatial Data Engineer , WW Sustainability
$152k - $205.6k
...global business teams.We are looking for a Data Engineer to help us extend our geospatial... ...multiple programming languages (Python/Scala/Java) to collect, process, and store data that... ...frameworks including PySpark, Apache Spark (Scala/Java), AWS Glue, Apache Airflow,...
Local area
Worldwide
Flexible hours
Amazon
Seattle, WA
17 hours ago
Data Engineer - West Region
$100k - $125k
...we co-create custom software, data, AI, and cloud solutions with... ...organizations.Our Data Architecture & Engineering team sees data as the... ...languages such as SQL, Python, Java and or Scala.* Experience with... ...technologies, which may include Spark, Kafka, Airflow, dbt, Dagster,...
Temporary work
Work at office
Local area
Slalom
Seattle, WA
4 days ago
Applied Scientist, Amazon Live Data Engineering, Sciences and Analytics (DESA)
$142.8k - $193.2k
...years. Amazon Live has a mature data platform powering reporting... ...experimentation — working alongside Data Engineers who build the infrastructure... ...- Experience programming in Java, C++, Python or related... ...distributed systems such as Hadoop, Spark etc.- Experience with causal...
Flexible hours
Amazon
Seattle, WA
1 day ago
Senior Data Platform Engineer
...place. We go beyond typical data-driven approaches or pure... ...architectures, combining rigorous engineering with learning systems... ...preferably Python and/or C++/Java/Go. Experience with... ...such as S3, Airflow/Dagster, Spark/Ray, Kubernetes, Parquet, or similar systems. Ability...
Local area
FieldAI
Seattle, WA
a month ago
Senior Data Engineer
...We are seeking a Senior Data Engineer to design, develop, and optimize enterprise-scale data pipelines and platforms supporting Finance and... ...real-time processing solutions using Kafka, Event Hub, and Spark Structured Streaming. Establish data quality, validation, monitoring...
Full time
BrickRed Systems
Seattle, WA
1 day ago
Data Engineer
...Must-Have Skills & Experience: Strong hands-on experience as a Data Engineer . Strong proficiency in Python . Experience building and maintaining large-scale Apache Spark pipelines on AWS. Strong knowledge of the modern AWS Data Lake ecosystem , including...
Tenarai
Seattle, WA
17 hours ago
Senior Data Engineer
$137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design,... ....Experience building cloud-native data pipelines using Spark, SQL, Python, and modern orchestration tools.Experience with lakehouse...
Local area
Immediate start
Flexible hours
West Monroe Partners
Seattle, WA
1 day ago
Data Engineer
$101.7k - $119.6k
...you ready to make an impact?West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you... ...related to data manipulation strategies Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda Exposure using...
Local area
Immediate start
Flexible hours
2 days per week
West Monroe Partners
Seattle, WA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg). Be the first to apply!