Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)
Intelliswift
Detailed Job Description
6+ years overall software development experience with at least 3+ years of experience in large scale data platforms
.Excellent expertise in Spark and Java
.Knowledge of Golang is highly desirable
.Good understanding of containerization using Docker and Kubernetes
.Understanding of version control like Git and CI/CD workflow
.Understanding of Parquet/Avro/Hive/Iceberg
.Well experienced in debugging and troubleshooting
.Good Communication and excellent collaboration skills to interact with internal customer
s
Deliverabl es:
Help support Data Replication Service (Spark jobs) and develop features/bug fi
xes.Help support SparkCp (a library) in debugging and fixing issues encountered by
DRS.Help support the CDH Migration Tool in debugging and fixing issues encountered by custom
ers.Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportabil
ity.Perform onboarding tasks to help move customer d
ata.Monitor and address user requests and issues as they ar
ise.- ...Data Cloud Engineer Rippling is the first way for businesses to manage all of... ...stacks like Python, Apache Trino, Iceberg, Temporal. Create Data... ...source projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro) Rippling is an equal...SuggestedWork at office3 days per week
- The GCP Data Engineer will be responsible for constructing and developing... ...role using Python, Java, Spark, and SQL. 5+ experience working... ...as HDFS, Spark, Impala, and Hive. Experience with Shell scripting... ...different file formats like Avro, Parquet, and JSON. Hands-on...Suggested
- ...Our client provider of digital technology and transformation, information technology and services Position: Data Engineer with Databricks and Spark Location: Bellevue, WA Duration: 4 Months Job Type: Temporary Assignment Work Type: Onsite/Hybrid...SuggestedTemporary work
$98k - $198k
Milliman, Inc is seeking a Senior Data Engineer in Seattle, WA, to enhance data infrastructure. The ideal candidate has 5+ years in data engineering, proficiency in Spark and SQL, and experience with healthcare data. Responsibilities include developing scalable data architectures...Suggested- Robinhood is seeking a Senior Software Engineer for their Data Compute team in Bellevue, WA. This role involves designing scalable solutions for... ...reliability. Ideal candidates have extensive experience with Spark and data orchestration technologies such as Airflow. The...SuggestedFlexible hours
$153k - $204k
...time inference. Our stack is engineered for speed, scale, and cost-... ...our planet-scale performance data warehouse. You will own the... ...optimize table formats (Apache Iceberg, Parquet, Avro) to balance query... ...such as Apache Iceberg, Apache Spark, Trino, llm-d, vLLM, or PyTorch...Permanent employmentTemporary workCasual workWork at officeFlexible hours$75 per hour
...We are looking for a Data Engineer to join the Infrastructure Automation team. Our success... ...programming language, such as Python, Java, Scala, or NodeJS* Should have experience... ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data...- ...across more than 30 countries. Role--AWS Data Engineer Location -Seattle WA... ...or programming language such as Python Java Scala or NodeJS Experience buildingoperating... ...big data technologies such as Hadoop Hive Spark EMR Understanding of data...Local area
$170k - $230k
...you're energized by shaping data infrastructure from zero to one... ...that scales spanning Engineering, Science, PM-T, and Design across... ...programming language, such as Python, Java, Scala, or NodeJS ~... ...technologies such as: Hadoop, Hive, Spark, EMR Experience operating...Flexible hours$132.1k - $178.8k
...personalized experiences. We're looking for data engineers who are passionate about building large... ..., using big data tools such as Spark, Hive, SQL, Apache Airflow, AWS Glue, EMR, Lambda... ...programming language, such as Python, Java, Scala, or NodeJS PREFERRED...Flexible hours$132.1k - $178.8k
...Amazon Compensation Data team is looking for Data Engineer (DE) to join our team for modernizing... ...data transformations in spark and automating pipelines.... ...AWS services such as EMR(Hive/Spark), Redshift, S3, Glue... ...language, such as Python, Java, Scala, or NodeJS...Flexible hours$132.1k - $178.8k
...Amazon Business Team is looking for a Data Engineer (DE) to play a significant role in building... ...custom built Applications using Python/Java. You are required to support and manage... ...big data technologies such as: Hadoop, Hive, Spark, EMR PREFERRED QUALIFICATIONS -...Flexible hours$132.1k - $178.8k
...Amazon seeks an experienced Data Engineer to join the DPS (Deny Party Screening... ..., Glue/lake formation, EMR/Spark, Athena etc. • Develop and... ...modern language such as C++, C#, Java, Python, Golang, PowerShell,... ...technologies such as: Hadoop, Hive, Spark, EMR PREFERRED...Flexible hours$132.1k - $178.8k
...a highly skilled and technically adept Data Engineer to join our PVA Data Engineering team.... ...diverse technologies such as Python, EMR, Spark, Iceberg, Airflow, and many AWS data services... ...programming language, such as Python, Java, Scala, or NodeJS - Experience with Apache...WorldwideFlexible hours- ...A leading ecommerce company in Washington is seeking a Cloud Data Engineer. The successful candidate will be responsible for modernizing... ...Candidates should possess extensive experience with Microsoft Fabric, Spark, and Delta Lake, alongside strong SQL and Python skills....
- Job Title: Senior Data Engineer Location: Seattle, WA Job Summary AWS Infrastructure... ...languages such as Python, Spark, SQL and AWS services such as... ...language, such as Python, Java, Scala, or NodeJS Experience... ...technologies such as: Hadoop, Hive, Spark, EMR Experience...
$132.1k - $178.8k
...Services LLC We are seeking a highly skilled and technically adept Data Engineer to join our PVA Data Engineering team. In this role, you... ...with a range of data technologies, including Python, EMR, Spark, Iceberg, Airflow, and many AWS data services such as Glue, Athena,...WorldwideFlexible hours- ...Position : Principal - Data Engineer Location: Bellevue WA ( Hybrid) Rate - DOE... ...Databricks and is programmed leveraging Spark (PySpark, SparkSQL) • PowerShell experience... ...(TSQL, PostgreSQL) • Proficiency with parquet and delta formats Additionally - they...
$99k - $149k
...primary responsibility is to integrate data from a variety of sources into common data... ...technologies (Snowflake, Redshift, Hive, kafka, spark, Flink or similar technologies) Passionate... ...Demonstrated experience in software engineering fundamentals and coding Salary Range...Work experience placementLocal area$184k - $230k
...Business Area: Engineering Seniority Level:... ...to transform complex data into clear and actionable... ...systems to join the Apache Spark Team. You will be at the... ...features using Scala, Java, and Python on modern... ...formats like Apache Parquet and Iceberg Fault tolerance and...Remote workWork from homeFlexible hours$93.9k - $154.2k
...Senior Data Engineer EXL is hiring a Senior Data Engineer to join a strategic AI / ML platform... ...at scale, with rigorous attention to Parquet partitioning, join performance on large... ...schema registry tooling (e.g., Confluent), Iceberg, or Delta Lake. Experience working in...H1bRemote work3 days per week- ...Data Engineer Location: BELLEVUE, WA Primary Responsibilities • Support... ...movement pipelines leveraging SQL, Python and Spark that meet all functional & non-... ...experience in Spark, Python, PySpark, Scala, SQL/Hive • Familiar with Spark MLlib, SParkSQL...
$173.1k - $276.8k
...with you. Job Description The Lead Data Engineer is a senior technical leader responsible... ...distributed data systems usingHadoop,Spark, and modern lakehouse architectures. *... ...distributed query engines such asPresto, Trino, Hive, and SparkSQL. * Strong knowledge of...Work at officeLocal area- ...competitive advantage through Data Management. We partner with... ...years of experience in data engineering, platform engineering, or a closely... ...; deep working knowledge of Parquet partitioning and performance... ...tooling (e.g., Confluent), Iceberg, or Delta Lake. Experience working...Full time
- Responsibilities Design and build data transformations efficiently and reliably for... ...business. Establish solid design and best engineering practices for engineers as well as non-... ...Data technologies (Hadoop, MapReduce, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse...
$214.67k - $322k
...OKLink and more. About the Team The OKX Data Engineering team is responsible for the whole data... ...Experience with data processing tools such as Spark and Flink Solid Experience implementing... ..., MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase Perks & Benefits...$42.75 per hour
...026 June 8th, 2026 June 22nd, 2026 Team Introduction As a data engineer in the Data Platform E‑Commerce team, you will have the opportunity... ...2026. Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.)....Hourly paySummer workInternshipLocal area$155k - $225k
...revolutionizing healthcare by leveraging data and automation to empower... ...opportunity to join a data engineering team to advance our... ...processing jobs (e.g., Spark executor errors, memory leaks... ...formats, including Apache Parquet and Apache Avro. Infrastructure as Code...Permanent employmentWork at officeHome officeFlexible hours$177.8k - $240.5k
...GDSP is seeking a Data Engineer to own the data infrastructure that unlocks deal intelligence... ...programming language, such as Python, Java, Scala, or NodeJS - Experience mentoring... ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large...Local areaFlexible hours$177.8k - $240.5k
...this is the place for you. The ASP Data Engineering Team supports the data needs of the AWS... ...programming language, such as Python, Java, Scala, or NodeJS - Experience with AWS... ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data...Local areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg). Be the first to apply!
- staff data engineer Seattle, WA
- data visualization developer Seattle, WA
- data science developer Seattle, WA
- senior data center engineer Seattle, WA
- sr information security engineer Seattle, WA
- junior big data engineer Seattle, WA
- entry level big data engineer Seattle, WA
- data engineer contract Seattle, WA
- aws data engineer Seattle, WA
- data engineer manager Seattle, WA

