Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)

Intelliswift

Detailed Job Description


6+ years overall software development experience with at least 3+ years of experience in large scale data platforms

.Excellent expertise in Spark and Java

.Knowledge of Golang is highly desirable

.Good understanding of containerization using Docker and Kubernetes

.Understanding of version control like Git and CI/CD workflow

.Understanding of Parquet/Avro/Hive/Iceberg

.Well experienced in debugging and troubleshooting

.Good Communication and excellent collaboration skills to interact with internal customer

s

Deliverabl

es:
Help support Data Replication Service (Spark jobs) and develop features/bug fi

xes.Help support SparkCp (a library) in debugging and fixing issues encountered by

DRS.Help support the CDH Migration Tool in debugging and fixing issues encountered by custom

ers.Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportabil

ity.Perform onboarding tasks to help move customer d

ata.Monitor and address user requests and issues as they ar

ise.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg) in Seattle, WA vacancy
  •  ...Data Cloud Engineer Rippling is the first way for businesses to manage all of...  ...stacks like Python, Apache Trino, Iceberg, Temporal. Create Data...  ...source projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro) Rippling is an equal... 
    Suggested
    Work at office
    3 days per week

    ZoneIn

    Seattle, WA
    4 days ago
  • The GCP Data Engineer will be responsible for constructing and developing...  ...role using Python, Java, Spark, and SQL. 5+ experience working...  ...as HDFS, Spark, Impala, and Hive. Experience with Shell scripting...  ...different file formats like Avro, Parquet, and JSON. Hands-on... 
    Suggested

    TechDigital Group

    Seattle, WA
    2 days ago
  •  ...Our client provider of digital technology and transformation, information technology and services Position: Data Engineer with Databricks and Spark Location: Bellevue, WA Duration: 4 Months Job Type: Temporary Assignment Work Type: Onsite/Hybrid... 
    Suggested
    Temporary work

    Tekwissen

    Bellevue, WA
    3 days ago
  • $98k - $198k

    Milliman, Inc is seeking a Senior Data Engineer in Seattle, WA, to enhance data infrastructure. The ideal candidate has 5+ years in data engineering, proficiency in Spark and SQL, and experience with healthcare data. Responsibilities include developing scalable data architectures... 
    Suggested

    Milliman, Inc

    Seattle, WA
    2 days ago
  • Robinhood is seeking a Senior Software Engineer for their Data Compute team in Bellevue, WA. This role involves designing scalable solutions for...  ...reliability. Ideal candidates have extensive experience with Spark and data orchestration technologies such as Airflow. The... 
    Suggested
    Flexible hours

    Robinhood

    Bellevue, WA
    4 days ago
  • $153k - $204k

     ...time inference. Our stack is engineered for speed, scale, and cost-...  ...our planet-scale performance data warehouse. You will own the...  ...optimize table formats (Apache Iceberg, Parquet, Avro) to balance query...  ...such as Apache Iceberg, Apache Spark, Trino, llm-d, vLLM, or PyTorch... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    4 days ago
  • $75 per hour

     ...We are looking for a Data Engineer to join the Infrastructure Automation team. Our success...  ...programming language, such as Python, Java, Scala, or NodeJS* Should have experience...  ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data... 

    People, Data & Solutions

    Seattle, WA
    3 days ago
  •  ...across more than 30 countries. Role--AWS Data Engineer Location -Seattle WA...  ...or programming language such as Python Java Scala or NodeJS Experience buildingoperating...  ...big data technologies such as Hadoop Hive Spark EMR Understanding of data... 
    Local area

    E-Solutions

    Seattle, WA
    4 days ago
  • $170k - $230k

     ...you're energized by shaping data infrastructure from zero to one...  ...that scales spanning Engineering, Science, PM-T, and Design across...  ...programming language, such as Python, Java, Scala, or NodeJS ~...  ...technologies such as: Hadoop, Hive, Spark, EMR Experience operating... 
    Flexible hours

    Amazon

    Seattle, WA
    2 days ago
  • $132.1k - $178.8k

     ...personalized experiences. We're looking for data engineers who are passionate about building large...  ..., using big data tools such as Spark, Hive, SQL, Apache Airflow, AWS Glue, EMR, Lambda...  ...programming language, such as Python, Java, Scala, or NodeJS PREFERRED... 
    Flexible hours

    Amazon

    Bellevue, WA
    3 days ago
  • $132.1k - $178.8k

     ...Amazon Compensation Data team is looking for Data Engineer (DE) to join our team for modernizing...  ...data transformations in spark and automating pipelines....  ...AWS services such as EMR(Hive/Spark), Redshift, S3, Glue...  ...language, such as Python, Java, Scala, or NodeJS... 
    Flexible hours

    Amazon

    Seattle, WA
    3 days ago
  • $132.1k - $178.8k

     ...Amazon Business Team is looking for a Data Engineer (DE) to play a significant role in building...  ...custom built Applications using Python/Java. You are required to support and manage...  ...big data technologies such as: Hadoop, Hive, Spark, EMR PREFERRED QUALIFICATIONS -... 
    Flexible hours

    Amazon

    Seattle, WA
    2 days ago
  • $132.1k - $178.8k

     ...Amazon seeks an experienced Data Engineer to join the DPS (Deny Party Screening...  ..., Glue/lake formation, EMR/Spark, Athena etc. • Develop and...  ...modern language such as C++, C#, Java, Python, Golang, PowerShell,...  ...technologies such as: Hadoop, Hive, Spark, EMR PREFERRED... 
    Flexible hours

    Amazon

    Seattle, WA
    19 hours ago
  • $132.1k - $178.8k

     ...a highly skilled and technically adept Data Engineer to join our PVA Data Engineering team....  ...diverse technologies such as Python, EMR, Spark, Iceberg, Airflow, and many AWS data services...  ...programming language, such as Python, Java, Scala, or NodeJS - Experience with Apache... 
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    3 days ago
  •  ...A leading ecommerce company in Washington is seeking a Cloud Data Engineer. The successful candidate will be responsible for modernizing...  ...Candidates should possess extensive experience with Microsoft Fabric, Spark, and Delta Lake, alongside strong SQL and Python skills.... 

    GovX

    Seattle, WA
    4 days ago
  • Job Title: Senior Data Engineer Location: Seattle, WA Job Summary AWS Infrastructure...  ...languages such as Python, Spark, SQL and AWS services such as...  ...language, such as Python, Java, Scala, or NodeJS Experience...  ...technologies such as: Hadoop, Hive, Spark, EMR Experience... 

    Ampcus, Inc

    Seattle, WA
    19 hours ago
  • $132.1k - $178.8k

     ...Services LLC We are seeking a highly skilled and technically adept Data Engineer to join our PVA Data Engineering team. In this role, you...  ...with a range of data technologies, including Python, EMR, Spark, Iceberg, Airflow, and many AWS data services such as Glue, Athena,... 
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    3 hours ago
  •  ...Position : Principal - Data Engineer Location: Bellevue WA ( Hybrid) Rate - DOE...  ...Databricks and is programmed leveraging Spark (PySpark, SparkSQL) • PowerShell experience...  ...(TSQL, PostgreSQL) • Proficiency with parquet and delta formats Additionally - they... 

    Georgia IT Inc

    Bellevue, WA
    3 days ago
  • $99k - $149k

     ...primary responsibility is to integrate data from a variety of sources into common data...  ...technologies (Snowflake, Redshift, Hive, kafka, spark, Flink or similar technologies) Passionate...  ...Demonstrated experience in software engineering fundamentals and coding Salary Range... 
    Work experience placement
    Local area

    Indeed

    Seattle, WA
    4 days ago
  • $184k - $230k

     ...Business Area: Engineering Seniority Level:...  ...to transform complex data into clear and actionable...  ...systems to join the Apache Spark Team. You will be at the...  ...features using Scala, Java, and Python on modern...  ...formats like Apache Parquet and Iceberg Fault tolerance and... 
    Remote work
    Work from home
    Flexible hours

    Cloudera

    Seattle, WA
    2 days ago
  • $93.9k - $154.2k

     ...Senior Data Engineer EXL is hiring a Senior Data Engineer to join a strategic AI / ML platform...  ...at scale, with rigorous attention to Parquet partitioning, join performance on large...  ...schema registry tooling (e.g., Confluent), Iceberg, or Delta Lake. Experience working in... 
    H1b
    Remote work
    3 days per week

    EXL

    Seattle, WA
    3 days ago
  •  ...Data Engineer Location: BELLEVUE, WA Primary Responsibilities • Support...  ...movement pipelines leveraging SQL, Python and Spark that meet all functional & non-...  ...experience in Spark, Python, PySpark, Scala, SQL/Hive • Familiar with Spark MLlib, SParkSQL... 

    Futran Tech Solutions Pvt. Ltd.

    Bellevue, WA
    19 hours ago
  • $173.1k - $276.8k

     ...with you. Job Description The Lead Data Engineer is a senior technical leader responsible...  ...distributed data systems usingHadoop,Spark, and modern lakehouse architectures. *...  ...distributed query engines such asPresto, Trino, Hive, and SparkSQL. * Strong knowledge of... 
    Work at office
    Local area

    Visa

    Bellevue, WA
    19 hours ago
  •  ...competitive advantage through Data Management. We partner with...  ...years of experience in data engineering, platform engineering, or a closely...  ...; deep working knowledge of Parquet partitioning and performance...  ...tooling (e.g., Confluent), Iceberg, or Delta Lake. Experience working... 
    Full time

    EXL

    Seattle, WA
    4 days ago
  • Responsibilities Design and build data transformations efficiently and reliably for...  ...business. Establish solid design and best engineering practices for engineers as well as non-...  ...Data technologies (Hadoop, MapReduce, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse... 

    TikTok

    Seattle, WA
    1 day ago
  • $214.67k - $322k

     ...OKLink and more. About the Team The OKX Data Engineering team is responsible for the whole data...  ...Experience with data processing tools such as Spark and Flink Solid Experience implementing...  ..., MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase Perks & Benefits... 

    OKX

    Seattle, WA
    1 day ago
  • $42.75 per hour

     ...026 June 8th, 2026 June 22nd, 2026 Team Introduction As a data engineer in the Data Platform E‑Commerce team, you will have the opportunity...  ...2026. Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.).... 
    Hourly pay
    Summer work
    Internship
    Local area

    TikTok

    Seattle, WA
    4 days ago
  • $155k - $225k

     ...revolutionizing healthcare by leveraging data and automation to empower...  ...opportunity to join a data engineering team to advance our...  ...processing jobs (e.g., Spark executor errors, memory leaks...  ...formats, including Apache Parquet and Apache Avro. Infrastructure as Code... 
    Permanent employment
    Work at office
    Home office
    Flexible hours

    Xealth

    Seattle, WA
    21 days ago
  • $177.8k - $240.5k

     ...GDSP is seeking a Data Engineer to own the data infrastructure that unlocks deal intelligence...  ...programming language, such as Python, Java, Scala, or NodeJS - Experience mentoring...  ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large... 
    Local area
    Flexible hours

    Amazon

    Seattle, WA
    19 hours ago
  • $177.8k - $240.5k

     ...this is the place for you. The ASP Data Engineering Team supports the data needs of the AWS...  ...programming language, such as Python, Java, Scala, or NodeJS - Experience with AWS...  ...big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data... 
    Local area
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg). Be the first to apply!