Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)
Full-time
Intelliswift - An LTTS Company
Detailed Job Description
6+ years overall software development experience with at least 3+ years of experience in large scale data platforms
.Excellent expertise in Spark and Java
.Knowledge of Golang is highly desirable
.Good understanding of containerization using Docker and Kubernetes
.Understanding of version control like Git and CI/CD workflow
.Understanding of Parquet/Avro/Hive/Iceberg
.Well experienced in debugging and troubleshooting
.Good Communication and excellent collaboration skills to interact with internal customer
s
Deliverabl es:
Help support Data Replication Service (Spark jobs) and develop features/bug fi
xes.Help support SparkCp (a library) in debugging and fixing issues encountered by
DRS.Help support the CDH Migration Tool in debugging and fixing issues encountered by custom
ers.Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportabil
ity.Perform onboarding tasks to help move customer d
ata.Monitor and address user requests and issues as they ar
ise.Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg) in Seattle, WA vacancy
- ...addresses.About the roleThe Data Cloud team is building... ...Python, Apache Kafka, Iceberg, Temporal.Create Data... ...and grow your engineering skills in different challenging... ...projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro)Additional...SuggestedWork at office3 days per week
Rippling
Seattle, WA4 days ago - ...of truth for employee data, businesses can automate... ...Python, Apache Trino, Iceberg, Temporal. Create Data... ...spacesBuild and grow your engineering skills in different... ...projects (Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, Avro) Additional InformationRippling...SuggestedWork at office3 days per week
Rippling
Seattle, WA10 hours ago $171.9k - $221k
...systems are only as good as the data behind them. As we move... ...We are seeking a Staff Data Engineer to own that flywheel end to... ...record-level CRUDL API, and Spark/analytics access and self-service... ...table/lake formats (e.g. Iceberg, Delta, Parquet, or comparable), including schema...SuggestedFull timeContract workWork at officeFlexible hoursShift workLVT (LiveView Technologies)
Seattle, WA2 days ago- People Tech Group, based in Seattle, is seeking a professional with hands-on experience in Big Data technologies such as Spark, Phoenix, Kafka, and HBase. The ideal candidate will have at least 3 years of experience in large-scale projects and a strong familiarity with...Suggested
- ...a crucial role in the data ecosystem of the TikTok... ...computer science, software engineering, or related fields,... ...programming languages such as Java, C++, and Scala, with... .../frameworks (such as Hive, HBase, Kudu, etc.) and... ...formats such as Parquet and ORC is preferred.Req...SuggestedFlexible hours
TikTok
Seattle, WA1 day ago - ...AWS Data Engineer Location - Seattle WA Experience with SQL data modeling warehousing and... ...or programming language such as Python Java Scala or NodeJS Experience building operating... ...big data technologies such as Hadoop Hive Spark EMR Understanding of data security...Local area
E-Solutions
Seattle, WA2 days ago $154.6k - $209.1k
The AWS Analytics Engineering (AAE) organization is the analytics backbone... ...— we build and operate the data platform that powers business... ...language, such as Python, Java, Scala, or NodeJS- Experience... ...technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large...Temporary workFlexible hoursAmazon
Seattle, WA3 days ago- ...Senior Data EngineerAmpcus Inc. is a certified global... ...hardware, and network engineers, supply chain... ...languages such as Python, Spark, SQL and AWS services such... ...language, such as Python, Java, Scala, or NodeJSExperience... ...such as: Hadoop, Hive, Spark, EMRExperience operating...
Ampcus
Seattle, WA1 day ago $132.1k - $178.8k
...ultimate goal is to build a robust/scalable data infrastructure and automated reporting... ...Intelligence, Product, Finance, Engineering, Privacy, and Legal stakeholders to translate... ...big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with one or more scripting...Flexible hoursAmazon
Seattle, WA3 days ago$101.3k - $160k
Business Data Technologies (BDT) makes it easier for teams across... ...BDT customers move beyond the engineering and operational burden associated... ...using SQL, Python and Spark. · Build and deliver high quality... ...technologies such as: Hadoop, Hive, Spark, EMR- Experience with any...Flexible hoursAmazon
Seattle, WA2 days ago- As a data engineer in the Data Platform E-Commerce team, you will have the opportunity to build, optimize and grow one of the largest data... ...;• Experience in the Big Data technologies(Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.);• Experience...
TikTok
Seattle, WA1 day ago $154.6k - $209.1k
...you want to turn manufacturing data into decisions that move... ...will join a small, growing data engineering team that owns the pipelines,... ...programming language, such as Python, Java, Scala, or NodeJS- Experience... ...such as: Hadoop, Hive, Spark, EMR- Experience operating large...Full timeTemporary workSeasonal workFlexible hoursDay shiftAmazon
Bellevue, WA3 days ago- ...Sr Data EngineerTechnology is at the heart of Disney's past, present, and future.... ...Technology is a global organization of engineers, product developers, designers, technologists... ...compute using tools/libraries such as Spark, Presto, Hive to query and process large datasets at...Work experience placement
Disney
Seattle, WA5 days ago - ...Data EngineerOnsite (Bellevue -WA)Mandatory Primary Skills: Hadoop... ...by adding more datasets.Data Engineer would work on: extending the Python... ...with Snowflake and Databricks Iceberg alongside the primary feeds.We... .... Cloud object storage and Parquet. Enough Kubernetes to tell...
Echo IT Solutions
Bellevue, WA3 days ago $143.7k - $194.4k
...architecture — making it the data foundation for AI-... ...depend on.We need an engineer who wants to own that... .... Core technologies: Java, Python, TypeScript (AWS CDK), Apache Spark on EMR, Apache Iceberg — plus EKS, DynamoDB,... ..., Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/...InternshipFlexible hoursAmazon
Seattle, WA4 days ago$153k - $204k
...operations. About The Role As a Senior Data Engineer you will own and evolve the data... ...data lake infrastructure (Apache Iceberg, Trino, Apache Airflow, Apache Spark, Apache Superset) and ETL... ...data engineering such as Python, Java, or Scala. Hands-on experience with...Permanent employmentTemporary workCasual workWork at officeFlexible hours$163.4k - $219.1k
Job Posting Title:Manager, Data EngineeringReq ID:10159576Job Description:Job Summary... ...data products. You will lead a team of engineers responsible for building and improving... ...and formats/standards, such as Parquet and Iceberg Experience designing or maintaining automated...Full timeWork experience placementWorldwideShift workHulu
Seattle, WA2 days ago- ...the TeamData is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including... ...of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink...Hourly payWork at officeLocal areaRemote workFlexible hours
Doordash
Seattle, WA1 day ago - ...025. Learn more at What You’ll Do The Data Engineering Team builds and operates the foundational... ...data processing systems using Spark, Flink, or similar technologies. Experience... ...architectures and analytical technologies such as Iceberg, Delta, StarRocks, Clickhouse, or Trino...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours
$132.1k - $178.8k
As a Data Engineer II in Amazon's Global Logistics (GL) Exports team, you will play a crucial... ...build scalable ETL pipelines using Python, Spark, SQL, and AWS services (S3, Glue,... ...or programming language, such as Python, Java, Scala, or NodeJS- Experience building/operating...WorldwideFlexible hoursAmazon
Bellevue, WA10 hours ago$132.1k - $178.8k
...at weekly and monthly granularity.As a Data Engineer on this team, you will build and scale the... ...and data solutions using Python, SQL, Spark, and AWS services (S3, Glue, Redshift, Airflow... ...programming language, such as Python, Java, Scala, or NodeJS- Knowledge of...Flexible hoursDay shiftAmazon
Bellevue, WA3 days ago$132.1k - $178.8k
...you passionate about standardizing data platforms and automating data engineering to drive analytics and reporting? Do... ...and ETL pipelines using Python, Spark, SQL, and AWS services (S3, Glue, Redshift... ...language, such as Python, Java, Scala, or NodeJS- Knowledge of distributed...WorldwideFlexible hoursAmazon
Bellevue, WA10 hours ago$152k - $205.6k
...global business teams.We are looking for a Data Engineer to help us extend our geospatial... ...multiple programming languages (Python/Scala/Java) to collect, process, and store data that... ...frameworks including PySpark, Apache Spark (Scala/Java), AWS Glue, Apache Airflow,...Local areaWorldwideFlexible hoursAmazon
Seattle, WA4 days ago- About The Team The Analytics Engineering team at DoorDash is embedded within the Analytics and Data Engineering Orgs, and is responsible for building internal data... ...Familiarity with database fundamentals (e.g. S3, Trino, Hive, Spark), and experience with SQL performance tuning...Hourly payWork at officeLocal areaRemote workFlexible hours
$100k - $125k
...we co-create custom software, data, AI, and cloud solutions with... ...organizations.Our Data Architecture & Engineering team sees data as the... ...languages such as SQL, Python, Java and or Scala.* Experience with... ...technologies, which may include Spark, Kafka, Airflow, dbt, Dagster,...Temporary workWork at officeLocal areaSlalom
Seattle, WA3 days ago- ...Data EngineerJob Description Must Have Technical/Functional Skills Data engineer experience, SQL, AWS, Python Roles & Responsibilities Basic... ...language (e.g., Python, Java, or R) Preferred qualifications... ...Azure. Proficiency in Apache Spark, Kafka, NoSQL databases, and...
Tata Consultancy Services
Seattle, WA2 days ago - ...Launch Your Data Career with Proof, Not Promises—At SynergisticITIf you're serious about... ...career in Data Science, Analytics, or Engineering, it's time to stop guessing and start... ...automationData Engineering TrackPython/Java, Spark, Airflow, DatabricksETL architecture, Snowflake...
SynergisticIT
Seattle, WA5 days ago $150.4k - $277.6k
...Senior Data EngineerImagine what you could do here. At Apple, new... ...We are seeking an exceptional engineer with a background in large scale... ...team that drives Apache Spark's state-of-the art features and... ...with JVM languages (Scala or Java preferred), Spark, Golang, or...RelocationApple
Seattle, WA5 days ago- ...place. We go beyond typical data-driven approaches or pure... ...architectures, combining rigorous engineering with learning systems... ...preferably Python and/or C++/Java/Go. Experience with... ...such as S3, Airflow/Dagster, Spark/Ray, Kubernetes, Parquet, or similar systems. Ability...Local area
FieldAI
Seattle, WA21 days ago $142.8k - $193.2k
...years. Amazon Live has a mature data platform powering reporting... ...experimentation — working alongside Data Engineers who build the infrastructure... ...- Experience programming in Java, C++, Python or related... ...distributed systems such as Hadoop, Spark etc.- Experience with causal...Flexible hoursAmazon
Seattle, WA10 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg). Be the first to apply!
Related searches
- data engineer machine learning Seattle, WA
- aws data engineer Seattle, WA
- big data developer Seattle, WA
- sr data engineer Seattle, WA
- big data cloud engineer Seattle, WA
- finance data engineer Seattle, WA
- junior big data engineer Seattle, WA
- entry level data engineer Seattle, WA
- sr information security engineer Seattle, WA
- data center engineer Seattle, WA