EMR/Spark SQL & Job Query-Tuning Engineer
Staffxpert LLC
a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; } EMR/Spark SQL & Job Query-Tuning Engineer
Location: Seattle, WA (Onsite)
About UsSTAFFXPERT LLC is a leading talent solutions and technology staffing firm connecting skilled professionals with innovative organizations across diverse industries. We are committed to delivering exceptional opportunities and helping top talent advance their careers through impactful projects and long-term partnerships.
Job SummarySTAFFXPERT LLC is seeking an EMR/Spark SQL & Job Query-Tuning Engineer on behalf of our client in Seattle, WA. This role is ideal for a Spark performance expert who specializes in optimizing PySpark, Spark SQL, and Hive workloads within large-scale data environments. The successful candidate will focus on improving application-level performance by tuning queries, optimizing execution plans, reducing memory consumption, minimizing shuffle operations, and enhancing overall job efficiency on Amazon EMR.
Key Responsibilities- Optimize and tune PySpark, Spark SQL, and Hive SQL jobs to improve performance, scalability, and resource utilization.
- Analyze Spark execution plans and DAGs to identify and resolve performance bottlenecks.
- Design and implement efficient partitioning, caching, and data processing strategies.
- Reduce shuffle overhead, spill events, executor memory pressure, and job execution times.
- Optimize join strategies, including broadcast joins, sort-merge joins, and other Spark execution techniques.
- Troubleshoot data skew, serialization issues, and distributed processing inefficiencies.
- Collaborate with data engineering and platform teams to improve workload performance and reliability.
- Monitor, benchmark, and continuously enhance large-scale data processing jobs.
- Recommend and implement best practices for Spark and EMR performance optimization.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience.
- Strong hands-on experience with PySpark, Spark SQL, Hive SQL, and Amazon EMR.
- Proven expertise in Spark performance tuning, query optimization, and execution plan analysis.
- Deep understanding of Spark internals, distributed computing concepts, and data processing frameworks.
- Experience optimizing large-scale data workloads and addressing memory, partitioning, and shuffle-related challenges.
- Proficiency in analyzing Spark UI metrics and troubleshooting performance issues.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Knowledge of Adaptive Query Execution (AQE), Catalyst Optimizer, and Tungsten Engine.
- Experience working with Parquet, ORC, and other columnar data formats.
- Familiarity with AWS data services and cloud-based big data platforms.
- Experience supporting enterprise-scale analytics or data engineering environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the EMR/Spark SQL & Job Query-Tuning Engineer in Seattle, WA vacancy
- ...Hi, Role: EMR/Spark SQL Engineer Location: Seattle ,WA EMR/Spark SQL & Job Query-Tuning Engineer Application/code-level optimization of PySpark/Spark/Hive SQL jobs; query tuning, DAG restructuring, join/serialization/partition optimization...SQLFull time
SoftPathTechnologies
Seattle, WA2 days ago $200k - $287.5k
....As a Senior Forward Deployed Engineer (FDE), you will be embedded with... ...focus on modernizing their Spark and Data Engineering focused workloads... ...and optimize data models, queries, and data processing workflows... ...:Strong proficiency in SQL and experience working with relational...SQL- ...how analysts work rather than getting in the way. The Role As a Query Engineer at Golden Analytics, you’ll build and own our connections to... ...products with strong development experience at the data layer - SQL, cloud-based database systems, data lakes, data interchange...SQL
$160k - $220k
...talk.Senior Database Reliability Engineer (DBRE) Experience Level: Mid-... ...failover automation).Optimize query performance, indexing... ...configuration, backups, failovers, vacuum tuning, and schema management using... ...software engineers to review SQL, optimize schemas, and ensure...SQLPermanent employmentWork at officeLocal areaWorldwideFlexible hours$157.7k - $213.8k
...improve their business. Founded by engineers — and customer obsessed — we... ...capabilities of traditional SQL query engines. As a software... ...some example projects:Apache Spark: Develop the de facto open source... ...engine that's fast, tuning free, scalable, and robust.What...SQLLocal areaWorldwide$90k - $115k
...methodologies, tools, distributed processing engines, event streaming platforms, and other... ...in Big Data Platforms: Apache Spark, Presto, Amazon EMR* Experience with Cloud Data Warehouses... ...BigQuery.* Strong programming skills using SQL, Stored Procedures and Object-Oriented...SQLTemporary workLocal area$122.4k
...opportunity for a JavaScript Engineer to join their team.About this... ...relational databases like MS SQL Server or MySQL or PostgreSQL... ...writing efficient, performant queries using database specific query... ...performance profiling and code-tuning of enterprise applications.Experience...SQLFull timeTemporary workWork at officeRemote workMonday to FridayShift workDay shift$196.91k - $277.97k
...inference.Partner with Product, Engineering, User Research, Designer and... ...computing language SQL, Python, or R for metrics creation... ...model preprocessing;Using SQL or Spark to query, explore, and manipulate data... ...or Tableau; andBuilding, tuning, and validating statistical models...SQLFull timeWork experience placementInternship$163.32k - $228k
...Design data schema, write queries to extract data, and... ...through ETL processes in SQL.Perform root cause... ...degree in Computer Science, Engineering (any), Information... ...preprocessing;Using SQL and Spark to query, explore, and... ...Tableau; andBuilding, tuning, and validating statistical...SQLFull timeWork experience placement- ...for Software Development Engineers to collaborate with... ...services, and database queries. Implement process monitoring... ...and perform performance tuning. Rotational on-call availability... ..., API Gateway, S3, EMR, DynamoDB, and SQS/SNS. * 2+ years of SQL & PL/SQL skills. Prefer...SQL
$91k - $197k
...Operations Team) System Operations IT Engineering branch, supporting the regional... ...patterns, data exchange, database queries, transformation, and operational... ...Skills: Advanced database structures, SQL query development, performance tuning, maintenance, and administration...SQLFull timeWork at officeSound Transit
Seattle, WA1 day ago- ...QA/Test Engineer Experience Required: 4–6 years Please share skills... ...(Step Functions, Airflow) SQL (strong), Python, PySpark... ...data pipelines on AWS (Glue, Spark, S3, Athena, Redshift). ~ Understanding... ...). ~ Ability to write SQL queries for data validation and...SQLContract work
Saxon Global
Seattle, WA5 days ago - About the TeamThe Spark Platform team owns and operates... ...a Senior Software Engineer on Spark Platform, you will... ...Apache Spark — internals, query execution, shuffle, the... ...platform scale on Amazon EMR, Databricks, or an in-house... ...and with the query and SQL engines that read them....SQLHourly payWork at officeLocal areaRemote workRelocationFlexible hours
$166k - $258k
...considered for this position.As a Senior Engineer 2, you'll be part of a key team of Nordstrom... ...pipelines using Airflow, Python, and Spark to integrate with Nordstrom systems.Enable... ...performant datasets and data models.Strong SQL and data modeling skills, with experience...SQLFull timeTemporary workWork at officeRotating shift- • BS in Computer Science or Engineering or equivalent industry experience... ...Power Automate, Dataverse, SQL, SharePoint. • Technical... ...Optimization Delegation - Optimize queries to ensure data processing... .... • Canvas App Performance Tuning • UI Responsiveness - Design...SQL
ClifyX
Seattle, WA4 days ago $101.3k - $160k
...DA) team is looking for a Data Engineer to influence Fuse's decisions... ...from a variety of sources using SQL, scripting, and AWS big data... ...- Experience with one or more query language (e.g., SQL, PL/SQL, DDL... ...such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool...SQLFlexible hours- Fuel Talent LLC is seeking a Data Engineer in Seattle to own and enhance core data pipelines... ...-driven workflows. You will work with SQL Server, SSIS, and VisualCron orchestration... ...building ETL/ELT pipelines, developing T-SQL queries, managing deployments, and collaborating...SQL
$129.2k - $174.8k
...Develop Web applications • Improve performance of the applications and servers through Performance tuning/sizing of servers, and changing the design and fine tuning the SQL queries.• Support various testing procedures (Unit testing, Integration testing, class room testing,...SQLPermanent employmentFlexible hours- ...ETL with Informatica Power Center Strong expertise with advanced SQL on Oracle/DB2/Microsoft SQL Server Experienced in effective... ...modeling Strong analytical skills (able to read/write complex SQL queries to analyze data, investigate defects, validate data quality, etc...SQL
$113.3k - $205.52k
...Jamf: As a Senior Site Reliability Engineer, you'll help us balance development... ...(profilers, heap and thread dumps, query plans, traces, logs, metrics).(Required... ...adopt. (Required) Experience optimizing SQL queries and database engine tuning. (Preferred) Experience with CI/CD...SQLWork at officeRemote workWorldwideFlexible hoursGrabJobs
Seattle, WA2 days ago$132.1k - $178.8k
...looking for a results-driven Data Engineer to build and scale the data... ...data. Optimize storage, queries, and AWS infrastructure costs... ...technologies such as Hadoop, Hive, Spark, or EMR.- Experience with data... ...more query languages (e.g., SQL, PL/SQL, DDL, HiveQL, SparkSQL...SQLLocal areaFlexible hours$160k - $230k
...We’re hiring talented Software Engineers to join the Snowflake Database... ....Design and implement novel query optimization or distributed data... ...EXPERIENCE WITH THE FOLLOWING:SQL or other database technologies... ...solutions like Hadoop and Spark.Large scale distributed systems...SQLWork at office$121.5k - $188.5k
...intersection of four disciplines: agent engineering, context engineering, evaluations and guardrails... ...architectures, and backend databases (SQL, NoSQL, or cloud-native datastores).... ...spaces.Exposure to big data technologies (Spark, BigQuery, Redshift) or integrating ML models...SQLFull time- ...Kafka, Flume, Sqoop, Hive,HBase, Pig, Map Reduce, Spark, Storm with hands on experience - all or most... ...with Agile methodologies• Expertise in SQL databases (e.g. MySQL or Oracle) and strong ability to write SQL queries. • At least 2 years of experience in translating...SQL
$70k - $140k
...client-facing environment.The mission of the Associate Investment Engineer is to support the Investment Strategy department's investment... ...tools preferredSnowflake experience and experience writing SQL queries preferredMust possess a high level of initiative, attention to...SQLTemporary workWork at officeLocal areaRemote workWorldwide3 days per week- ...and mastering their craft. As a Snowflake Engineer, Consultant, you will:• Design, develop, and... ...solutions.• Develop solutions using SQL, Python, and modern data engineering tools.• Support data quality, performance tuning, and platform optimization initiatives.• Contribute...SQLTemporary workLocal area
$180.71k - $217k
...Evernorth Services Inc. seeks a Software Engineering Senior Advisor for the Seattle, WA location... ...time within SLA by improving mongo queries and indexes;• Developing Data Verification... ...Connectivity (JDBC), Structured Query Language (SQL), NoSQL, Scrum, Maven, REST-based...SQLFull timeLocal areaWork from home$95k - $105k
...testing, including strong understanding of XML schema, tools supporting web service interface testing, and JSON SME-level SQL skills, including complex query writing, ability to review schema for DB structure understanding, and use of various SQL tools for testing Knowledge...SQLTata Consultancy Services
Seattle, WA1 day ago- ...Flume, Sqoop, Hive, Pig, Map Reduce, Spark, Storm with hands on experience -... ...toolsExcellent Communication Skills.Expertise in SQL databases (e.g. MySQL or Oracle) and strong ability to write SQL queries.Proven ability to lead a team of engineers.Ability to work in onsite/offshore...SQL
- ...with the creators of the fastest-growing and fastest-improving query engine on the planet. Unlike other databases, MotherDuck was architected... ..., analytics engineer, or similar, with hands-on skills in SQL, Python, and cloud-native data tooling.2+ years in a pre-sales...SQLWork at officeLocal areaFlexible hours
MotherDuck
Seattle, WA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to EMR/Spark SQL & Job Query-Tuning Engineer. Be the first to apply!
