EMR/Spark SQL & Job Query-Tuning Engineer
Staffxpert LLC
a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; } EMR/Spark SQL & Job Query-Tuning Engineer
Location: Seattle, WA (Onsite)
About UsSTAFFXPERT LLC is a leading talent solutions and technology staffing firm connecting skilled professionals with innovative organizations across diverse industries. We are committed to delivering exceptional opportunities and helping top talent advance their careers through impactful projects and long-term partnerships.
Job SummarySTAFFXPERT LLC is seeking an EMR/Spark SQL & Job Query-Tuning Engineer on behalf of our client in Seattle, WA. This role is ideal for a Spark performance expert who specializes in optimizing PySpark, Spark SQL, and Hive workloads within large-scale data environments. The successful candidate will focus on improving application-level performance by tuning queries, optimizing execution plans, reducing memory consumption, minimizing shuffle operations, and enhancing overall job efficiency on Amazon EMR.
Key Responsibilities- Optimize and tune PySpark, Spark SQL, and Hive SQL jobs to improve performance, scalability, and resource utilization.
- Analyze Spark execution plans and DAGs to identify and resolve performance bottlenecks.
- Design and implement efficient partitioning, caching, and data processing strategies.
- Reduce shuffle overhead, spill events, executor memory pressure, and job execution times.
- Optimize join strategies, including broadcast joins, sort-merge joins, and other Spark execution techniques.
- Troubleshoot data skew, serialization issues, and distributed processing inefficiencies.
- Collaborate with data engineering and platform teams to improve workload performance and reliability.
- Monitor, benchmark, and continuously enhance large-scale data processing jobs.
- Recommend and implement best practices for Spark and EMR performance optimization.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience.
- Strong hands-on experience with PySpark, Spark SQL, Hive SQL, and Amazon EMR.
- Proven expertise in Spark performance tuning, query optimization, and execution plan analysis.
- Deep understanding of Spark internals, distributed computing concepts, and data processing frameworks.
- Experience optimizing large-scale data workloads and addressing memory, partitioning, and shuffle-related challenges.
- Proficiency in analyzing Spark UI metrics and troubleshooting performance issues.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Knowledge of Adaptive Query Execution (AQE), Catalyst Optimizer, and Tungsten Engine.
- Experience working with Parquet, ORC, and other columnar data formats.
- Familiarity with AWS data services and cloud-based big data platforms.
- Experience supporting enterprise-scale analytics or data engineering environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the EMR/Spark SQL & Job Query-Tuning Engineer in Seattle, WA vacancy
$200k - $287.5k
....As a Senior Forward Deployed Engineer (FDE), you will be embedded with... ...focus on modernizing their Spark and Data Engineering focused workloads... ...and optimize data models, queries, and data processing workflows... ...:Strong proficiency in SQL and experience working with relational...SQL- ...how analysts work rather than getting in the way. The Role As a Query Engineer at Golden Analytics, you’ll build and own our connections to... ...products with strong development experience at the data layer - SQL, cloud-based database systems, data lakes, data interchange...SQL
$160k - $220k
...talk.Senior Database Reliability Engineer (DBRE) Experience Level: Mid-... ...failover automation).Optimize query performance, indexing... ...configuration, backups, failovers, vacuum tuning, and schema management using... ...software engineers to review SQL, optimize schemas, and ensure...SQLPermanent employmentWork at officeLocal areaWorldwideFlexible hours$157.7k - $213.8k
...improve their business. Founded by engineers — and customer obsessed — we... ...capabilities of traditional SQL query engines. As a software... ...some example projects:Apache Spark: Develop the de facto open source... ...engine that's fast, tuning free, scalable, and robust.What...SQLLocal areaWorldwide$122.4k
...opportunity for a JavaScript Engineer to join their team.About this... ...relational databases like MS SQL Server or MySQL or PostgreSQL... ...writing efficient, performant queries using database specific query... ...performance profiling and code-tuning of enterprise applications.Experience...SQLFull timeTemporary workWork at officeRemote workMonday to FridayShift workDay shift$90k - $115k
...methodologies, tools, distributed processing engines, event streaming platforms, and other... ...in Big Data Platforms: Apache Spark, Presto, Amazon EMR* Experience with Cloud Data Warehouses... ...BigQuery.* Strong programming skills using SQL, Stored Procedures and Object-Oriented...SQLTemporary workLocal area$196.91k - $277.97k
...inference.Partner with Product, Engineering, User Research, Designer and... ...computing language SQL, Python, or R for metrics creation... ...model preprocessing;Using SQL or Spark to query, explore, and manipulate data... ...or Tableau; andBuilding, tuning, and validating statistical models...SQLFull timeWork experience placementInternship$163.32k - $228k
...Design data schema, write queries to extract data, and... ...through ETL processes in SQL.Perform root cause... ...degree in Computer Science, Engineering (any), Information... ...preprocessing;Using SQL and Spark to query, explore, and... ...Tableau; andBuilding, tuning, and validating statistical...SQLFull timeWork experience placement- ...for Software Development Engineers to collaborate with... ...services, and database queries. Implement process monitoring... ...and perform performance tuning. Rotational on-call availability... ..., API Gateway, S3, EMR, DynamoDB, and SQS/SNS. * 2+ years of SQL & PL/SQL skills. Prefer...SQL
- ...QA/Test Engineer (1 Position) Experience Required: 4-6 years... ...(Step Functions, Airflow) SQL (strong), Python, PySpark... ...data pipelines on AWS (Glue, Spark, S3, Athena, Redshift). ~... ...). ~ Ability to write SQL queries for data validation and reconciliation...SQLContract work
Saxon Global
Seattle, WA2 days ago - About the TeamThe Spark Platform team owns and operates... ...a Senior Software Engineer on Spark Platform, you will... ...Apache Spark — internals, query execution, shuffle, the... ...platform scale on Amazon EMR, Databricks, or an in-house... ...and with the query and SQL engines that read them....SQLHourly payWork at officeLocal areaRemote workRelocationFlexible hours
$166k - $258k
...considered for this position.As a Senior Engineer 2, you'll be part of a key team of Nordstrom... ...pipelines using Airflow, Python, and Spark to integrate with Nordstrom systems.Enable... ...performant datasets and data models.Strong SQL and data modeling skills, with experience...SQLFull timeTemporary workWork at officeRotating shift- Fuel Talent LLC is seeking a Data Engineer in Seattle to own and enhance core data pipelines... ...-driven workflows. You will work with SQL Server, SSIS, and VisualCron orchestration... ...building ETL/ELT pipelines, developing T-SQL queries, managing deployments, and collaborating...SQL
$101.3k - $160k
...DA) team is looking for a Data Engineer to influence Fuse's decisions... ...from a variety of sources using SQL, scripting, and AWS big data... ...- Experience with one or more query language (e.g., SQL, PL/SQL, DDL... ...such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool...SQLFlexible hours- ...ETL with Informatica Power Center Strong expertise with advanced SQL on Oracle/DB2/Microsoft SQL Server Experienced in effective... ...modeling Strong analytical skills (able to read/write complex SQL queries to analyze data, investigate defects, validate data quality, etc...SQL
$129.2k - $174.8k
...Develop Web applications • Improve performance of the applications and servers through Performance tuning/sizing of servers, and changing the design and fine tuning the SQL queries.• Support various testing procedures (Unit testing, Integration testing, class room testing,...SQLPermanent employmentFlexible hours- ...professional experience in data engineering, data platforms, or related... ...., PostgreSQL, MySQL, Oracle, SQL Server).Solid experience with... ...Kafka, AWS Kinesis, Apache Flink, Spark Streaming).Proficiency in... ...modeling, schema design, and query optimization.Familiarity with...SQLContract workLocal area
Georgia IT Inc
Seattle, WA4 days ago $132.1k - $178.8k
...looking for a results-driven Data Engineer to build and scale the data... ...data. Optimize storage, queries, and AWS infrastructure costs... ...technologies such as Hadoop, Hive, Spark, or EMR.- Experience with data... ...more query languages (e.g., SQL, PL/SQL, DDL, HiveQL, SparkSQL...SQLLocal areaFlexible hours$160k - $230k
...We’re hiring talented Software Engineers to join the Snowflake Database... ....Design and implement novel query optimization or distributed data... ...EXPERIENCE WITH THE FOLLOWING:SQL or other database technologies... ...solutions like Hadoop and Spark.Large scale distributed systems...SQLWork at office$121.5k - $188.5k
...intersection of four disciplines: agent engineering, context engineering, evaluations and guardrails... ...architectures, and backend databases (SQL, NoSQL, or cloud-native datastores).... ...spaces.Exposure to big data technologies (Spark, BigQuery, Redshift) or integrating ML models...SQLFull time- ...Kafka, Flume, Sqoop, Hive,HBase, Pig, Map Reduce, Spark, Storm with hands on experience - all or most... ...with Agile methodologies• Expertise in SQL databases (e.g. MySQL or Oracle) and strong ability to write SQL queries. • At least 2 years of experience in translating...SQL
$180.71k - $217k
...Evernorth Services Inc. seeks a Software Engineering Senior Advisor for the Seattle, WA location... ...time within SLA by improving mongo queries and indexes;• Developing Data Verification... ...Connectivity (JDBC), Structured Query Language (SQL), NoSQL, Scrum, Maven, REST-based...SQLFull timeLocal areaWork from home- ...and mastering their craft. As a Snowflake Engineer, Consultant, you will:• Design, develop, and... ...solutions.• Develop solutions using SQL, Python, and modern data engineering tools.• Support data quality, performance tuning, and platform optimization initiatives.• Contribute...SQLTemporary workLocal area
- ...is seeking a Data Integration Engineer to join an exciting and growing... ..., Celonis Intelligence, SQL, Python, cloud-native integration... ...knowledge of SQL with experience querying, validating, and analyzing... ...platforms including Databricks, Spark, Delta Lake, Microsoft Fabric,...SQLWork from homeFlexible hours
- ...with recruiting a skilled and experienced Data / Integration Engineer. Thisposition supports the following program: U.S. Department... ...Candidates with Microsoft-stack depth (Power BI, PowerAutomate, Power Query, SQL Server) and the aptitude to transfer are strongfits; direct...SQLContract workPart timeFor contractorsWork at office
Biz First
Seattle, WA1 day ago $70k - $140k
...client-facing environment.The mission of the Associate Investment Engineer is to support the Investment Strategy department's investment... ...tools preferredSnowflake experience and experience writing SQL queries preferredMust possess a high level of initiative, attention to...SQLTemporary workWork at officeLocal areaRemote workWorldwide3 days per week- ...Flume, Sqoop, Hive, Pig, Map Reduce, Spark, Storm with hands on experience -... ...toolsExcellent Communication Skills.Expertise in SQL databases (e.g. MySQL or Oracle) and strong ability to write SQL queries.Proven ability to lead a team of engineers.Ability to work in onsite/offshore...SQL
$115k - $140k
...Customer Success Engineer Finvari is a fast-growing SaaS startup transforming the way construction companies handle payments.... ...Implementation Specialist, etc.) ~ Strong experience with SQL, data querying, and working with structured/unstructured data ~ Proven ability...SQLWork at officeRemote workVisa sponsorshipWork visaFlexible hours1 day per weekFinvari
Seattle, WA1 day ago$110.33k
...system design and administration, software engineering, and operational support for academic... ...cloud-native data platforms, including Azure SQL Database and SQL Managed Instance.... ...on experience migrating, configuring, and tuning Azure SQL Database or Managed Instances.Familiarity...SQLFull timeTemporary workWork at officeShift work2 days per week$80k - $90k
...enrichment, and validation activities. • Conduct performance tuning and optimization of ETL jobs, databases, and data flows. • Analyze... ...) • ETL Design & Development • Data Warehousing Concepts • SQL (Advanced) • Data Modeling • Data Migration & Modernization...SQLPermanent employmentTata Consultancy Services
Seattle, WA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to EMR/Spark SQL & Job Query-Tuning Engineer. Be the first to apply!
