EMR/Spark SQL & Job Query-Tuning Engineer
Full-time
SoftPathTechnologies
Hi,
Role: EMR/Spark SQL & Job Query-Tuning Engineer
Location:Redmond,WA
skills Required:
Application/code-level optimization of PySpark/Spark/Hive SQL jobs; query tuning, DAG restructuring, join/serialization/partition optimization, shuffle-spill and cache reduction.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the EMR/Spark SQL & Job Query-Tuning Engineer in Washington DC vacancy
$130k - $158k
...a Senior Databricks Migration Engineer to work onsite for the US Postal... ...migration efforts from legacy SQL systems, warehouses and... ...concurrency, low-latency Power BI queries (DirectQuery and Import modes)... ...the team from SQL-centric to Spark-centric thinking.Create comprehensive...SQLPermanent employmentWork at office$110k - $130k
...looking for a seasoned ETL Engineer to work with our team and our... ...data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including... ...etc.AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents... ...with relational databases, query authoring and optimization...SQL$160k - $220k
...Senior Database Reliability Engineer (DBRE) Experience Level: Mid... ...failover automation). Optimize query performance, indexing... ...configuration, backups, failovers, vacuum tuning, and schema management using... ...software engineers to review SQL, optimize schemas, and ensure...SQLPermanent employmentWork at officeLocal areaWorldwideFlexible hoursOkta
Washington DCmore than 2 months ago- ...Optimization: Serve as the primary expert for performance tuning and optimization of all SQL queries, stored procedures, and database configurations,... ...Administrator Associate), experience with Big Data technologies (Spark, Hadoop), and DevOps practices (CI/CD, Terraform). Job...SQLPermanent employmentFull time
- ...Job Requirements 5+ years of professional software engineering experience focusing on Python-based production application development... ...OpenAI. Experience in PostgreSQL relational modeling, SQL query tuning, and managing complex JSONB data types. Experience...SQL
RESOURCESOFT, INC.
Bethesda, MD3 days ago $210k - $230k
...currently hiring for a Senior Site Reliability Engineer (SRE) to design, implement, and maintain... ...capacity planning and performance tuning• Perform root cause analysis and implement... ...and optimize Azure services (VMs, Storage, SQL Database, AKS, Monitor, etc.)• Implement...SQLCurrently hiringRemote work- ...is seeking a Senior Big Data Engineer / Java Data Integration Engineer... ...technologies such as Kafka, Spark, Elasticsearch, and cloud-based... ...Spark | Elasticsearch | Oracle | SQL | ETL | Data Integration |... ...transformation pipelines. Optimize SQL queries, database processes, and...SQLFull timeRemote workFlexible hours
- ...designed for both commercial and government applications. Our engineers and space scientists are on a mission to eliminate the... ...Camunda, Apache Airflow, Ansible, or similar)Ability to query and manipulate data in SQL and/or NoSQL databasesStrong command of test strategy...SQLWork at officeRemote workHome office
$130k - $165k
...seeking a Senior Data Engineer to design, build,... ...Python, Apache Spark (PySpark), Databricks, dbt, SQL (PostgreSQL), and AWS... ...leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache... ...performance tuning , system optimization... ...tuning and complex query design Salary We...SQLFull timeTemporary workRemote workCapital Technology Group
Silver Spring, MD24 days ago$150k - $250k
Software Systems Engineer - TS/SCI w/ FS Poly 3 days ago Be among the first 25 applicants... ...and big data pipelines such as Glue, EMR, HIVE, Spark, S3, SQS, and SNS Demonstrated... ...using the AWS CDK Prior experience with SQL querying of relational database, such as MySQL,...SQLFull time$197.3k - $225.1k
Lead Data Engineer (Python, Scala, Spark) Do you love building and pioneering in the technology... ...coded, and effectively tuned for performance Basic... ...development including Python, SQL, Scala, or Java 4+ years of... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or...SQLFull timePart timeInternshipH1bLocal area- ...guidanceExperience in troubleshooting, performance tuning, and optimizationProficient in shell... ...programming languagesKnowledge of Spark/PySparkExcellent SQL knowledge, ability to read/write SQL... ...You’d Be DoingAs a Data Operations Engineer you will be responsible for...SQLWork experience placement
Inclusion Cloud
Washington DC7 hours ago - ...configuring IIS and IIS hosted applications Proficiency at SQL server database querying, maintenance and performance tuning Microsoft .NET, AppFabric, SharePoint Server,... ...familiarity with source control (Git)Systems Engineer:Supervise, coordinate and/or design, develop and...SQL
Bow Wave LLC
Washington DC13 days ago $158.6k - $181k
Senior Data Engineer (Python, AWS, Spark) Do you love building and pioneering in the... ...elegantly coded, and effectively tuned for performance. Basic... ...development including Python, SQL, Scala, or Java. 2+ years of... ...Lake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or...SQLFull timePart timeInternshipH1bLocal area$75k - $115k
...is seeking a Junior Data Engineer to design, build, and maintain... ...Databricks, dbt, Apache Spark (PySpark), SQL (PostgreSQL), and Python .... ...AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow... ...skills, including performance tuning and complex query design We are committed to...SQLFull timeTemporary workRemote work- ...highly technical team of database engineers globally. This team focuses on... ...on PostgreSQL development, SQL coding, data conversion, and... ...modeling, and database performance tuning. Strong expertise with... ...efforts, including SQL coding, query optimization, and data conversion...SQLPermanent employmentFull timeWork at office2 days per week3 days per week
- ...Senior Data Engineer Location: Hybrid in Washington... ...integration of legacy SQL assets. Legacy Reporting... ...optimize SSRS report queries and SSAS tabular/multidimensional... ...Integration: Build and tune Dedicated and... ...and a modern Databricks Spark job in the same day....SQLLocal area
InterSources
Washington DC1 day ago $229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building... ..., elegantly coded, and effectively tuned for performance Basic... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ year experience...SQLFull timePart timeInternshipLocal area- ...seeking a Data & Software Engineer works with a small team to... ...including configuring and updating Spark JobsContainerizing and... ...including performance tuning, schema design, and query optimization for complex, analytical... ...Iceberg, Airflow, etc.· SQL (with Trino)· NoSQL,...SQL
$160k - $225k
We’re seeking a Systems Engineer to support our U.S. Government program in the Laurel... .../maintenance across Windows and SQL Server environments Execute application... ..., troubleshooting, and performance tuning Write and execute SQL queries and scripts to support...SQLImmediate startFlexible hours$115k - $151.8k
As a Sr. Systems Engineer II, you’ll deploy, operate, and support our observability platform... ...): backups, retention, indexing, and query performance.Monitor system health, set up... ...Grafana, Prometheus, OpenTelemetry, Python, SQL/PostgreSQL, secrets management, and SSH administration...SQLFull timeLocal area$119.7k - $199.3k
...Communications, Customer Care, Engineering & Product, Finance, Human... ...efforts using Python, Spark, Flink and other data... .../ELT, Data modeling, and querying and analyzing large datasets using SQL.Technical Skills: Extensive... ...Redshift, Athena, EMR, and Glue catalog. Strong...SQLFull timePart time- ...Organization: GeoAcuity Title: Systems Engineer Location: On-site — St. Louis, MO | DC Metro | Springfield, VA | Redlands, CA Position... ...-balancing); experience with at least one RDBMS, including SQL query writing (SQL Server, Oracle, PostgreSQL); US citizenship with...SQLFull time
The GIS Jobs Clearinghouse
Washington DC3 days ago $90k - $115k
...Enterprise Data Integration Engineer (Python/ETL) - Senior Location... ...logic using Python, SQL, and modern data engineering practices... ...joins, aggregations, and query optimization. ~ Experience integrating... ...notebooks, PySpark, Apache Spark, Databricks, or comparable...SQLRemote workMontcure, LLC
Washington DC6 days ago$119.32k - $202.85k
...recruiting for an experienced Senior Threat Detection & Response Engineer to support the research and development of new cyber... ...attack vectors, and vulnerabilities used Experience with query languages (e.g., SQL, KQL, etc.) Experience developing advanced dashboards (e.g...SQLFull timeContract workWork experience placementWork at officeRemote work$110k - $147k
Washington, D.C.Engineering /Full-time /On-siteA World-Changing CompanyPalantir builds the world’s leading software for data-driven decisions... ...languages or data engineering frameworks, such as Python, SQL, Spark, Java, C++, TypeScript/JavaScript, or similar.What We...SQLFull timeWork experience placementWork at officeRemote workWork from homeRelocation package$120k - $180k
...Information Technology, Test & Evaluation, Engineering & Analysis, and Training.... ...reliable datasets that are optimized for querying, reporting, and analysis.Analytical Modeling... ...enterprise analytic platforms, Qlik, Streamlit, SQL, data modeling, dashboard development,...SQLContract workFor contractors$115k - $150k
...our clients.As a Senior Data Engineer, you will architect, build, and... ...performance optimization of databases, queries, and pipelines (e.g.,... ...workflows using tools like Apache Spark, Kafka, Airflow, and dbt.... ...scalable data solutions.Expertise in SQL and relational database...SQLFull timeVisa sponsorship- ...targeting & intelligence analysis, systems engineering & integration, and training capabilities... ...+ years of experience.Possess fluency in SQL and Python or R.Familiar with the... ...processing and analysis.Able to accurately query datasets, extract data and validate the data...SQL
- ...is seeking a Data Integration Engineer to join an exciting and growing... ..., Celonis Intelligence, SQL, Python, cloud-native integration... ...Strong SQL skills with experience querying, validating, and reconciling... ...platforms including Databricks, Spark, Delta Lake, Microsoft Fabric,...SQL
Silverthorne Advisory Group LLC
Arlington, VA26 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to EMR/Spark SQL & Job Query-Tuning Engineer. Be the first to apply!
Related searches
- sql engineer Washington DC
- sql database developer analyst Washington DC
- sql developer Washington DC
- sql programmer Washington DC
- sql data analyst Washington DC
- sql database Washington DC
- junior sql analyst Washington DC
- sql server database developer Washington DC
- sql tableau Washington DC
- remote sql Washington DC