EMR/Spark SQL & Job Query-Tuning Engineer
Full-time
SoftPathTechnologies
Hi,
Role: EMR/Spark SQL & Job Query-Tuning Engineer
Location:Redmond,WA
skills Required:
Application/code-level optimization of PySpark/Spark/Hive SQL jobs; query tuning, DAG restructuring, join/serialization/partition optimization, shuffle-spill and cache reduction.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the EMR/Spark SQL & Job Query-Tuning Engineer in Washington DC vacancy
$152k - $228k
...Senior Database Reliability Engineer (DBRE) 2 days ago Be among the... ...failover automation). Optimize query performance, indexing strategies... ..., backups, failovers, vacuum tuning, and schema management using tools... ...software engineers to review SQL, optimize schemas, and ensure...SQLPermanent employmentWork at officeFlexible hoursOkta, Inc.
Washington DC2 days ago- ...troubleshooting, performance tuning, and optimization Proficient in... ...programming languages Knowledge of Spark/PySpark Excellent SQL knowledge , ability to read/write SQL queries Skilled in Hive (HQL) and HDFS... ...BE DOING As a Data Operations Engineer you will be responsible for...SQLWork experience placement
$130k - $158k
...a Senior Databricks Migration Engineer to work onsite for the US Postal... ...migration efforts from legacy SQL systems, warehouses and... ...concurrency, low-latency Power BI queries (DirectQuery and Import modes)... ...the team from SQL-centric to Spark-centric thinking.Create comprehensive...SQLPermanent employmentWork at office$110k - $130k
...looking for a seasoned ETL Engineer to work with our team and our... ...data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including... ...etc.AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents... ...with relational databases, query authoring and optimization...SQL- ...Job Requirements 5+ years of professional software engineering experience focusing on Python-based production application development... ...OpenAI. Experience in PostgreSQL relational modeling, SQL query tuning, and managing complex JSONB data types. Experience...SQL
RESOURCESOFT, INC.
Bethesda, MD1 day ago - ...is seeking a Senior Big Data Engineer / Java Data Integration Engineer... ...technologies such as Kafka, Spark, Elasticsearch, and cloud-based... ...Spark | Elasticsearch | Oracle | SQL | ETL | Data Integration |... ...transformation pipelines. Optimize SQL queries, database processes, and...SQLFull timeRemote workFlexible hours
$130k - $165k
...seeking a Senior Data Engineer to design, build,... ...Python, Apache Spark (PySpark), Databricks, dbt, SQL (PostgreSQL), and AWS... ...leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache... ...performance tuning , system optimization... ...tuning and complex query design Salary We...SQLFull timeTemporary workRemote workCapital Technology Group
Silver Spring, MD20 days ago$210k - $230k
...currently hiring for a Senior Site Reliability Engineer (SRE) to design, implement, and maintain... ...capacity planning and performance tuning• Perform root cause analysis and implement... ...and optimize Azure services (VMs, Storage, SQL Database, AKS, Monitor, etc.)• Implement...SQLCurrently hiringRemote work- ...designed for both commercial and government applications. Our engineers and space scientists are on a mission to eliminate the... ...Camunda, Apache Airflow, Ansible, or similar)Ability to query and manipulate data in SQL and/or NoSQL databasesStrong command of test strategy...SQLWork at officeRemote workHome office
- ...configuring IIS and IIS hosted applications Proficiency at SQL server database querying, maintenance and performance tuning Microsoft .NET, AppFabric, SharePoint Server,... ...familiarity with source control (Git)Systems Engineer:Supervise, coordinate and/or design, develop and...SQL
Bow Wave LLC
Washington DC9 days ago $150k - $250k
Software Systems Engineer - TS/SCI w/ FS Poly 3 days ago Be among the first 25 applicants... ...and big data pipelines such as Glue, EMR, HIVE, Spark, S3, SQS, and SNS Demonstrated... ...using the AWS CDK Prior experience with SQL querying of relational database, such as MySQL,...SQLFull time$75k - $115k
...is seeking a Junior Data Engineer to design, build, and maintain... ...Databricks, dbt, Apache Spark (PySpark), SQL (PostgreSQL), and Python .... ...AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow... ...skills, including performance tuning and complex query design We are committed to...SQLFull timeTemporary workRemote work$158.6k - $181k
Senior Data Engineer (Python, AWS, Spark) Do you love building and pioneering in the... ...elegantly coded, and effectively tuned for performance. Basic... ...development including Python, SQL, Scala, or Java. 2+ years of... ...Lake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or...SQLFull timePart timeInternshipH1bLocal area$229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building... ..., elegantly coded, and effectively tuned for performance Basic... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ year experience...SQLFull timePart timeInternshipLocal area- ...highly technical team of database engineers globally. This team focuses on... ...on PostgreSQL development, SQL coding, data conversion, and... ...modeling, and database performance tuning. Strong expertise with... ...efforts, including SQL coding, query optimization, and data conversion...SQLPermanent employmentFull timeWork at office2 days per week3 days per week
- ...Senior Data Engineer Location: Hybrid in Washington... ...integration of legacy SQL assets. Legacy Reporting... ...optimize SSRS report queries and SSAS tabular/multidimensional... ...Integration: Build and tune Dedicated and... ...and a modern Databricks Spark job in the same day....SQLLocal area
InterSources
Washington DC2 days ago - ...seeking a Data & Software Engineer works with a small team to... ...including configuring and updating Spark JobsContainerizing and... ...including performance tuning, schema design, and query optimization for complex, analytical... ...Iceberg, Airflow, etc.· SQL (with Trino)· NoSQL,...SQL
$160k - $225k
We’re seeking a Systems Engineer to support our U.S. Government program in the Laurel... .../maintenance across Windows and SQL Server environments Execute application... ..., troubleshooting, and performance tuning Write and execute SQL queries and scripts to support...SQLImmediate startFlexible hours$115k - $151.8k
As a Sr. Systems Engineer II, you’ll deploy, operate, and support our observability platform... ...): backups, retention, indexing, and query performance.Monitor system health, set up... ...Grafana, Prometheus, OpenTelemetry, Python, SQL/PostgreSQL, secrets management, and SSH administration...SQLFull timeLocal area$90k - $115k
...Enterprise Data Integration Engineer (Python/ETL) - Senior Location... ...logic using Python, SQL, and modern data engineering practices... ...joins, aggregations, and query optimization. ~ Experience integrating... ...notebooks, PySpark, Apache Spark, Databricks, or comparable...SQLRemote workMontcure, LLC
Washington DC2 days ago$119.7k - $199.3k
...Communications, Customer Care, Engineering & Product, Finance, Human... ...efforts using Python, Spark, Flink and other data... .../ELT, Data modeling, and querying and analyzing large datasets using SQL.Technical Skills: Extensive... ...Redshift, Athena, EMR, and Glue catalog. Strong...SQLFull timePart time- ...is seeking a Data Integration Engineer to join an exciting and growing... ..., Celonis Intelligence, SQL, Python, cloud-native integration... ...Strong SQL skills with experience querying, validating, and reconciling... ...platforms including Databricks, Spark, Delta Lake, Microsoft Fabric,...SQL
Silverthorne Advisory Group LLC
Arlington, VA22 days ago - ...Organization: GeoAcuity Title: Systems Engineer Location: On-site — St. Louis, MO | DC Metro | Springfield, VA | Redlands, CA Position... ...-balancing); experience with at least one RDBMS, including SQL query writing (SQL Server, Oracle, PostgreSQL); US citizenship with...SQLFull time
The GIS Jobs Clearinghouse
Washington DC4 days ago $58k - $136.2k
Data Platform Operations Engineer (Secret Cleared) Position Description CGI Federal is a seeking Data... ...Support operations of Azure Synapse (pipelines, Spark pools, SQL pools), including monitoring and performance tuning. . Maintain operational monitoring, alerting,...SQLLocal areaArlington, VA20 days ago- ...Systems Analyst (ORSA) - Data Engineering & Analytics Focus Our CompanyN2... ...threat.Expert-level proficiency in SQL and relational database design, including complex queries, joins, subqueries, and... ...Experience with big data technologies (Spark, distributed computing)....SQL
N2IA Technologies
Washington DC9 days ago $110k - $147k
Washington, D.C.Engineering /Full-time /On-siteA World-Changing CompanyPalantir builds the world’s leading software for data-driven decisions... ...languages or data engineering frameworks, such as Python, SQL, Spark, Java, C++, TypeScript/JavaScript, or similar.What We...SQLFull timeWork experience placementWork at officeRemote workWork from homeRelocation package$120k - $180k
...Information Technology, Test & Evaluation, Engineering & Analysis, and Training.... ...reliable datasets that are optimized for querying, reporting, and analysis.Analytical Modeling... ...enterprise analytic platforms, Qlik, Streamlit, SQL, data modeling, dashboard development,...SQLContract workFor contractors$119.32k - $202.85k
...recruiting for an experienced Senior Threat Detection & Response Engineer to support the research and development of new cyber... ...attack vectors, and vulnerabilities used Experience with query languages (e.g., SQL, KQL, etc.) Experience developing advanced dashboards (e.g...SQLFull timeContract workWork experience placementWork at officeRemote work$115k - $150k
...our clients.As a Senior Data Engineer, you will architect, build, and... ...performance optimization of databases, queries, and pipelines (e.g.,... ...workflows using tools like Apache Spark, Kafka, Airflow, and dbt.... ...scalable data solutions.Expertise in SQL and relational database...SQLFull timeVisa sponsorship- ...targeting & intelligence analysis, systems engineering & integration, and training capabilities... ...+ years of experience.Possess fluency in SQL and Python or R.Familiar with the... ...processing and analysis.Able to accurately query datasets, extract data and validate the data...SQL
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to EMR/Spark SQL & Job Query-Tuning Engineer. Be the first to apply!
Related searches
- sql database developer analyst Washington DC
- sql consultant Washington DC
- sql server database engineer Washington DC
- junior sql analyst Washington DC
- entry level sql Washington DC
- data analyst - r python sql Washington DC
- remote sql Washington DC
- sql server database developer Washington DC
- sql Washington DC
- sql server Washington DC