Databricks SME

Job Description

The Antitrust Division of the U.S. Department of Justice (DOJ) is responsible for enforcing federal antitrust laws and promoting fair competition in the marketplace. The Data Management Specialist will support the management, administration, and optimization of data infrastructure, focusing on cloud services, database management, data analysis, and reporting solutions using Azure, SQL Server, Power BI, Apache Tomcat, R Studio, and Databricks.

\n

Responsibilities

\n

\n

\n
• Administer and support Azure cloud resources, including Azure SQL Database, Blob Storage, and Azure Data Lake, ensuring optimal functionality and performance.
\n
• Manage and configure Azure-based solutions for data storage, security, and access control.
\n
• Implement automation scripts for managing and provisioning Azure resources using Azure CLI and PowerShell.
\n
• Monitor and optimize SQL Server instances for efficiency and reliability, performing database backups, restore operations, and ensuring data integrity.
\n
• Assist with migrations and upgrades of SQL Server environments to cloud-based platforms (Azure SQL).
\n
• Assist in the deployment, maintenance, and troubleshooting of applications using Apache Tomcat.
\n
• Contribute to the development of Databricks pipelines, helping implement data transformation and data engineering processes, and build scalable ETL processes with data teams.
\n
• Create and maintain Power BI reports, dashboards, and data visualizations to provide actionable insights for business teams.
\n
• Use R Studio for data analysis, statistical modeling, and generating insights from large datasets in collaboration with the data science team.
\n
• Document processes, workflows, and configurations to ensure consistent and effective data management practices.
\n

\n

Required Qualifications

\n

\n

\n
• U.S. Citizenship Required.
\n
• Public Trust security clearance required (cannot begin assignment until granted; candidates currently holding a Public Trust, especially with DOJ, are preferred).
\n
• Bachelor’s degree in Computer Science, Information Technology, Data Management, or a related field.
\n
• 3+ years of experience working in data management, with hands-on experience in Azure, SQL Server, Power BI, Apache Tomcat, R Studio, and Databricks.
\n
• Proficient in Azure Administration (Azure SQL Database, Azure Blob Storage, Azure Data Lake).
\n
• Strong knowledge of SQL Server Database Administration (performance tuning, backups, and restores).
\n
• Practical experience with Power BI for report creation, dashboards, and data visualization.
\n
• Proficiency in R Studio for data analysis and statistical modeling.
\n
• Basic experience with Azure Databricks for data engineering and big data processing workflows.
\n
• Strong teamwork abilities and capability to communicate technical information to non-technical stakeholders.
\n

\n

Preferred Qualifications

\n

\n
• Experience with Azure DevOps for continuous integration and deployment (CI/CD) in data management projects.
\n
• Familiarity with automation tools (PowerShell, Python) for script-based management of data resources.
\n
• Knowledge of Data Governance principles and best practices.
\n
• Experience with data migration and cloud-based database management (moving SQL Server to Azure SQL).
\n
• Microsoft Certifications in Azure, Power BI, or SQL Server.
\n

\n

Technical Skills

\n

\n
• Cloud & Database Platforms: Azure (SQL Database, Blob Storage, Data Lake), SQL Server.
\n
• Big Data & Analytics: Azure Databricks, R Studio, Power BI.
\n
• Application Deployment: Apache Tomcat.
\n
• Scripting & Automation: Azure CLI, PowerShell, Python.
\n

\n

Experience

\n

\n
• Typically requires a Bachelor's degree with 2-4 years of prior relevant experience (or Master's with less than 2 years), with a specific requirement of 3+ years working in data management.
\n

\n

Education

\n

\n
• Bachelor’s degree in Computer Science, Information Technology, Data Management, or a related field.
\n

\n

Certifications

\n

\n
• Microsoft Certifications in Azure, Power BI, or SQL Server are a plus.
\n

\n

Clearance / Work Authorization

\n

\n
• U.S. Citizenship Required.
\n
• Public Trust security clearance required prior to start (start prior to clearance completion is permissible per intake notes).
\n
• Additional background check required: A completed personal disclosure form and a soft credit check.
\n

\n

Interview Process

\n

\n
• Phone / Skype interview.
\n
• Persons involved: Manager / Customer.
\n
• Timeline: ASAP.
\n

\n