Software Engineer - Senior I (Databricks Engineer) - Secret Clearance Required

Overview

Software Engineer – Senior I (Databricks Engineer) with Secret clearance is sought to support the migration of mission-critical legacy applications, services, and platforms into a next-generation Medallion Model on Databricks. This role focuses on modernizing enterprise data systems that impact national mission success in a fast-paced, collaborative environment.

Job Details

Location: Dulles, VA

Clearance: Secret (Must be able to obtain TS/SCI and DHS Suitability)

Company: Quantum Science Solutions (QSS)

Position: Software Engineer – Senior I (Databricks Engineer)

Responsibilities

• Support migration of services, applications, and platforms from legacy back-end systems to Databricks.
• Identify optimal migration paths, build detailed plans, and execute migration strategies.
• Migrate legacy pipelines from NiFi to Databricks and perform validation.
• Implement the Medallion Model for all migrated data assets.
• Develop Standard Operating Procedures (SOPs) for integrating data assets into Databricks with a focus on efficiency, instrumentation, and performance.
• Optimize development, testing, monitoring, and security processes for data assets.
• Automate and optimize data ingestion, pipeline orchestration, and management using programming and scripting languages.
• Leverage AWS CloudWatch and related tools to enhance transparency and monitor pipeline performance.
• Ensure team SOPs are documented and communicated effectively.
• Provide technical oversight to ensure correctness, timeliness, and quality of deliverables.
• Communicate effectively with all levels of management and customer stakeholders.

Required Qualifications

• Must be a U.S. Citizen.
• Active Secret clearance, with ability to obtain TS/SCI and DHS Suitability.
• 8+ years of directly relevant software development experience.
• Minimum of 5 years performing data engineering in a cloud environment.
• Hands-on experience with relational, NoSQL, and file-based storage (Databricks, Elastic, Postgres, S3, Athena).
• Strong background in CI/CD pipeline development.
• Working knowledge of Databricks, NiFi, AWS Redshift, and Elasticsearch.

Preferred Skills

• Databricks Workflows, Unity Catalog, Autoloader, Delta Live Tables/Delta Lake, Workspaces/Notebooks, and MLflow.
• Apache Spark expertise.
• Familiarity with AWS Professional certifications (Solutions Architect, Developer, Data Engineer).
• Knowledge of CISA best practices, software supply chain security, and NIST SP 800-218.
• Experience with collaboration tools including MS Teams, Outlook, SharePoint, and Confluence.
• Excellent problem-solving and communication skills.

Education

• Bachelor’s degree in software engineering, Computer Science, or related discipline.
• In lieu of degree, 10 additional years of experience (total of 18+ years) may be substituted.

Benefits

• Competitive compensation with annual performance bonuses
• 401(k) with company match
• Opportunities for continuous learning and skill development

Why QSS?

At QSS, you’re not just filling a role, you’re shaping mission-critical solutions that keep our nation secure. We invest in your growth, foster innovation, and reward technical excellence.