Data Engineer

Data Engineer

Location: Arlington, VA, Hybrid 1 or 2 days onsite weekly Clearance Requirement: Active Secret Employment Type: Full-Time

About Company: Disruptive Solutions, a Service-Disabled Veteran-Owned Small Business (SDVOSB) delivering mission-focused cybersecurity and technology solutions for federal and commercial clients. We specialize in advanced cybersecurity operations, AI/ML integration, cloud modernization, data governance, and risk management. With a proven track record supporting agencies like the Department of Defense (DoD), Department of Homeland Security (DHS), Cybersecurity and Infrastructure Security Agency (CISA), and the Department of Treasury, we deliver innovative solutions that maximize efficiency and strengthen cyber resilience. At our core, we are dedicated partners committed to securing the mission with innovation, integrity, and measurable impact.

Job Summary: As a Data Engineer, you will design, develop, and maintain data infrastructure, build data pipelines, troubleshoot data issues, collaborate with stakeholders, and ensure data governance using ETL, Databricks, Python, Spark, Scala, and SQL.

Key Responsibilities:

• Analyze science, engineering, business, and other data processing problems to develop and implement solutions to complex applications problems, system administration issues, or network concerns.
• Perform systems management and integration functions, improve existing computer systems, and review computer system capabilities, workflow, and schedule limitations.
• May analyze or recommend commercially available software.
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
• Leverage big data technologies to efficiently process and analyze large datasets.
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.

Required Qualifications:

• 3–10 years of directly related experience and B.A./B.S. or M.A./M.S. in a related field.
• Experience building within Palantir Foundry applications, including Workshop, Ontology Manager, and Gaia.
• Experience with Machine Learning models and/or Generative AI.
• Experience with APIs.
• Previous experience with Advana or the War Data Platform.
• Experience with the DoW mission and associated datasets.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Proficiency in ETL processes and firsthand experience with technologies, such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• 3+ years of experience as a Data Engineer.
• Available to work onsite in Arlington 1–2 days per week.

Preferred Qualifications:

• Experience with Machine Learning models and/or Generative AI.
• Experience with APIs.
• Previous experience with Advana or the War Data Platform.
• Experience with the DoW mission and associated datasets.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Proficiency in ETL processes and firsthand experience with technologies, such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.

Equal Opportunity Statement: Disruptive Solutions, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender identity, or any other characteristic protected by law.