Senior Data Engineer (DataBricks)

Job DescriptionJob DescriptionJob Title: Senior Data Engineer (DataBricks)Job Type: Full Time/ContractLocation: Northern Virginia, Maryland, DCClearance: SecretWho is Ardalyst Defense, LLC?Ardalyst Defense, LLC is a Maryland, Service-Disabled Veteran-Owned Small Business (SDVOSB) that provides engineering services and technical, analytical and cyberspace operations services to integrated U.S. government agency operations. Ardalyst personnel have decades of direct operations experience in full-scope Cyberspace Operations - at the Service, Joint and National Agency levels.Are you an Ardalyst?Ardalyst is a mashup of Ardent, meaning “passionate” and Catalyst, meaning “change agent.” To be an Ardalyst means to be passionate about creating and sustaining meaningful transformations.Speak your mind – Collaboration is at the heart of everything we do and our belief in diversity of people supports our goal for diversity in thought. “Ardalysts” (that's just what we call ourselves) come ready to contribute and find solutions.Focus On Your Strengths – We invest in understanding the strengths and weaknesses of each employee so that you can shine at what YOU do best.See Yourself Grow – Ardalysts have cited being encouraged to take educated risk, kick-start progress, and advance their skills as one of their favorite things about working at Ardalyst and we're determined to keep it that way.Job DescriptionWe are seeking an experienced Databricks Engineer to support the design, development, integration, and maintenance of enterprise-scale data and analytics solutions in hybrid cloud environments. In this role, you will lead Databricks implementations, develop data processing and analytics capabilities using modern data engineering technologies, and provide technical guidance throughout the solution lifecycle. You will collaborate with stakeholders to define technical requirements, resolve complex data and infrastructure challenges, ensure data quality and observability, and support the successful deployment of scalable, cloud-based data platforms that enable mission and business objectives.Duties and ResponsibilitiesAs a lead engineer for Databricks integration for designing, developing, enhancing, and maintaining enterprise-scale data projects, the following skills are required:Develop and deliver the client installation plan through coordination with clients and the project teamAct as escalation point for technical issues from clients and other system engineersManage client expectations regarding solution functionality, deployment processes, and realistic timelinesProvide subject matter expert in solution architecture for hybrid cloud environmentsCollaborate with Leadership Team to review and contribute to Product RoadmapsIdentify the organizational impact of the technical solution architectureProvide technical leadership to the engineering team, as necessaryTravel as required to customer sites, naval installations, shipyards, and vessels in support of installation, maintenance, modernization, and troubleshooting activities.Perform other related duties as assigned by supervisors, team leads, or program management.Required Skills/QualificationsSenior Databricks engineer with 5 years' experience with knowledge of databases, data warehousing, data analytics, or related data technologies.Associate's degree in information technology, Networking, Cybersecurity, or a related field, or an equivalent combination of education, military training, and relevant experience.Active DoD Secret Security Clearance required.Hybrid cloud data and infrastructure design with implementation experience utilizing typical data quality functions involving standardization, transformation, rationalization, linking, and matching.Seven (7) years' experience in Python and SQL for data analysis, data processing, or problem-solving., to include experience working with in-memory computing using R, Python, Spark, PySpark, Kafka, and Scala.Seven (7) years' experience identifying data source telemetry and routing it for operational observabilityExcellent communication (written and oral) and interpersonal skillsBenefitsCompetitive salary commensurate with experiencePaid Time Off (PTO)Paid Holidays401(k) Retirement PlanHealth, Dental, Vision and Life insuranceShort Term and Long-Term Disability insuranceMonetary assistance with training and certificationsWhat Ardalyst Offers YouThe opportunity to support meaningful Navy missions while working alongside experienced IT, engineering, and cybersecurity professionals.A collaborative environment where employees are encouraged to contribute ideas, expand their technical skills, and take on new challenges.Exposure to a wide range of technologies, systems, and operational environments that support professional growth and hands-on experience.Opportunities for training, certification development, and continued learning.DisclaimerArdalyst Defense, LLC is an EOE that empowers employees, no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, veteran status, or other protected characteristic—to meet and exceed customer expectations and thrive in a collaborative and dynamic work environment.