Data Engineer

Job DescriptionJob Description540 is seeking a Data Engineer to support a mission-critical federal health data modernization initiative. The team is bringing together data from diverse defense and federal systems to build scalable pipelines, APIs, and data products that improve how critical information is integrated, accessed, and used.In this role, you'll work hands-on with complex health and mission data to develop scalable, production-ready capabilities while helping establish reusable patterns for data ingestion, integration, and delivery. Your work will contribute to the technical foundation of a growing data platform ecosystem supporting multiple teams, data products, and mission areas.Location: Remote within the continental United States. Periodic travel may be required Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance Education Requirement: Bachelor's Degree in Computer Science, Engineering, Data Science, or a related technical field (preferred) 540 Internal Thrive Level: Data Engineer II or IIIWHY 540?540 is a forward-thinking company that the government turns to in order to #getshitdone. We don't just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.HOW YOU'LL DRIVE IMPACTDesign, develop, and maintain scalable, production-ready data pipelines using Spark, Python, and SQL in a Databricks environmentIntegrate and transform diverse health, financial, and operational datasets into reliable, reusable data productsDevelop data models and analytics datasets that support enterprise reporting and operational decision-makingBuild and maintain API-based integrations for ingesting and exchanging data across systemsMonitor, troubleshoot, and optimize scheduled workflows and production pipelines for performance, reliability, and scalabilityImplement data validation, quality checks, lineage, and governance practices that improve trust in data productsContribute to automated testing, code reviews, technical documentation, and reusable engineering patternsCollaborate with engineers, architects, analysts, and customer stakeholders to translate data needs into practical technical solutionsREQUIRED SKILLS & EXPERIENCE3+ years of data engineering, software engineering, or related technical experienceStrong proficiency with Python and SQLExperience with Apache Spark or similar distributed data-processing frameworksExperience working with Databricks or a similar modern data platformExperience building and maintaining production data pipelines and ETL/ELT processesWorking knowledge of data modeling and transforming raw data into reusable analytics datasets or data productsExperience integrating or consuming data through REST APIsExperience troubleshooting and optimizing data pipelines for performance and reliabilityFamiliarity with data validation, quality, governance, security, privacy, and compliance considerationsExperience with Git-based development workflows and modern software engineering practicesComfort working in terminal and command-line environmentsExperience using AI-assisted development tools to accelerate routine engineering tasks, testing, documentation, and debuggingStrong communication skills and experience working with customers or stakeholders to understand and resolve data needsAbility to navigate ambiguity, learn unfamiliar systems, and independently drive assigned work toward resolutionNICE TO HAVE SKILLS & EXPERIENCEAWS cloud experienceExperience working with very large datasets, including datasets containing billions of recordsExperience with Palantir FoundryExperience with Advana or similar DoW data environmentsExperience with GitLab, CI/CD pipelines, or automated deployment workflowsExperience working with federal health, financial, or other regulated and sensitive dataBENEFITS & PERKSFlexible PTO + all Federal holidays offHealth, dental and vision insurance plansFlexible Spending Account (FSA)401k with employer matchCompany-sponsored life insurance, short- and long-term disabilityProfessional development (training, certifications, conferences)Paid cloud developer accountsReferral bonusesHQ office perks (parking / metro reimbursement, nitro coffee & lunches)Annual social events (540 Week, hackathon, charity golf tournament, etc.)Access to 540's Washington Capitals & Nationals ticketsEQUAL EMPLOYMENT OPPORTUNITY (EEO)540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.