Spark or Java Developer

Apache Spark DeveloperAbsolute Business Solutions Corp (ABSC) is not just another tech company. We're a community of innovators, engineers, analysts and business professionals working together with our customers to tackle the most complex challenges. For more than 20 years we've supported critical DoD, IC and Federal Civilian missions and global, multi-national corporations. We specialize in supporting our clients in the Intelligence, Technology, Defense, AI/ML, and Data Science fields. As we continue to grow at a rapid pace, we are seeking some amazing new professionals to join our team.We are actively hiring a Secret or Top Secret/ TS/SCI-cleared Apache Spark Developer to support NGA's Data Modernization Services (DMS) mission by building and optimizing large-scale data processing pipelines. This role focuses on developing high-performance Spark applications within a containerized, Kubernetes-based environment, supporting mission analytics, data exploitation, and AI/ML integration. The ideal candidate thrives in distributed data environments, understands performance tuning deeply, and can operate effectively in secure, air-gapped systems.This role is on-site/flexible hours in Herndon, VA; Springfield, VA; St. Louis, MO; or Aurora, CO.Clearance Required for this role: TS/SCI with willingness/ability to obtain/maintain Counterintelligence PolygraphCore Technology StackApache Spark (PySpark, Scala)Delta Lake, ParquetStructured StreamingKubernetes (execution environment)DockerS3 / object storageAWS / GCP / Azure (environment-dependent)Git, Jenkins (CI/CD)Python (PySpark)Scala (preferred)Bash / scriptingKey ResponsibilitiesDesign, develop, and maintain Apache Spark pipelines (batch and streaming) using PySpark and/or ScalaProcess and transform large-scale datasets using modern data lake architectures (Delta Lake, Parquet)Optimize Spark jobs for performance, including:Partitioning strategiesShuffle optimizationMemory tuningFile sizing and storage efficiencyImplement Structured Streaming pipelines for near real-time data processingDevelop and deploy Spark applications within containerized environments (Docker)Execute workloads in Kubernetes clusters, supporting scalable and distributed processingIntegrate Spark pipelines with downstream systems, including:Analytics platforms (SQL, notebooks)AI/ML workflows and feature engineering pipelinesSupport data ingestion and storage in object-based systems (e.g., S3-compatible storage)Troubleshoot data pipeline failures and ensure reliability in mission-critical environmentsOperate within secure, air-gapped environments, including:Managing dependencies without internet accessWorking within controlled network and security constraintsRequired QualificationsTS/SCI (eligibility) with ability/willingness to obtain/maintain counterintelligence polygraphBachelor's degree plus 5 years' experience in data engineering or Spark development (will entertain additional years' experience in lieu of degree)Strong hands-on experience with:Apache Spark or Enterprise Java DeveloperPython (PySpark)Data processing at scaleExperience working with:Parquet and/or Delta LakeDistributed data systemsFamiliarity with:Docker / containerizationKubernetes (basic to intermediate experience)Object storage systems (e.g., S3 or equivalent)Strong troubleshooting and performance tuning skillsProficiency in Bash or scriptingPreferred QualificationsExperience with Scala for Spark developmentExperience with Structured Streaming in production environmentsFamiliarity with Iceberg or lakehouse architecturesExperience with CI/CD pipelines (Jenkins, Git)Exposure to Terraform or Infrastructure as CodeExperience supporting AI/ML data pipelinesPrior experience supporting NGA, IC, or DoD programsPay range dependent on geolocation for candidate. An approximate salary range for this position is $150,000-$ . Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.ABSC is a technology and services company that combines the agility of a small business with proven processes refined over more than two decades in business. We specialize in supporting public sector clients in the Intelligence, Defense, Health, and Safety areas. Our team stands ready to deliver the next generation of programs, personnel, and solutions to help advance our federal government customers' driving innovation, agility, and security across all mission areas.Some of our benefits include:Generous PTO plus 11 Federal HolidaysRetirement Planning – 401k Fully Vested with MatchTuition Assistance Program – Annual contributions to help you pay down your loansAnnual Health and Wellness Allowance – buy an Apple Watch, a treadmill, or hit the gym on usCareer Development – Annual Funds to spend on Education and TrainingVolunteer Time Off – Annually, all employees can spend 8 hours directly supporting a charity of choiceCharitable Match – ABSC matches an employee's donation to a qualifying charityReferral Program – We pay for internal and external referrals!LOV Awards – Earn bonus awards throughout the year from our Living Our Values awards programApply to join our team today! We are always looking to grow our team - if you know someone who is seeking a new career opportunity, please share this job opening with them! ABSC offers generous external referral bonuses. You don't need to be an employee to benefit from our Referral Program!*ABSC is a proud V3, Virginia Values Vets, member which recognizes our commitment to hiring Veterans. If you are a veteran, please be sure to include that in your application. Thank you! *Equal Opportunity Employer, including veterans and individuals with disabilities.