Senior Data Engineer (AWS & Databricks)

Position Overview

Objectways is seeking an experienced Senior Data Engineer to design, build, and maintain modern data platforms supporting analytics, reporting, and business operations. Strong experience with AWS data pipelines, Databricks, PySpark, and infrastructure as code required.

*ITAR Compliance Notice: This position involves handling ITAR-controlled data. All applicants must be U.S. Persons as defined under 8 U.S.C. § 1324b(a)(3), including U.S. Citizens, Lawful Permanent Residents, or individuals holding protected status. Eligibility will be verified prior to hire.

Responsibilities

• Design, develop, and maintain scalable data pipelines and automation using AWS Glue.
• Build and optimize data processing and transformation workflows using PySpark.
• Develop and manage data solutions on Databricks.
• Perform data discovery and source-data profiling to understand new and existing data sources.
• Assess data quality and implement checks to ensure accuracy, consistency, and reliability.
• Support data modeling efforts and translate business needs into reusable data structures.
• Provision and manage infrastructure as code using Terraform.
• Build and maintain CI/CD pipelines for deploying data solutions.
• Collaborate with business stakeholders, analysts, and engineering teams to deliver data solutions that meet business requirements.

Required Qualifications

• Minimum of 8 years of experience with AWS and Databricks.
• Must be a U.S. Person due to ITAR requirements.
• Hands-on experience with Databricks.
• Experience building AWS data pipelines and automation using Glue.
• Proficiency in PySpark for data processing and transformation.
• Experience with data discovery, source-data profiling, and data quality assessment.
• Experience supporting data modeling and translating business needs into reusable data structures.
• Experience with Terraform and CI/CD for infrastructure as code and deploying data solutions.

Preferred Qualifications

• Experience with Delta Lake or Lakehouse architectures.
• Strong SQL development and performance tuning skills.
• AWS or Databricks certifications.
• Experience working in large enterprise environments.