Lead Data Platform Engineer (REMOTE)

About the job Lead Data Platform Engineer (REMOTE)


We are seeking a Lead Data Platform Engineer (REMOTE) for a full time and direct hire role for one of our amazing health tech partners in the United States. This role is remote, but you MUST be living in the United States and be willing to work east coast hours. You MUST be a US Citizen for Green Card Holder. This role does NOT offer sponsorship, it's NOT a consulting role, and we do NOT work with 3rd parties!

Overview:

This hands-on Engineer will help architect, build, and maintain modern cloud-based data solutions in a scalable AWS environment. You will contribute to the development of enterprise-grade data platforms, analytics infrastructure, and data processing frameworks that support business intelligence, operational reporting, and product innovation. You will work closely with cross-functional teams to design reliable data pipelines, optimize data workflows, and improve overall platform performance, security, and scalability. This position is ideal for someone who enjoys solving complex data challenges and influencing technical direction across cloud-native systems.

Responsibilities:

• Design, develop, and support scalable data pipelines and cloud-native data architectures.
• Build and maintain production-ready applications and data processing frameworks using Python, PySpark, Scala, and related technologies.
• Partner with engineering and business stakeholders to deliver analytics-ready datasets and reporting capabilities.
• Contribute to technical architecture decisions, platform improvements, and development best practices.
• Develop and optimize ETL/ELT workflows and streaming data solutions.
• Create and manage data models, reporting structures, and analytics dashboards using AWS-native tools.
• Work with relational and NoSQL databases to support high-volume data processing and storage requirements.
• Implement cloud infrastructure solutions leveraging AWS services and container orchestration platforms such as Kubernetes or ECS.
• Collaborate with operations teams on backup, disaster recovery, data retention, and security strategies.
• Participate in code reviews, technical mentorship, and collaborative problem-solving across the engineering organization.
• Evaluate and recommend modern technologies and frameworks that improve scalability, efficiency, and reliability.

Requirements:

• 3+ years of professional experience in software engineering, data engineering, or cloud platform development.
• Strong experience building and maintaining scalable data platforms and distributed processing systems.
• Proficiency in Python, PySpark, Scala, and/or Typescript.
• Hands-on experience developing Spark-based ETL and reporting frameworks using Spark SQL and Spark Streaming.
• Experience with AWS cloud services, including tools such as S3, Redshift, Glue, Athena, EMR, Lambda, Step Functions, EventBridge, and QuickSight.
• Knowledge of modern data storage and serialization formats such as Parquet and Iceberg.
• Experience with relational databases and NoSQL technologies.
• Strong understanding of cloud security concepts, including IAM, KMS, encryption, Secrets Manager, and data access controls.
• Ability to independently troubleshoot technical challenges and deliver scalable solutions with minimal oversight.
• Experience designing cloud-native applications and services in production environments.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline, or equivalent practical experience.

Preferred Experience:

• Experience building enterprise data lakes, data platforms, or Data-as-a-Service solutions.
• Familiarity with healthcare systems, healthcare analytics, or healthcare IT environments.
• Exposure to modern analytics and reporting platforms in large-scale cloud ecosystems.

All qualified applicants will receive consideration for employment without regard to race, color, national origin, age, ancestry, religion, sex, sexual orientation, gender identity, gender expression, marital status, disability, medical condition, genetic information, pregnancy, or military or veteran status. You must be legally authorized to work in the United States without current or future sponsorship.