Senior Engineer - Data

Job Description

Job Description

ComResource is looking for a Senior Data Engineer.

Responsibilities:

Software Development

• Implement high-quality software features and components for complex software solutions, including the responsible use of agentic coding tools to enhance productivity, maintainability, and software quality.
• Lead sizing and complexity evaluation discussions for initiatives.
• Troubleshoot complex software, application, and performance issues through analysis, testing, benchmarking, and root-cause investigation.
• Guide and mentor peers in engineering best practices, including automated testing, code reviews, documentation, and secure coding standards.

Testing & Quality Assurance

• Follow and implement test practices covering all layers of the application, including unit, system, end-to-end, security, performance, regression, and automation testing.
• Implement QA processes such as code review and static analysis.
• Coach junior team members on testing techniques including TDD, BDD, and testing for positive and negative scenarios.

Data Management

• Design and implement scalable data ingestion and processing solutions supporting analytical and operational workloads.
• Apply data modeling, schema design, query optimization, and database performance tuning techniques for relational database systems.
• Design solutions that address data quality, idempotency, late-arriving data, scalability, and maintainability requirements.

Infrastructure & Integrations

• Design and support cloud-native solutions leveraging AWS technologies including MWAA (Apache Airflow), Glue, Lambda, SQS, S3, EKS (Kubernetes), Aurora PostgreSQL, and Redshift.
• Manage infrastructure using IaC, including Terraform.
• Build and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
• Establish advanced monitoring, alerting, and logging solutions for infrastructure.
• Design systems for high availability, load balancing, and disaster recovery.

Operations

• Support production systems through deployment activities, monitoring, incident response, troubleshooting, and operational improvements.
• Collaborate with partner teams to improve platform stability, performance, and scalability.
• Utilize techniques like blue/green deployments to minimize user impact.
• Participate in on-call support processes as needed.

Security & Compliance

• Develop software with a security-first mindset using knowledge of standard security protocols, common security risks, secure coding techniques, and appropriate usage and protection of sensitive information including PHI.
• Proactively design secure code employing best practices and threat modeling.
• Implement secure integration methods and data-transfer protocols including TLS, SFTP, PGP, and equivalent technologies.

Requirements & Design

• Collaborate with technical and business stakeholders to design appropriate systems based on business needs and technical constraints.
• Write detailed technical stories and technical epics.
• Define and manage tech debt and coordinate non-functional requirements.
• Translate business needs into practical technical solutions that balance functionality, maintainability, scalability, and delivery timelines.

Essentials:

• Bachelor's degree or equivalent work experience in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, or IT.
• 7+ years of software engineering experience.
• High level of experience with Python and strong experience with at least one other programming language; TypeScript and/or Java preferred.
• Experience with cloud computing platforms and infrastructure as code with heavy use of MWAA (Apache Airflow), Glue, Lambda, SQS, S3, and EKS (Kubernetes).
• High level of experience with SQL relational database management systems, including database design, data modeling, and query optimization; PostgreSQL preferred.
• Experience with non-relational databases and messaging systems.
• Experience with standard service and software deployment patterns and CI/CD systems such as GitHub Actions or Concourse.
• High level of experience developing, deploying, and supporting REST services and microservices.
• Excellent written and verbal communication skills.

Req ID: CG388269910