Data Engineer

Senior Data Engineer - Identity & Access Management
Location: 100% Remote
Work Hours: Must work within Eastern Time business hours
Organization: Cyber - Identity & Access Management


Position Overview
Client's Cyber / Identity & Access Management organization is building a new application and engineering capability focused on agentic technology and risk identification.
We are seeking a Senior Data Engineer / Data & Backend Engineer who can help build the application from the ground up. This is not a traditional data engineering position. The ideal candidate will combine strong data engineering, AWS cloud, API development, application performance, and production troubleshooting skills.
The engineer will help build data pipelines and a low-latency GraphQL API that will make data available to Client employees and support critical runtime developer workflows.
This will be a small team consisting of two full-time engineers and this senior contractor, providing an opportunity to have significant technical ownership and influence.
Key Responsibilities

• Design, build, and optimize high-volume data pipelines supporting the new IAM application.
• Develop and maintain scalable data engineering solutions using AWS and modern data technologies.
• Build and support a lightweight, low-latency GraphQL API that exposes data to internal applications and users.
• Design data models and data-processing workflows to efficiently present data through APIs.
• Develop and maintain data pipelines using technologies such as PySpark, Apache Spark, AWS Glue, and related data platforms.
• Work with AWS services including Lambda, ECS, DynamoDB, PostgreSQL, S3, and AWS Glue.
• Troubleshoot application performance, latency, scalability, and reliability issues in production.
• Implement monitoring and observability solutions for data pipelines and APIs.
• Optimize cloud infrastructure and applications for performance, scalability, and reliability.
• Collaborate with engineering, cybersecurity, IAM, and other stakeholders to define technical solutions.
• Participate in architecture, design, development, testing, deployment, and production support.
• Help establish engineering practices and technical standards for the newly formed team.
• Translate complex data into reliable, accessible APIs and services.
• Support the development of systems designed to identify and assess risks associated with emerging agentic technologies.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 7+ years of IT/technology experience.
• 5+ years of hands-on software/data engineering experience.
• Strong hands-on AWS experience.
• Strong data engineering experience with large-scale data pipelines.
• Experience with PySpark, Apache Spark, AWS Glue, or similar technologies.
• Strong API development experience.
• Experience developing GraphQL or REST APIs.
• Experience building and troubleshooting low-latency applications/APIs.
• Strong experience with production monitoring and troubleshooting.
• Experience with cloud-based databases and data stores.
• Strong programming experience with Python, Scala languages.
• Strong analytical, troubleshooting, and problem-solving skills.

Required AWS Experience
Candidates should have hands-on experience with several of the following, with the following considered particularly important:

• AWS Lambda
• Amazon ECS
• DynamoDB
• PostgreSQL
• Amazon S3
• AWS Glue

Experience with additional AWS services and serverless technologies is a plus.


Data Engineering Skills
Experience with one or more of the following:

• PySpark
• Apache Spark
• AWS Glue
• Data pipelines
• Batch processing
• Distributed data processing
• Data modeling
• Data integration
• Data quality
• Large-scale data processing
• Performance optimization

API & Application Development

• GraphQL API development
• REST API development
• Low-latency API design
• API performance optimization
• API integration
• Application troubleshooting
• Distributed application architecture
• Monitoring and observability

Preferred Qualifications

• Experience building applications from the ground up.
• Experience working in cybersecurity or Identity & Access Management.
• Experience with agentic AI or AI-enabled applications.
• Experience supporting critical runtime applications.
• Experience with cloud performance and latency optimization.
• Experience with production monitoring and observability.
• Experience with serverless AWS architectures.
• Experience with Snowflake, Batch, or similar data platforms.
• Experience working in a small, highly collaborative engineering team.
• Client experience is highly desirable.

Work Environment

• 100% remote opportunity.
• Candidate must be able to work during Eastern Time Zone business hours.
• This is a new application and team build-out within Client's Cyber / Identity & Access Management organization.
• The candidate will work closely with two full-time engineers and will be expected to provide senior-level technical guidance and help accelerate the team's development.