Data Engineers

Data Engineers

4 new openings

assessmen required

hybrid in NC or PA

Skills are Kafka, AWS services, Python

JD

Seeking 4 Data Engineers/Developers to join a high-intensity, fast-paced environment supporting the onboarding and integration of a new generative AI compliance tool. The focus of this role is building a connector application using real-time streaming architecture to interface internal AI generative tools/chatbots with Norm AI for compliance monitoring and data processing.



Key Responsibilities

• Build and maintain a real-time streaming connector application in AWS ECS using Python.
• Implement real-time data streaming via Apache Kafka to continuously pull data from generative AI/chatbot applications, invoke Norm AI APIs, and process compliance review results.
• Handle data engineering tasks, including processing compliance review feedback/comments and routing data to AWS S3 buckets and DynamoDB for downstream reinforcement learning and analysis.
• Set up application and platform monitoring using tools like Splunk, CloudWatch, Dynatrace, or Datadog.
• Optionally assist in long-term UI dashboard/application development for compliance metrics and review.

Key Requirements & Tech Stack

• Top 3 Required Skills:
• AWS Core Services: AWS ECS, S3, DynamoDB, AWS Glue, IAM roles, and bucket policies.
• Kafka: Strong hands-on experience with real-time Kafka streaming architectures.
• Python: Proficiency in custom Python development for data pipelines and API consumption.
• Additional Technical Skills: Experience with API consumption (RESTful), application monitoring (CloudWatch, Splunk, Dynatrace), and cloud deployment.
• Non-Technical Attributes: Genuine curiosity, honesty regarding skill boundaries, strong problem-solving initiative, and adaptability to pick up new tools (e.g., Claude Code, novel AI tools) quickly.