Senior Data Engineer

Senior Data Engineer — Contract

Location: Hybrid — 3 days/week onsite in Newark, NJ

About the Role

Join a major investment firm as a Senior AWS Data Engineer supporting enterprise data platform initiatives. This role focuses on building scalable data pipelines, CI/CD automation, and end-to-end data solutions across the AWS ecosystem. Experience with Informatica (data catalogue, marketplace, data lineage, data quality), Denodo, and/or Ataccama is a strong plus.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent combination of education and experience
• 8+ years of experience as a Data Engineer on the AWS stack, including DevOps tooling
• AWS Solutions Architect or AWS Developer Certification required
• Strong hands-on experience with AWS services, including:
• CloudFormation, S3, Athena, Glue, Glue DataBrew, EMR/Spark
• RDS, Redshift, DynamoDB, Lambda, Step Functions
• IAM, KMS, SM, EventBridge, EC2, SQS, SNS
• LakeFormation, CloudWatch, CloudTrail, DataSync, DMS
• Experience implementing high-velocity streaming solutions using Amazon Kinesis, AWS Managed Airflow, and AWS Managed Kafka (preferred)
• Proven experience building AWS data lake/data warehouse solutions
• Skilled in designing, developing, and implementing data ingestion pipelines on AWS
• Knowledge of ETL/ELT implementation for data solutions
• Experience delivering end-to-end data solutions: ingest, storage, integration, processing, and access
• Familiarity implementing RBAC strategies using AWS IAM and Redshift RBAC model
• Experience building and implementing CI/CD pipelines using CloudFormation and Jenkins
• Strong programming skills in Python, Shell scripting, and SQL
• Experience with SQL stored procedures for data analysis
• Experience building automated pipelines to ingest data from relational databases, file systems, and NAS shares into AWS RDS, Aurora, and Redshift
• Experience building automated pipelines to ingest data from REST APIs into AWS S3 and relational databases
• Solid DevOps background, including:
• Bitbucket (source code management)
• Python, Shell, Groovy scripting
• API deployment for tooling integration
• Jenkins and CloudBees (Pipeline as Code, Shared Libraries)
• SonarQube, Artifactory, and similar DevOps tools
• Maven, MS Build, Gradle
• Docker
• Jira and Confluence
• Infrastructure as Code via CloudFormation
• Experience creating Jenkins CI pipelines integrating Sonar/security scans and test automation
• Ability to accurately document exceptions, issues, action plans, meeting minutes, and lessons learned

Responsibilities

• Design, build, and maintain efficient, reusable, and reliable code
• Ensure optimal performance and quality of high-scale data applications and services
• Participate in system design discussions
• Independently perform hands-on development and unit testing
• Collaborate with the development team to integrate components into the enterprise data platform
• Work cross-functionally with product, QE/QA, and other teams throughout the full software development lifecycle
• Identify and resolve performance issues
• Stay current with emerging technologies and implementation practices
• Participate in code reviews to ensure standards and best practices are met
• Take ownership of estimating, planning, and managing tasks in an Agile environment
• Take shared responsibility for software quality rather than relying on separate QA teams
• Collaborate closely with all team members toward shared goals
• Engage with users as needed to clarify requirements