Senior, Data Engineer

Senior, Data Engineer

Epsilon powers connected marketing by unlocking the full potential of data and identity. This position requires work from the company office in Chicago, IL, certain days per week, with telecommuting allowed for the balance of the week.

Responsibilities and Duties:

• Develop and execute software tests to identify software problems and their causes.
• Write and optimize complex SQL scripts and build Python scripts to execute large-scale transformations on Greenplum.
• Create test plans, run rigorous unit/integration tests, and deliver reproducible, well-documented results.
• Design and maintain AI-enabled, PySpark data pipelines on AWS primarily EMR, Glue, Athena, DynamoDB, and S3 to process large datasets at scale.
• Harden and tune jobs for performance, cost, and compliance, and manage data partitioning, cataloging, and lineage.
• Automate deployments and infrastructure with CloudFormation and parameterized configurations, and schedule batch workloads to keep pipelines timely and reliable.
• Build internal dashboards and data products (e.g., Amplify apps) and instrument monitoring/alerting to catch issues early.
• Translate client tickets into clear technical tasks.

Qualifications and Requirements:

• A Master's degree in Computer Science, Information Technology, Engineering, or related field.
• Two years of experience in the job offered or two years in any occupation in which the required experience was gained.
• Two years in the following: Build PySpark ETL on AWS EMR/Glue reading/writing S3 (partitioning, predicate pushdown, broadcast joins) to deliver analytics-ready fact/dimension tables on schedule.
• Author and tune complex SQL on Greenplum/Postgres (window functions, ROW_NUMBER dedupe, distribution keys, AO/AOCO compression, VACUUM/ANALYZE) to process large datasets efficiently.
• Manage AWS Glue Data Catalog and query curated layers with Athena; design S3 layouts (prefix/partition strategy, lifecycle policies) to cut query time and storage cost.
• Implement CI/CD with CodeCommit, CodeBuild, and CodePipeline; parameterize environments and use CloudFormation for IaC to enable repeatable, auditable, and fast rollbacks.
• Engineer observability with CloudWatch logs/metrics/alarms and job health checks, create SLA dashboards and alerting to detect failures early and reduce MTTR.
• Enforce data quality via SQL/Python unit tests, reconciliation (row counts, sums, duplicates), referential-integrity checks, and documented UAT evidence for change control.
• Apply security and data-governance controls: normalize and encrypt sensitive identifiers, use KMS-managed keys, and enforce IAM least privilege with audit logging.
• Develop GenAI-assisted delivery integrates LLMs (AWS Bedrock) with PySpark/SQL to auto-suggest transformations, generate test cases, and summarize validation results.
• Build lightweight internal data apps with AWS Amplify + DynamoDB/Athena to manage lookup keys/brand lists and enable stakeholder self-service with controlled access.

Epsilon operates in 30+ countries across EMEA, the Americas, and APAC, with more than 8,000 employees. We seek candidates who align with our company values: Act with integrity, work together to win together, innovate with purpose, respect all voices, and empower with accountability.

Epsilon benefits include flexible time off, parental/new child leave, childcare & elder care assistance, adoption assistance, comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling, and more.

Compensation Range: USD $145,870.00 - USD $182,000.00/Annually.