Senior data quality engineer

job summary:
A premier, global professional services enterprise is seeking a Senior Data Quality Engineer to architect, scale, and optimize next-generation data validation frameworks. In this permanent, direct-hire position, you will serve as a critical guardian of data integrity, ensuring that complex data pipelines deliver pristine, reliable assets to downstream analytics platforms. This role offers an exceptional opportunity to pioneer AI-assisted development methodologies within modern data architectures. Our comprehensive corporate compensation package features highly competitive salary options alongside robust medical, dental, and vision benefits.

#LI-CG2

location: Chicago, Illinois
job type: Permanent
salary: $120,000 - 150,000 per year
work hours: 8am to 5pm
education: Bachelors


responsibilities:
Responsibilities As a core member of our data platform team, a typical day in this role involves:

• Architecting Frameworks: Designing, implementing, and scaling robust, end-to-end automated testing frameworks to validate complex data pipelines.
• Securing Pipeline Integrity: Validating diverse ingestion streams spanning high-throughput APIs, relational databases (SQL Server), and unstructured flat files.
• Governing Lakehouse Architecture: Monitoring and certifying data quality layers across an enterprise Medallion Architecture (Bronze, Silver, and Gold zones).
• Automating Validation: Building reusable patterns and automated validation rules for schema enforcement, data integrity constraints, and structural transformations using Great Expectations.
• Innovating with AI: Leveraging advanced AI-assisted coding tools (such as Claude Code) and prompt engineering workflows to dramatically accelerate and standardize test generation.
• Driving CI/CD Integration: Embedding automated data quality checks directly into modern CI/CD pipelines via Azure DevOps or GitHub Actions.
• Collaborating Cross-Functionally: Partnering with Data Engineers, Product Owners, and DevOps teams to define organization-wide data quality SLAs, compliance standards, and acceptance criteria.
• Resolving Anomalies: Leading root-cause investigations into data quality anomalies and implementing long-term reliability and observability improvements.

#LI-CG2

qualifications:
Qualifications

Must-Haves

Education: Bachelor's degree in Computer Science, Information Technology, or a related technical discipline.

Experience: Minimum of 5 years of progressive experience specializing in data quality engineering, automated data testing, or data platform engineering.

Framework Mastery: Proven hands-on experience building automated testing suites utilizing tools such as Great Expectations, dbt test suites, or Databricks Data Quality Framework (DQX).

Core Code Proficiency: Advanced, production-level Python programming capabilities and expert-level SQL development skills.

AI Tooling Savvy: Demonstrated experience utilizing AI-driven development tools (e.g., Claude Code, GitHub Copilot) along with a strong understanding of prompt engineering principles.

Pipeline Validation: Clear expertise validating data ingestion across APIs, relational databases, and multi-layered data transformations.

DevOps Alignment: Direct experience integrating test suites into automated CI/CD pipelines using GitHub Actions or Azure DevOps.

Nice-to-Haves

Technical exposure to Azure Databricks, Apache Spark, and PySpark development.

Familiarity with Delta Lake storage layers and governance via Unity Catalog.

Experience developing reusable AI prompt libraries or custom developer environment configurations (.md skills or templates).

Knowledge of advanced data architecture strategies, including data contracts, schema evolution management, and synthetic test data generation.

Exposure to cloud infrastructure as code (Terraform, Bicep) and real-time streaming data technologies (Kafka, Event Hubs).

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on click.appcast.io.


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).


This posting is open for thirty (30) days.