Senior Data Engineer

Senior Data Engineer

Make an impact like never before. We're growing rapidly and are looking for a Senior Data Engineer. This role can be worked remotely from anywhere within the USA. We're a close knit team that has access to global resources. You'll have the opportunity to explore a wide range of industries, technologies, and geographies, all while enjoying the personal touch that our local operating approach offers. Growth at CGI is driven by your goals, so if you're looking for an inclusive place where you're empowered to chart your own path, then we'd love to meet you.

Your future duties and responsibilities:

• Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.
• Perform end to end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems.
• Develop and execute complex SQL queries for backend and data validation testing.
• Test large scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).
• Perform functional, integration, regression, system, and data quality testing across data pipelines and applications.
• Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments.
• Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution.
• Develop and maintain reusable test scripts and automation solutions where applicable.
• Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives.

Required qualifications to be successful in this role:

• 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.
• Strong hands on SQL skills, including writing complex queries for source to target validation, reconciliation, and data quality testing.
• Experience testing large scale data platforms and ETL/ELT pipelines.
• Hands on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).
• Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.
• Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control M.
• Strong understanding of data quality concepts, data transformations, data mappings, and source to target validation.
• Experience with defect management and test management processes within Agile/Scrum delivery environments.
• Strong analytical, troubleshooting, communication, and collaboration skills.

Skills:

What you can expect from us:

Together, as owners, let's turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.

Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.