Senior Data Engineer

Senior Data EngineerVLink, founded in 2006, is a leading global provider of software engineering services with next-gen technologies and best-in-class talent. Our headquarters are in the U.S, and we have offices in 7+ countries from North America-Europe to APAC, with expansion plans in the Middle East. With over 1,000 employees working globally, VLink has helped SMBs, and large enterprises achieve their business goals, and gained the trust of Fortune-250 companies. VLink is 'Great Place to Work® CertifiedTM' and has been a consistent winner as- Best Places to Work in CT. Trust, collaboration, and accountability are the three elements that are at the core of VLink's work culture. We value our professionals, providing comprehensive benefits and the opportunity for growth.Future Duties And ResponsibilitiesDesign, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.Perform end to end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems.Develop and execute complex SQL queries for backend and data validation testing.Test large scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).Perform functional, integration, regression, system, and data quality testing across data pipelines and applications.Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments.Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution.Develop and maintain reusable test scripts and automation solutions where applicable.Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives.Required Qualifications To Be Successful In This Role8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.Strong hands on SQL skills, including writing complex queries for source to target validation, reconciliation, and data quality testing.Experience testing large scale data platforms and ETL/ELT pipelines.Hands on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control M.Strong understanding of data quality concepts, data transformations, data mappings, and source to target validation.Experience with defect management and test management processes within Agile/Scrum delivery environments.Strong analytical, troubleshooting, communication, and collaboration skills.Employment PracticesVLink is an equal opportunity employer committed to fostering an inclusive environment where diversity is celebrated. All qualified applicants will be considered for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Employment is contingent upon successful completion of a background check. This job application process may use AI-powered tools to assist in screening and evaluating applications based on objective, job-related qualifications. AI is used solely to support the recruitment process and all final hiring decisions are made exclusively by our human recruitment team. Applicant information will be handled in accordance with VLink's privacy policy.