Sr. Data Engineer

Sr. Data Engineer

Remote, Canada Contract

Note: Security clearance is mandatory

We need resources with Databricks or SAS

Programming Languages

• Python Certification (e.g., PCAP)
• R Programming Certification (e.g., DataCamp, Coursera)

Technical Expertise

• Proven experience converting SAS EG code to PySpark, SQL, and/or R
• Familiarity with SAS macros, data steps, and PROC SQL
• Experience with Databricks notebooks, Delta Lake, and Spark SQL
• Ability to optimize PySpark code for performance and scalability

Mainframe & DB2 Integration

• Experience accessing DB2 data via ODBC/JDBC or ETL tools
• Familiarity with mainframe systems (JCL, COBOL, IMS)
• Ability to replicate or migrate data from DB2 to cloud data lake

Tooling & Automation

• Use of SAS-to-PySpark conversion tools (e.g., SAS2PY, SPROCKET, Scintilla, AI tools)
• Automated testing and validation frameworks for data parity
• Schema mapping and lineage tracking capabilities

Project Delivery & Governance

• Experience successfully onboarding with client systems.
• Clear documentation of conversion logic and testing results
• Version control and CI/CD integration (e.g., Git, Azure DevOps)
• Compliance with internal data governance and security policies

Databricks Platform

• Databricks Certified Data Engineer Associate or Professional
• Databricks Certified Machine Learning Associate or Professional

Apache Spark Developer Certification