IT Specialist (ADF/Azure Databricks)

JOB SUMMARY:

The IT Specialist ensures the platform reliability, performance, and integrity of compliance and analytics data platforms within a cloud-based ecosystem. This role anchors operational excellence by supporting trade and market surveillance, compliance metrics, and analytics dashboards. It impacts business-critical reporting and regulatory adherence, influencing risk management and decision-making across the organization. The position reports to the Compliance Technology Manager and collaborates with cross-functional teams under Agile/Scrum frameworks using Jira and Confluence.

PRINCIPAL DUTIES AND RESPONSIBILITIES:

Monitor, troubleshoot, and resolve issues in compliance and analytics data pipelines to meet SLAs. Perform root cause analysis for data quality and integrity issues and implement corrective actions. Provide operational support for analytics dashboards and reporting tools, ensuring data consistency across compliance and analytics layers. Takes initiative to proactively anticipate challenges and drive solutions before issues arise. Manage run-time integration and orchestration between Azure Databricks and Azure Data Factory, including configuration of linked services, triggers, and pipelines. Support data solutions leveraging Medallion architecture to ensure structured, scalable, and secure data layers. Maintain and optimize workflows in Databricks, Azure Data Factory (ADF), and Azure SQL Database for performance, scalability, and cost efficiency. Support deployment and configuration of data solutions in production environments. Document operational procedures and troubleshooting steps in Confluence; track tasks and issues in Jira. Ensure adherence to data governance, security, and regulatory standards; assist in compliance audits and reporting processes. Demonstrates flexibility to perform diverse functions within the team to address organizational needs.

POSITION SPECIFICATIONS:

Experience: Minimum 3 years in data operations, support engineering, or analytics platform administration. Technical Skills: Proficiency in Medallion architecture, Azure Databricks, Azure Data Factory, Azure SQL Database, and orchestration between Databricks and ADF. Data Analysis: Ability to query and analyze large datasets for troubleshooting and validation. Tools: Hands-on experience with Jira and Confluence; familiarity with Agile/Scrum methodologies. Preferred: Python or PySpark for automation; knowledge of compliance or financial services workflows; exposure to visualization tools (Power BI, Tableau). Skills: Strong problem-solving, communication, and collaboration abilities. SMBC’s employees participate in a Hybrid workforce model that provides employees with an opportunity to work from home, as well as, from an SMBC office. SMBC requires that employees live within a reasonable commuting distance of their office location. Prospective candidates will learn more about their specific hybrid work schedule during their interview process. Hybrid work may not be permitted for certain roles, including, for example, certain FINRA-registered roles for which in-office attendance for the entire workweek is required. SMBC provides reasonable accommodations during candidacy for applicants with disabilities consistent with applicable federal, state, and local law. If you need a reasonable accommodation during the application process, please let us know at View email address on click.appcast.io. EOE, including Disability/veterans #J-18808-Ljbffr SMBC