Data Engineer

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.Summary:We seek an experienced Applications Lead (Technical Lead) to own technical support leadership for Data Analytics solution—supporting a global users across multiple Azure-based production environments. This is not an operations manager role; it is a hands-on technical leadership role focused on complex incident resolution, data-intensive troubleshooting, and performance / scalability in large datasets and pipelines.You will serve as the escalation support technical lead for the most challenging cases (e.g., large datasets, heavy transformations, performance bottlenecks, configuration issues across data platforms), guiding support analysts and partnering with engineering/product to drive root cause closure and durable fixes. The role requires deep strength in PySpark, T-SQL, data engineering, and analytics platform troubleshooting across Databricks, SQL Server / DWH, Azure data services.Qualifications:8+ years of experience in application support / technical lead / data platform troubleshooting roles, with demonstrated ownership of complex incident/problem resolution in production-like environments.Hands-on Azure Data Engineering and Python experience.Databricks + PySpark familiarity, including: Building/navigating workspaces and notebooksPySpark read/write operations and basic transformation logicStrong T SQL / DWH background, including: SQL database design and developmentStored procedures, table & scalar functions, performance tuning via execution plans and indexingAdvanced querying (CTEs, temp tables, correlated subqueries; cursors where appropriate)Experience with large-scale data wrangling, including scenarios with very large row counts (e.g., 100M+), and ability to reason about data complexity and performance bottlenecks.Strong understanding of RDBMS concepts and (preferred) MSBI stack fundamentals.Hands-on ETL and reporting experience, including troubleshooting of pipelines and data flows end-to-end.Strong communication skills: ability to explain complex data/platform issues clearly to engineers, support teams, and stakeholders.Preferred ExperienceHands-on SQL Diagnostics & Performance Tuning: Writing and optimizing advanced T SQL to diagnose and resolve issues (SPs, scalar/table functions, CTEs/temp tables, correlated subqueries; use execution plans, indexing strategy, and query refactoring for performance).Azure Data Factory (ADF): building pipelines and troubleshooting orchestration patterns; ability to map concepts between SSIS and ADF.ADLS file-format expertise: Parquet/Delta vs CSV/Excel tradeoffs for volume, performance, and operational supportability.Power BI workspace concepts (nice to have), plus data management/data analysis tools like Alteryx (nice to have).Basic accounting concepts to better interpret audit/financial datasets.Advanced Excel (Pivot, formulas, lookups, VBA macros) as a nice to have.SAP/Oracle ERP technical profile: Understanding ERP architectureSupport implementation/customization/performance tuning of extraction codeBasic ABAP/UNIX familiarity as a nice to haveOrion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.Candidate Privacy PolicyOrion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:What information we collect during our application and recruitment process and why we collect it;How we handle that information; andHow to access and update that information.Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.