Tech Lead
Full-time
NTT DATA, Inc.
Job Summary
A highly skilled 9 to 11 years of experience on SSIS. SQL Server, Azure Databricks, Pyspark, Hands-On Data Tech Lead to drive the modernization and scaling of our enterprise data platform to provide technical leadership while remaining deeply technical and actively writing code. Also lead the migration, integration, and development of data pipelines across our legacy SQLServer/SSIS environments and our modern cloud infrastructure built on Azure Databricks and PySpark and act as the principal architect and developer for end-to-end ELT/ETL pipelines, ensuring optimal performance, data governance, and scalability.
- Lead the migration of legacy SQL Server Integration Services (SSIS) packages to modern, cloud-native Azure Databricks / PySpark Lakehouse environments.
- Architect end-to-end Modern Data Warehouse (MDW) and Medallion architecture systems (Bronze, Silver, Gold layers) within Azure.
- Mentor and guide a team of data engineers, conducting stringent code reviews, enforcing design patterns, and establishing development standards.
- Collaborate with stakeholders including Data Architects, Business Analysts, and DevOps teams to translate complex business requirements into technical blueprints.
- Develop and optimize scalable, modular, high-performance batch and real-time ETL/ELT pipelines using PySpark on Azure Databricks cluster environments.
- Maintain and refactor existing on-premise SSIS packages and complex T-SQL code (stored procedures, views, performance tuning) to ensure business continuity during transition phases.
- Implement Delta Lake features, managing transactions, schema evolution, and time-travel querying functionalities.
- Orchestrate workflows seamlessly by integrating Azure Data Factory (ADF) with on-premise databases, cloud storage (ADLS Gen2), and Databricks activities.
- Optimize Spark configurations and cluster utilization to drastically reduce cloud compute overhead and job execution windows.
- Enforce data quality frameworks encompassing automated data validation, error reconciliation, and operational audit logging.
- Implement CI/CD automations via Azure DevOps or GitHub Actions to manage environments, code repositories (Git), and deployment pipelines.
Skill Requirements
Technical Skills
- Azure Big Data Stack: Deep, production-level knowledge of Azure Databricks, Delta Lake, Unity Catalog, and Azure Data Lake Storage (ADLS Gen2).
- Programming Languages: Advanced proficiency in Python and PySpark core APIs (Spark SQL and DataFrames).
- Legacy ETL & Databases: Mastery of SQL Server, Advanced T-SQL writing, and extensive experience configuring, deploying, and troubleshooting SSIS packages.
- Orchestration: Hands-on experience mapping dependencies and scheduling triggers using Azure Data Factory (ADF).
- Data Modeling: Expert understanding of relational (OLTP) and dimensional (OLAP) schemas, explicitly Star and Snowflake architectures.
- DevOps & Security: Competency with Git branching, CI/CD automated release deployments, and secure data handling mechanisms (Azure Key Vault, network isolation).
Soft Skills & Leadership
- Proven track record as a coding lead who splits time between management/design and hands-on execution.
- Excellent cross-functional communication skills, comfortably discussing data strategies with both executive leaders and junior technical staff.
- Strong debugging and root-cause analysis (RCA) skills for multi-tier platform failures.
- Preferred Certifications: Microsoft Certified: Azure Data or Databricks
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Tech Lead in Butlerville, IN vacancy
- ...Job Title: Lead, Software Engineering Job Code: 46302 Job Location: Fort Wayne, IN Job Schedule: 9/80: Employees work 9 out of every 14 days – totaling 80 hours worked – and have every other Friday off Job Description: L3Harris is seeking a skilled...SuggestedFull time
- ...unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Overview At Mastercard, our industry expertise is enhanced by our commitment to being a force for good in...SuggestedFull timeWorldwideFlexible hours
- ...unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Overview--The Lead Software Engineer provides technical leadership for the Transaction Lookup Services (TLS)...SuggestedFull timeWorldwide
- ...unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Overview: Mastercard’s Services - Portfolio Intelligence Program is seeking a Lead Software Development...SuggestedFull timeWorldwide
- ...unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Who is Mastercard? We work to connect and power an inclusive, digital economy that benefits everyone,...SuggestedFull timeTemporary workWorldwide
- ...extensible inventory management platform to fuel business growth. Lead & Mentor: Mentor other engineers, encouraging best practices in... ...chain optimization systems. Proficiency in FuzeRx's merged tech stack: Ruby on Rails, TypeScript/JavaScript, and PostgreSQL (Note...Full timeTemporary workWork experience placementRemote workLong distanceFlexible hours
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- ...through modern, data-driven user interfaces. This role requires deep technical expertise, end-to-end ownership, and the ability to lead complex engineering initiatives across architecture, development, and operations. About the Role Software Design & Architecture...Full timeWorldwide
- ...possess a willingness to learn and adapt. You are passionate about design and technology and committed to doing things properly to avoid tech debt. • Participate in team prioritisation discussions with Product/Business stakeholders. • Estimate and own delivery tasks...Full timeWorldwideShift work
- ...GitHub Copilot, Claude Code, and Docker Desktop. This is a rare opportunity to shape the future of how engineers at one of the world's leading technology companies build, test, and ship software. About the Role: Design, build, and maintain core components of the...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- : Software Development Engineer II Job Summary The Software Development Engineer II (SDE II) works collaboratively within their team to perform feature analysis, research, requirements gathering, feature design, implementation/coding, testing, deployment, maintenance...Full timeWork experience placementWork at officeRemote workHome office
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWork at officeWorldwide
- ...Experience with equipment integration using OPC Servers KEY RESPONSIBILITIES AND DUTIES: Technical Leadership Support and lead major software IT initiatives and projects across the organization Lead technical discussions and contribute to architectural decisions...Full timeLive inRemote workWeekend workAfternoon shift
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
$60 - $95 per hour
Role Overview Apply GPU programming expertise to create tasks that help train large language models, with an emphasis on performance and architecture. Key Responsibilities Design GPU-related training tasks for large language models. Design, implement, and optimize...Hourly payFull timeFor contractorsRemote work- ...milliseconds using a multi-tiered, message-oriented approach for high performance and availability. • Would you like to develop industry leading solutions for fighting fraud? • Are you motivated by speeding business solutions to market? • Do you want to innovate, using...Full timeWorldwide
- ...traceability matrix • Test data preparation and execution • Defect tracking and monitoring it to closure • Escalating issues / risks to leads and managers • Keeping the test artifacts up-to-date in central repository • Maintaining good relations with project team and...Full timeWorldwide
- ...end-to-end SDLC activities, including requirements analysis, design, development, testing, deployment, and production support. • Lead troubleshooting, root cause analysis, and resolution of production incidents. • Participate in architecture discussions, technology...Full timeWorldwide
- ...functionality to assigned domain, products or services in application development, that impacts future developments. Supports and may lead initiatives including multiple features and applications involving highly integrated design and architecture. Demonstrates knowledge...Full timeRemote work
- ...future of digital commerce on our rapidly scaling Priceless Platform. As an engineering leader, you will leverage your expertise in leading high-visibility projects and hands-on technical knowledge to help us achieve flawless execution. We are experiencing tremendous...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWork experience placementWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- ...available Role 1) Develop medium-sized project/initiatives as an individual contributor with advanced knowledge within discipline, leading a segment initiative 2) Develops applications, system to system interfaces and complete software solutions, and creates...Full timeWorldwide
- Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions...Full timeWorldwide
- : The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets ...Full timeWork experience placementWork at officeLocal areaFlexible hours
- ...responsibility. •Understanding of and extensive experience with Software Engineering Concepts and Methodologies. •Proven ability to lead large complex projects and the ability to work effectively with all areas within Global Technology Operations, Corporate Groups and...Full timeWork experience placementWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead. Be the first to apply!
Related searches
- government tech Butlerville, IN
- government technology Butlerville, IN
- process tech Butlerville, IN
- IT tech Butlerville, IN
- part time remote tech Butlerville, IN
- anesthesia tech travel Butlerville, IN
- high tech Butlerville, IN
- finance tech Butlerville, IN
- technology sales Butlerville, IN
- travel mri tech Butlerville, IN