Azure Data Lead
VDart Inc
Azure Data lead - Python, Pyspark, Databricks, ADF, Data Lake,
Azure Senior Data Lead Leads modernization of Python applications into scalable PySpark solutions on Azure Databricks Role Purpose Lead the modernization and migration of existing Python object-oriented applications into scalable PySpark and Spark SQL data-processing solutions on Azure Databricks - bringing a strong blend of software engineering, data engineering, cloud architecture, and performance optimization. Key Responsibilities Analyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution. Design, develop, and deploy enterprise-scale data pipelines on Azure Databricks; build reusable PySpark frameworks and utility modules. Implement Delta Lake solutions using the Bronze Silver Gold architecture. Build robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics. Implement data quality, reconciliation, validation, and monitoring frameworks. Optimize Spark jobs (partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, Delta optimization) and benchmark converted applications against original Python implementations. Core Skills Python (expert), OOP, and advanced Python design patterns PySpark, Spark SQL, and SQL Azure Databricks, Azure Data Factory, ADLS Gen2 Apache Spark, Delta Lake, Data Lakehouse architecture, distributed computing Must-have (per requisition): Python, Azure Databricks, Azure Data Factory (ADF), MS SQL, Oracle PL/SQL. Good to have: PySpark; certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python. Experience & Expected Outcome Senior data engineering leader with proven delivery of large-scale Databricks modernization programs. Expected outcome: existing Python applications converted into scalable, cost-efficient, enterprise-grade data solutions on Azure Databricks with proven performance parity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Data Lead in New York, NY vacancy
- Jobtailor is seeking a seasoned data leader to own the enterprise data and analytics strategy... ...on Microsoft Fabric and shape the Azure ecosystem strategy, guiding data governance... ...across the organization. You will build, lead, and develop a high-performing data organization...Suggested
- A leading solutions provider for the insurance industry is seeking an experienced Azure Databricks Architect to design and develop modern data solutions. This role requires expertise in Azure and Databricks, with a focus on cloud-native architecture. Ideal candidates will...SuggestedPart time
- A technology solutions company is seeking an experienced Azure Test Lead to oversee testing efforts while ensuring high quality within a dynamic... ...The ideal candidate will possess 8-10 years of experience in Data Testing, Azure, and Test Automation, along with strong...Suggested
- Jobtailor seeks a senior data architecture leader to own end-to-end Azure-based data platforms, focusing on Databricks Lakehouse, Delta Lake, and scalable... ...reporting, analytics, and ML. Responsibilities include leading ETL/ELT design, governance, security, and cost...Suggested
- Qualifications Solutions Architect, Python, Azure, Databricks, Apache Spark/PySpark, Data Modeling, Unity Catalog. 10-15 years of experience in data engineering or a related field. Extensive experience with Databricks and Apache Spark. Proficiency in programming languages...SuggestedFull time
- EXL is seeking an experienced data architecture lead to design and govern enterprise data platforms on Azure, with a focus on Databricks Lakehouse, Delta Lake, and scalable cloud-native ecosystems. The role involves defining ingestion, transformation, and serving layers...
- Tenth Revolution Group is seeking a Data Architect for an on-site role in Hong Kong. You... ...strategies, build scalable architectures and lead data modeling efforts to enable analytics... .... Ideal candidates will have strong Azure Data Services experience and a collaborative...Permanent employment
$100k - $120k
A leading technology firm is seeking a Senior Azure Data Engineer to lead data integration and migration initiatives. Successful candidates will have over 10 years of experience in ETL development, strong expertise in tools like Informatica, and the ability to work collaboratively...Remote job- Job Description:Leading Global Bank is seeking a hands-on Data Scientist to design, build, and deploy scalable machine learning and advanced analytics solutions... ...improvement.Build scalable ML pipelines using Azure ML, Databricks, Spark, and cloud-native data platforms...
- A global recruitment firm is seeking a hands-on technologist to lead Client Master Data Management solutions for Wealth Management channels. This senior role requires over 10 years of expertise in data engineering and MDM, strong decision-making skills, and the ability...
$128k - $252k
...for this role ends on 09/30/2026. As a Manager and Integration & Data Lead within our Finance Transformation Tech Enablement team, you... ...integration concepts. Experience with cloud-based data platforms (Azure, AWS, or GCP) and associated data services. Familiarity with...Contract workLocal area- ...A leading enterprise organization is seeking a Data Management Lead to build and mature an enterprise-wide data management and governance program. This is... ...Experience working with enterprise cloud data platforms (Azure, AWS, Databricks, or similar). Understanding of SQL,...
Madison-Davis, LLC
New York, NY3 days ago $160k
...Data Governance Lead New York, New York, United States $ 160,000.00 - 160,000.00 (US Dollar) About the Job Data Governance Lead As... ...into data platforms, data lakes, and cloud environments (AWS/Azure). Candidate Profile: ~ Bachelors degree in...Inizio Partners
New York, NY7 hours ago$180k - $220k
Our client, an innovative AI and Data company, is hiring a Data Operations Lead to join the team in New York. The successful candidate will own the end-to-... ...torchaudio, and cloud platforms including AWS, GCP or Azure. ~Entrepreneurial mindset with the ability to thrive...Full timeAlldus International Consulting Ltd
New York, NYa month ago- Carrier is looking for a Technical Lead focused on Data Analytics technologies to enhance its market leadership. You will spearhead the development... ...with hands-on skills in Python and cloud computing (AWS, Azure). Join us at Carrier to create impactful solutions for...
$134k - $202k
Job Overview The FOIA Data Migration & Compliance Lead is a technically skilled, government-domain-experienced professional who serves as both a hands... ...role requires working within pre‑approved toolsets and Azure‑native capabilities. Minimum Qualifications Bachelor’s...Contract workLocal areaImmediate startRemote work- ...sponsorship avail) We’re partnering with a leading organization in the digital health space... ...solutions. They’re looking for a Health Data & Regulatory Compliance Lead to help... ...Background in cloud environments (AWS or Azure) Why this role stands out Work on AI‑driven...Contract workPart time
$150k - $200k
...innovative technology to deliver industry-leading digital solutions. Synechron’s... ...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array... ...AI ecosystems across AWS, Microsoft Azure, and Google Cloud. Databricks certifications...Temporary workFlexible hours- ...collaborative, while having a lot of fun along the way. Job Overview The Lead, Data Scientist will design, develop, and implement advanced data... ...cases and drive business value. Experience with Cloud (GCP, Azure, AWS) and big data processing technologies (Redshift, Big Query...Work at office
- ...Capital Group Ltd. is looking for an experienced Enterprise Data Architect to lead the data architecture function for Data Management, driving... ...data governance, and proficiency with tools like Snowflake and Azure services. Strong communication skills are essential for...Remote work
$189k - $370k
OverviewThe Client Data Solution Lead helps Key Groupe Clients (KGCs) unlock business and marketing value through Connected Identity solutions that are the foundation for client transformation and growth. The successful candidate will act as a trusted advisor to senior...Temporary workFreelanceFlexible hours- ...consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Oracle Fusion Data Migration Lead. Location(s): New York, NY (Remote). Detailed Job Description: Key Responsibilities:Lead the end-to-end data migration strategy...Remote work
$105k - $135k
...for our clients globally - across all segments and industries.The Global Payments Solutions Data & AI - Data Strategy and Governance team (DSG) is looking for a Data Governance Lead for Global Transactions Services, part of the GPS team which is a ~$15bn business who will...Full timeDay shift$193.73k - $322.88k
Position Summary Healthcare Provider L65 - Associate Vice President, AI and Data Solutions - Data Lead Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant impact on our clients' success. You’ll...Local areaVisa sponsorship$100.8k - $151.2k
...026-07-13Location: Getzville, New York, United StatesSalary: $100,800.00 - $151,200.00Category: Data Governance, ProfessionalCompany: CitiThe Data Governance Foundation Lead Analyst is responsible for contributing to the directional strategy and assisting in creation and...Full timeWork experience placementFlexible hours$125.67k - $131.5k
Job ID: 97735850128Posted: 2026-07-13Location: Getzville, New York, United StatesCategory: Data GovernanceCompany: CitiCitibank, N.A. seeks a Data Quality Lead Analyst for its Getzville, New York location.Duties: Issue identification, escalation, and remediation for Credit...Full timeRemote work$185k - $264.5k
...: Hybrid - 3 days per week Corporate Vice President (MG3)Head of Data Risk & Governance OversightRole Overview:New York Life is seeking... ...strategic leader to serve as the Enterprise Data Governance Oversight Lead within Risk Management. This role sits at the center of the firm’...Local area3 days per week$119k - $170k
Location Designation: Hybrid - 3 days per week Role OverviewThe Lead, Data, Insights & AI is responsible for enabling data-driven decision-making across Field Technology, Release Management, and Change Management by creating a trusted and consistent view of operational...Local area3 days per week$147.5k - $211k
Location Designation: Hybrid - 3 days per week Role Overview:The Data Protection & Data Risk Management Lead plays a key role in advancing New York Life’s data governance, data protection & data risk management initiatives. This hands-on engineering team leader role focuses...Local area3 days per week- ...Biotech Health Data Governance Lead (AI Training) About The Role What if your expertise in biotech and clinical data governance could directly shape how AI understands and reasons about life sciences research? We're looking for a Biotech Health Data Governance Lead to...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Lead. Be the first to apply!
Related searches
- data analytics lead New York, NY
- data team lead New York, NY
- manager workday data conversion lead New York, NY
- data lead New York, NY
- data loss prevention analyst New York, NY
- data labeling New York, NY
- data collection New York, NY
- data technician New York, NY
- data governance New York, NY
- data visualization New York, NY