Azure Data Lead
VDart Inc
Azure Data lead - Python, Pyspark, Databricks, ADF, Data Lake,
Azure Senior Data Lead Leads modernization of Python applications into scalable PySpark solutions on Azure Databricks Role Purpose Lead the modernization and migration of existing Python object-oriented applications into scalable PySpark and Spark SQL data-processing solutions on Azure Databricks - bringing a strong blend of software engineering, data engineering, cloud architecture, and performance optimization. Key Responsibilities Analyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution. Design, develop, and deploy enterprise-scale data pipelines on Azure Databricks; build reusable PySpark frameworks and utility modules. Implement Delta Lake solutions using the Bronze Silver Gold architecture. Build robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics. Implement data quality, reconciliation, validation, and monitoring frameworks. Optimize Spark jobs (partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, Delta optimization) and benchmark converted applications against original Python implementations. Core Skills Python (expert), OOP, and advanced Python design patterns PySpark, Spark SQL, and SQL Azure Databricks, Azure Data Factory, ADLS Gen2 Apache Spark, Delta Lake, Data Lakehouse architecture, distributed computing Must-have (per requisition): Python, Azure Databricks, Azure Data Factory (ADF), MS SQL, Oracle PL/SQL. Good to have: PySpark; certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python. Experience & Expected Outcome Senior data engineering leader with proven delivery of large-scale Databricks modernization programs. Expected outcome: existing Python applications converted into scalable, cost-efficient, enterprise-grade data solutions on Azure Databricks with proven performance parity.
- A leading solutions provider for the insurance industry is seeking an experienced Azure Databricks Architect to design and develop modern data solutions. This role requires expertise in Azure and Databricks, with a focus on cloud-native architecture. Ideal candidates will...SuggestedPart time
- A technology solutions company is seeking an experienced Azure Test Lead to oversee testing efforts while ensuring high quality within a dynamic... ...The ideal candidate will possess 8-10 years of experience in Data Testing, Azure, and Test Automation, along with strong...Suggested
- EXL is seeking an experienced data architecture lead to design and govern enterprise data platforms on Azure, with a focus on Databricks Lakehouse, Delta Lake, and scalable cloud-native ecosystems. The role involves defining ingestion, transformation, and serving layers...Suggested
$100k - $120k
A leading technology firm is seeking a Senior Azure Data Engineer to lead data integration and migration initiatives. Successful candidates will have over 10 years of experience in ETL development, strong expertise in tools like Informatica, and the ability to work collaboratively...SuggestedRemote job$175k - $200k
...per annum New York, United States Permanent Feature Lead - AI & Data EngineeringLocation: New York, NY (Hybrid, 3 days onsite)... ...patterns.Experience delivering cloud-native solutions within AWS, Azure, or GCP environments.Experience working directly with Product...SuggestedPermanent employmentFull time- Job Description:Leading Global Bank is seeking a hands-on Data Scientist to design, build, and deploy scalable machine learning and advanced analytics solutions... ...improvement.Build scalable ML pipelines using Azure ML, Databricks, Spark, and cloud-native data platforms...
$41k
...Data Management Lead The Data Management Lead is responsible for defining and executing the organization's data management strategy, ensuring... ...databases. ~ Knowledge of cloud platforms such as AWS, Azure, or Google Cloud. ~ Familiarity with data warehousing and...Full timeFor contractorsPhoton
New York, NY4 days ago- Shape the future of data-driven decision-making at one of the world's most innovative financial... ...journey.As a Vice President, Data Owner Lead within the Trust and Security team at... ...Web Services, Google Cloud, or Microsoft Azure, and big data technologies such as Hadoop...
$180k - $220k
Our client, an innovative AI and Data company, is hiring a Data Operations Lead to join the team in New York. The successful candidate will own the end-to-... ...torchaudio, and cloud platforms including AWS, GCP or Azure. ~Entrepreneurial mindset with the ability to thrive...Full timeAlldus International Consulting Ltd
New York, NYa month ago- Carrier is looking for a Technical Lead focused on Data Analytics technologies to enhance its market leadership. You will spearhead the development... ...with hands-on skills in Python and cloud computing (AWS, Azure). Join us at Carrier to create impactful solutions for...
- A leading enterprise organization is seeking a Data Management Lead to build and mature an enterprise-wide data management and governance program. This is an... ...working with enterprise cloud data platforms (Azure, AWS, Databricks, or similar). Understanding of SQL,...
- ...sponsorship avail) We’re partnering with a leading organization in the digital health space... ...solutions. They’re looking for a Health Data & Regulatory Compliance Lead to help... ...Background in cloud environments (AWS or Azure) Why this role stands out Work on AI‑driven...Contract workPart time
$150k - $200k
...innovative technology to deliver industry-leading digital solutions. Synechron’s... ...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array... ...AI ecosystems across AWS, Microsoft Azure, and Google Cloud. Databricks certifications...Temporary workFlexible hours- ...Cleint currently seeks a " Senior Data Practitioner/Data Lead " to join our team in " New York, NY ". [Hybrid 3 days/week to onsite is must]... ...pipelines for machine learning inference. Strong knowledge of Azure data platforms including: Azure Databricks...Work at office3 days per week
Saransh Inc
New York, NY3 days ago $112.29k - $161.28k
Company descriptionPHM is the leading health media agency in the US, built for the modern... ...industry depth meets media scale, where data becomes direction, where creativity and storytelling... ...develop warehouse solutions built on the Azure and AWS technology stacks. These...Temporary workFreelanceFlexible hours- ...collaborative, while having a lot of fun along the way. Job Overview The Lead, Data Scientist will design, develop, and implement advanced data... ...cases and drive business value. Experience with Cloud (GCP, Azure, AWS) and big data processing technologies (Redshift, Big Query...Work at office
$193.73k - $322.88k
Position Summary Healthcare Provider L65 - Associate Vice President, AI and Data Solutions - Data Lead Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant impact on our clients' success. You’ll...Local areaVisa sponsorship$105k - $135k
...for our clients globally - across all segments and industries.The Global Payments Solutions Data & AI - Data Strategy and Governance team (DSG) is looking for a Data Governance Lead for Global Transactions Services, part of the GPS team which is a ~$15bn business who will...Full timeDay shift$182.4k - $228k
...sandboxed replicas of the digital spheres where real knowledge work occurs and built from the operating data of the companies that actually hold it. As the Data Acquisition Lead, you will own the commercial motion that gets us that data end to end. You will figure out which...Full time- ...Capital Group Ltd. is looking for an experienced Enterprise Data Architect to lead the data architecture function for Data Management, driving... ...data governance, and proficiency with tools like Snowflake and Azure services. Strong communication skills are essential for...Remote work
- ...consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Oracle Fusion Data Migration Lead. Location(s): New York, NY (Remote). Detailed Job Description: Key Responsibilities:Lead the end-to-end data migration strategy...Remote work
$100.8k - $151.2k
...026-08-26Location: Getzville, New York, United StatesSalary: $100,800.00 - $151,200.00Category: Data Governance, ProfessionalCompany: CitiThe Data Governance Foundation Lead Analyst (C13) is responsible for contributing to the directional strategy and assisting in creation...Full timeWork at officeFlexible hours$119k - $170k
Location Designation: Hybrid - 3 days per week Role OverviewThe Lead, Data, Insights & AI is responsible for enabling data-driven decision-making across Field Technology, Release Management, and Change Management by creating a trusted and consistent view of operational...Local area3 days per week$147.5k - $211k
Location Designation: Hybrid - 3 days per week Role Overview:The Data Protection & Data Risk Management Lead plays a key role in advancing New York Life’s data governance, data protection & data risk management initiatives. This hands-on engineering team leader role focuses...Local area3 days per week$86.8k - $217.1k
IQVIA is growing! Hiring multiple Senior Data Team Leads across our FSP (Functional Service Provider) and Traditional (Sponsor-Agnostic) delivery models.Apply now and have your resume considered for Senior Data Team Lead opportunities across multiple teams - allowing us...Full timePart timeImmediate startRemote workWork from homeWorldwide$185k - $264.5k
...: Hybrid - 3 days per week Corporate Vice President (MG3)Head of Data Risk & Governance OversightRole Overview:New York Life is seeking... ...strategic leader to serve as the Enterprise Data Governance Oversight Lead within Risk Management. This role sits at the center of the firm’...Local area3 days per week$192.3k - $260k
...This is a senior leadership role responsible for the management of Data Center cost engagements for existing clients, and for driving and... ...oversee team members and/or direct report(s), and serve as Team Lead.· Serve as Team Lead for capital planning and dedicated accounts,...Full timeLocal areaRemote work$100.8k - $151.2k
...026-08-28Location: Getzville, New York, United StatesSalary: $100,800.00 - $151,200.00Category: Data Governance, ProfessionalCompany: CitiThe Data Governance Foundation Lead Analyst is responsible for contributing to the directional strategy and assisting in creation and...Full timeWork experience placementFlexible hours$65 - $75 per hour
...A technology consulting firm is seeking an experienced CRM Data Migration Specialist to assist clients with migrating legacy Siebel CRM data to a new ServiceNow platform. This hybrid role requires expertise in data extraction, RESTful API development, and collaboration...Hourly payNext Generation
New York, NY17 hours ago- A global data solutions provider is seeking a Managing Data Migration Consultant to lead a team in executing data migration projects. You will collaborate with clients and ensure successful project delivery while mentoring junior colleagues. The role requires strong experience...
Syniti
New York, NY17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Lead. Be the first to apply!
