Lead Azure Data Engineer
$140k - $175kRyansg
Position Summary The Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst, Data Analyst, IT Teams and key stake holders. This role will lead projects and coach junior staff on build and optimize data pipelines, integrating data from various sources, ETL (Extract, Transform, Load) processes and ensuring data quality and consistency. The Lead will ensure that our data engineering practices are aligned with the latest technologies and industry best practices, focusing on performance, reliability, and efficiency.
What will your job entail?
Job Responsibilities:
• Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives.
• Mentor less experienced data engineers and team members, fostering a collaborative and innovative work environment.
• Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure.
• Manage and enhance complex SSIS packages for data integration and ETL processes, along with SSRS reports for business intelligence.
• Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory, implementing both batch and real-time data integration processes.
• Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments.
• Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage, optimizing for query performance and cost-efficiency.
• Integrate and configure Profisee Master Data Management tools within Azure, focusing on data governance and quality.
• Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms.
• Implement data cataloging, classification, and lineage using Azure Purview, developing data governance policies, and ensuring compliance.
• Enhance and support Tableau reporting solutions, developing complex dashboards, and integrating with Azure data services.
• Drive automation and process optimization using Azure services and scripting and implement CI/CD pipelines using Azure DevOps.
• Lead SQL Server database optimization and performance tuning efforts.
• Lead, Coach and Mentor junior staff on projects.
• Bachelor’s degree required, Master’s degree preferred; Computer science, Information Technology or Engineering is preferred. Any other related discipline or commensurate work experience considered.
• 12+ years of experience in Data Engineering with a Bachelor’s degree, or 8 years of experience with a Master’s degree is preferred.
• Subject Matter Expert in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services.
• Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance with Azure Purview.
• Proven experience in Tableau and BI Reporting, and strong skills in Automation and Process Licenses & Certifications:
• Advanced Data Analytics Certifications (ADAC), SAS Statistical Business Analyst Professional Certification (SBAPC), or Cloudera Certified Professional (CCP) Data Engineer a plus. Skills:
Technical/Functional Skills: • Big Data Analytics
• Leadership
• Data Governance
• Data Modeling
• Data Processing
• Data Warehousing
• Database Management
• Knowledge of ETL processes
• Machine Learning
• Predictive Analysis
• Programming Languages Behavioral Skills:
• Critical Thinker
• Communication
• Relationship Building
• Effective Communication
• Time Management
• Problem Solving
• Attention to Detail
*****Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time*****
Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.
How We Support Our TeammatesRyan Specialty seeks to offer our employees a comprehensive and best-in-class benefits package that helps them — and their family members — achieve their physical, financial, and emotional well-being goals. In addition to paid time off for company holidays, vacation, sick and personal days, Ryan offers paid parental leave, mental health services and more.
The target salary range for this position is $140,000.00 - $175,000.00 annually.The wage range for this role considers many factors, such as training, transferable skills, work experience, licensure and certification, business needs, and market demands. The pay range is subject to change and may be modified in the future. Full-time roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards, visit our website
We provide individuals with disabilities reasonable accommodations to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at View email address on waitwhatdoyoudo.com
The above is intended to describe this job's general requirements. It is not to be construed as an exhaustive statement of duties, responsibilities, or physical requirements. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
- About Accenture:Accenture helps the world's leading enterprises reinvent by building their digital core... ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve...SuggestedWork experience placementLive inWork at officeLocal area
- ...Data Engineer Position Details Sector: Electric Utility, Energy, and Power Location... ...engineer who is strong in Python, SQL, Azure, and ETL/ELT development and can independently... ...collaborating with senior technical leads, engineers, analysts, and business...SuggestedContract work3 days per week
- ...Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation — and we're looking for a Senior Data Engineer who's ready to lead the way. We've been partnering with companies to build software that matters since 1988. From Fortune...SuggestedFull time
$88k - $116k
...Description Job Description Company Description We are Olsson. We engineer and design solutions that improve the world around us. As a... ...companies in the world to work for. We design large hyperscale data center campuses and colocation data centers throughout the U.S.....SuggestedFull timeWork at officeRemote workFlexible hours$119k - $144k
...Senior Data Scientist – Market EvaluationYou will work with large and complex... ...information easier to understand and act upon.Lead end-to-end data science projects —... ...cloud platforms and modern software engineering practices, including Azure, AWS, GCP, and Git.Strong knowledge...SuggestedLocal area$71k - $96k
...market operations, and report findings to stakeholders. You will build understanding of how MISO’s market systems interact, collect data, and turn results into clear insights. You’ll contribute to improving analytical processes and supporting reliability for 47 million...- ...proven it. As one of the leading international travel insurance... ...here The Information Security Engineer is an integral member of the... ...assets, systems, networks, and data by implementing, monitoring,... ...security concepts across Microsoft Azure and SaaS platforms ~ Strong...
- ...whether outcomes align with design requirements. Join a growing team to analyze market operations, develop market design ideas, collect data, visualize findings, and help streamline analytical processes. This role supports continuous evolution of one of the world’s largest...
- We Are:The beginning of a new Data & AI decade that will reshape work and society has begun... ..., and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional,... ...solutions, Databricks or Snowflake.Ability to lead and effectively facilitate design...Work experience placementLive inWork at officeLocal area
- ...an immediate opening for an experienced Azure solution architect. This position gets involved... ...-facing consulting role responsible for leading technical discovery and solution... ...wide variety of client stakeholders in IT, engineering, and marketing, as well as our client’s...Full timeImmediate start
- ...Description Job Title: Senior Databricks Data Engineer Work Location: St. Louis, MO,... ...experience in implementing Databricks, AWS/Azure, Scala, Spark, Snowflake, SQL, Python... ...understanding of delivery methodology (SDLC) and lead teams in the implementation of the...Contract work
- ...Position: Data Engineer Azure Databricks & Synapse Lakehouse Location: Indianapolis, IN 46204 Client: State of Indiana Duration: 12+ Months Job Description: Seeking a data engineer to design, build, and maintain secure, scalable data solutions using...
- ...Innovators, Collaborators and Doers. We’re seeking a Senior ML Engineer to join us. As a Senior ML Engineer at Zotec, you will... ...learning and AI systems that give our teams direct, governed access to data and AI tooling. You will design and ship models, build the...
- ...Leverage Elanco’s Enterprise Data and PaaS/SaaS Platforms to deliver... ...and execution of systems engineering solutions, driving standards across... ..., Veeva RIM, Ennov). Act as a lead mentor and coach, fostering a... ...Cloud platforms (Microsoft Azure, GCP) and associated automation...Full timeWork at office
- ...environment, offering competitive compensation and an industry-leading 401k contribution. Our team is built through merit and... ...we give back! Join us today. We are seeking a skilled Data Analytics Engineer to join our team to support the U.S. Army Financial Management...Work experience placementRemote work
- Theoris is seeking a Junior Data Engineer to join a newly formed government data team in Indianapolis. You will focus on cleansing, validating, transforming, and testing enterprise data across multiple source systems to support analytics and reporting. You will work with...
- ...Indianapolis INDUSTRY: Government JOB OVERVIEW: We are seeking a Junior Data Engineer to join a newly formed team responsible for modernizing and... ...to learn new technologies and data environments. PREFERRED: Azure Data Factory and Microsoft Fabric exposure. Wherescape,...Full timeLocal area
- ...JUNIOR DATA SCIENTIST We're hiring! We are looking for a junior Data Scientist to join our growing team based in Amsterdam. Human Data... ...customers to prevent from churning. Customers are amongst the leading brands in the world. They trust us to build their online marketing...Full timeWork at office
- ...Data Scientist SeniorLocation: This role requires associates to be in-office 1 day per week, fostering collaboration and connectivity,... ...optimize member experiences.How you will make an impact:Designs and lead predictive modeling projects to address more complex business...Temporary workWork at officeLocal area1 day per week
- ...Data ScientistDrive the future of AI-powered decision-making by leading sophisticated machine learning and GenAI solutions that shape... ..., work hand-in-hand with ML Engineers to deploy models and verify system... ...frameworks using tools like Azure DevOps.Skills / Knowledge /...Work from homeFlexible hours
- ...specifications to enable successful trial implementation Program and test data collection systems and associated data repository mappings for a... ...submission, inspection and regulatory response activities Lead cross Business Unit/Therapeutic Area projects or programs with...
- ...DescriptionJob DescriptionTitle: Data Scientist Location:... ...scalable data solutions across Azure Databricks and Azure Synapse Analytics... ...closely with the solution leads, project managers, data architects... ...sources using various data engineering tools and methods.Designs, builds...Local area
$120.4k - $188.13k
...evolve, grow, and succeed – today and into tomorrow. As an Electrical Engineer in our Advanced Manufacturing group, you’ll contribute to projects that enable the heart of our clients’ successful data center facilities engineering, design and construction. In this role,...Full timeFor contractorsWork at officeRemote workFlexible hours- ...supervision from the senior staff or the Director of Electrical Engineering, provide engineering design and analysis for lighting, power,... ..., low voltage systems (fire alarm systems, telecommunications, data networks, lighting control systems, power monitoring systems, etc...Full timeContract workFor contractorsInternshipLocal area
- ...Job DescriptionJob Description Cloud Engineer Platform Engineering | ****@*****.*** | Eli Lilly... ...deploy cloud architectures on Microsoft Azure that meet performance, security, availability... ...standards, regulatory requirements, and data governance policies; implement and...
- ...Designing, building and Implementation of environment setup in Azure cloud for applications, data team and DevOps.· Implementation of Azure cloud... ...:· Degree level education in Mathematics, Computing or Engineering discipline or equivalent experience· 8+ years of total...
- ...presentations to high level program management and customers Leading major program and/or design reviews and major proposal... ...and/or service; Completed reports or studies may be deliverable engineering products to the customer Providing functional and technical...For contractorsFor subcontractorLocal area
- Jacobs is seeking a Voice, Data, Security (VDS) Engineer to join our Life Sciences North America Team. In this role, you’ll design and CAD electrical systems for advanced facilities, collaborating across disciplines to deliver complex packages. The position offers hybrid...
$65.5k - $99k
...that we're making a difference. We're looking for a Voice, Data, Security (VDS) Engineer to join our Life Sciences North America Team. Location... ...complex packages in coordination with designers and design leads and form the core of our delivery team Bring your curiosity...Full timeInternshipLocal areaRemote workRelocation- We Are:Accenture is a leading global professional services company that helps the world’s... ...technology and leadership in cloud, AI and data with unmatched industry experience,... ...platforms (e.g., Open AI, Anthropic, AWS, Azure, Google Cloud).You have knowledge of big...Work experience placementLive inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Azure Data Engineer. Be the first to apply!





