Data Engineer

Join Hamilton Lane, a global leader in private markets, as we scale to meet the demands of our growing client base. Here, you’ll work with ambitious, high‑performing teams built on integrity, candor and collaboration, backed by our market‑leading data and technology. We invest heavily in our people and our partners, giving you the platform to enrich lives, safeguard futures and grow your career. About the Role We are seeking a talented ETL Data Engineer with strong experience in Python and Azure Synapse Analytics to join our dynamic team. You will play a critical role in our expanding data engineering team. You will be responsible for designing, developing, and maintaining ETL data integration processes primarily using Python (PySpark), Azure Synapse Analytics Pipelines, and other Azure Synapse Analytics resources, ensuring the accuracy and availability of data for our analytical needs. Responsibilities Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks, and/or Azure Synapse Analytics Pipelines. Apply expertise in data warehousing, designing and building effective data storage structures in a Massively Parallel Processing (MPP) SWL Pool. Extract data from various sources, including REST APIs, SWL database tables, and CSV files. Design and optimize Azure Synapse Analytics notebooks/pipelines for scalability and performance. Implement Data Fabric concepts such as data lakes, lakehouses, delta lakes, and data cataloging. Collaborate with data architects to create data models and schemas aligned with business requirements. Implement data quality checks and validation processes to maintain accuracy and consistency. Identify and resolve performance bottlenecks, optimizing ETL notebooks/pipelines to meet SLAs. Monitor ETL jobs, diagnose issues, and implement solutions to ensure data pipeline reliability. Maintain comprehensive documentation of ETL processes, data flows, and transformations. Work closely with cross‑functional teams to understand data requirements and support data‑related initiatives. Ensure data security and compliance with governance and privacy standards. Qualifications Bachelor’s degree in Computer Science, Information Technology, or related field (or equivalent experience). Azure Data Engineer certification is a plus. Proven experience in ETL data engineering using Python (PySpark) for REST APIs, SQL database tables, and CSV files. Proficiency in Azure Synapse Analytics resources (Notebooks, Pipelines, Linked Services, Azure Key Vault). Strong SQL skills, including complex query writing, optimization, and experience with SparkSQL and MS SQL. Experience with version control systems such as Git (Azure DevOps). Strong problem‑solving and analytical skills with attention to detail. Excellent verbal and written communication skills. Familiarity with big data technologies, machine learning, data analysis, and data visualization tools (Power BI, Tableau) is preferred. Experience with Agile methodologies is a plus. Benefits Healthcare coverage, mental health resources, health & fitness reimbursement, and Wellness Rewards Program. Tuition and certification reimbursement programmes, ongoing education and development trains for you to grow with Hamilton Lane. Paid volunteer time and candidate referral compensation. Adoption reimbursement, paid time off for new parents and newlyweds, and nursing parent travel support. Retirement program contributions and employee stock purchasing plan. Hamilton Lane is an affirmative action‑equal opportunity employer. All qualified applicants will be considered for employment without regard to their race, color, creed, religion, sex, pregnancy, national origin, ancestry, citizenship status, age, marital or partnership status, sexual orientation, gender identity or expression, disability, genetic predisposition, veteran or military status, status as a victim of domestic violence, a sex offense or stalking, or any other classification prohibited by applicable law. #J-18808-Ljbffr