Senior Data Engineer

Job Summary Senior Data Engineer responsible for designing, building, and maintaining scalable data pipelines on Databricks and SQL Server, with a focus on AI tools and automation to enhance productivity, reliability, and analytics. Core Data Engineering Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQL. Optimize data workflows and SQL/Spark queries for performance, cost efficiency, and reliability. Contribute to the design of the enterprise Data Lake and curated data assets. Build robust ingestion frameworks, transformation logic, and reusable data engineering components. Support data migrations and modernization efforts from legacy systems to cloud‑based platforms. AI-Augmented Productivity & Automation Use AI coding copilots (Databricks Assistant, GitHub Copilot, SQL copilots) to accelerate development, code review, testing, and documentation. Automate repetitive tasks (schema evolution, config generation, logging templates, test data creation) with generative AI tools. Leverage AI to auto‑detect pipeline anomalies, data drift, quality issues, and performance bottlenecks. Integrate AI‑assisted query optimization tools to improve Spark and SQL performance. Learn and utilize LLM‑powered tools to generate, refactor, and explain complex SQL, PySpark logic, and pipeline configurations. Collaboration & Delivery Work cross‑functionally with Product and data consumers to deliver high‑quality data solutions. Participate in Agile ceremonies and contribute to sprint planning and technical design discussions. Mentor junior data engineers and promote best practices in AI‑assisted data engineering. Ensure strong documentation, standards adoption, and continuous improvement across the team. Qualifications 5–7+ years of hands‑on data engineering experience. Advanced proficiency in Python, SQL, PySpark, and ETL/ELT frameworks. Strong experience with Databricks and distributed data processing. Demonstrated ability to optimize SQL/Spark workloads for performance and cost. Experience using AI development tools such as GitHub Copilot, Databricks Assistant, SQL/IDE AI copilots, and AI‑based data quality or monitoring tools. Solid understanding of data modeling, governance, and CI/CD for data pipelines. Excellent communication skills and ability to work in a cross‑functional environment. Experience working in Agile environments with tools like Jira and Confluence. Benefits & Perks Health: Medical, vision, and dental benefits; flexible spending accounts and health savings accounts. Yourself: Generous paid time off, paid holidays, sick time, paid birthday leave, and free concert tickets. Wealth: 401(k) program with company match and stock program. Family: New‑parent programs, caregiver leave, childcare cash, and infertility support. Career: Tuition reimbursement, student‑loan repayment, internal growth and development programs, and training. Others: Volunteer time off and crowdfunding network. Equal Employment Opportunity Live Nation is committed to equal employment opportunity for all applicants and encourages diversity. We will consider qualified applicants with criminal histories and comply with the Los Angeles Fair Chance Ordinance, San Francisco Fair Chance Ordinance, and California Fair Chance Act. We provide reasonable accommodations for qualified individuals with disabilities and will engage in an interactive process to determine effective accommodations. Live Nation supports a workplace that values diversity in gender, race, sexual orientation, religion, age, disability status, and caring responsibilities. #J-18808-Ljbffr Live Nation