Senior Data Engineer

Senior Data EngineerAvaya LLC is seeking a Senior Data Engineer (Irving, TX) to spearhead the design, construction, and upkeep of our AI-enabled data pipeline. Collaborate closely with project managers, engineers, and analysts to elevate our data ecosystem. Develop and maintain scalable data pipelines for ingesting, transforming, and distributing large datasets. Design and implement secure data storage solutions. Optimize data processing performance and cost efficiency through monitoring and tuning. Integrate cloud services effectively for data engineering tasks while ensuring security and compliance. Implement data governance measures and ensure compliance with regulations. Utilize automation tools to streamline data operations. Collaborate with teams to understand data needs and deliver actionable solutions. Enhance real-time data insights for big data processing and analytics. Support BI initiatives through integration with visualization tools. Local telecommuting permitted.Salary Range: $157,414 to $207,800 per yearMinimum Requirements: Requires a Bachelor's degree in Computer and Information Science or a related field and 6 years of experience building and maintaining big data, advanced data pipelines and scalable data infrastructure. Must have experience with: Cloud-based technologies, (Azure and Data Lakes); Lakehouse Storage Technologies and formats such as Azure Data Lake 2 (ADSL2), Delta Lake; AI, machine learning, and modern data processing tools (Pandas, NumPy, and Matplotlib); Automation tools (Terraform and GitHub Actions); Database Skills (SQL, ETL processes); Big data technologies (Hive, Spark, PySpark, Airflow and Databricks); Visualization tools (Power BI, Looker); and Programming languages (Python, Go, Scala, and Java). Local telecommuting permitted.