Applications Development Senior Programmer Analyst - Assistant Vice President

For additional information, please review .* Develop and maintain scalable ETL/ELT pipelines using **PySpark, Spark SQL, and Delta Lake on Databricks**.* Support implementation and management of data platforms across **AWS, Azure, or GCP**.* Work with big data technologies such as **Databricks, Snowflake, and Apache Iceberg** to process large datasets.* Optimize Spark workloads through performance tuning, partitioning strategies, and cost-efficient processing.* Contribute to **Lakehouse architecture implementation**, ensuring data quality, consistency, and reliability.* Assist in implementing **data federation solutions using Starburst/Trino** across multiple data sources.* Support **data governance initiatives**, including data quality checks, lineage tracking, metadata management, and adherence to enterprise standards.* Ensure compliance with **data security and governance policies**, including access controls (RBAC) and auditability.* Perform troubleshooting and performance optimization for data pipelines and queries.* Support data modeling for analytics, reporting, and downstream consumption.* Collaborate with data scientists and ML teams to enable pipelines for **AI/ML and RAG-based use cases**.* Participate in Agile processes, including sprint planning, stand-ups, and retrospectives.* Work with stakeholders to gather requirements and deliver data solutions aligned with business needs.* 4–7 years of experience in **Data Engineering or related roles**.* Strong hands-on experience with **Python, PySpark, and Spark SQL**.* Experience with **Databricks (Delta Lake, performance tuning)**.* Working knowledge of **Ab Initio (GDE, Co> Operating System, Conduct> It)**.* Experience with **Snowflake** for data warehousing and analytics.* Familiarity with **Starburst/Trino** and data federation concepts.* Exposure to **Apache Iceberg or similar open table formats**.* Hands-on experience with at least one cloud platform (**AWS, Azure, or GCP**) and related data services (e.g., Glue, ADF, Dataflow, Redshift, Synapse, BigQuery).* Understanding of **data governance frameworks**, including data quality, lineage, cataloging, and security principles.* Experience supporting **data pipelines for analytics and machine learning workloads**.* Familiarity with **Agile/Scrum methodologies**.* Strong problem-solving, collaboration, and communication skills. #J-18808-Ljbffr