Data Engineer

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process. New York, NY, US 2 days ago Requisition ID: 2270 Salary Range: $155,000.00 To $170,000.00 Annually Purpose of Position: We are looking for a highly skilled Data Engineer to join our Data Governance Team. The ideal candidate will have a strong background in data engineering with specific experience in Databricks. You will be responsible for designing, building, and maintaining scalable data pipelines and architectures to enable advanced analytics and data-driven decision-making across the organization. Essential Job Functions: Design and develop scalable data pipelines using Databricks, ensuring efficient data processing and integration from various sources. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs. Implement best practices for data management, storage, and retrieval, focusing on optimizing performance and ensuring data integrity. Work with large datasets and perform data cleansing, transformation, and aggregation to support analytics and reporting functions. Monitor and troubleshoot data pipeline performance, ensuring high availability and reliability. Stay updated with the latest advancements in data engineering and Databricks technologies to continuously improve our data infrastructure. Document data processes and workflows, ensuring transparency and knowledge sharing across the team. Ensure data security and compliance with regulatory requirements and industry best practices. Perform other duties as directed. Knowledge, Skills and Experience Requirements : Bachelor’s degree in Computer Science, Information Technology, Engineering, orequivalent experience 2+ years of experience as a Data Engineer, preferred proven expertise in using Databricks. Strong proficiency in data processing tools and languages such as SQL, Python, and Spark. Experience with cloud platforms, particularly Azure, and integration with Databricks. Understanding of data architecture principles and experience with ETL tools and methodologies. Excellent problem-solving skills, with the ability to manage multiple priorities in a fast-paced environment. Strong communication skills, with the ability to collaborate effectively with cross-functional teams. Our job titles may span more than one career level. The starting base salary for this role is between $155,000.00 – $170,000.00. The actual base pay is dependent upon many factors, such as: training, transferrable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. Hybrid Work Model Effective February 18, 2025, employees in office-based positions will be working a Hybrid work schedule consisting of three days or more, on-site per week, Monday - Thursday, although the specific days may vary by site or organization, with Friday designated as a remote-working day, unless business critical tasks require an on-site presence. This Hybrid work model does not apply to, and daily in-person attendance is required for, the contact center, branch service roles, and general services where the work to be performed is located at a Company site; positions covered by a collective-bargaining agreement (unless the agreement provides for hybrid work); or any other position for which the Company has determined the job requirements cannot be reasonably met working remotely. Please note, this Hybrid work model guidance does not apply to roles that have been designated as “remote”. #J-18808-Ljbffr