Senior Data Engineer

Data Engineer

We are seeking a skilled and detail-oriented Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with data analysts, data scientists, and business stakeholders to ensure data is accessible, reliable, and optimized for performance.

Responsibilities

• Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.
• Develop, implement, and deploy ETL solutions.
• Preprocess and analyze large datasets to identify patterns, trends, and insights.
• Evaluate, validate, and optimize data models to ensure efficiency, and generalizability.
• Monitor and maintain the performance of data pipeline, data models in production environments, identifying opportunities for improvement and update as needed.
• Document development processes, results, and lessons learned to facilitate knowledge sharing and continuous improvement.

Qualifications

• Bachelor's or master's degree in computer science, Engineering, or a related field.
• Strong programming skills in languages such as Python, PySpark, SQL etc.
• Experience in Build and optimize ETL workflows using tools/technologies such as Spark, Snowflake, Airflow and/or Azure Data factory, Glue, Redshift etc.
• Craft and optimize complex SQL queries and stored procedures for data transformation, aggregation, and analysis.
• Develop and maintain data models ensuring scalability and optimal performance.
• Utilize Snowpark for data processing within the Snowflake platform.
• Integrate Snowflake for efficient data storage and retrieval.
• Exposure to API integrations to facilitate data workflows.
• Experience in implementing CI-CD pipelines through DevOps platforms.
• Good experience in cloud infrastructure such as Azure, AWS or GCP

All your information will be kept confidential according to EEO guidelines. This job description in no way states or implies that these are the only duties to be performed by the employee(s) currently in this position. Employee(s) will be required to follow any other job related instructions and to perform any other job-related duties requested by any person authorized to give instructions or assignments. A review of this position has excluded the marginal functions of the position that are incidental to the performance of fundamental job duties. All duties and responsibilities are essential job functions and requirements and are subject to possible modification to reasonably accommodate individuals with disabilities. To perform this job successfully, the incumbent(s) will possess the skills, aptitudes, and abilities to perform each duty proficiently. Some requirements may exclude individuals who pose a direct threat or significant risk to the health or safety of themselves or others. The requirements listed in this document are the minimum levels of knowledge, skills, or abilities. This document does not create an employment contract, implied or otherwise, other than an "at-will" relations.