Solution Engineer

Solution Engineer (Snowflake/Databricks)

Location – Wilmington, DE & Buffalo, NY

1. Job Description – Solution Engineer (Snowflake/Databricks)

We are seeking an experienced Solution Engineer to support a large-scale Teradata migration to modern cloud data platforms, including Snowflake and Databricks. You will design and build data solutions that power commercial, marketing, and finance data use cases while ensuring performance, cost efficiency, and compliance.

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on Snowflake and Databricks.
• Implement medallion architecture (Bronze/Silver/Gold) for batch and streaming data.
• Build CDC and streaming data integrations to support near real-time use cases.
• Develop high-quality Python/PySpark and SQL code for data transformation and analytics.
• Support platform migration activities from Teradata to Snowflake/Databricks, including validation and cutover.
• Contribute to CI/CD pipelines and automated testing (e.g., PyTest).
• Optimize workloads for performance and cloud cost, leveraging Azure capabilities.
• Collaborate with Solution Architects and business stakeholders to translate requirements into technical solutions.
• Adhere to Agile practices, participating in sprint planning, standups, and reviews.
• Ensure all solutions comply with financial services regulatory and security expectations.

Required Skills & Experience

• 6–8 years of experience in data engineering, data platforms, or related roles.
• Hands-on experience with Snowflake and Databricks in production.
• Strong proficiency in Python and PySpark for data engineering workloads.
• Advanced SQL skills, including complex queries and performance tuning.
• Experience implementing medallion architecture and layered data models.
• Practical experience with CDC and streaming technologies/concepts.
• Working experience with Azure as the underlying cloud platform.
• Exposure to cost optimization practices on cloud data platforms.
• Experience working in Agile teams with CI/CD, Git, and automated testing.
• Background in financial services or other regulated environments.

Nice to Have

• Direct experience migrating from Teradata or other legacy warehouses to cloud platforms.
• Hands-on use of Unity Catalog and/or Apache Iceberg.
• Experience in application development and integrating data into downstream apps/APIs.
• Familiarity with data governance, data quality, and data management best practices.

Education

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field, or equivalent experience.

Key Competencies

• Strong problem-solving and analytical thinking.
• Ability to explain complex technical topics to non-technical stakeholders.
• Ownership mindset with focus on delivery, quality, and stability.
• Collaborative working style in cross-functional teams.