Sr Data Engineer

Senior Data Engineer

Location: Remote – Latin America (Must be able to work within U.S. time zones) Type of Contract: Full-Time | Remote | Contractor Salary Range: Market Rates

Our client is seeking a skilled Senior Data Engineer with 6+ years of experience in data engineering and deep expertise in Snowflake optimization, large-scale data pipelines, and data quality engineering. You will play a key role in building and maintaining a production-ready evaluation pipeline to assess the accuracy and reliability of new datasets against reported company revenue. Your work will directly impact data quality, analytical accuracy, and the performance and cost efficiency of their data infrastructure.

Key Responsibilities

• Build and maintain Snowflake-based evaluation pipelines to measure the accuracy of new datasets independently and in combination with existing data sources.
• Implement statistical evaluation metrics, including correlation and mean absolute error (MAE), to compare estimated company revenue against reported results.
• Optimize Snowflake performance and compute costs through warehouse sizing, clustering, materialization strategies, query optimization, and data pruning.
• Develop automated processes to collect, map, validate, and maintain ground truth company revenue data.
• Implement data quality checks, reconciliation rules, and monitoring systems to identify inconsistencies and maintain reliable downstream reporting.
• Evaluate new datasets, investigate data quality issues, and build pipelines capable of processing large-scale, full transaction-level histories.
• Own the end-to-end data engineering lifecycle, making technical decisions, improving existing prototypes, and adapting the solution to evolving project requirements.

Must-Have Qualifications

• 6+ years of professional experience in Data Engineering, with Snowflake as a primary data platform.
• Proven hands-on experience optimizing Snowflake warehouses, storage, and query execution for performance and cost efficiency in production environments.
• Strong SQL and Python skills, with the ability to design, build, maintain, and troubleshoot end-to-end data pipelines.
• Experience building and optimizing pipelines that process very large datasets, including complete transaction-level histories rather than sampled data.
• Practical experience with data quality engineering, including data validation, reconciliation, monitoring, and ongoing reliability improvements.
• Demonstrated ability to troubleshoot complex data issues, investigate inconsistencies, and deliver reliable, production-ready data solutions.
• Ability to work within U.S. time zones and collaborate effectively with distributed teams.

Preferred Qualifications

• Experience working with financial, market, transaction-level, or time-series data.
• Familiarity with statistical evaluation metrics, including correlation and mean absolute error (MAE), and their application to data accuracy assessments.
• Experience integrating and maintaining third-party data feeds, including working with data licensing and data-sharing arrangements.
• Hands-on experience with dbt or similar data transformation frameworks in Snowflake environments.
• Experience developing ground truth datasets and comparing estimated values against reported or verified results.
• Experience taking existing prototypes or proof-of-concept solutions and evolving them into scalable, reliable production systems.