Data Engineer
SoftPathTechnologies
Position: Full-Time
Location: Redmond, WA
Experience: 5+ years Job Summary
We are looking for a Data Engineer with strong experience in Python or C#, database technologies, ETL, data pipelines, log analysis, and cloud-based data services.
The ideal candidate will be responsible for integrating data from multiple sources, developing reliable data pipelines, maintaining data quality, troubleshooting data issues, and delivering actionable analytics through dashboards and reporting solutions.
Key Responsibilities-
Design, develop, and maintain scalable data pipelines.
-
Integrate data from internal and external sources, including APIs, data lakes, and third-party applications.
-
Develop ETL workflows using Python, Azure Data Factory, or similar technologies.
-
Work with SQL, Kusto Query Language (KQL), and Cosmos DB.
-
Implement data validation, reconciliation, and automated testing.
-
Analyze application and system logs to identify data and operational issues.
-
Troubleshoot data-related problems and implement long-term solutions.
-
Develop and maintain Power BI dashboards and reports.
-
Integrate APIs and workflow-based services.
-
Ensure data is clean, consistent, accessible, and suitable for analytical use.
-
Collaborate with engineering, analytics, and application teams.
-
Support data pipeline monitoring and production troubleshooting.
-
Bachelor's degree in Computer Science, Computer Engineering, or another engineering discipline.
-
5+ years of experience with Python or C# .
-
5+ years of experience working with database systems.
-
Strong experience with SQL and/or Cosmos DB .
-
2+ years of experience with ETL technologies and data pipeline development.
-
Experience with Azure Data Factory or similar ETL/data integration platforms.
-
Experience with log analysis using SQL, Kusto, Application Insights, Grafana, or similar tools.
-
3+ years of experience creating and maintaining Power BI dashboards .
-
Experience working with APIs and workflow integrations.
-
Strong analytical and problem-solving skills.
-
Ability to synthesize complex information and large datasets to support technical and business decisions.
-
Azure cloud services
-
Kusto Query Language (KQL)
-
Azure Data Factory
-
Cosmos DB
-
Application Insights
-
Azure DevOps
-
Git and CI/CD
-
Data quality and automated validation
-
Data lake technologies
-
API integration
-
Real-time data processing
-
Power BI
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- senior data center engineer Washington DC
- senior cloud data engineer Washington DC
- senior data integration developer Washington DC
- data developer Washington DC
- data engineer Washington DC
- big data cloud engineer Washington DC
- data platform engineer Washington DC
- data engineering intern summer Washington DC
- data engineer analytics Washington DC
- data engineer manager Washington DC
