Senior Data Engineer

Sr. Data EngineerWork hours: 8am-5pm CTThis candidate will be working on data integration solutions for Optum Consume office. The work will involve data integration/engineering work involving Azure Databricks, Py Spark, spark/scala and other technologies. Also include support the current bigdata platform.The candidate will be working with BI team (4 members) and Data Science team (5 members). Also will be working with other partner teams.Top responsibilities for this position:Develop data engineering solution to support Optum Consumer Offices Data and Analytics, within the Optum Consumer office Databricks environment.Develop SQL and other analytical solution to support BI.Perform validation of data ingestion by EDA team.Work with external teams to identify data opportunities.The ideal candidate background should have:Healthcare experience is preferred, but not mandatory. Looking for a candidate with strong data integration and SQL skills. Look for somebody with good experience in Azure Dataricks platform. Bigdata platform experience is a plus.Required skills/attributes:4+ years Azure/Databricks development environment experience utilizing notebooks4+ years of experience in data engineering and data integration2+ years UNIX or Linux development environment experience2+ years of experience with programming languages (shell scripts, Python, Java/Scala)4+ years of experience with writing SQL queriesExtensive knowledge and experience in data engineering principles and experience in large data integration projects using azure DatabricksExperience in data analysis and provide solutions for complex problemsExtensive knowledge of relational databases principles and structures