IT-Sr Data

Data EngineerProvide a summary of the project/initiative which describes whats being done? Data Engineer will support the new product initiative. The project has just not yet started and planned to kick off on May 4th. What does the ideal candidate background look like (ex: healthcare specific background, etc.)? Experience Azure developer. Expert in SQL Queries. Experience with Scala/Python. Azure Databricks, CICD, Jenkins GITHUB Healthcare Insurance experience is MUST What experience will set candidates apart from one another? Experience in Azure and data bricks. Excellent in writing/understanding complicated queries. Expert in Scala Are you open to candidates that would need to be 100% remote for the duration of the engagement? Yes. What does the team structure look like - how many members and what is the break-down of the teams skill sets (ex: 1 PM, 4 Developers, etc.)? One Scrum team with 6 team members: 6 Data Engineers (3 Onshore/ 3 Offshore) 2 Data Analyst. What does the interview process look like? a. How many rounds? - 2 rounds - First with Hiring Manager. and Second interview with 3- Tech Leads Group b. Video vs. phone? - Video c. How technical will the interviews be? - Details experience in using Azure Cloud Technologies will be checked with possible hands on query writing and scala code writing Responsibilities: Build and deploy performance and scalable solutions by applying data engineering concepts and development best practices Build scalable and end to end Spark pipelines for large-scale healthcare data Ensure high quality solutions by design and build unit tests, integration test, performance test and user acceptance tests Optimize data pipelines to handle growing data volumes Collaborate on designs for data pipelines and data tooling that meet performance and data quality standards Build methods and tools to automate development activities Ability to prioritize tasks and work concurrently on multiple tasks Participate in business analysis and data discovery to gather data requirements Ability to build complex but compact well performing SQL queries. Required Qualifications: 8+ years of experience in distributed systems, data engineering, software engineering, or similar fields 5+ years of solid coding skills in a language such as Scala, Java, or Python 3+ years of experience with CI/CD development environment 2+ years of experience with Azure Cloud with Databricks technologies (Must be current experience) (No AWS Databricks) Preferred Qualifications: Experience with DevOps, Continuous Integration, and Continuous Delivery Experience developing Java RESTful Services using Spring Boot Experience building and deploying applications to the Microsoft Azure cloud using Infrastructure as Code tools, such as Terraform Experience working in an Agile environment Background in the healthcare industry Expertise with modern programming languages, systems, and architectures Develop analysis and design of transactional systems and/or programs Please note that this is 4 month engagement with possibility of extension if additional funding approved. Software Technology Inc