Remote Staff Data Engineer

Staff Data EngineerAt IMO, a core team of clinicians, software developers, and data scientists combine computer science and medical expertise to help patients and healthcare professionals access high quality health information quickly and easily to improve total patient health. We are currently in need of a Staff Data Engineer to join this team! The Staff Data Engineer will support our software developers, data architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives. Join our growing Software Engineering department as a Staff Data Engineer to help design, create, and support high quality solutions that support 80% of US clinicians and build the application of Data Engineering within IMO!Position Responsibilities:Leads work to create and maintain optimal data pipeline architecture for IMO Data Platform.Leads work to assemble large, complex data sets that meet functional / non-functional business requirements.Leads work to identify, design, and implement internal process improvements in automating manual processes, optimizing data delivery and performance, re-designing data pipeline infrastructure for scalability, availability and reliability, etc.Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.Builds analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.Leads and facilitates work with stakeholders including the Executive, Product, Architecture, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.Keeps our data separated and secure across national boundaries through multiple data centers and AWS regions.Creates data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.Works on a Scrum team with data and analytics experts to strive for greater functionality in our data systems.Leads vendor product evaluations and current technology assessment to make recommendations appropriate tools.Supports the Product Owner and the team with technical solutions to fulfill business needs and ensure technical viability.Supports efficient estimation of technical work for product change requests to assist Product Owner in planning.Champions team’s adherence to technical standards and ensures alignment with architectural direction.Leads discovery of the team's tech debt and collaborates with team to continuously minimize it.Leads and coordinates incident resolution, root cause analysis, and capture of preventative actions.Collaborates with Architecture to support technical roadmaps and POCs for the team.Actively collaborates across the Product Group to understand technical problems and solutions.Works cooperatively with team members to manage conflict constructively and fosters trust, commitment, accountability.Mentors colleagues’ technical development into generalized specialists.Delivers quality product leveraging the values of transparency, inspection and adaptation in an agile way.Takes ownership to proactively anticipate the implications and consequences of situations and acts appropriately to make decisions.Implements creative solutions to technical challenges and embraces out-of-the-box thinking to apply knowledge and learning from various disciplines to create new or improve existing products.Position Requirements:A relevant technical BA/BS Degree and five years of experience, or seven years of relevant professional experience implementing well-architected data pipelines that are dynamically scalable, highly available, fault-tolerant, and reliable for analytics and platform solutions.Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with non-relational databases at Enterprise scaleExperience building and optimizing ‘big data’ data pipelines, architectures and data sets.Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify opportunities for improvement, troubleshooting and data tracing from source to output.Strong analytics skills related to working with unstructured datasets at high volume and velocity.Builds processes supporting data transformation, data structures, metadata, dependency, and workload management.A successful history of manipulating, processing and extracting value from large disconnected datasets.Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores integrating with event-driven data streams.Experience with big data tools, such as Spark, Kafka, RabbitMQ etc.Experience with relational SQL and NoSQL databases, such as PostgreSQL, DynamoDB, MongoDB and Elasticsearch.Experience with ETL and BI Dashboard tools, such as Talend, Informatica, Tableau, Looker, etc.Experience with data pipeline and workflow management tools, such as Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services such as EC2, EMR, RDS, Redshift.Experience with stream-processing systems, such as Storm, Spark-Streaming, etc.Experience with object-oriented/functional scripting languages, such as Python, Java, C++, Scala, etc.Strong experience with agile development incorporating Continuous Integration and Continuous Delivery (CI/CD), utilizing technologies such as GIT, Jenkins, Terraform.Experience supporting and working with cross-functional teams in a dynamic and agile environment. Software Technology Inc