Data Engineer

The Pathology Department is seeking a Data Engineer I to assist with the creation and maintenance of complex data pipelines from raw acquisition of data to visualization. The Data Engineer I will support the design, production, and maintenance of software infrastructure to automatically extract, transform, and load data from diverse sources. The Data Engineer I will help input/output data from databases and realize complex queries. The Data Engineer I will support the creation of scripts for data manipulation, cleaning, filtering, and preparation of data outputs to be used for data visualization or web display. This will also include creating parts of systems to monitor and guarantee data quality, perform daily data quality assurance tasks, maintain, and troubleshoot the infrastructure, and audit data sources. The Data Engineer I will help explore and analyze data to answer policy-related questions as needed. Specific Duties & Responsibilities Assist with the design, production, and maintenance of data pipelines for data acquisition, management, and transformation, and back-end code development to power data web applications and convert raw data into usable information. Contribute to writing and maintenance of ETL/ELTs that operate on a variety of structured and unstructured sources. Assist with the development and maintenance of web data scraping systems for automatic data acquisition. Assist design data architecture and provide ongoing support. Assist with input/output data from databases and perform queries. Assist in the creation of scripts to clean, transform, and analyze data. Contribute to production data pipelines using data warehousing systems. Create and implement production software to monitor data quality and detect data anomalies. Perform daily manual data quality assurance tasks. Support, maintain, and troubleshoot the software infrastructure. Source data, conduct analyses, visualize data, and generate insights to support ongoing research projects and other requests across the organization. Assist developers, analysts, data scientists, researchers, policy experts, and other partners. Communicate with division leadership, and others on the team. Collaborate with external partners, contractors, and vendors. Other duties as assigned. Minimum Qualifications Bachelor’s Degree. Three years of related experience. Additional education may substitute for required experience, and additional related experience may substitute for required education beyond a high school diploma/graduation equivalent, to the extent permitted by the JHU equivalency formula. Preferred Qualifications Technical Skills & Expected Level of Proficiency Data Pipeline Architecture & ETL/ELT Development - Intermediate Database Querying - Intermediate Data Tools and Platforms - Intermediate Data Validation and Quality Assurance - Intermediate Data Warehousing & Architecture - Intermediate Project Management - Intermediate Programming Languages - Intermediate Troubleshooting - Intermediate Web Scraping and Data Acquisition - Intermediate #J-18808-Ljbffr