HPC Applications Engineer

HPC Infrastructure EngineerMass General Brigham Division of Research IS & Computing, Enterprise Research Infrastructure and Services is seeking an HPC Infrastructure Engineer. This position works within multi-disciplinary teams that build data processing pipelines, computational-based analytics jobs and web-based reporting tools. Using your knowledge of distributed computing systems, you will specialize in data analytics platforms (HPC) and data science methods to facilitate healthcare research. Primarily this role will support researchers in developing pipelines on the ERISOne HPC Linux Cluster and ERISXdl Linux GPU Cluster providing all users with both implementation and consultation aspects.We are seeking someone with the proven ability to help teams and projects successfully accomplish their technology objectives. Key characteristics are an eagerness to learn and apply new technologies, versatility, and breadth in technical skills, and communication and customer service skills. Candidates are not expected to be deeply knowledgeable in all areas but must demonstrate the ability and desire to learn and to support a large and diverse environment in its use of technology. Ideal candidates thrive on variety and innovation in their daily work, on interaction with customers who are world-renowned leaders in their scientific field, and on working with a wide range of technologies in a decentralized non-standard environment (academic).Principle Duties and Responsibilities:Design architecture, and deploy hardware and/or cloud solutions for research scientific computing. This includes CPU and GPU-based compute, high-speed networking and data storage.Configuration and deployment of all server updates, security patches, tools, drivers, etc. transitioned from Service Design/Architecture.Manage and configure Slurm/LSF job scheduling parameters for equitable resource sharing and optimum throughput.Maintain and extend our scientific software catalog - working closely with our research community to build workflows and pipelines.Perform project-related monitoring, technical support, and troubleshooting of server systems.Creates/Executes/deploys scripts, tools, and server builds for IT Infrastructure.Technical consultation on projects; and vendor escalation when warranted.Maintain all relevant documentation for administration procedures.Develop, publish, and maintain knowledge base articles and documentation on system features, and usage as well as training and reference materials for the community using the Confluence and Jira tools.Provisioning services, such as quoting, ordering, tracking, and installation of new equipment.Use the Mass General Brigham values to govern decisions, actions, and behaviors. These values guide how we get our work done: Patients, Affordability, Accountability & Service Commitment, Decisiveness, Innovation & Thoughtful Risk; and how we treat each other: Diversity & Inclusion, Integrity & Respect, Learning, Continuous Improvement & Personal Growth, Teamwork & Collaboration.Other duties and responsibilities as assignedQualifications:BA/BS/engineering degree required or equivalent combination of skills/experience. Advanced degree in engineering or related scientific discipline preferred. 8+ years in managing/administering Linux server environments. Preferred experience within scientific computing. 2+ years managing computational clusters, HPC and/or grid computing environments. 5+ years experience with server deployment technologies (Ansible). Highly desired:Experience with cloud technologies (AWS, GCP)Experience with one or more scripting technologies (Shell scripting, Python).A combination of education and experience may be substituted for requirementsSkills/Abilities:Demonstrated ability in providing Linux systems administration in a large-scale environment, including AufoFS,PAM, SSSD, LDAP integration and single sign-on.Experience with at least one cluster scheduling system (LSF, Slurm).Knowledge of Docker, Singularity and Kubernetes primitives and architecture.Proficiency with remote access technologies and tools such as SSH and RDP.Experience with monitoring software such as Graphana and Prometeus.AWS cloud technology knowledge and implementation for HPC requirements.Understanding of common network protocols like DHCP, DNS, TCP/IP.Experience providing support to research investigators with diverse computing needs is highly desired.Knowledge of Ansible management software, similar configuration management tools, and cloud computing platforms is highly desirable.Deep knowledge of information technology security and data privacy considerations applicable to a healthcare environment.Experience in an agile, rapid support environment is desirable.Ability to multitask and prioritize work requirements, keeping team and management informed.Excellent communication and interpersonal skills to effectively communicate with cross-functional teams including staff at all levels of the organization including both technical and non-technical personnel.