Principal Automation Engineer

Principal Automation EngineerThe Office of Technology and Innovation (OTI) leverages technology to drive opportunity, improve public safety, and help run better across New York City. From delivering affordable broadband to protecting against cybersecurity threats and building digital government services, OTI is at the forefront of how the city delivers for New Yorkers in the 21st century. At OTI, we offer great benefits, and the chance to work on projects that have a meaningful impact on millions of people. You'll have the opportunity to work with cutting-edge technology and collaborate with other passionate professionals who share your drive and commitment to making a difference through technology.The successful candidate will serve as a Principal Automation Engineer for the Infrastructure Management division and will provide Site Reliability engineering to all current and new automation services, write/update/maintain code, highest point of escalation, lead design sessions manage personal work as well as work of DevOps Engineers. Responsibilities will include:Provide Site Reliability Engineering support for all current and new automation services, ensuring reliability, performance, and uptime targets are met.Write, update, and maintain infrastructure and automation code, including CI/CD pipelines, IaC modules, and monitoring/alerting scripts.Serve as the highest point of escalation for production incidents, lead root cause analysis, and drive resolution for complex platform issues.Lead design sessions for new services, cluster expansions, and platform improvements to align architecture with scalability and security requirements.Plan and prioritize own workload while also managing, coordinating, and reviewing work of other DevOps Engineers to meet delivery timelines.Act as the technical owner for production environments, enforcing standards, documentation, and operational best practices across the team.Handle special projects and initiatives as assigned.Hours/Shift: Day - Due to the technical duties of this position in a 24/7 operation, candidate may be required to work overtime and/or various shifts such as weekends and/or nights/evenings.Work Location: Brooklyn, NYTo Apply: Open to City Employees Only Permanent in this Title Only permanent employees in the title and those that are reachable on the current civil service list are eligible to apply. Please go to and search for Job ID# 789386 * Interested applicants with other civil service titles who meet the preferred requirements should also submit a resume for consideration.Minimum Qualifications: 1. A master's degree in computer science from an accredited college or university and three (3) years of progressively more responsible, full-time, satisfactory experience in Information Technology (IT) including applications development, systems development, data communications and networking, database administration, data processing, or user services. At least eighteen (18) months of this experience must have been in an administrative, managerial or executive capacity in the areas of applications development, systems development, data communications and networking, database administration, data processing or in the supervision of staff performing these duties; or 2. A baccalaureate degree from an accredited college or university and four (4) years of progressively more responsible, full-time, satisfactory experience as described in "1" above; or 3. A four-year high school diploma or its educational equivalent, and six (6) years of progressively more responsible, full-time, satisfactory experience as described in "1" above; or 4. A satisfactory combination of education and experience equivalent to "1", "2" or "3" above. However, all candidates must have at least a four-year high school diploma or its educational equivalent and must possess at least three (3) years of experience as described in "1" above, including the eighteen (18) months of administrative, managerial, executive or supervisory experience as described in "1" above. In the absence of a baccalaureate degree, undergraduate credits may be substituted for a maximum of two (2) years of the required experience in IT on the basis of 30 semester credits for six (6) months of the required experience. Graduate credits in computer science may be substituted for a maximum of one (1) year of the required experience in IT on the basis of 30 graduate semester credits in computer science for one (1) year of the required IT experience. However, undergraduate and/or graduate credits may not be substituted for the eighteen (18) months of experience in an administrative, managerial, executive, or supervisory capacity as described in "1" above.Preferred Skills: The successful candidate should possess the following: - 10+ years of experience in DevOps platform engineering or related field. - Expertise in writing infrastructure-as-code (IaC) using Terraform, including module development and state management. - Experience with AWS, Azure, or Google Cloud Platform (GCP), infrastructure services including virtual networks, storage, and compute resources. - Experience with Kubernetes containerization and orchestration - Familiarity with Jfrog Artifactory and HA configurations, ELK Stack (Elasticsearch, Logstash, Kibana). - Experience with automation tools such as Ansible. Knowledge and experience with the following are also preferred: - OpenShift - Elasticsearch - Ansible Automation Platform - Azure Kubernetes service - Azure storage - Azure networking - Project management - Data processing and data pipelining experience - Logstash and log stash filters - Kafka deployment and support - NSX-T - VMware vSphere55a Program: This position is also open to qualified persons with a disability who are eligible for the 55-a Program. Please indicate at the top of your resume and cover letter that you would like to be considered for the position through the 55-a Program.Public Service Loan Forgiveness: As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at Requirement: New York City Residency is not required for this position.Additional Information: The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.