Lead Observability Engineer (Grafana Cloud)

Are you ready to make an impact at DTCC?Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential, building infrastructure capabilities to meet client needs and implementing data standards and governance.Pay and Benefits:Competitive compensation, including base pay and annual incentiveComprehensive health and life insurance and well-being benefits, based on locationPension / Retirement benefitsPaid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).The Impact you will have in this role:Being a member of IT FinSight Delivery team, you will be for an Observability Engineer that will be performing the role for the Observability Engineering team. The team maintains the firm’s application and infrastructure monitoring tools, reporting and analytics tools. This position is primarily for working on monitoring tools like Grafana Cloud (SaaS), Dynatrace, OpenText Operations Bridge Manager and Splunk Cloud. Your Primary Responsibilities:Design and Implementation: Developing and implementing monitoring solutions for applications and infrastructure to ensure high availability and performance.Monitoring and Analysis: Continuously monitoring system performance, identifying bottlenecks, and analyzing trends to proactively address potential issues.Incident Management: Responding to and managing incidents, performing root cause analysis, and implementing corrective actions to prevent recurrence.Collaboration: Working closely with development, operations, and other IT teams to ensure monitoring solutions are integrated and aligned with business needs.Tool Management: Selecting, configuring, and maintaining monitoring tools and platforms, ensuring they are up-to-date and effective.Reporting: Generating and presenting reports on system performance, incidents, and trends for stakeholders.Optimization: Continuously improving monitoring processes and tools to enhance efficiency and effectiveness.Compliance and Security: Ensuring monitoring solutions comply with security policies and regulatory requirements.Working on engineering and development focused projects from start to finish with minimal supervision Providing technical and operational support for our customer base as well as other technical areas within the company that utilize our toolsRisk management functions such as reconciliation of vulnerabilities, security baselines as well as other risk and audit related objectives Administrative functions for our tools such as keeping the tool documentation current and handling service requests 24x7 on-call L3 support on a rotational schedule with other team membersParticipate in user training to increase awareness of observability solutionsEnsuring incident, problem and change tickets are addressed in a timely fashion, as well as escalating technical and managerial issuesFollowing DTCC’s ITIL process for incident, change and problem resolution **NOTE:  The Responsibilities of this role are not limited to the details above. ** Qualifications:Min of 6 years of relevant experienceBachelors’ degree in Computer Science or any technical field and/or equivalent experienceTalents Needed for Success:Minimum of 6 years of experience in IT infrastructure, application monitoring, and performance management.5+ years’ experience of Splunk engineering/support in a production environment. This includes all phases of lifecycle management: planning, design, deployment, upkeep and retirementShould have a developed competency with monitoring solutions in a production environmentMonitoring Tools: Proficiency in using monitoring tools such as Grafana Cloud, Dynatrace, OpenText Operations Bridge Manager, Splunk, and others.Scripting and Automation: Knowledge of scripting languages like Python, Bash, or PowerShell to automate monitoring tasks and processes.Cloud Platforms: Experience with cloud platforms such as AWS, Azure, or Google Cloud, including their monitoring and management services.Networking: Understanding of network protocols, configurations, and troubleshooting.System Administration: Strong background in system administration for both Windows and Linux environments.Database Management: Familiarity with database monitoring and performance tuning.Problem-Solving: Strong analytical and problem-solving skills to identify and resolve issues quickly.Communication: Excellent communication skills to collaborate with different teams and present findings to stakeholders.Attention to Detail: Keen attention to detail to ensure accurate monitoring and reporting.Adaptability: Ability to adapt to new technologies and methodologies in a fast-paced environment.Self-starter, continually striving to improve the teams service offerings and one’s own skillsetThe salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. With over 50 years of experience, DTCC is the premier post-trade market infrastructure for the global financial services industry. From 20 locations around the world, DTCC, through its subsidiaries, automates, centralizes, and standardizes the processing of financial transactions, mitigating risk, increasing transparency, enhancing performance and driving efficiency for thousands of broker/dealers, custodian banks and asset managers. Industry owned and governed, the firm innovates purposefully, simplifying the complexities of clearing, settlement, asset servicing, transaction processing, trade reporting and data services across asset classes, bringing enhanced resilience and soundness to existing financial markets while advancing the digital asset ecosystem. In 2024, DTCC’s subsidiaries processed securities transactions valued at U.S. $3.7 quadrillion and its depository subsidiary provided custody and asset servicing for securities issues from over 150 countries and territories valued at U.S. $99 trillion. DTCC’s Global Trade Repository service, through locally registered, licensed, or approved trade repositories, processes more than 25 billion messages annually. To learn more, please visit us at or connect with us on LinkedIn, X, YouTube, Facebook and Instagram. DTCC proudly supports Flexible Work Arrangements favoring openness and gives people freedom to do their jobs well, by encouraging diverse opinions and emphasizing teamwork. When you join our team, you’ll have an opportunity to make meaningful contributions at a company that is recognized as a thought leader in both the financial services and technology industries. A DTCC career is more than a good way to earn a living. It’s the chance to make a difference at a company that’s truly one of a kind.Learn more about Clearance and Settlement by clicking here.The IT SIFMU Delivery Department supports core Clearing and Settlement application delivery for DTC, NSCC and FICC. The department also develops and supports Asset Services, Wealth Management & Insurance Services and Master Reference Data applications.Full timePosting Date: 2026-04-17