Senior Observability Engineer

Benefits OverviewA career at CoBank can offer you the opportunity to make a personal impact on the people and communities where we do business. In order to be the best, we hire the best!Benefits Offered by CoBankCareers with a purposeTime-Off Packages, 15 days of vacation, 10 paid sick days and 11 paid holidaysCompetitive Compensation & IncentiveHybrid work model: flexible arrangements for most positionsBenefits Packages, including Medical, Dental and Vision coverage, Disability, AD&D, and Life InsuranceRobust associate training and development with CoBank UniversityTuition reimbursement for higher educationOutstanding 401k: up to 6% matching and additional 3% non-elective contribution & Student Loan MatchCommunity Impact: United Way Angel Day, Volunteer Day and Associate Directed ContributionAssociate Resource Groups: creating a culture of respect and inclusionRecognize a fellow associate through our GEM awardsJob DescriptionAre you a seasoned professional with a passion for observability, telemetry, and system reliability? Do you excel in a dynamic, collaborative, and inclusive work environment? At CoBank, we are seeking a Senior Observability Engineer to help design, implement, and scale enterprise observability capabilities across both on-premises and cloud environments. In this role, you will play a key part in defining and advancing CoBank's observability strategy, with an initial focus on instrumentation and telemetry for on-prem systems, evolving into cloud-native observability within AWS. You will partner closely with infrastructure and application teams to enable visibility across systems and services, ensuring reliable, performant, and measurable platforms. As a Senior Observability Engineer at CoBank, you will be responsible for implementing and optimizing observability solutions using platforms such as Splunk and Splunk Observability Cloud, while supporting modern telemetry standards including OpenTelemetry. You will also contribute to building scalable ingestion pipelines, improving signal quality, and enabling actionable insights across infrastructure and applications.Essential FunctionsDesigns, implements, and maintains enterprise observability solutions across on-prem and AWS environments.Develops and enhances monitoring, alerting, logging, and tracing capabilities using Splunk and related platforms.Implements instrumentation standards using OpenTelemetry and other telemetry frameworks.Integrates telemetry from diverse systems (infrastructure, applications, and platforms) into centralized observability solutions.Collaborates with application teams to enable APM, distributed tracing, and performance monitoring.Builds and manages telemetry pipelines and collectors (e.g., OpenTelemetry Collector or similar tools).Monitors system health and proactively identify reliability and performance issues.Optimizes telemetry ingest, data quality, and alert effectiveness to reduce noise and cost.Troubleshoots issues across infrastructure, applications, and observability platforms.Partners with cross-functional teams to establish and promote observability best practices.Stays current with emerging trends and technologies in observability, APM, and SRE practices.EducationHigh school diploma or GED requiredBachelor's Degree in computer science, information systems, or a related discipline preferredWork Experience5 years of experience in DevOps, SRE, cloud engineering, or IT operations required3 years of experience implementing or supporting observability/monitoring solutions requiredHands-on experience with Splunk (search, dashboards, alerting, ingest).Experience with OpenTelemetry or similar instrumentation frameworks.Experience supporting observability across hybrid environments (on-prem and cloud; AWS preferred).Experience integrating telemetry from enterprise systems such as infrastructure platforms, virtualization, or cloud services.Familiarity with telemetry pipelines or aggregators (e.g., OpenTelemetry Collector, Logstash, Fluentd) preferred.Experience supporting application teams with monitoring, APM, and instrumentation preferred.Exposure to open-source observability tools such as Prometheus, Grafana, or ELK stack preferred.Experience with Splunk Observability Cloud, Datadog, Dynatrace, or similar platforms preferred.Experience optimizing telemetry ingest, alerting strategies, or data retention is a plus preferred.Strong problem-solving skills and ability to work in a fast-paced environment preferred.Ability to apply independent judgment on most decisions and work with minimal guidance preferred.Demonstrates strategic thinking and ownership of technical outcomes preferred.Strong collaboration skills across engineering, operations, and development teams preferred.Enhances relationships and builds partnerships with cross-functional teams including infrastructure, application development, and security. Effectively communicates complex observability concepts to technical and non-technical audiences and helps guide teams in adopting best practices.Works on problems of diverse scope where analysis requires evaluation of multiple system signals and telemetry sources. Applies judgment to design scalable observability solutions and adapt existing approaches to improve visibility and reliability. Operate independently, with work reviewed at key milestones.Demonstrates strong knowledge of observability principles including metrics, logs, traces, and alerting strategies. Apply modern practices to improve system insight, performance, and reliability. Resolves complex issues through analysis of telemetry data and contributes to evolving observability standards across the organization.About CoBankThe typical base pay range for this role is between $121,000 - $163,400. Compensation may vary based on individual job-related knowledge, skills, expertise, and experience. This position is eligible for a discretionary annual incentive program driven by organization and individual performance. The listed salary, other compensation and benefits information is accurate as of the date of this posting. This job will be posted for a minimum of five (5) business days or until the position is filled. CoBank reserves the right to adjust compensation for all positions and to modify or discontinue benefits programs at any time in its sole discretion, subject to applicable law.CoBank is a cooperative bank serving vital industries across rural America. The bank provides loans, leases, export financing and other financial services to agribusinesses and rural power, water and communications providers in all 50 states. The bank also provides wholesale loans and other financial services to affiliated Farm Credit associations serving more than 76,000 farmers, ranchers and other rural borrowers in 23 states around the country. CoBank is a member of the Farm Credit System, a nationwide network of banks and retail lending associations chartered to support the borrowing needs of U.S. agriculture, rural infrastructure and rural communities. Headquartered outside Denver, Colorado, CoBank serves customers from regional banking centers across the U.S. and also maintains an international representative office in Singapore.REASONABLE ACCOMMODATIONWe are committed to ensuring that our online application process provides an equal employment opportunity to all applicants, including qualified individuals with disabilities. If you are an applicant with a disability, or are assisting an applicant with a disability, and require accessibility assistance or would like to request a reasonable accommodation for any aspect of the application process, including completing an application, interviewing, or otherwise participating in the employee selection process, please submit a request by emailing View email address on click.appcast.io. Include your contact information and specific details about your requested accommodation.Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.CoBank is an Equal Opportunity Employer.All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, disability, or status as a protected veteran.