Observability Engineer

Observability Engineer - Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Observability Engineer

Location: 100% Remote (U.S.)

Position Type: Full-time, Direct W2

Salary Range: $100,000–$160,000 Annually

Experience Required: 12+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary: We are looking for an Observability Engineer to design and operate the metrics, logging, tracing, and alerting platforms that give engineering teams confidence in the systems they run. The role spans the full observability stack — from collection agents and pipelines to long-term storage, dashboards, and alerting workflows — with a strong focus on usability, signal quality, and operational ROI. The ideal candidate has built and operated observability platforms at scale, understands the trade-offs between open-source and SaaS approaches, and can translate noisy telemetry into actionable insight for both engineers and business stakeholders.

Key Responsibilities

• Design and operate enterprise-grade observability platforms covering metrics, logs, traces, events, and synthetic monitoring.
• Architect Prometheus / Thanos / Mimir, Grafana, Loki, Tempo, OpenTelemetry, and Datadog deployments for high availability and scale.
• Develop standards for service instrumentation, including OpenTelemetry adoption, metric naming, label cardinality, and structured logging conventions.
• Define and enforce SLOs, SLIs, and error budgets, and build the dashboards and alerts that operationalize them.
• Build alerting strategies that minimize noise, surface actionable signals, and integrate cleanly with on-call workflows in PagerDuty, Opsgenie, or similar tools.
• Operate large-scale time-series and log storage platforms, balancing retention, query performance, and cost.
• Design distributed tracing pipelines and help teams use traces to diagnose latency and reliability issues.
• Develop self-service tooling, paved-road libraries, and templates that make adoption of observability standards easy for product teams.
• Drive cost management and label-cardinality discipline across the observability estate.
• Lead incident response readiness improvements through better dashboards, alerting hygiene, and post-incident analysis tooling.
• Partner with SRE and platform teams to integrate observability into deployment pipelines, canary analysis, and progressive delivery workflows.
• Evaluate and recommend observability vendors and open-source tools based on cost, capability, and operational maturity.
• Mentor engineering teams on observability fundamentals, debugging techniques, and SLO-driven operations.
• Maintain documentation, onboarding guides, and runbooks for the observability platform.

Required Qualifications

• Bachelor’s degree in Computer Science or a related field.
• Ten or more years of experience in SRE, platform engineering, or observability roles.
• Deep hands-on experience with Prometheus, Grafana, and at least one major commercial observability platform such as Datadog, New Relic, or Splunk.
• Strong understanding of OpenTelemetry, distributed tracing, and structured logging.
• Proficiency in at least one general-purpose language such as Go, Python, or Java.
• Experience operating high-cardinality, high-throughput metrics and log pipelines.
• Strong understanding of SLOs, error budgets, and SRE principles.
• Experience integrating observability with CI/CD and incident management tooling.
• Solid grasp of Linux internals, networking, and container platforms.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience with Thanos, Mimir, Cortex, Loki, or Tempo at scale.
• Contributions to OpenTelemetry or observability open-source projects.
• Familiarity with eBPF-based observability tooling.
• Experience driving observability cost optimization initiatives.
• Exposure to regulated environments with audit-grade logging requirements.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.