Principal Observability Architect

Role Description

We are seeking a highly experienced Principal Observability Architect to lead the design, implementation, modernization, and optimization of enterprise-scale observability and analytics platforms. This role will serve as the technical authority for log management, observability engineering, telemetry pipelines, AIOps, security analytics, and data lakehouse architectures leveraging Splunk, Databricks, Cribl, OpenTelemetry, and cloud-native technologies.

The ideal candidate possesses deep expertise in traditional observability platforms (Splunk, Dynatrace, AppDynamics, ServiceNow ITOM) and modern data lakehouse architectures utilizing Databricks, Delta Lake, Unity Catalog, and AI/ML-driven analytics. This individual will drive the strategic transformation from legacy SIEM and observability platforms toward scalable, cloud-native observability data lakes.

Qualifications

• 10+ years of experience in Enterprise Observability, Monitoring, or Security Analytics.
• 5+ years architecting large-scale Splunk environments.
• 3+ years designing Databricks Lakehouse architectures.
• Experience managing environments exceeding 50 TB/day preferred; 100+ TB/day strongly preferred.
• Experience leading enterprise transformation programs.

Requirements

• Deep expertise in Splunk Enterprise, Splunk Cloud, Splunk ITSI, Enterprise Security, SPL Development, Data Models, Indexer Clustering, Search Head Clustering, SmartStore, Heavy Forwarders, Universal Forwarders.
• Strong experience with Databricks Lakehouse, Delta Lake, Unity Catalog, Delta Live Tables, Structured Streaming, Databricks SQL, Genie, Mosaic AI, Lakehouse Federation.
• Experience with one or more cloud platforms: Microsoft Azure, Amazon Web Services, Google Cloud.
• Strong knowledge of Kafka, OpenTelemetry, OCSF, Iceberg, Spark, SQL, Python, REST APIs, Event Streaming Architectures.

Benefits

• Deliver enterprise observability architecture roadmap within the first 12 months.
• Reduce observability platform costs through modernization initiatives.
• Design and implement a scalable observability data lake architecture.
• Improve telemetry ingestion performance and reliability.
• Enable AI-powered analytics and operational intelligence capabilities.
• Establish enterprise governance standards for observability and security telemetry.
• Support petabyte-scale observability and security analytics workloads.

Ideal Background

Candidates from organizations utilizing large-scale observability environments such as healthcare, banking, retail, telecommunications, logistics, cloud providers, or managed services organizations are highly desirable. Experience supporting environments generating 100TB+ of telemetry per day and integrating Splunk, Databricks, Cribl, OpenTelemetry, and cloud-native data platforms is strongly preferred.