Software / Platform / Data Engineer, Agent Trace Collection

Build an end-to-end system that captures GitHub Copilot CLI agent traces across developer machines, scrubs sensitive content centrally in Azure, and serves a sanitized, queryable dataset for review. You will own the pipeline from the endpoint capture script through Azure ingestion, privacy scrubbing, and the viewer.

• Implement the OpenTelemetry capture path, including endpoint environment-variable and .bashrc configuration, OTLP export, and a collector pipeline with receivers, processors, and exporters.
• Build central Azure ingestion and a privacy-scrubbing layer that detects and redacts secrets and personally identifiable information before reviewers can access data.
• Connect sanitized data stores to a read-only trace viewer that correlates tasks, sessions, and traces.

• Bachelor''s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 5+ years of software, platform, or data engineering experience delivering production systems.
• 3+ years of hands-on Azure experience.
• 2 years of relevant experience with observability, tracing, or telemetry pipelines.
• Ability to independently turn a written design into a working pipeline.
• A privacy-first approach, treating data protection as a hard requirement.

• Remote contract engagement.

$100 per hour.