Tech Lead - Network Observability
$180k - $260kClockwork.io
Job Description
Job Description
About Clockwork Systems
Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization
Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.
To learn more, visitAbout the Role
We are seeking an experienced Tech Lead to lead the architecture, development, and scaling of a high-performance network monitoring and observability platform. This role will focus on building systems that provide deep visibility into RDMA, RoCE, InfiniBand, and TCP/IP networks. The ideal candidate has strong experience in distributed systems, Linux networking, and modern observability stacks (e.g., Grafana/Prometheus).
What You Will Do- Lead architecture, design, and development of scalable network monitoring platforms for high-performance RDMA, RoCE, InfiniBand, and TCP/IP infrastructure.
- Build backend telemetry services, observability dashboards, alerts, diagnostics, anomaly detection, SLA monitoring, and traffic analysis workflows.
- Troubleshoot complex production issues across application, OS, server, RDMA, and network layers while optimizing low-latency collection, aggregation, and alerting.
- Establish engineering standards, drive automation, define technical roadmaps with cross-functional teams, and mentor engineers on distributed systems and high-performance networking best practices.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
- Strong hands-on programming experience in C++, Go, Python, Rust, or similar systems programming languages.
- Proven experience leading engineering teams, major technical initiatives, or complex infrastructure projects.
- Experience building distributed systems, backend services, telemetry pipelines, or observability platforms.
- Hands-on experience with RDMA, RoCE, InfiniBand, or other high-performance network fabrics.
- Familiarity with libibverbs, RDMA verbs, RDMA CM, queue pairs, completion queues, memory registration, and related RDMA concepts.
- Strong knowledge of Linux networking, TCP/IP, DNS, routing, MTU, congestion control, packet loss, latency, and performance tuning.
- Experience with traceroute-style diagnostics, path discovery, network reachability checks, synthetic probes, or active network measurements.
- Experience with monitoring and visualization platforms such as Prometheus, Grafana, Datadog, Splunk, OpenTelemetry, or similar tools.
- Strong debugging skills across software, operating system, server, and network layers.
- Experience operating production systems in Linux-based environments.
- Strong architectural judgment and ability to design systems for reliability, scalability, and operational simplicity.
- Experience supporting AI/ML, HPC, storage, or GPU cluster infrastructure workloads.
- Experience with large-scale RoCE or InfiniBand deployments.
- Experience with NCCL, distributed training infrastructure, or AI cluster diagnostics.
- Experience with eBPF, XDP, DPDK, perf, tcpdump, Wireshark, ethtool, iproute2, rdma-core, or Linux kernel networking tools.
- Experience with cloud infrastructure on AWS, GCP, or Azure.
- Experience with Kubernetes, service discovery, configuration management, and infrastructure automation.
- Knowledge of security, compliance, and infrastructure best practices.
- Experience designing time-series data systems, alerting pipelines, or high-cardinality telemetry platforms.
Enjoy
- Challenging projects.
- A friendly and inclusive workplace culture.
- Competitive compensation.
- A great benefits package.
- Catered lunch.
Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $180,000 - $260,000. The offered compensation package may also include stock options or other equity awards, subject to Clockwork's equity program and applicable approvals
In addition to cash compensation, this role is eligible to participate in the company's equity program , which may include stock options granted in accordance with the company's equity plan and subject to approval and applicable vesting schedules.
Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.
$180k - $260k
...to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems,... ...looking for a passionate and experienced Tech Lead - Frontend / Full Stack to join our... ...and turning complex infrastructure and network data into clear, intuitive visual experiences...Network$235k - $295k
...of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above....NetworkWorldwide- Acryl Data seeks a Site Reliability Engineering (SRE) Tech Lead to enhance the reliability and scalability of its DataHub platform. The role involves leading infrastructure design, optimizing system performance, and driving continuous improvement across cloud deployments...Suggested
- ...infrastructure used for hardware-in-the-loop (HIL) testing. Monitor the overall health of test devices and infrastructure; perform basic network/power troubleshooting, maintain device logs, and escalate complex hardware issues. Configure and manage embedded devices via...NetworkLocal areaRemote work
- Tesla is seeking a hands-on Tech Lead in Palo Alto to build next-generation server-side systems for Robotaxi and Optimus. You will work... ...services and play a vital role in scaling the Tesla robotaxis network. Candidates should have a Bachelor's in Computer Science and 3+...Network
- Gravity Engineering Services Pvt Ltd. is seeking a Staff Technical Lead Manager for our ML Evaluation team in Mountain View, California.... ...collaborating with modeling teams to validate deep neural networks. The successful candidate will bring 5+ years of experience in building...Network
$262k - $365k
...of experience in software development. 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure... ...retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural...NetworkFull time$262k - $365k
...algorithms. 5 years of experience in a technical leadership role leading project teams and setting technical direction. 3 years of... ...retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language...Network$224k - $356.5k
...Software Developer or manager to serve as Tech Lead in our team in Santa Clara. The NVLink team develops the firmware and network OS (NVOS) for NVLink, NVIDIA’s networking... ...base. Establish guidelines for evaluation, observability, and continuous improvement of our networking...Network- ...and most influential companies. As a Lead Infrastructure Engineer at JPMorganChase... ...infrastructure engineering such as hardware, networking terminology, databases, storage... ...including compute, databases, messaging, observability, and telemetry Knowledge of incident,...NetworkPermanent employment
- ...echelon in site reliability. As a Senior Lead Site Reliability Engineer at JPMorgan... ...with others to create and implement observability and reliability designs for complex systems... ...engineering community, and continues to expand network and leads evaluation sessions with...Network
- ...platforms and services that improve how complex infrastructure is observed, understood, and operated. You bring experience developing... ...systems, orchestration platforms, compute infrastructure, storage, networking, cloud services, and business-critical enterprise platforms....Network
- ...managed solution with AI-powered discovery, observability, and governance capabilities.... ...experienced Site Reliability Engineering (SRE) Tech Lead to join DataHub and drive the... ...deployment automation ~ Strong knowledge of networking, security, and database operations in cloud...NetworkWork at officeHome officeFlexible hours3 days per week
- ...the limits of what's possible. As a Lead Software Engineer at JP Morgan Chase within... ..., IaaS, storage, security, and networking concepts. Preferred qualifications, capabilities... ...Dynamo Inference). Familiarity with observability tools such as Prometheus and Grafana....Network
- DeepRec.ai in Palo Alto, CA is seeking a Technical Lead to design and build core systems for a modern AI platform. This hands-on... ...backend design, write production-grade code, contribute to architecture, and improve observability and performance. #J-18808-Ljbffr DeepRec.ai
- ...notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase... ...Dynamo Inference). Proficiency with observability tools like Prometheus and Grafana. Experience... ...Ray.io, Slurm). Strong knowledge of network architecture, database programming (SQL/...NetworkFor contractors
- Role Overview Own and build the full diagnostic, observability, and RCA infrastructure that makes Sage Care’s AI assistant Role Overview Own and build the full diagnostic, observability, and RCA infrastructure that makes Sage Care’s AI assistant trustworthy and debuggable...Immediate start
- ...learn from real-world usage. This role owns the systems that make that possible. What You’ll Do Own the feedback, evaluation, and observability layer for production AI agents Build systems to detect, diagnose, and resolve failures at scale Design evaluation frameworks...3 days per week
- ...auditability and forensic visibility for user and system actions Lead threat modeling across infrastructure, product, and research... ...how services, automations, or models are scoped, constrained, and observed You think in terms of systems and trust boundaries You have high...
$145.83k - $219k
...designing systems that support autonomous vehicle operations, ensuring reliability and operational readiness through automation and observability. The ideal candidate will have experience in software development, debugging, and a passion for reliability engineering....$248k - $396.75k
...discipline which demands knowledge across different systems, networking, coding, database, capacity management, continuous delivery and... ...support operational and reliability aspects of large scale Observability & Telemetry collection platform with a focus on performance at...Network- Snap Inc. seeks an L6 Staff Tech Lead to design, build, and scale the Service Infrastructure powering Snap’s backend across Stories,... ...approach. You will mentor engineers, improve reliability and observability, and drive platform cost efficiency while collaborating with...
$150k - $230k
...to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload... ...We are seeking a Senior Engineer to lead development of our Core ClockSync... ...the intersection of distributed systems, networking, and systems engineering to ensure correctness...Network$160k - $210k
...sharing using Microsoft Fabric and Delta Sharing protoco lsManage network security including private endpoints, NAT Gateway... ...Kubernetes and container orchestrati onExperience with monitoring and observability tools (Datadog, Azure Monito r)Previous experience building multi...NetworkLive inFlexible hours$224k - $431.25k
...is seeking a Senior Software Developer or manager to serve as Tech Lead in Santa Clara. This role involves spearheading the development... ...have over 12 years of software development experience, strong networking knowledge, and proficiency in embedded C/C++ and Python. The...Network$118k - $170k
...to have a genuine connection with the work you do. At Ruckus Networks, you will work on large-scale cloud networking platforms that... ...customers globally. You will help improve reliability, automation, observability, and customer experience while working with modern cloud and...NetworkWork at officeRelocation3 days per week- ...Reliability Engineer in Mountain View, California. The role emphasizes improving system reliability through defining SLOs, implementing observability stacks, and automating processes. The ideal candidate will possess over 3 years of relevant experience, particularly in using...
- ...in Palo Alto, California. The role focuses on defining SLOs, enhancing system reliability through engineering, and implementing observability stacks using Kubernetes, Prometheus, and Grafana. The ideal candidate has 3+ years of experience and strong programming skills for...
$228k - $242k
...designed to be easy to integrate into existing delivery and logistics networks, offering a scalable drone delivery solution for a broad range... ...a highly motivated and experienced Reverse Logistics Technical Lead to join our Global Central Operations team in Palo Alto, CA . In...NetworkLocal area$150k - $260k
...teams to define APIs and product surfaces Improve reliability, observability, and UX around blockchain interactions Help shape product... ...events & culture Compensation The base pay range for this role is $150,000 - $260,000 per year. #J-18808-Ljbffr Crypto Pro NetworkNetworkContract workTemporary workWork at officeWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead - Network Observability. Be the first to apply!
- technical leader Palo Alto, CA
- technical lead Palo Alto, CA
- network operations center manager Palo Alto, CA
- network contractor Palo Alto, CA
- network operations center Palo Alto, CA
- director network services Palo Alto, CA
- networking Palo Alto, CA
- cloud network engineer Palo Alto, CA
- computer network Palo Alto, CA
- food network Palo Alto, CA


