Senior Software Engineer

Responsibilities

• Manage open-weight model serving, including deployment, configuration, cold-start strategy, SLOs, upgrades, and canaries.
• Administer Kubernetes inference and sandbox workloads, including operators, CRDs, autoscaling, GPU scheduling and sharing, and node lifecycle.
• Deploy, back up, scale, and recover vector stores and graph stores with tested restore procedures.
• Own the sandbox runtime and host-side control plane, including lifecycle, execution, snapshots, forks, teardown, metering, and isolation threat modeling.
• Direct FastAPI control-plane services, Terraform/OpenTofu, Bicep, and dashboards.
• Provide the infrastructure layer used by backend services and debug into dependent services when needed.
• Maintain open-source engineering standards through reviewed pull requests, documentation, and reproducible builds.

Requirements

• At least 5 years of experience shipping production systems in Rust or another systems language such as Go, C, C++, or Zig, with willingness to work in Rust.
• Production experience operating Kubernetes workloads, including controllers or operators, scheduling, autoscaling, and node lifecycle.
• Strong ability to threat-model isolation boundaries and apply least privilege, credential isolation, audit trails, and human approval controls.
• Hands-on experience deploying or operating open-weight LLM serving infrastructure such as vLLM or SGLang in reliable, metered production endpoints.
• Experience diagnosing and improving distributed-system performance using measurable latency and optimization results.
• Practical experience with Rust and Tokio, Python/FastAPI, Kubernetes operators, controller-runtime, Kubebuilder, CRDs, KEDA, Karpenter, GPU device plugins, or DRA.
• Familiarity with Firecracker, Kata, gVisor or comparable isolation technologies, secrets management, egress control, vector stores, graph stores, backup, and failover.
• Experience operating across AWS, Azure, GCP, and managed GPU clouds using infrastructure as code and observability tooling.
• Applicants must be authorized to work full time in the United States; employment visa sponsorship is unavailable.

Benefits

• Competitive early-stage startup compensation based on capabilities, experience, and location.
• Bonus eligibility.
• Health insurance with meaningful dependent coverage.
• Flexible paid time off.
• Equity.
• Fully remote culture with teammates in Seattle.
• Travel required twice per year for company summits.