Staff Engineer, LLM Inference & Production

OpenRelay, Inc. in San Francisco/Seattle is seeking a high-autonomy engineer to own production LLM serving, from problem discovery to production, collaborating directly with the founders to shape technical direction. You will optimize performance, cost, and reliability of models, bring new open-weight models to production, and tune GPU serving with batching, caching, and quantization. You will design routing across replicas andpaces, and push measurable wins in throughput and latency. #J-18808-Ljbffr OpenRelay, Inc.