Member of Technical Staff (Inference)

Requirements Worked on system optimizations for model serving, such as batching, caching, load balancing, and parallelism , Worked on low-level optimizations for inference, such as GPU kernels and code generation , Worked on algorithmic optimizations for inference, such as quantization, distillation, and speculative decoding, and low-precision numerics , Worked on large-scale inference engines or reinforcement learning frameworks , Worked on large-scale, high-concurrent production serving , Worked on testing, benchmarking, and reliability of inference services What the job involves Optimizing the latency and throughput of model inference , Building reliable production serving systems to serve millions of users , Accelerating research on scaling test-time compute , Model-hardware co-design for next-generation architectures #J-18808-Ljbffr