GPU Performance Engineer

We are Genmo, a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI. Join us in shaping the future of AI and pushing the boundaries of what's possible in video generation.We're seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits.The RoleYou'll be our performance optimization expert, using advanced profiling tools to identify bottlenecks and implementing solutions that achieve 5-10x speedups. From writing custom CUDA kernels to eliminating cold start latency, you'll ensure our infrastructure delivers world-class performance. This role is perfect for someone who gets excited about microsecond optimizations and pushing hardware to its theoretical limits.Key ResponsibilitiesProfile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentationWrite high-performance CUDA and Triton kernels for critical model operationsOptimize cold start latency from seconds to milliseconds for our serving infrastructureTune memory access patterns, kernel fusion, and GPU utilizationCollaborate with ML engineers to optimize model implementationsDebug performance issues across the full stack from application to hardwareImplement custom memory pooling and allocation strategiesShare optimization techniques and build performance culture across teamsQualificationsBachelor's or Master's degree in Computer Science, Electrical Engineering, or related field5+ years systems programming experience with 3+ years focused on GPU optimizationExpert proficiency with GPU profiling tools (Nsight Systems, nvprof)Strong CUDA programming skills with production kernel developmentDeep understanding of GPU architecture (memory hierarchy, SMs, warps)Track record of achieving significant performance improvements (5-10x)Experience with Python and C++ in production environmentsWe ValueExperience with Triton kernel developmentKnowledge of CUTLASS or similar high-performance librariesBackground in ML-specific optimizations (attention, transformers)RDMA/InfiniBand optimization experienceContributions to GPU libraries or frameworksLow-level debugging skills (PTX/SASS reading)Genmo is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Genmo, Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.LocationSan Francisco HQEmployment TypeFull timeDepartmentEngineering