Software Engineer, AI Infra (Palo Alto)

About the RoleWe are looking for a Staff/Lead Software Engineer, AI Infrastructure, to play a critical role in building and scaling the core infrastructure that powers Pika’s AI capabilities. In this position, you will lead the design and implementation of GPU infrastructure, AI model serving APIs, and general AI infrastructure execution—enabling cutting-edge machine learning features that drive our products.You will be responsible for architecting robust, distributed systems optimized for high-performance AI workloads, large-scale GPU orchestration, and low-latency, reliable API serving. Your work will directly impact the way users experience and interact with generative AI at scale. As a senior technical leader, you’ll also mentor engineers, drive best practices, and set the technical vision for AI infrastructure at Pika.What You’ll DoDesign, develop, and maintain scalable GPU infrastructure for training and serving state-of-the-art AI modelsArchitect and optimize high-throughput, low-latency APIs for AI model serving and inferenceLead the orchestration, scheduling, and efficient utilization of heterogeneous GPU resources across clustersBuild and support robust systems for model deployment, monitoring, scaling, and reliability in production environmentsCollaborate with ML, backend, and platform engineering teams to deliver seamless AI-powered product featuresDrive technical direction, code reviews, and mentorship across the AI Infrastructure teamWhat We’re Looking ForStrong experience (5+ years) as a software engineer working on systems infrastructure, including hands-on work with ML serving and GPU orchestrationDeep knowledge of distributed systems, Kubernetes (or similar orchestration frameworks), and cloud-native infrastructure (AWS/GCP/Azure)Proven expertise in building and optimizing APIs for large-scale AI model serving (TensorFlow Serving, Triton, TorchServe, or similar)Familiarity with the challenges of high-throughput, scalable GPU fleet management, scheduling, and efficient model executionProficiency in backend languages such as Python, Go, or C++, and experience optimizing for performance and reliabilityOwnership mentality and the drive to solve complex problems independently in ambiguous, high-growth environmentsExcellent communication, collaborative, and mentorship skillsNice to HaveExperience with multi-modal AI model infrastructure (LLMs, generative models, video/image/speech models)Background in building infra for multi-tenant SaaS, enterprise AI/ML platforms, or operational automation at scalePrevious startup experience or experience leading high-impact projects through ambiguity and rapid iterationExperience with competitive coding or large-scale distributed computing environmentsWhat We OfferCompetitive salary in the AI industryEquity in a rapidly growing team shaping the future of AIComprehensive health benefits, monthly stipends, and company retreatsA supportive and collaborative office culture—everyone builds, ships, and learns togetherAbout PikaAt Pika, we’re building the infrastructure that empowers everyone to create videos and express ideas through advanced AI. Our team is passionate about removing technical barriers to creativity, and we thrive on working together to solve hard problems. We’re based in Palo Alto, CA, with a collaborative team working in-office 3–5 days a week.Compensation Range: $250K - $350KLocationPalo Alto HQEmployment TypeFull timeLocation TypeOn-siteDepartmentEngineeringCompensationbase salary $250K – $350K