PhD Research Intern, Generalist Embodied Agents Research - Summer 2024

NVIDIA is searching for an outstanding researcher on the topic of Foundation Models for Generalist Embodied Agent Research (GEAR). Everything that moves will eventually be autonomous. ChatGPT unifies all kinds of natural language understanding tasks in a single interface: text in, text out. What is the equivalent for an Embodied Agent? What does it take to build a model that actively explores the world, ingests a multimodal sensory stream, plans over long horizons, acquires new skills, and bootstraps its own capabilities? You will work with an amazing and collaborative research team that consistently publishes influential works on LLMs, multimodal foundation models, AI in gaming, robotics, policy learning, and simulation. Our past projects include Voyager, MineDojo, Eureka, VIMA, MimicPlay, Prismer, and more. Your contributions will have a significant impact on our cutting‑edge research projects and will help shape our products. What you'll be doing: Design and implement novel techniques and methods for LLMs, multimodal models, and embodied agents. Engineer robust infrastructure and data pipelines for scaling up foundation models. Work with product groups to transfer technology. Collaborate with external researchers. What we need to see: Must be pursuing a Ph.D. in Computer Science/Engineering, Electrical Engineering, etc. Outstanding engineering skills for rapid research prototyping, open‑source release, or production development. Experience in Python, C++ and CUDA. Excellent knowledge and hands‑on experience for training LLMs, multimodal foundation models, or large generative models. Experience in reinforcement learning, agent learning, and robotics are desirable. Knowledge of common AI frameworks, such as PyTorch. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA