Research Scientist / Engineer - Training Infrastructure

Job Title: Research Scientist / Engineer – Training Infrastructure Position Type: Full time Location: Palo Alto, CA • Remote - US • Remote - International Salary Range: $220,000 - $300,000 (USD) Job ID#: 154559 We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change. We are looking for engineers with significant experience solving hard problems in PyTorch, CUDA and distributed systems. You will work alongside the rest of the research team to build & train cutting edge foundation models on thousands of GPUs that are built to scale from the ground up. Responsibilities Design, implement, and optimize efficient distributed training systems for models with thousands of GPUs Research and implement advanced parallelization techniques (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel) Build monitoring, visualization, and debugging tools for large-scale training runs Optimize training stability, convergence, and resource utilization across massive clusters Requirements Extensive experience with distributed PyTorch training and parallelisms in foundation model training Deep understanding of GPU clusters, networking, and storage systems Familiarity with communication libraries (NCCL, MPI) and distributed system optimization

• Preferred) Strong Linux systems administration and scripting capabilities
• Preferred) Experience managing training runs across >100 GPUs
• Preferred) Experience with containerization, orchestration, and cloud infrastructure

As an Equal Opportunity Employer, IntelliPro values diversity and does not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, genetic information, disability, or any other legally protected group status. Moreover, our Inclusivity Commitment emphasizes embracing candidates of all abilities and ensures that our hiring and interview processes accommodate the needs of all applicants. Learn more about our commitment to diversity and inclusivity at "". Compensation: The pay offered to a successful candidate will be determined by various factors, including education, work experience, location, job responsibilities, certifications, and more. Additionally, IntelliPro provides a comprehensive benefits package, all subject to eligibility. #J-18808-Ljbffr Ipro Networks Pte. Ltd.