This workshop explores the challenges and opportunities in designing software system infrastructure for training and serving large-scale AI models. It covers key aspects such as scalability, resource efficiency, system optimization, and deployment strategies, aiming to foster discussions on practical solutions, emerging techniques, and best practices essential for efficient and efficient AI infrastructure.