Multimodal Planning

Training-free Guidance in Text-to-Video Generation via Multimodal Planning and Structured Noise Initialization
Video sketch as a new training-free guidance method for T2V diffusion models
Jialu Li*, Shoubin Yu*, Han Lin*, Jaemin Cho, Jaehong Yoon, Mohit Bansal
Preprint Cite Code Project
Training-free Guidance in Text-to-Video Generation via Multimodal Planning and Structured Noise Initialization