Patch-level CLIP Latents

Bifrost-1: Bridging Multimodal LLMs and Diffusion Models with Patch-level CLIP Latents
a unified framework that bridges multimodal LLMs and diffusion models with patch-level CLIP latents
Han Lin, Jaemin Cho, Amir Zadeh, Chuan Li, Mohit Bansal
Preprint Cite Code Project
Bifrost-1: Bridging Multimodal LLMs and Diffusion Models with Patch-level CLIP Latents