FramePack: Revolutionizing Video Generation Through Next-Frame Prediction

11 days ago 高效码农

Introduction to FramePack FramePack is an open-source video generation framework developed to address the computational challenges of long-form video synthesis. Unlike traditional video diffusion models that struggle with memory constraints as video length increases, FramePack introduces a novel next-frame(-section) prediction architecture that maintains constant memory usage regardless of video duration. This breakthrough enables users to generate multi-minute videos on consumer-grade GPUs with as little as 6GB VRAM. The system’s core innovation lies in its context compression mechanism, which intelligently packages historical frame data into fixed-length memory packets. This approach allows FramePack to achieve comparable batch sizes to image diffusion models …