Streamdiffusion

A specialized pipeline for real-time interactive image generation achieving throughput exceeding 100 FPS.

StreamDiffusion reengineers the standard diffusion process for ultra-low latency performance. By replacing traditional U-Net iterations with a streamlined Stream Batch strategy and utilizing TensorRT acceleration, it enables seamless 91 FPS generation on an NVIDIA RTX 4090. The architecture supports Rcmm (Residual Classifier-free Guidance) and stochastic similarity filters to maintain temporal consistency during live video-to-video translation. It is the definitive tool for developers building high-speed creative interfaces or live broadcast filters.

https://github.com/cumulo-autumn/StreamDiffusion