ComfyStream

ComfyStream is the native, open-source extension that enables real-time video processing by running ComfyUI workflows on live WebRTC streams.

This is a critical tool for low-latency AI video. ComfyStream functions as an extension for ComfyUI (the backend inference engine), taking a video stream as input, processing each frame through a specified workflow, and outputting the result in a new stream (Source: Livepeer Blog). The architecture leverages key components: a ComfyUI Backend, a WebRTC Streaming Layer, and a specialized Optimization Layer. Performance is driven by specifics like a one-step distilled UNet and TensorRT acceleration for faster inference, achieving real-time frame rates. Developed in collaboration with Livepeer, ComfyStream unlocks new possibilities for interactive entertainment, AI-enhanced live performances, and sophisticated, real-time video effects.

https://github.com/yondonfu/comfystream