Pipecat

Pipecat is the open-source Python framework for building ultra-low-latency, real-time voice and multimodal AI bots that see, hear, and speak.

Pipecat is your go-to open-source Python framework for orchestrating real-time, multimodal conversational AI applications. It directly solves the complex coordination problem of integrating services like Speech Recognition (Deepgram), Large Language Models (OpenAI GPT), and Speech Synthesis (Cartesia) into a single, seamless pipeline. This pipeline architecture ensures ultra-low latency, with typical voice interactions completing in a tight 500-800ms, making conversations feel natural and responsive. Use Pipecat to build everything from phone agents and voice assistants to complex multimodal apps incorporating audio, video, and text.

https://pipecat.ai