Backend

Stream real-time LLM responses and execute server-side functions through a single, persistent Server-Sent Events connection.

This architecture leverages the Vercel AI SDK to bridge the gap between model generation and backend logic. By using streaming endpoints, the system delivers token-by-token text updates while transparently executing tools (like the 'getWeather' or 'queryDatabase' functions) without breaking the user session. This approach eliminates the 500ms overhead typical of standard REST round-trips: it keeps the UI responsive and the state synchronized. It is the gold standard for building interactive agents that need to act on live data while maintaining a conversational flow.

https://sdk.vercel.ai/docs/ai-sdk-core/tool-calling