WebSocket support for OpenAI Responses API live on AI Gateway

AI Gateway now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus previous_response_id , instead of re-sending the full context over a fresh HTTP request every turn. OpenAI reports up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls. Route Responses API traffic over WebSocket The Responses route opens at GET /v1/responses and accepts raw response.create frames over a persistent WebSocket connection. The mode is compatible with store=false and Zero Data Retention , and follows OpenAI's WebSocket mode specification upstream. See the AI Gateway documentation for setup and the full route list. Read more