Skip to main content

Module http

Module http 

Source
Expand description

HTTP client for an OpenAI-compatible inference endpoint: large request bodies and long server think times.

Functionsยง

build_http_client
Build a client suitable for multi-KB JSON prompts and slow inference APIs.