Expand description
HTTP client for an OpenAI-compatible inference endpoint: large request bodies and long server think times.
Functionsยง
- build_
http_ client - Build a client suitable for multi-KB JSON prompts and slow inference APIs.
HTTP client for an OpenAI-compatible inference endpoint: large request bodies and long server think times.