Skip to main content

Module http

Module http 

Source
Expand description

HTTP client for an OpenAI-compatible inference endpoint: large request bodies and long server think times.

Re-exportsยง

use anyhow::Context; ๐Ÿ”’
use anyhow::Result; ๐Ÿ”’
use std::time::Duration; ๐Ÿ”’

Functionsยง

build_http_client
Build a client suitable for multi-KB JSON prompts and slow inference APIs.