Projects with this topic
Sort by:
-
Single-header C++17: exponential backoff with jitter, provider failover and a circuit breaker for LLM calls. Part of llm-cpp.
Updated -
Single-header C++17: define a schema, validate model JSON against it, and re-prompt until the output conforms. Part of llm-cpp.
Updated