mirror of
https://github.com/zhayujie/chatgpt-on-wechat.git
synced 2026-10-26 01:54:36 +08:00
Cache the system prompt and conversation prefix on tool-carrying requests, with a 1h TTL on the shared system + tools prefix (configurable via claude_cache_ttl) and 5m on the conversation tail. Report prompt_tokens as the full prompt including cached tokens. Co-authored-by: cowagent <cow@cowagent.ai>