清华大学AI开源AKV，基于SGLang的LLM智能体缓存工程服务器
来源标题：Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang
机器译题：清华大学AI开源AKV，一款基于SGLang的LLM智能体缓存工程服务器
Tsinghua researchers released AKV, an SGLang-based serving system for cache engineering. LLM agents drop and reposition KV cache instead of summarizing history, cutting average cost 27.7% across 4 agent benchmarks. The post Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang appeared first on MarkTechPost .