Tech
[OpenAI] openai 的 cache 是咋计算的呀? input_tokens=cache_write_tokens+3?
这个相差的 3 是啥呀?
第一次写缓存:
{
"input_tokens": 8412,
"input_tokens_details": {
"cache_write_tokens": 8409,
"cached_tokens": 0
}
}
第二、三次命中缓存:
{
"input_tokens": 8412,
"input_tokens_details": {
"cache_write_tokens": 0,
"cached_tokens": 8409
}
}
Read the full discussion on V2EX
This article was aggregated from V2EX. Click to join the conversation.
View on V2EX