Back
calc-buffer-size (clj)
(source)function
(calc-buffer-size {:keys [stream_buffer_len max_tokens]})
- Use stream_buffer_len if provided.
- Otherwise, buffer size should be at least equal to max_tokens
plus the [DONE] terminator if it is provided.
- Else fallbacks on ##Inf and use an infinite-buffer instead