Bugfix: Cut message content when exceeding token budget#453

Merged

rhennigan merged 2 commits intomainfrom bugfix/cut-message-content-when-exceeding-token-budget

Nov 13, 2023

+43-11

Commits on Nov 13, 2023

When a message exceeds the remaining token budget, try to reduce its size to get under the limit
rhennigan
committed
Set correct token limit for PaLM
rhennigan
committed