Balancing Bot ‘Memory’

Ok, so for lack of a better term I had to use memory, sry. Anyway, I noticed that some of the better bots use perhaps too many tokens, because they have the ‘memory’ of a Retriever when it comes to our previous chat history. i mean, literally one I like can barely remember ten prompts back. Any thoughts on this? i was thinking of pruning back some of the detail, to make it a little more general, instead of having several well defined characters, but don’t know.

submitted by /u/sandhill47
[link] [comments]