Add option to control KoboldCPP max response tokens#3746

timothycarambat merged 1 commit intomasterMintplex-Labs/anything-llm:masterfrom

3708-bug-when-using-koboldcpp-the-max-response-length-is-always-512-regardless-of-context-sizeMintplex-Labs/anything-llm:3708-bug-when-using-koboldcpp-the-max-response-length-is-always-512-regardless-of-context-sizeCopy head branch name to clipboard