Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase llm_max_tokens value #27

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

guygregory
Copy link

@guygregory guygregory commented Jul 25, 2024

Purpose

  • LLM responses were being truncated for common prompt responses, so increasing the value from 100 to 800 tokens to reduce the chance of this happening

Does this introduce a breaking change?

[ ] Yes
[x] No

Pull Request Type

What kind of change does this Pull Request introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

  • Get the code
git clone [repo-address]
cd [repo-name]
git checkout [branch-name]
npm install
  • Test the code

What to Check

Verify that the following are valid

  • ...

Other Information

LLM responses were being cut short for common prompt responses, so increasing the value from 100 to 800 tokens to reduce the chance of this happening
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant