ExternalVendorCode/lollms-webui
1
0
Fork 0
mirror of https://github.com/ParisNeo/lollms-webui.git synced 2024-12-18 20:17:50 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

going from 512 to 2048 context size

Browse Source
This commit is contained in:
saloui 2023-05-05 16:40:08 +02:00
parent f7ff5a777d
commit d6837db9bf
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -197,7 +197,7 @@ On Linux/MacOS more details can be found [here](docs/Linux_Osx_Usage.md)
* `--top-p`: the cumulative probability threshold for top-p sampling (default: 0.90)
* `--repeat-penalty`: the penalty to apply for repeated n-grams (default: 1.3)
* `--repeat-last-n`: the number of tokens to use for detecting repeated n-grams (default: 64)
* `--ctx-size`: the maximum context size to use for generating responses (default: 512)
* `--ctx-size`: the maximum context size to use for generating responses (default: 2048)
Note: All options are optional and have default values.

2
configs/default.yaml
View File

@ -1,6 +1,6 @@
version: 3
config: default
ctx_size: 512
ctx_size: 2048
db_path: databases/database.db
debug: false
n_threads: 8