evlli/hass-core
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add ollama context window size configuration (#124555)

Browse source 
* Add ollama context window size configuration

* Set higher max context size
This commit is contained in:
Allen Porter 2024-08-25 12:22:57 -07:00 • committed by GitHub
parent be206156b0
commit 3304e27fa3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 73 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

5
homeassistant/components/ollama/const.py
View file

@ -11,6 +11,11 @@ DEFAULT_KEEP_ALIVE = -1 # seconds. -1 = indefinite, 0 = never
KEEP_ALIVE_FOREVER = -1
DEFAULT_TIMEOUT = 5.0 # seconds
CONF_NUM_CTX = "num_ctx"
DEFAULT_NUM_CTX = 8192
MIN_NUM_CTX = 2048
MAX_NUM_CTX = 131072
CONF_MAX_HISTORY = "max_history"
DEFAULT_MAX_HISTORY = 20