shahondin1624/llama.cpp
1
0
Fork 0
Code Issues 2 Pull Requests Actions 3 Packages Projects Releases Wiki Activity

server: implement /models?reload=1 (#21848)

Browse Source
This commit is contained in:
Xuan-Son Nguyen
2026-05-04 16:23:26 +02:00
committed by GitHub
parent d8794eecd5
commit 935a340292
5 changed files with 313 additions and 88 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tools/server/README.md
+5 -1
View File
@@ -1646,7 +1646,11 @@ Listing all models in cache. The model metadata will also include a field to ind
}
```
Note: For a local GGUF (stored offline in a custom directory), the model object will have `"in_cache": false`.
Note:
1. For a local GGUF (stored offline in a custom directory), the model object will have `"in_cache": false`.
2. Adding `?reload=1` to the query params will refresh the list of models. The behavior is as follow:
- If a model is running but updated or removed from the source, it will be unloaded
- If a model is not running, it will be added or updated according to the source
The `status` object can be: