Skip to content

Commit

Permalink
Add link to bakllava gguf model
Browse files Browse the repository at this point in the history
  • Loading branch information
abetlen committed Nov 9, 2023
1 parent baeb7b3 commit 8207280
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/server.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,7 @@ You'll first need to download one of the available multi-modal models in GGUF fo

- [llava-v1.5-7b](https://huggingface.co/mys/ggml_llava-v1.5-7b)
- [llava-v1.5-13b](https://huggingface.co/mys/ggml_llava-v1.5-13b)
- [bakllava-1-7b](https://huggingface.co/mys/ggml_bakllava-1)

Then when you run the server you'll need to also specify the path to the clip model used for image embedding and the `llava-1-5` chat_format

Expand Down

0 comments on commit 8207280

Please sign in to comment.