Skip to content

Commit

Permalink
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Browse files Browse the repository at this point in the history
  • Loading branch information
abetlen committed Nov 9, 2023
2 parents b62c449 + fb1f956 commit baeb7b3
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/server.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ You'll first need to download one of the available function calling models in GG
Then when you run the server you'll need to also specify the `functionary-7b-v1` chat_format

```bash
python3 -m llama_cpp.server --model <model_path> --chat-format functionary
python3 -m llama_cpp.server --model <model_path> --chat_format functionary
```

### Multimodal Models
Expand All @@ -61,7 +61,7 @@ You'll first need to download one of the available multi-modal models in GGUF fo
Then when you run the server you'll need to also specify the path to the clip model used for image embedding and the `llava-1-5` chat_format

```bash
python3 -m llama_cpp.server --model <model_path> --clip-model-path <clip_model_path> --chat-format llava-1-5
python3 -m llama_cpp.server --model <model_path> --clip_model_path <clip_model_path> --chat_format llava-1-5
```

Then you can just use the OpenAI API as normal
Expand Down

0 comments on commit baeb7b3

Please sign in to comment.