Skip to content

Commit

Permalink
fix: change ip address
Browse files Browse the repository at this point in the history
  • Loading branch information
ishaansehgal99 committed Nov 6, 2023
1 parent 5d4f435 commit eecd4f9
Showing 1 changed file with 9 additions and 9 deletions.
18 changes: 9 additions & 9 deletions presets/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,19 +62,19 @@ Replace `<MODEL-VERSION>`, `<YOUR-IMAGE-URL>`, and `<IMAGE-PULL-SECRET>` with yo
Endpoint: ```/``` <br>
Method: GET <br>
Purpose: Check if the server is running. <br>
Example: ```curl http://localhost:5000/```
Example: ```curl http://<SERVICE-IP>:80/```

2. Model Health Check <br>
Endpoint: ```/healthz``` <br>
Method: GET <br>
Purpose: Check if the model and GPU are properly initialized. <br>
Example: ```curl http://localhost:5000/healthz```
Example: ```curl http://<SERVICE-IP>:80/healthz```

3. Shutdown <br>
Endpoint: ```/shutdown``` <br>
Method: POST <br>
Purpose: Shutdown server and program processes. <br>
Example: ```curl -X POST http://localhost:5000/shutdown```
Example: ```curl -X POST http://<SERVICE-IP>:80/shutdown```

4. Complete Text <br>
Endpoint: ```/generate``` <br>
Expand All @@ -95,7 +95,7 @@ curl -X POST \
"max_gen_len": 128
}
}' \
http://localhost:5000/generate
http://<SERVICE-IP>:80/generate
```

### Llama-2-chat Interaction
Expand Down Expand Up @@ -147,7 +147,7 @@ curl -X POST \
]
}
}' \
http://localhost:5000/chat
http://<SERVICE-IP>:80/chat
```
```
curl -X POST \
Expand Down Expand Up @@ -176,7 +176,7 @@ curl -X POST \
}
}
}' \
http://localhost:5000/chat
http://<SERVICE-IP>:80/chat
```
```
curl -X POST \
Expand All @@ -197,7 +197,7 @@ curl -X POST \
]
}
}' \
http://localhost:5000/chat
http://<SERVICE-IP>:80/chat
```
### Falcon
Chat Interaction <br>
Expand All @@ -207,7 +207,7 @@ Purpose: Facilitates chat-based text interactions. <br>

Basic Example - Replace `YOUR_PROMPT_HERE` with your actual prompt:
```
curl -X POST "http://localhost:5000/chat" -H "accept: application/json" -H "Content-Type: application/json" -d '{"prompt":"YOUR_PROMPT_HERE"}'
curl -X POST "http://<SERVICE-IP>:80/chat" -H "accept: application/json" -H "Content-Type: application/json" -d '{"prompt":"YOUR_PROMPT_HERE"}'
```

Advanced Example with Configurable Parameters:
Expand Down Expand Up @@ -240,7 +240,7 @@ curl -X POST \
"forced_eos_token_id":null,
"remove_invalid_values":null
}' \
"http://localhost:5000/chat"
"http://<SERVICE-IP>:80/chat"
```

## Model Parameters
Expand Down

0 comments on commit eecd4f9

Please sign in to comment.