Skip to content

Commit

Permalink
Make temperature default to None instead of 0.7
Browse files Browse the repository at this point in the history
This makes it possible to say "use whatever default Poe decides on". Currently
fastapi-poe always sends a default of 0.7, but internally we default to values other than
0.7 for some bots.

There is no internal change needed; the server already allows this value to be None.
  • Loading branch information
JelleZijlstra committed Sep 17, 2024
1 parent 322d279 commit d47d986
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/fastapi_poe/types.py
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ class QueryRequest(BaseRequest):
- `message_id` (`Identifier`): an identifier representing a message.
- `access_key` (`str = "<missing>"`): contains the access key defined when you created your bot
on Poe.
- `temperature` (`float = 0.7`): Temperature input to be used for model inference.
- `temperature` (`float | None = None`): Temperature input to be used for model inference.
- `skip_system_prompt` (`bool = False`): Whether to use any system prompting or not.
- `logit_bias` (`Dict[str, float] = {}`)
- `stop_sequences` (`List[str] = []`)
Expand All @@ -111,7 +111,7 @@ class QueryRequest(BaseRequest):
metadata: Identifier = ""
api_key: str = "<missing>"
access_key: str = "<missing>"
temperature: float = 0.7
temperature: Optional[float] = None
skip_system_prompt: bool = False
logit_bias: Dict[str, float] = {}
stop_sequences: List[str] = []
Expand Down

0 comments on commit d47d986

Please sign in to comment.