You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is possible to override the default max_tokens_to_sample value (256) by adding a key to the model parameters.
The default model parameters output currently looks like: {"modelId": "anthropic.claude-instant-v1", "temperature": 0}
It is possible to add additional model parameters to this structure, but this max not be obvious to users..
request is to update the default to add max_tokens_to_sample explicitly - like this: {"modelId": "anthropic.claude-instant-v1", "temperature": 0, "max_tokens_to_sample":256}
Making it more obvious that it can be modified.
The text was updated successfully, but these errors were encountered:
It is possible to override the default
max_tokens_to_sample
value (256) by adding a key to the model parameters.The default model parameters output currently looks like:
{"modelId": "anthropic.claude-instant-v1", "temperature": 0}
It is possible to add additional model parameters to this structure, but this max not be obvious to users..
request is to update the default to add
max_tokens_to_sample
explicitly - like this:{"modelId": "anthropic.claude-instant-v1", "temperature": 0, "max_tokens_to_sample":256}
Making it more obvious that it can be modified.
The text was updated successfully, but these errors were encountered: