Skip to content

Non-standard parameters and default-parameters

Compare
Choose a tag to compare
@ahyatt ahyatt released this 01 Jun 19:14
· 38 commits to main since this release

With this release, clients can set parameters that are not guaranteed to work with any model, but can be used to set specific parameters that could be unique to a model, when the client knows a specific model will be used. See llm-make-chat-prompt for details.

Clients can also set default chat parameters on models, which will apply to every chat with that model, unless overridden by the prompt parameters.