This helper function makes it easier to create a list of parameters used across many models. The parameter names are automatically standardised and included in the correctly place in the API call.
Note that parameters that are not supported by a given provider will generate a warning, not an error. This allows you to use the same set of parameters across multiple providers.
params(
temperature = NULL,
top_p = NULL,
top_k = NULL,
frequency_penalty = NULL,
presence_penalty = NULL,
seed = NULL,
max_tokens = NULL,
log_probs = NULL,
stop_sequences = NULL,
...
)
Temperature of the sampling distribution.
The cumulative probability for token selection.
The number of highest probability vocabulary tokens to keep.
Frequency penalty for generated tokens.
Presence penalty for generated tokens.
Seed for random number generator.
Maximum number of tokens to generate.
Include the log probabilities in the output?
A character vector of tokens to stop generation on.
Additional named parameters to send to the provider.