A chatbot provider — Provider • ellmer

A Provider captures the details of one chatbot service/API. This captures how the API works, not the details of the underlying large language model. Different providers might offer the same (open source) model behind a different API.

Provider(
  name = stop("Required"),
  model = stop("Required"),
  base_url = stop("Required"),
  params = list(),
  extra_args = list()
)

Arguments

name: Name of the provider.
model: Name of the model.
base_url: The base URL for the API.
params: A list of standard parameters created by params().
extra_args: Arbitrary extra arguments to be included in the request body.

Value

An S7 Provider object.

Details

To add support for a new backend, you will need to subclass Provider (adding any additional fields that your provider needs) and then implement the various generics that control the behavior of each provider.

Examples

Provider(
  name = "CoolModels",
  model = "my_model",
  base_url = "https://cool-models.com"
)
#> <ellmer::Provider>
#>  @ name      : chr "CoolModels"
#>  @ model     : chr "my_model"
#>  @ base_url  : chr "https://cool-models.com"
#>  @ params    : list()
#>  @ extra_args: list()