Header menu logo Nao

VllmConfig Type

Configuration for vLLM-served models (OpenAI-compatible API)

Record fields

Record Field Description

ApiKey

Full Usage: ApiKey

Field type: string option
Field type: string option

BaseUrl

Full Usage: BaseUrl

Field type: string
Field type: string

Model

Full Usage: Model

Field type: string
Field type: string

Static members

Static member Description

VllmConfig.Default

Full Usage: VllmConfig.Default

Returns: VllmConfig
Returns: VllmConfig

Type something to start searching.