Skip to main content

Configuration

  • YAML
  • JSON (Deprecated)
config.yaml
models:
  - name: <MODEL_NAME>
    provider: huggingface-inference-api
    model: <MODEL_ID>
    apiKey: <YOUR_HF_TOKEN>
    apiBase: <YOUR_HF_INFERENCE_API_ENDPOINT_URL>