Use Nivana in LibreChat

LibreChat supports custom OpenAI-compatible endpoints in librechat.yaml. Add Nivana as one and every conversation is routed to the best model for each message.

What you need

  • A Nivana API key: sign in, open the account menu and choose API keys. New accounts get 2,000 free credits.
  • The base URL https://nivana.one/v1 and the model name nivana/auto (or nivana/quality, nivana/speed, nivana/cost to lean the router one way).

Set up LibreChat

endpoints:
  custom:
    - name: "Nivana"
      apiKey: "${NIVANA_API_KEY}"
      baseURL: "https://nivana.one/v1"
      models:
        default: ["nivana/auto", "nivana/quality", "nivana/speed", "nivana/cost"]
        fetch: true
      titleConvo: true
      titleModel: "nivana/speed"

Put NIVANA_API_KEY=nvn_sk_… in LibreChat’s .env, restart, and choose Nivana in the endpoint menu.

Limits

Tool calling works: the client’s tools are passed to the routed model, which can call them, and each step is routed on its own. JSON mode and sampling parameters (temperature, max tokens) are ignored, Nivana’s own web search is off when the client sends tools, and very long tool histories are not summarised, so a request larger than every model’s context window fails.

Every response’s model field names the model that actually answered. See the OpenAI-compatible endpoint and how routing works.