# Chat Completions

# OpenAI

# API key

How to get:

  1. Go to OpenAI and sign in.
  2. Use "View API keys" option to create a new API key.

Important!

Lost API keys can't be restored! Make sure to keep it safe!

# Claude

If you have access to Anthropic's Claude API:

  • Select 'Claude' for 'Chat Completion Source'.
  • Input your API key.
  • Click connect.

# Mistral AI

Mistral AI is a team developing both open and proprietary models with high scientific standards and a focus on openness. You can run their models locally or through their API service, La Plateforme.

# API

  • The first step is to create an account on La Plateforme.
  • Once that's done, you can choose a plan and set up your payment information or opt for the Free Tier.
  • Next, you can create your API key. You may need to wait a couple of minutes before the key becomes valid!

Important!
Lost API keys can't be restored! You would have to create a new one. Make sure to keep it safe!

# Proxy

It is possible to configure a proxy/alternative endpoint for OpenAI's backend. This custom endpoint can connect to alternative Chat Completion APIs that support the generic OpenAI API schema.

Examples of backends which implement this API are:

This feature is accessed by:

  • Switching to the 'Chat Completion' API type.
  • Selecting 'OpenAI' for 'Chat Completion Source'.
  • Leaving the details like the API key empty.
  • Opening the 'AI Response Configuration' tab and scrolling down to the 'OpenAI / Claude Reverse Proxy' section.

There you may enter the proxy/custom endpoint and optionally an API key under 'Proxy Password' if needed. For example, TabbyAPI provides you with an API key you have to use.

Back in the 'AI Connections' tab, you can find two optional checkboxes labeled:

  • Bypass API status check.
  • Show "External" models (provided by API).

Checking 'Bypass API status check' tells SillyTavern to stop alerting you about a non-functioning API endpoint. Check this if your API endpoint works, but SillyTavern keeps warning you anyway.

Hint: If it doesn't work, try adding /v1 at the end of the endpoint URL!

Checking 'Show "External" models (provided by API)' will show the external available models as reported by your custom API endpoint in the dropdown (scroll down past OpenAI's models). This allows you to select different API models right from SillyTavern without having to go into your custom app and change the model.

This feature is not required for custom API endpoints to work and might not be available on every backend.