# Instruct Mode

Instruct Mode allows you to adjust the prompting for instruction-following models trained on various prompt formats, such as Alpaca, ChatML, Llama2, etc.

Fully supported. This includes:

• All of the sources under Text Completion
• KoboldAI Classic
• AI Horde

A chosen instruct template must match the expectations of an actual model that is running on a backend.

This is usually reflected in a model card on HuggingFace, and some even provide SillyTavern-compatible JSON files.

Example: NeverSleep/Noromaid-13b-v0.1.1

This is not supported (and not needed) for Chat Completion APIs. They use an entirely different prompt builder.

Exception: OpenRouter with instruct override enabled. This is a legacy setting and will eventually be removed.

While technically supported for NovelAI, none of their models were trained to understand instruct formatting. Kayra uses a special instruct module that is activated automatically when an instruction wrapped in curly braces is encountered in chat messages, so using Instruct Mode for the entire prompt will lead to degraded quality of the outputs.

Here's an example that auto-activates the instruct module for NovelAI:

User: { Write a happy song about Nintendo Switch. }

Provides ready-made presets with prompts and sequences for some well-known instruct models.

Changing a preset resets your system prompt to default! Don't forget to save your preset if you made any changes you don't want to lose.

If toggled, connecting to an API will automatically select this preset if no other presets were triggered by the regex match.

Instruct mode needs to be enabled prior. Only one preset can be marked as default.

If defined as a valid regular expression, when connected to a model and its name matches this regex, will automatically select this preset.

Instruct mode needs to be enabled prior. Only the first regex match across presets will be selected (evaluated in alphabetical order).

Each sequence text will be wrapped with newline characters when inserted into the prompt. Required for Alpaca and its derivatives.

Disable if you want to have full control over line terminators.

If enabled, known {{macro}} substitutions will be replaced if defined in message wrapping sequences.

Also, a special {{name}} macro can be used in message prefixes to reference the actual name attached to a message (rather than a currently active {{char}} or {{user}}), which can be helpful when using group chats or /sendas command. If the name can't be determined, "System" is used as a fallback placeholder.

If enabled, prepend characters and user names to chat history logs after inserting the sequences.

Automatically enabled for group chats and messages sent using personas, unless the Force for Groups and Personas setting is unchecked!

Usually added to the beginning of each prompt. Should define the instructions for the model to follow. Supports substitutions via any of the supported {{macro}} parameters.

For example:

Write one reply in internet RP style for {{char}}. Be verbose and creative.

Define how the System Prompt will be wrapped.

Inserted before a System prompt.

Inserted after a System prompt.

Important: this applies only to the System Prompt itself, not the entire Story String! If you want to wrap the Story String, add these sequences to the Story String template in the Context Template section.

These settings define how messages belonging to different roles will be wrapped upon building a prompt.

All prefix sequences will also be automatically used as stopping strings.

Inserted before a User message and as a last prompt line when impersonating.

Inserted after a User message.

Inserted before an Assistant message and as a last prompt line when generating an AI reply.

Inserted after an Assistant message

Inserted before a System (added by slash commands or extensions) message.

Inserted after a System message.

If checked true, System messages will be using User role message sequences.

Otherwise, System messages use their own sequences (if not empty) or will not do any wrapping at all (if empty).

Various advanced configurations for finer tuning of the prompt building

Inserted before the first Assistant's message.

Only the first message of the chat history counts, not the message that actually goes into the prompt first!

Inserted before the last Assistant's message or as a last prompt line when generating an AI reply.

Not used when generating text in a background (e.g. Stable Diffusion prompts or Summaries). System Instruction Prefix or Regular Assistant Prefix will be used instead.

Inserted as a last prompt line when generating neutral/system text in a background (e.g. Stable Diffusion prompts or Summaries).

Will be inserted at the start of the chat history if it doesn't start with a User message.

Use case: when an instruct format strictly requires prompts to be user-first and have messages with alternating roles only, examples: Llama 2 Chat, Mistral Instruct.

Text that denotes the end of the reply. Also sent as a stopping string to the backend API.

If a stop sequence is generated, everything past it will be removed from the output (including the sequence itself).