Context Injection

Context injection supplies the model with additional information so it can tailor its responses without the user needing to explicitly instruct EVI.

EVI supports context injection via a Session Settings message. The context field in a Session Settings message allows you to silently add information to the conversation, guiding EVI without triggering a response.

This context is appended to the end of each user_message, ensuring that it is consistently referenced throughout the session.

Injected context can be used to remind EVI of its role, keep important details active in the conversation, or add relevant updates as needed. This method is ideal for adapting EVI’s tone or focus based on real-time changes, helping it respond more accurately without requiring repetitive input from the user.

Injecting context

To inject context, send a Session Settings message with a context object that includes two fields:

• text: The content you want to inject, providing specific guidance for EVI. For example, if the user expresses frustration, you might set the context to encourage an empathetic response.
• type: Defines how long the context remains active. Options include:
  • temporary: Context that is only applied in the preceding assistant response.
  • persistent: Context that is applied to all subsequent messages in the Chat.

Example: Supporting travel planning context

To tailor EVI’s responses for a travel planning scenario, you can inject context at different persistence levels based on user actions and session needs:

1
{
2
  "type": "session_settings",
3
  "context": {
4
    "text": "The user adjusted their time range from Jan 10 - Jan 20 to Jan 14 - Jan 24.",
5
    "type": "temporary"
6
  }
7
}

Clearing injected context

Context you have injected can be cleared by sending a Session Settings message with a context field of null:

1
{
2
  "type": "session_settings",
3
  "context": null
4
}