Changelog

May 24, 2024

EVI API additions

  • Added support for streaming custom language model responses in parts. Developers can send text chunks to start generating audio responses much faster. The Custom Language Model endpoint now expects text to be formatted in the following payload:

    # send this to add text
    {"type": "assistant_input", "text": "<chunk>"}
    # send this message when you're done speaking
    {"type": "assistant_end"}
  • Added support for pausing and resuming EVI responses with with pause_assistant_message and resume_assistant_message. Sending a pause message stops EVI from generating and speaking Assistant messages. Sending a resume message allows EVI to continue responding to the User messages.

EVI API modifications

  • Increased the limit for tool descriptions from 100 chars to 512 chars
  • Set the maximum length for tool_name to 64 chars

May 17, 2024

EVI API additions

  • Added support for built-in tools, starting with web search: Using built-in tools
  • Added support for phone calling through a Twilio integration: Phone calling
  • Added DACHER voice to the voice configuration options
  • Added support for the gpt-4o language model

EVI API modifications

  • Increased the limit for tool descriptions from 100 chars to 512 chars

May 10, 2024

EVI API additions

  • Added support for three open-source models through the Groq language model provider: Gemma 7B (gemma-7b-it), Llama 3 8B (llama3-8b-8192), and Llama 3 70B (llama3-70b-8192)
  • Added support for Llama 30 70B language model through the Fireworks language model provider (accounts/fireworks/models/llama-v3-70b-instruct)
  • Added a custom_session_id field in the SessionSettings message, and documentation for using it: Custom Session ID

EVI API modifications

  • Disabled short response generation for custom language models
  • Added error codes for when Hume credits run out while using EVI. Users will receive either the E0300 error code if they are out of credits or E0301 if they are blocked via subscription. The WebSocket connection will also be closed with code 1008

Bugs bashed

  • Fixed an issue with the from_text field in UserMessage. It is now set to True if any part of the UserMessage is from a developer-provided UserInput message

May 3, 2024

EVI API additions

  • Added support for Tools through our tool use feature
  • Added ToolErrorMessage as a supported input type

Bugs bashed

  • Added an error that returns status 400 if a Config, Tool, or Prompt is created with a name or versionDescription that’s too long or non-ASCII. Names must be under 75 chars, versionDescription must be under 256 chars, description for Tools must be under 100 chars, fallback_content for Tools must be under 2048 chars, and model_resource for LanguageModels must be under 1024 chars
  • Fixed several edge cases and bugs involving Tool calls, including supporting only single tool calls with EVI (no parallel tool calling)

April 30, 2024

EVI API additions

  • Added support for reading language model type from EVI configs
  • Added support for reading language model temperature from EVI configs
  • Added system prompt to SessionSettings message to allow dynamic prompt updating

EVI API changes

  • Renamed TextInput message to UserInput to indicate this is text to be added to the chat history as a User message and used as context by the LLM
  • Renamed TtsInput message to AssistantInput to make it clear that this is input text to be spoken by EVI and added to the chat history as an Assistant message
  • Moved audio configuration options to SessionSettings message

Bugs bashed

  • Fixed chats staying open after errors, chats will now end upon exceptions
  • Added an error thrown if config uses both custom_model and prompt, because custom language models do not use prompts
  • Fixed issue where erroring when sending errors would cause the API to get stuck
  • Added clearer errors for custom language models
  • Added unable to configure audio service error
  • Added an error to invalidate outdated language model responses
Was this page helpful?