> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://dev.hume.ai/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://dev.hume.ai/_mcp/server. # Empathic Voice Interface FAQ We’ve compiled a list of frequently asked questions from our developer community. If your question isn't listed, we invite you to join the discussion on our [Discord](https://discord.com/invite/WPRSugvAm6). #### Is EVI multilingual? EVI 4-mini currently supports **English, Japanese, Korean, Spanish, French, Portuguese, Italian, German, Russian, Hindi, Arabic**. EVI 3 only supports **English** and **Spanish**. #### How many concurrent connections does EVI support? **EVI concurrency limits depend on your subscription plan. For the most up-to-date concurrency limits, please visit our [pricing page](https://www.hume.ai/pricing).** EVI is designed to scale seamlessly, and we can support deployments with thousands of concurrent users. If you're on a Business or Enterprise Plan and expect higher usage, feel free to [contact us](https://www.hume.ai/contact) about increasing your limits. #### What language model does EVI use? Our API is based on our own empathic speech-language model and can blend in responses from any external LLM API. Visit our [configuration guide](docs/speech-to-speech-evi/configuration/build-a-configuration#default-configuration-options) for details on Hume's default configuration options. #### How can I use my own API key for the LLM provider? When sending messages through EVI's WebSocket, you can specify your own `language_model_api_key` in the `SessionSettings` message. For more details, see our [API reference](/reference/speech-to-speech-evi/chat#send.SessionSettings.language_model_api_key). #### What do EVI's expression labels and measures mean? These outputs reflect our prosody model's confidence that the speaker is expressing the label in their tone of voice and language. Our prosody model is derived from extensive perceptual studies of emotional expressions with millions of participants. The model is trained to pick up on vocal modulations and patterns in language that people reliably interpret as expressing specific emotions. Importantly, the labels do not imply that the person is *experiencing* the emotions. 1. **Expression labels**: These categories (like "amusement") represent categories of emotional expression that most people perceive in vocal and linguistic patterns. They are not based on explicit definitions of emotions, but rather common interpretations of expressive cues. 2. **Expression measures**: These numbers indicate the model's confidence that a given expression would be interpreted as belonging to a specific category by human observers. They represent the *likelihood* of a particular interpretation of expressions, not the presence or intensity of a specific emotion. For more details, see the foundational research by [Cowen and Keltner (2017)](https://www.pnas.org/doi/epdf/10.1073/pnas.1702247114). #### Why is prosody (tone-of-voice) measured at the sentence level? At the word-level, prosody measurements are highly dependent on context. Our internal testing shows that they are more stable at the sentence level. #### Can EVI integrate with my existing systems? **Yes**! EVI supports [webhooks](/docs/speech-to-speech-evi/configuration/webhooks) and [tool use](/docs/speech-to-speech-evi/features/tool-use) to connect with your databases, APIs, and business logic. This allows you to build voice interfaces that can access real-time information and take actions within your existing infrastructure. #### How do Hume’s speech-language models work? Our speech-language model is a multimodal language model that takes into account both expression measures and language. The speech-language model generates a language response and guides text-to-speech (TTS) prosody. #### Why is EVI so much faster than other LLMs? Hume's speech-language model is not contingent on other LLMs and is therefore able to generate an initial response much faster than existing LLM services. EVI supports integrating other frontier LLMs into its longer responses which are configurable by developers. #### How does EVI work with supplemental language models? EVI uses Hume's speech-language model (SLM) that processes both audio and text input to generate expressive speech output. This model is used for both voice and text generation by default. However, many developers want to use specific frontier LLMs, or their own custom LLM. To enable this, we support supplemental LLMs with EVI, where the process is as follows: 1. EVI transcribes user audio and EVI's prosody model extracts expression measures from the audio 2. The transcribed user message and expression measures (converted to a text format) are sent to the supplemental LLM 3. The supplemental LLM generates a text response, and sends it back to EVI. 4. EVI's speech-language model voices this text, adjusting its tone, expressiveness, speaking rate, and other characteristics based on the text content. This is not just text-to-speech - it takes into account the previous turns, the user's speech, and the expressive context to generate the right voice. One good analogy: think of EVI as a skilled actor "acting out" the text from the supplemental LLM, rather than just a robot producing speech for each word. This system makes EVI interoperable with any LLM, allowing developers to leverage powerful LLMs for text generation while maintaining EVI's expressive voice capabilities. #### Which LLM-specific features are supported with supplemental models? EVI supports features that are common across multiple LLM providers, including: * Temperature (available for all models) * Prompt caching (used for Anthropic and OpenAI models without requiring action from EVI developers) * Tool use (available for Anthropic, OpenAI, and Google models) * System prompts (available for all models) Model-specific features like OpenAI's logprobs and structured output, or Anthropic's model response prefill, are currently not supported to maintain consistency across LLM providers. #### Which supplemental LLM for EVI has the lowest latency? The landscape of large language models (LLMs) and their providers is constantly evolving, affecting which supplemental LLM is fastest with EVI. The key factor influencing perceived latency using EVI is the time to first token (TTFT), with lower TTFT being better. The model and provider combination with the smallest TTFT will be the fastest. [Artificial Analysis](https://artificialanalysis.ai/faq) offers a useful [dashboard](https://artificialanalysis.ai/models#latency) for comparing model and provider latencies. Notably, there's a tradeoff between speed and quality. Larger, slower models are easier to prompt. We recommend testing various supplemental LLM options when implementing EVI. #### Does EVI support TTS? **Yes**! To perform TTS within an EVI chat session, you can follow the steps below: 1. **Establish initial connection**: Make the initial [handshake request](/reference/speech-to-speech-evi/chat) to establish the WebSocket connection. 2. **Send text for synthesis**: Send an [Assistant Input](/reference/speech-to-speech-evi/chat#send.AssistantInput) message with the text you want to synthesize into speech: #### assistant\_input ```json { "type": "assistant_input", "text": "Text to be synthesized." } ``` 3. **Receive synthesized speech**: After sending an `assistant_input` message, you will receive an [Assistant Message](/reference/speech-to-speech-evi/chat#receive.AssistantMessage) and [Audio Output](/reference/speech-to-speech-evi/chat#receive.AudioOutput) for each sentence of the provided text. The `assistant_message` contains the text and expression measurement predictions, while the `audio_output` message contains the synthesized, emotional audio. See the sample messages below: #### assistant\_message ```json { "type": "assistant_message", "id": "g8ee90fa2c1648f3a32qrea6d179ee44", "message": { "role": "assistant", "content": "Text to be synthesized." }, "models": { "prosody": { "scores": { "Admiration": 0.0309600830078125, "Adoration": 0.0018177032470703125 // ... additional scores } } }, "from_text": true } ``` #### audio\_output ```json { "type": "audio_output", "id": "g8ee90fa2c1648f3a32qrea6d179ee44", "data": "" } ``` 4. **End of Response**: Once all the text has been synthesized into speech, you will receive an [Assistant End](/reference/speech-to-speech-evi/chat#receive.AssistantEnd) message indicating the end of the response: #### assistant\_end ```json { "type": "assistant_end" } ``` Before implementing this in code, you can test it out by going to our [Portal](https://app.hume.ai/evi/playground). Start a call in the EVI Playground, then send an Assistant Message with the text you want to synthesize. #### Is it possible to pause EVI responses within a chat? **Yes**, EVI supports pausing EVI's responses. See our [guide on pausing EVI's responses](/docs/speech-to-speech-evi/features/pause-responses) for more details. #### Can I access the transcripts for past conversations with EVI? **Yes!** EVI provides full transcripts, expression measurements, and conversation analytics through our [Chat history API](/docs/speech-to-speech-evi/features/chat-history). These tools help you monitor performance, improve your implementation, understand user satisfaction, and gain insights from interactions at scale. For details and examples, see our [Chat History Guide](/docs/speech-to-speech-evi/features/chat-history). This feature is not available for accounts with the [no data retention](/docs/resources/privacy#zero-data-retention-and-data-usage-options) option enabled. #### Can I access the audio of past conversations with EVI? **Yes**, you can listen to your past conversations with EVI using our audio reconstruction feature. This feature allows you to fetch and play back conversations as single audio files. See our guide for audio reconstruction [here](/docs/speech-to-speech-evi/features/audio-reconstruction). This feature is not available for accounts with the [no data retention](/docs/resources/privacy#zero-data-retention-and-data-usage-options) option enabled. #### Can EVI remember past conversations with the same user? **Yes**! With EVI you can easily preserve context across Chats, allowing you to pick up right where you left off. For more details, see our [guide to resuming chats](/docs/speech-to-speech-evi/features/resume-chats). This feature is not available for accounts with the [no data retention](/docs/resources/privacy#zero-data-retention-and-data-usage-options) option enabled. ---