Our Platform

Overview

The Hume AI Platform can be applied to almost any application that has language, speech, images, or video of people. We offer a spectrum of models of nonverbal behavior and psychometrics that are complementary to large language models, offering a new window into the half of human communication that isn’t explicitly represented in words. Our APIs are provided for purposes of (1) scientific research and (2) the development of applications that respond to human expressive behaviors in keeping with ethical guidelines and scientific best practices.

Models

Currently, our models measure:

  • Speech prosody, or the non-linguistic tune, rhythm, and timbre of speech, which spans at least 18 distinct dimensions of meaning.
  • Emotional language, or the emotional tone of transcribed text, along 53 dimensions.
  • Facial expressions, including subtle facial movements often seen as expressing love or admiration, awe, disappointment, or cringes of empathic pain, which span at least 28 distinct dimensions of meaning.
  • Vocal bursts, including laughs, sighs, huhs, hmms, cries and shrieks (to name a few), which span at least 24 distinct dimensions of meaning.

These behaviors are complex and multifaceted. ​​To learn more, read about the science behind our models or visit our API reference.

Your Application

Used responsibly, expressive communication is integral to a wide range of technologies capable of advancing the greater good. It can help us build healthier social networks. It can train digital assistants to respond with nuance to our present state of mind—to how we say something rather than simply what we say. It can inform technologies that let animators bring relatable characters to life, apps that work to improve mental health, and communication platforms that enhance our empathy for others. It can even be used to create entirely new experiences, from new kinds of art to personalized VR worlds, optimized for specific emotions.

Ultimately, what you build is up to you, but feel free to explore the examples on our Playground and keep in mind our app review process.