Loading Events

« All Events

  • This event has passed.

A Textless Approach for Generative Spoken Language Modeling – Yossi Adi, from FAIR

November 21, 2021 @ 12:00 pm - 1:00 pm IST

On Sunday 21.11.2021 at 12:00, we will host Yossi Adi, from FAIR.



Meeting ID: 859 4144 4168

Passcode: 584021

A Textless Approach for Generative Spoken Language Modeling

An open question for AI research is creating systems that learn from natural interactions as infants learn their first language(s): spontaneously and without access to text or expert labels. Current NLP systems require large amounts of text, which excludes plenty of the world’s languages that have little textual resources or no widely used written form. In addition, textual features do not encode speaker-specific speech properties beyond content (e.g., identity, style, emotion, etc.), as well as structured signals that are part of natural human interaction (intonation, hesitation, laughter, etc.) which are important in the oral form.

In this talk, I’ll present our recent studies in developing a Textless Approach for Generative Spoken Language Modeling. The proposed framework is comprised of a pseudo-text Encoder, Sequential modeling, and Speech generation components, all of which were trained in an unsupervised fashion. Lastly, I will present various applications which can benefit from such modeling together with future research directions.


November 21, 2021
12:00 pm - 1:00 pm IST
Event Categories:

Leave a Comment