Hidden Topic Markov Models

Channel:

Google TechTalks

Subscribers:

348,000

Published on October 9, 2007 3:38:01 AM ● Video Link: https://www.youtube.com/watch?v=vgqWMGT9haY

Duration: 59:15

22,037 views

52

Google Tech Talks
August 8, 2007

ABSTRACT

Algorithms such as Latent Dirichlet Allocation (LDA) have achieved significant progress in modeling word document relationships. These algorithms assume each word in the document was generated by a hidden topic and explicitly model the word distribution of each topic as well as the prior distribution over topics in the document. Given these parameters, the topics of all words in the same document are assumed to be independent.

In this work, we propose modeling the topics of words in the document as a Markov chain. Specifically, we assume that all words in the same sentence have the same topic, and successive sentences are more likely to have the same...