Conditional Models for Combining Diverse Knowledge Sources in Information Retrieval

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=lcZ60o1tSsg



Duration: 1:13:40
52 views
0


Combining the outputs from multiple retrieval sources/engines is of great importance to a number of retrieval tasks such as multimedia retrieval, web retrieval and meta-search. For example, meta-search attempts to refine retrieval outputs by combining the ranked lists generated from different search engines. Despite the huge amount of combination strategies available, most of them are either completely independent on query topics or dependent on some manually defined query classes. To improve upon this, I first introduce a conditional probabilistic retrieval model as a principled framework for retrieval source combination. Based on this framework, I propose a novel combination approach called probabilistic latent query analysis (pLQA), which can discover latent query classes without prior human knowledge and merge retrieval sources adaptively according to query topics. To further adapt the combination function for individual queries, I also develop the probabilistic local context analysis(pLCA), which can automatically leverage unlearned retrieval sources via an undirected graphical model formalism. Experimental results on two large-scale retrieval tasks, i.e., multimedia retrieval and meta-search, demonstrate that the proposed methods can achieve considerable performance gains. Our future work includes extending the proposed methods to other applications such as question answering, cross-lingual IR, multi-engine machine translation, collaborative filtering and so forth.




Other Videos By Microsoft Research


2016-09-06Machine Learning Methods for Structured and Collective Classification
2016-09-06Communication Technology: Interruption and Overload
2016-09-06ParaEval: Using Paraphrases to Improve Machine Translation and Summarization Evaluations
2016-09-06Rethinking Processor and System Architecture
2016-09-06Crashing the Gate: Netroots, Grassroots, and the Rise of People-Powered Politics
2016-09-06Improving Routing Scalability through Mobile Geographic Hashing in MANETs
2016-09-06The Semantic Web: Myth and Reality
2016-09-06Learnable Similarity Functions and Their Applications in Information Integration and Clustering
2016-09-06Process Extraction in an Abstract Logic of Events [1/2]
2016-09-06Billions: Selling to the New Chinese Consumer
2016-09-06Conditional Models for Combining Diverse Knowledge Sources in Information Retrieval
2016-09-06Scalable Automated Methods for Software Reliability
2016-09-06Naked Conversations: How blogs are changing the Way businesses Talk with Customers
2016-09-06Natural Scene Categorization in Humans and Computers
2016-09-06Pair Programming Re-Design
2016-09-06An Interface to Support Multi-faceted Information Seeking and Targeted Relevance Feedback
2016-09-06Dependable Messaging in Sensor Networks
2016-09-06Discriminative Graphical Models for Structured Data Prediction
2016-09-06Dealing with data: classification, clustering and ranking
2016-09-06Toward the next generation interaction space: Tangible Space Initiative
2016-09-06G2 Microsystems Presents to Microsoft



Tags:
microsoft research