On the Estimation and Use of Statistical Modelling in Information Retrieval
Several tasks in information retrieval (IR) rely on assumptions regarding the distribution of some property (such as term frequency) in the data being processed. This thesis argues that such distributional assumptions can lead to incorrect conclusions and proposes a statistically principled method for determining the "true" distribution. This thesis further applies this method to derive a new family of ranking models that adapt their computations to the statistics of the data being processed. Experimental evaluation shows results on par or better than multiple strong baselines on several TREC collections. Overall, this thesis concludes that distributional assumptions can be replaced with an effective, efficient and principled method for determining the "true" distribution and that using the "true" distribution can lead to improved retrieval performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalRetrievalSimilar Papers 제목 키워드 기반
Modelling Word Burstiness in Natural Language: A Generalised Polya Process for Document Language Models in Information Retrieval
We introduce a generalised multivariate Polya process for document language modelling. The framework outlined here generalises a number of statistical language models used in information retrieval for modelling document …
Information RetrievalLanguage ModelingLanguage ModellingRetrievalEffects of Stop Words Elimination for Arabic Information Retrieval: A Comparative Study
The effectiveness of three stop words lists for Arabic Information Retrieval---General Stoplist, Corpus-Based Stoplist, Combined Stoplist ---were investigated in this study. Three popular weighting schemes were examined:…
Information RetrievalLanguage ModellingRetrievalRetrieving Comparative Arguments using Ensemble Methods and Neural Information Retrieval
In this paper, we present a submission to the Touche lab's Task 2 on Argument Retrieval for Comparative Questions. Our team Katana supplies several approaches based on decision tree ensembles algorithms to rank comparati…
Argument RetrievalInformation RetrievalLanguage ModellingRetrieval+1Gaussian Processes for Music Audio Modelling and Content Analysis
Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is c…
Beat TrackingGaussian ProcessesMusic TranscriptionModelling-based experiment retrieval: A case study with gene expression clustering
Motivation: Public and private repositories of experimental data are growing to sizes that require dedicated methods for finding relevant data. To improve on the state of the art of keyword searches from annotations, met…
ClusteringRetrieval