Font Size: a A A

Statistical Methods for Dating Collections of Historical Documents

Posted on:2012-05-31Degree:Ph.DType:Thesis
University:University of Toronto (Canada)Candidate:Tilahun, GelilaFull Text:PDF
GTID:2455390008997620Subject:Statistics
Abstract/Summary:
The problem in this thesis was originally motivated by problems presented with documents of Early England Data Set (DEEDS). The central problem with these medieval documents is the lack of methods to assign accurate dates to those documents which bear no date.;With the problems of the DEEDS documents in mind, we present two methods to impute missing features of texts. In the first method, we suggest a new class of metrics for measuring distances between texts. We then show how to combine the distances between the texts using statistical smoothing. This method can be adapted to settings where the features of the texts are ordered or unordered categoricals (as in the case of, for example, authorship assignment problems).;In the second method, we estimate the probability of occurrences of words in texts using nonparametric regression techniques of local polynomial fitting with kernel weight to generalized linear models. We combine the estimated probability of occurrences of words of a text to estimate the probability of occurrence of a text as a function of its feature – the feature in this case being the date in which the text is written. The application and results of our methods to the DEEDS documents are presented.
Keywords/Search Tags:Documents, Methods, DEEDS
Related items