Refine
Year of publication
- 2019 (4) (remove)
Document Type
- Part of a Book (3)
- Article (1)
Language
- English (4)
Has Fulltext
- yes (4)
Keywords
- Digital Humanities (4) (remove)
Publicationstate
- Postprint (3)
- Zweitveröffentlichung (3)
- Veröffentlichungsversion (1)
Reviewstate
- (Verlags)-Lektorat (2)
- Peer-Review (2)
Publisher
- Routledge, Taylor & Francis Group (2)
- Springer (1)
- Zenodo (1)
The use of digital resources and tools across humanities disciplines is steadily increasing, giving rise to new research paradigms and associated methods that are commonly subsumed under the term digital humanities. Digital humanities does not constitute a new discipline in itself, but rather a new approach to humanities research that cuts across different existing humanities disciplines. While digital humanities extends well beyond language-based research, textual resources and spoken language materials play a central role in most humanities disciplines.
We present an approach for automatic detection and correction of OCR-induced misspellings in historical texts. The main objective is the post-correction of the digitized Royal Society Corpus, a set of historical documents from 1665 to 1869. Due to the aged material the OCR procedure has made mistakes, thus leading to files corrupted by thousands of misspellings. This motivates a post processing step. The current correction technique is a pattern-based approach which due to its lack of generalization suffers from bad recall.
To generalize from the patterns we propose to use the noisy channel model. From the pattern based substitutions we train a corpus specific error model complemented with a language model. With an F1-Score of 0.61 the presented technique significantly outperforms the pattern based approach which has an F1-score of 0.28. Due to its more accurate error model it also outperforms other implementations of the noisy channel model.