Westerman, S J and Cribbin, T and Collins, Julie (2010) Human assessments of document similarity. Journal of the American Society for Information Science and Technology, 61 (8). pp. 1535-1542. ISSN 15322882Full text not available from this repository.
Two studies are reported that examined the reliability of human assessments of document similarity and the association between human ratings and the results of n-gram automatic text analysis (ATA). Human interassessor reliability (IAR) was moderate to poor. However, correlations between average human ratings and n-gram solutions were strong. The average correlation between ATA and individual human solutions was greater than IAR. N-gram length influenced the strength of association, but optimum string length depended on the nature of the text (technical vs. nontechnical). We conclude that the methodology applied in previous studies may have led to overoptimistic views on human reliability, but that an optimal n-gram solution can provide a good approximation of the average human assessment of document similarity, a result that has important implications for future development of document visualization systems.
|Subjects:||B Philosophy. Psychology. Religion > BF Psychology|
|Divisions:||Schools and Research Institutes > School of Natural & Social Sciences > Psychological Sciences|
|Research Priority Areas:||Sport, Exercise, Health & Wellbeing|
|Depositing User:||Julie Collins|
|Date Deposited:||19 Jan 2015 12:34|
|Last Modified:||07 Mar 2016 13:19|