Title |
Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers |
Authors |
Alberto Díaz, Pablo Gervás, Antonio García and Laura Plaza |
Abstract |
This paper presents the process of development and the characteristics of an evaluation collection for a personalisation system for digital newspapers. This system selects, adapts and presents contents according to a user model that define information needs. The collection presented here contains data that are cross-related over four different axes: a set of news items from an electronic newspaper, collected into subsets corresponding to a particular sequence of days, packaged together and cross-indexed with a set of user profiles that represent the particular evolution of interests of a set of real users over the given days, expressed in each case according to four different representation frameworks: newspaper sections, Yahoo categories, keywords, and relevance feedback over the set of news items for the previous day. This information provides a minimum starting material over which one can evaluate for a given system how it addresses the first two observations - adapting to different users and adapting to particular users over time - providing that the particular system implements the representation of information needs according to the four frameworks employed in the collection. This collection has been successfully used to perform some different experiments to determine the effectiveness of the personalization system presented. |
Topics |
Evaluation methodologies, Document Classification, Text categorisation, LR Infrastructures and Architectures |
Full paper |
Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers |
Slides |
- |
Bibtex |
@InProceedings{DAZ10.569,
author = {Alberto Díaz and Pablo Gervás and Antonio García and Laura Plaza}, title = {Development and Use of an Evaluation Collection for Personalisation of Digital Newspapers}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |