WeST at European Conference on Artificial Intelligence
Measuring the Influence of Tag Recommenders on the Indexing Quality in Tagging Systems
About the Data Sets - Download - Contact - Literature
About the Data Sets
During the last few years, collaborative tagging systems like Flickr, Del.icio.us or Bibsonomy became more and more popular. Tagging systems allow users to organize resources (e.g. photos, bookmarks or BibTeX entries) by assigning tags or keywords to them. Users can freely choose the terms which they want to use for indexing resources. Over time, the tag assignments of the different users lead to the emergence of a loose categorization system for resources, often called a folksonomy.
In our paper, which has been accepted for publication at the Hypertext Conference 2012, we investigate a methodology for measuring the influence of tag recommenders on the indexing quality in collaborative tagging systems. We propose to use the inter-resource consistency as an indicator of indexing quality. The inter-resource consistency measures the degree to which the tag vectors of indexed resourced reflect how the users understand the resources. We use this methodology for evaluating how tag recommendations coming from (1) the popular tags at a resource of from (2) the user's own vocabulary influence the indexing quality. We show that recommending popular tags decreases the indexing quality and that recommending the user's own vocabulary increases the indexing quality.
On this page, we provide the supplemental material for our paper. This supplemental material contains the full data set which has been collected during an user experiment with 582 participants. The web page containing the user experiment can be still accessed at http://userpages.uni-koblenz.de/~klaasd/experiment/
Download
The following supplemental material for this paper can be downloaded:
- tagging-experiment.tgz: The full data set collected during the user experiment. The data set is available as a dump from an SQL database. For more details about the data set, please see the README.txt file in the tgz-file.
Contact
Literature
2012
Dellschaft, Klaas; Staab, Steffen (2012): Measuring the Influence of Tag Recommenders on the Indexing Quality in Tagging Systems. In: HYPERTEXT 2012, Proceedings of the 23rd ACM Conference on Hypertext and Hypermedia.
Kontakt