Modeling Activation Processes in Human Memory to Predict the Reuse of Tags

Authors

  • Christoph Trattner Know-Center, Graz University of Technology
  • Dominik Kowald Know-Center, Graz University of Technology
  • Paul Seitlinger KTI, Graz University of Technology
  • Simone Kopeinik KTI, Graz University of Technology
  • Tobias Ley Institute of Informatics, Tallin University

DOI:

https://doi.org/10.1561/106.00000004

Abstract

Several successful tag recommendation mechanisms have been developed, including algorithms built upon Collaborative Filtering, Tensor Factorization, graph-based and simple "most popular tags" approaches. From an economic perspective, the latter approach has been convincing since calculating frequencies is computationally efficient and effective with respect to different recommender evaluation metrics. In this paper, we introduce a tag recommendation algorithm that mimics the way humans draw on items in their long-term memory in order to extend these conventional "most popular tags" approaches. Based on a theory of human memory, the approach estimates a tag's reuse probability as a function of usage frequency and recency in the user's past (base-level activation) as well as of the current semantic context (associative component).

Using four real-world folksonomies gathered from bookmarks in BibSonomy, CiteULike, Delicious and Flickr, we show how refining frequency-based estimates by considering recency and semantic context outperforms conventional "most popular tags" approaches and another existing and very effective but less theory-driven, time-dependent recommendation mechanism. By combining our approach with a simple resource-specific frequency analysis, our algorithm outperforms other well-established algorithms, such as Collaborative Filtering, FolkRank and Pairwise Interaction Tensor Factorization with respect to recommender accuracy and runtime. We conclude that our approach provides an accurate and computationally efficient model of a user's temporal tagging behavior. Moreover, we demonstrate how effective principles of recommender systems can be designed and implemented if human memory processes are taken into account.

Author Biographies

  • Christoph Trattner, Know-Center, Graz University of Technology

    Dr. Christoph Trattner is currently working as a post-doctoral researcher and the head of the Social
    Computing Research Group at Know-Center, Austria’s competence center for knowledge technologies.
    He has a PhD (with hons), a MSc (with hons) and BSc in Computer Science and Telematics from
    Graz University of Technology (Austria). His research interests include social computing, social systems,
    social media, social networks, social search & navigation, human computer interaction, data mining,
    user proï¬ling, adaptation, personalization, recommender systems and machine learning. He was involved,
    either as a collaborator or a project leader, in various national and international EU-funded research
    projects that dealt with social semantic technologies. Currently, he is the work package leader for the
    development of the social semantic server for the LEARNING LAYERS project funded by the EU.
    During the last four years, he published a signiï¬cant number of scientiï¬c articles in top venues and
    journals, e.g., the Journal of the Association for Information Science and Technology (JASIST), the
    ACM World Wide Web Conference (WWW), the IEEE Conference on Social Computing (SocialCom),
    the ACM WebScience Conference (WebSci), the ACM/IEEE International Conference on Advances in
    Social Networks Analysis and Mining (ASONAM), the ACM International Conference on Information
    and Knowledge Management (CIKM), the ACM Conference on Computer Supported Cooperative Work
    (CSCW) and the ACM Conference on Hypertext and Social Media (HT). He is the winner of several Best
    Paper/Poster Awards and Nominations. He regularly acts as a PC member on several top-tier conferences
    and co-organizes or co-chaires a number of workshops and conferences.

  • Dominik Kowald, Know-Center, Graz University of Technology
    Dominik Kowald is a university assistant at Knowledge Technologies Institute (Graz University of Technology) and software developer at the Know-Center. He studied Software-Engineering and Economy at Graz University of Technology and recently started his PhD on the topic: “Recommending Artifacts in Social-Semantic Networksâ€. In this respect his main research goal is to examine how recommender systems can be enhanced using models coming from human cognition, especially when dealing with tag and time information. Moreover, he is interested in the development of flexible recommender frameworks (e.g., TagRec). Currently he is working in the EU-IP Learning Layers, which is about scaling of technologies for informal learning in SME clusters. Furthermore, he has worked in the EU-project Organic Lingua, which is about demonstrating the potential of multilingual Web portal for sustainable agricultural & environmental education. Additionally he is working as a teaching assistant for the course Web Science and Web Technologies and as a software developer in different COMET-funded projects.

References

J. R. Anderson, M. D. Byrne, S. Douglass, C. Lebiere, and Y. Qin. An integrated theory of the mind. Psychological Review, 111(4):1036–1050, 2004.

J. R. Anderson, J. M. Fincham, and S. Douglass. Practice and retention: a unifying analysis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25:1120, 1999.

J. R. Anderson and L. J. Schooler. Reflections of the environment in memory. Psychological Science, 2(6):396–408, 1991.

L. Balby Marinho, A. Hotho, R. Jäschke, A. Nanopoulos, S. Rendle, L. Schmidt-Thieme, G. Stumme, and P. Symeonidis. Recommender Systems for Social Tagging Systems. SpringerBriefs in Electrical and Computer Engineering. Springer, Feb. 2012.

V. Batagelj and M. ZaversÌŒnik. Generalized cores. arXiv preprint cs/0202039, 2002.

P. G. Campos, F. DiÌez, and I. Cantador. Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols. User Modeling and User-Adapted Interaction, pages 1–53, 2013.

C. Cattuto, V. Loreto, and L. Pietronero. Semiotic dynamics and collaborative tagging. Proceedings of the National Academy of Sciences, 104(5):1461–1464, 2007.

K. Dellschaft and S. Staab. An epistemic dynamic model for tagging systems. In Proceedings of the nineteenth ACM conference on Hypertext and hypermedia, HT ’08, pages 71–80, New York, NY, USA, 2008. ACM.

K. Dellschaft and S. Staab. Measuring the influence of tag recommenders on the indexing quality in tagging systems. In Proceedings of the 23rd ACM conference on Hypertext and social media, HT ’12, pages 73–82, New York, NY, USA, 2012. ACM.

S. Doerfel and R. Jäschke. An analysis of tag-recommender evaluation procedures. In Proceedings of the 7th ACM Conference on Recommender Systems, RecSys ’13, pages 343–346, New York, NY, USA, 2013. ACM.

H. Ebbinghaus. Memory: A contribution to experimental psychology. Number 3. Teachers college, Columbia university, 1913.

F. Floeck, J. Putzke, S. Steinfels, K. Fischbach, and D. Schoder. Imitation and quality of tags in social bookmarking systems–collective intelligence leading to folksonomies. In On collective intelligence, pages 75–91. Springer, 2011.

W.-T. Fu. The microstructures of social tagging: a rational model. In Proceedings of the 2008 ACM conference on Computer supported cooperative work, pages 229–238. ACM, 2008.

W.-T. Fu and W. Dong. Collaborative indexing and knowledge exploration: a social learning model. IEEE Intelligent Systems, 27(1):39–46, 2012.

W.-T. Fu, T. Kannampallil, R. Kang, and J. He. Semantic imitation in social tagging. ACM Trans. Comput.-Hum. Interact., 17(3):12:1–12:37, July 2010.

W.-T. Fu, T. G. Kannampallil, and R. Kang. A semantic imitation model of social tag choices. In Computational Science and Engineering, 2009. CSE’09. International Conference on, volume 4, pages 66–73. IEEE, 2009.

J. Gemmell, T. Schimoler, M. Ramezani, L. Christiansen, and B. Mobasher. Improving folkrank with item-based collaborative filtering. Recommender Systems & the Social Web, 2009.

H. Halpin, V. Robu, and H. Shepherd. The complex dynamics of collaborative tagging. In Proceedings of the 16th international conference on World Wide Web, WWW ’07, pages 211–220, New York, NY, USA, 2007. ACM.

S. Hamouda and N. Wanas. Put-tag: personalized user-centric tag recommendation for social bookmarking systems. Social network analysis and mining, 1(4):377–385, 2011.

D. Helic, C. Körner, M. Granitzer, M. Strohmaier, and C. Trattner. Navigational efficiency of broad vs. narrow folksonomies. In Proceedings of the 23rd ACM conference on Hypertext and social media, HT ’12, pages 63–72, New York, NY, USA, 2012. ACM.

P. Heymann, G. Koutrika, and H. Garcia-Molina. Can social bookmarking improve web search? In Proceedings of the 2008 International Conference on Web Search and Data Mining, WSDM ’08, pages 195–206, New York, NY, USA, 2008. ACM.

P. Heymann, D. Ramage, and H. Garcia-Molina. Social tag prediction. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 531–538. ACM, 2008.

A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Information retrieval in folksonomies: Search and ranking. In The semantic web: research and applications, pages 411–426. Springer, 2006.

C.-L. Huang, P.-H. Yeh, C.-W. Lin, and D.-C. Wu. Utilizing user tag-based interests in recommender systems for social resource sharing websites. Knowledge-Based Systems, 2014.

R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in folksonomies. In Knowledge Discovery in Databases: PKDD 2007, pages 506–514. Springer, 2007.

R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Tag recommendations in social bookmarking systems. Ai Communications, 21(4):231–247, 2008.

C. Körner, D. Benz, A. Hotho, M. Strohmaier, and G. Stumme. Stop thinking, start tagging: tag semantics emerge from collaborative verbosity. In Proceedings of the 19th international conference on World wide web, WWW ’10, pages 521–530, New York, NY, USA, 2010. ACM.

D. Kowald, E. Lacic, and C. Trattner. Tagrec: Towards a standardized tag recommender benchmarking framework. In Proc. HT’14, New York, NY, USA, 2014. ACM.

D. Kowald, P. Seitlinger, C. Trattner, and T. Ley. Long time no see: The probability of reusing tags as a function of frequency and recency. In Proceedings of the 23rd international conference on World Wide Web, WWW ’14, New York, NY, USA, 2014. ACM.

R. Krestel and P. Fankhauser. Language models and topic models for personalizing tag recommendation. In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2010 IEEE/WIC/ACM International Conference on, volume 1, pages 82–89. IEEE, 2010.

Y.-l. Lin, C. Trattner, P. Brusilovsky, and D. He. The impact of image descriptions on user tagging behavior: A study of the nature and functionality of crowdsourced tags. Journal of the Association for Information Science and Technology, pages n/a–n/a, 2014.

M. Lipczak. Hybrid Tag Recommendation in Collaborative Tagging Systems. PhD thesis, Dalhousie University, 2012.

M. Lipczak, Y. Hu, Y. Kollet, and E. Milios. Tag sources for recommendation in collaborative tagging systems. ECML PKDD discovery challenge, pages 157–172, 2009.

M. Lipczak and E. Milios. The impact of resource title on tags in collaborative tagging systems. In Proceedings of the 21st ACM conference on Hypertext and hypermedia, HT ’10, pages 179–188, New York, NY, USA, 2010. ACM.

M. Lipczak and E. Milios. Efficient tag recommendation for real-life data. ACM Trans. Intell. Syst. Technol., 3(1):2:1–2:21, Oct. 2011.

J. Lorince and P. M. Todd. Can simple social copying heuristics explain tag popularity in a collaborative tagging system? In Proceedings of the 5th Annual ACM Web Science Conference, WebSci ’13, pages 215–224, New York, NY, USA, 2013. ACM.

L. Marinho, A. Nanopoulos, L. Schmidt-Thieme, R. Jäschke, A. Hotho, G. Stumme, and P. Symeonidis. Social tagging recommender systems. In F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, editors, Recommender Systems Handbook, pages 615–644. Springer US, 2011.

L. B. Marinho and L. Schmidt-Thieme. Collaborative tag recommendations. In Data Analysis, Machine Learning and Applications, pages 533–540. Springer, 2008.

C. Marlow, M. Naaman, D. Boyd, and M. Davis. Ht06, tagging paper, taxonomy, flickr, academic article, to read. In Proceedings of the seventeenth conference on Hypertext and hypermedia, HYPERTEXT ’06, pages 31–40, New York, NY, USA, 2006. ACM.

J. McAuley and J. Leskovec. Hidden factors and hidden topics: Understanding rating dimensions with review text. In Proceedings of the ACM Conference Series on Recommender Systems, New York, NY, USA, 2013. ACM.

C. Moltedo, H. Astudillo, and M. Mendoza. Tagging tagged images: on the impact of existing annotations on image tagging. In Proceedings of the ACM multimedia 2012 workshop on Crowdsourcing for multimedia, pages 3–8. ACM, 2012.

L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: bringing order to the web. 1999.

D. Parra and P. Brusilovsky. Collaborative filtering for social tagging systems: an experiment with citeulike. In Proceedings of the third ACM conference on Recommender systems, pages 237–240. ACM, 2009.

D. Parra-Santander and P. Brusilovsky. Improving collaborative filtering in social tagging systems for the recommendation of scientific articles. In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2010 IEEE/WIC/ACM International Conference on, volume 1, pages 136–142. IEEE, 2010.

M. Rawashdeh, H.-N. Kim, J. M. Alja’am, and A. El Saddik. Folksonomy link prediction based on a tripartite graph for tag recommendation. Journal of Intelligent Information Systems, pages 1–19, 2012.

S. Rendle. Factorization machines. In Data Mining (ICDM), 2010 IEEE 10th International Conference on, pages 995–1000. IEEE, 2010.

S. Rendle, L. Balby Marinho, A. Nanopoulos, and L. Schmidt-Thieme. Learning optimal ranking with tensor factorization for tag recommendation. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 727–736. ACM, 2009.

S. Rendle and L. Schmidt-Thieme. Pairwise interaction tensor factorization for personalized tag recommendation. In Proceedings of the third ACM international conference on Web search and data mining, WSDM ’10, pages 81–90, New York, NY, USA, 2010. ACM.

J. B. Schafer, D. Frankowski, J. Herlocker, and S. Sen. Collaborative filtering recommender systems. In The adaptive web, pages 291–324. Springer, 2007.

P. Seitlinger, D. Kowald, C. Trattner, and T. Ley. Recommending tags with a model of human categorization. In The ACM International Conference on Information and Knowledge Managament, New York, NY, USA, 2013. ACM.

P. Seitlinger and T. Ley. Implicit imitation in social tagging: familiarity and semantic reconstruction. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, CHI ’12, pages 1631–1640, New York, NY, USA, 2012. ACM.

B. Sigurbjörnsson and R. Van Zwol. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th international conference on World Wide Web, pages 327–336. ACM, 2008.

L. Steels. Semiotic dynamics for embodied agents. IEEE Intelligent Systems, 21(3):32–38, 2006.

C. Trattner, Y.-l. Lin, D. Parra, Z. Yue, W. Real, and P. Brusilovsky. Evaluating tag-based information access in image collections. In Proceedings of the 23rd ACM Conference on Hypertext and Social Media, HT ’12, pages 113–122, New York, NY, USA, 2012. ACM.

L. Van Maanen and J. N. Marewski. Recommender systems for literature selection: A competition between decision making and memory models. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, pages 2914–2919, 2009.

C. J. Van Rijsbergen. Foundation of evaluation. Journal of Documentation, 30(4):365–373, 1974.

R. Wetzker, C. Zimmermann, C. Bauckhage, and S. Albayrak. I tag, you tag: translating tags for advanced user models. In Proceedings of the third ACM international conference on Web search and data mining, pages 71–80. ACM, 2010.

S. Xu, S. Bao, B. Fei, Z. Su, and Y. Yu. Exploring folksonomy for personalized search. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 155–162. ACM, 2008.

D. Yin, L. Hong, and B. D. Davison. Exploiting session-like behaviors in tag prediction. In Proceedings of the 20th international conference companion on World wide web, pages 167–168. ACM, 2011.

D. Yin, L. Hong, Z. Xue, and B. D. Davison. Temporal dynamics of user interests in tagging systems. In Twenty-Fifth AAAI conference on artificial intelligence, 2011.

L. Zhang, J. Tang, and M. Zhang. Integrating temporal usage pattern into personalized tag prediction. In Web Technologies and Applications, pages 354–365. Springer, 2012.

N. Zheng and Q. Li. A recommender system based on tag and time information for social tagging systems. Expert Syst. Appl., 2011.

Downloads

Published

2016-02-18

Issue

Section

Articles