A Deep Learning Model for Context Understanding in Recommendation Systems
Abstract
Due to the robust growth in the amount of data and Internet users, there has been a significant rise in information overload, hindering timely access to user demand. While information retrieval systems, such as Google, Bing, and Altavista have partially addressed this challenge, prioritization and personalization of information have yet to be fully implemented. Therefore, recommendation systems are developed to resolve the issue by filtering and segmenting important information from an enormous volume of data based on different criteria such as preferences, interests, and user behaviors. By collecting data on users' interests and purchased products, the system can predict whether a particular user would enjoy an item, thus delivering an appropriate suggestion strategy. However, the increased number of Internet users and items has resulted in sparseness in increasingly vast datasets, reducing the performance of recommendation algorithms. Therefore, this study developed a model integrating Convolutional Neural Network (CNN) and Matrix Factorization (MF) to add extra product and user information, extract contexts, and add bias to the observed ratings in the training process, attempting to enhance the recommendation accuracy and context understanding. This approach can take advantage of CNN to efficiently capture an image's or document's local features, with the combination of MF to create relationships between 2 main entities, users and items. The proposed model obtained the highest RMSE of 0.93 when predicting favorable movies for 4,000 users, with an ability to learn complex contextual features and suggest more relevant content. The results are promising and can act as a reference for developing context understanding in recommendation systems, and future work may focus on optimizing the performance and developing more text-processing techniques.
Full Text:
PDFReferences
L. Lü, M. Medo, C. H. Yeung, Y.-C. Zhang, Z.-K. Zhang and T. Zhou, "Recommender systems," Physics reports, vol. 519, no. 1, pp. 1-49, 2012.
H. Ko, S. Lee, Y. Park and A. Choi, "A survey of recommendation systems: recommendation models, techniques, and application fields," Electronics, vol. 11, no. 1, p. 141, 2022.
F. O. Isinkaye, Y. O. Folajimi and B. A. Ojokoh, "Recommendation systems: Principles, methods and evaluation," Egyptian informatics journal, vol. 16, no. 3, pp. 261-273, 2015.
G. Shani and A. Gunawardana, "Evaluating recommendation systems," Recommender systems handbook, pp. 257-297, 2011.
Gomez-Uribe, C. A. and N. Hunt, "The netflix recommender system: Algorithms, business value, and innovation," ACM Transactions on Management Information Systems (TMIS), vol. 6, no. 4, pp. 1-19, 2015.
J. Bennett and S. Lanning, "The netflix prize," in KDD cup and workshop, 35, 2007.
B. Smith and G. Linden, "Two decades of recommender systems at Amazon. com," IEEE internet computing, vol. 21, no. 3, pp. 12-18, 2017.
S. S. Li and E. Karahanna, "Online recommendation systems in a B2C E-commerce context: a review and future directions," Journal of the association for information systems, vol. 16, no. 2, p. 2, 2015.
K. Al Fararni, B. Aghoutane, J. Riffi, A. Sabri and A. Yahyaouy, "Comparative study on approaches of recommendation systems," Embedded Systems and Artificial Intelligence, pp. 753-764, 2020.
C.-S. Juan-Pedro, I. Ramos-de-Luna, E. Carvajal-Trujillo and Á. F. Villarejo-Ramos, "Online recommendation systems: Factors influencing use in e-commerce," Sustainability, vol. 12, no. 21, p. 8888, 2020.
L. Ebrahimi, V. R. Mirabi, M. H. Ranjbar and E. H. Pour, "A customer loyalty model for e-commerce recommendation systems," Journal of Information & Knowledge Management , vol. 18, no. 3, p. 1950036, 2019.
Z. Wang, X. Yu, N. Feng and Z. Wang, "An improved collaborative movie recommendation system using computational intelligence," Journal of Visual Languages & Computing, vol. 25, no. 6, pp. 667-675, 2014.
M. Robillard, R. Walker and T. Zimmermann, "Recommendation systems for software engineering," IEEE software, vol. 27, no. 4, pp. 80-86, 2009.
L. Shah, H. Gaudani and P. Balani, "Survey on recommendation system," International Journal of Computer Applications, vol. 137, no. 7, pp. 43-49, 2016.
S. K. Raghuwanshi and R. K. Pateriya, "Collaborative filtering techniques in recommendation systems," Data, Engineering and Applications, pp. 11-21, 2019.
S. Eliyas and P. Ranjana, "Recommendation Systems: Content-Based Filtering vs Collaborative Filtering," 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), pp. 1360-1365, 2022.
P. B. Thorat, R. M. Goudar and S. Barve, "Survey on collaborative filtering, content-based filtering and hybrid recommendation system," International Journal of Computer Applications, vol. 110, no. 4, pp. 31-36, 2015.
G. Suganeshwari and S. P. S. Ibrahim, "A survey on collaborative filtering based recommendation system," 3rd international symposium on big data and cloud computing challenges (ISBCC–16’), pp. 503-518, 2016.
N. L. H. Hien, T. Q. Tien and N. V. Hieu, "Web crawler: Design and implementation for extracting article-like contents," Cybernetics and Physics, vol. 9, no. 3, pp. 144-151, 2020.
P. Kumar and R. S. Thakur, "Recommendation system techniques and related issues: a survey," International Journal of Information Technology, vol. 10, no. 4, pp. 495-501, 2018.
S. Bhattacharya and L. Ankit, "Movie recommendation system using bag of words and scikit-learn," Int J Eng Appl Sci Technol, vol. 4, pp. 526-528, 2019.
M. Sheikh Fathollahi and F. Razzazi, "Music similarity measurement and recommendation system using convolutional neural networks," International Journal of Multimedia Information Retrieval, vol. 10, no. 1, pp. 43-53, 2021.
F. Agarap, "An architecture combining convolutional neural network (CNN) and support vector machine (SVM) for image classification," arXiv preprint, p. arXiv:1712.03541, 2017.
D. Kim, C. Park, J. Oh, S. Lee and H. Yu, "Convolutional matrix factorization for document context-aware recommendation," 233-240, 2016.
B. S. Neysiani, N. Soltani, R. Mofidi and M. H. Nadimi-Shahraki, "Improve performance of association rule-based collaborative filtering recommendation systems using genetic algorithm," International Journal of Information Technology and Computer Science, vol. 11, no. 2, pp. 48-55, 2019.
Z. Cui, X. Xu, X. U. E. Fei, X. Cai, Y. Cao, W. Zhang and J. Chen, "Personalized recommendation system based on collaborative filtering for IoT scenarios," IEEE Transactions on Services Computing, vol. 13, no. 4, pp. 685-695, 2020.
W. Zhang and J. Wang, "Content-bootstrapped collaborative filtering for medical article recommendations," 2018 IEEE International Conference on Bioinformatics, pp. 1184-1188, 2018.
U. Javed, K. Shaukat, I. A. Hameed, F. Iqbal, T. M. Alam and S. Luo, "A review of content-based and context-based recommendation systems," International Journal of Emerging Technologies in Learning (iJET), vol. 16, no. 3, pp. 274-306, 2021.
J. Son and S. B. Kim, "Content-based filtering for recommendation systems using multiattribute networks," Expert Systems with Applications, vol. 89, pp. 404-41, 2017.
A. Kardan and M. Ebrahimi, "A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups," Information Sciences, vol. 219, pp. 93-110, 2013.
Tsai and M. Chen, "Using adaptive resonance theory and data‐mining techniques for materials recommendation based on the e‐library environment," The Electronic Library, vol. 26, no. 3, pp. 287-302, 2008.
R. Khan, H. Ur, C. K. Lim, M. F. Ahmed, K. L. Tan and M. B. Mokhtar, "Systematic review of contextual suggestion and recommendation systems for sustainable e-tourism," Sustainability, vol. 13, no. 15, p. 8141, 2021.
C. Rivera, M. Tapia-Leon and S. Lujan-Mora, "Recommendation systems in education: a systematic mapping study," International Conference on Information Technology & Systems, pp. 937-947, 2018.
Feng, M. Khan, A. U. Rahman and A. Ahmad, "News recommendation systems-accomplishments, challenges & future directions," IEEE Access, vol. 8, pp. 16702-16725, 2020.
M. C. Kim and C. Chen, "A scientometric review of emerging trends and new developments in recommendation systems," Scientometrics, vol. 1, pp. 239-263, 2015.
G. Wei, Q. Wu and M. Zhou, "A hybrid probabilistic multiobjective evolutionary algorithm for commercial recommendation systems," IEEE Transactions on Computational Social Systems, vol. 8, no. 3, pp. 589-598, 2021.
V. T. R. M. Vivek, C. Saravanan and K. V. Kumar, "A Novel Technique for User Decision Prediction and Assistance Using Machine Learning and NLP: A Model to Transform the E-commerce System," Big data management in Sensing: Applications in AI and IoT, p. 61, 2022.
J. Davidson, B. Liebald, J. Liu, P. Nandy, T. V. Vleet, U. Gargi and S. Gupta, "The YouTube video recommendation system," Proceedings of the fourth ACM conference on Recommender systems, pp. 293-296, 2010.
W. Bellante, R. Vilardi and D. Rossi, "On Netflix catalog dynamics and caching performance," 2013 IEEE 18th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), pp. 89-93, 2013.
X. H. Pham, T. N. Luong and J. J. Jung, "An black-box testing approach on user modeling in practical movie recommendation systems," International Conference on Computational Collective Intelligence, pp. 72-79, 2013.
S. Raza and C. Ding, "News recommender system: a review of recent progress, challenges, and opportunities," Artificial Intelligence Review, pp. 1-52, 2021.
F. Carmagnola, F. Vernero and P. Grillo, "Sonars: A social networks-based algorithm for social recommender systems," International Conference on User Modeling, Adaptation, and Personalization, pp. 223-234, 2009.
W. Zou, "Design and application of incremental music recommendation system based on Slope one algorithm," Wireless Personal Communications, vol. 102, no. 4, pp. 2785-2795., 2018.
W. Strank, Analyzing Networks of Musical Context in the Digital Age1, 119: The Oxford Handbook of Music and Advertising, 2021.
J. Sanz-Cruzado Puig, Contact recommendation in social networks: algorithmic models, diversity and network evolution, 2021.
L. Lü, M. Medo, C. H. Yeung, Y.-C. Zhang and a. T. Z. Zi-Ke Zhang, "Recommender systems," Physics reports, vol. 519, no. 1, pp. 1-49, 2012.
E. Brynjolfsson, Y. Hu and M. D. Smith, "Consumer surplus in the digital economy: Estimating the value of increased product variety at online booksellers," Management science, vol. 49, no. 11, pp. 1580-1596, 2003.
X. Amatriain and J. Basilico, "Recommender systems in industry: A netflix case study," Recommender systems handbook, pp. 385-419, 2015.
H. Verma, "Netflix Recommendation Engine - How Netflix uses Big data and Analytics to Recommend you your Favourite Shows," startuptalky, 21 12 2021. [Online]. Available: https://startuptalky.com/netflix-recommendation-engine/. [Accessed 29 10 2022].
M. Zhang and Y. Liu, "A commentary of TikTok recommendation algorithms in MIT Technology Review 2021," Fundamental Research, vol. 1, no. 6, pp. 846-847, 2021.
Z. Chen and C. Shi, "Analysis of Algorithm Recommendation Mechanism of TikTok," International Journal of Education and Humanities, vol. 4, no. 1, pp. 12-14, 2022.
S. Albawi, T. A. Mohammed and S. Al-Zawi, "Understanding of a convolutional neural network," 2017 international conference on engineering and technology, pp. 1-6, 2017.
J. Chai, H. Zeng, A. Li and E. W. Ngai, "Deep learning in computer vision: A critical review of emerging techniques and application scenarios," Machine Learning with Applications, vol. 6, p. 100134, 2021.
N. L. H. Hien, L. V. Huy and N. V. Hieu, "Artwork style transfer model using deep learning approach," Cybernetics and Physics, vol. 10, no. 3, pp. 127-137, 2021.
L. Liu, F.-X. Wu, Y.-P. Wang and J. Wang, "Multi-receptive-field CNN for semantic segmentation of medical images," IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 11, pp. 3215-3225, 2020.
N. L. H. Hien and A.-L. Kor, "Analysis and Prediction Model of Fuel Consumption and Carbon Dioxide Emissions of Light-Duty Vehicles," Applied Sciences, vol. 12, no. 2, p. 803, 2022.
Prabhu, "Understanding of Convolutional Neural Network (CNN) — Deep Learning," medium, 4 3 2018. [Online]. Available: https://medium.com/@RaghavPrabhu/understanding-of-convolutional-neural-network-cnn-deep-learning-99760835f148. [Accessed 29 10 2022].
N. L. H. Hien, H. M. Hoang, N. V. Hieu and N. V. Tien, "Keyphrase Extraction Model: A New Design and Application on Tourism Information," Informatica, vol. 45, no. 4, 2021.
P. J. L. a. G. W. Li, "Application of convolutional neural network in natural language processing," 15th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), pp. 120-122, 2018.
Y. R. B. a. C. V. Koren, "Matrix factorization techniques for recommender systems," Computer, vol. 42, no. 8, pp. 30-37, 2009.
H.-J. Xue, X. Dai, J. Zhang, S. Huang and J. Chen, "Deep matrix factorization models for recommender systems," IJCAI, vol. 17, pp. 3203-3209, 2017.
grouplens, "MovieLens 1M Dataset," 2 2003. [Online]. Available: https://grouplens.org/datasets/movielens/1m/. [Accessed 29 10 2022].
H. Liu, C. Zheng, D. Li, X. Shen, K. Lin, J. Wang, Z. Zhang, Z. Zhang and N. N. Xiong, "EDMF: Efficient deep matrix factorization with review feature learning for industrial recommender system," IEEE Transactions on Industrial Informatics, vol. 18, no. 7, pp. 4361-4371, 2021.
H. Wu, Z. Zhang, K. Yue, B. Zhang, J. He and L. Sun, "Dual-regularized matrix factorization with deep neural networks for recommender systems," Knowledge-Based Systems, vol. 145, pp. 46-58, 2018.
DOI: https://doi.org/10.31449/inf.v48i1.4475
This work is licensed under a Creative Commons Attribution 3.0 License.