Learners' Adoption of Course Recommendation Systems by Integrating External Factors and Technology Acceptance Model

Authors

  • Zameer Gulzar
  • P. Padmavathy
  • Fatima Amer Jid Almahri
  • J. Srinivas
  • M. M. Pasha

DOI:

https://doi.org/10.47839/ijc.24.1.3881

Keywords:

Recommendation System, Technology Acceptance Model, Information Retrieval, Course

Abstract

The use of the course recommendation systems is an important focus of research in the field of educational technology. Understanding how students interact with them and accept these systems is essential as the learning environment is changing due to the integration of digital platforms. The Recommendation systems (RSs) are useful tools for narrowing down the course options and exposing students to the courses that suit their needs. The majority of the research related to recommendation systems focuses on effectiveness rather than factors influencing its acceptability, and in practice, user satisfaction cannot be explained by accuracy alone. This study considers the course recommendation systems and examines whether the courses proposed by our recommender systems (RS) are accepted by learners, particularly research students, based on their learning requirements. This can help researchers understand why some users embrace new technology while others resist it. Therefore, research scholars (n=150) willingly engaged in this study were asked to use the RS and complete a questionnaire based on their experience as part of a self-administrated longitudinal survey. This study evaluates the effect of external variables that the Technology Acceptance Model (TAM) does not account for, such as perceived availability, relevance, and experience. It also evaluates the recommendation system’s capacity for making accurate recommendations. When compared to our keyword (75.11% accuracy) and N-gram (89.85%) based approaches, the accuracy of our hybrid recommendation was calculated to be 95.25 percent. The findings further support the extended TAM’s role as a useful theoretical framework for explaining academics’ acceptance of RS and other elements that have a positive bearing on the TAM’s core variables. Consequently, a new modified TAM that includes three outside elements is proposed. The results’ validity and dependability are confirmed by the significant value calculated for Cronbach’s alpha. Because the ramifications of this study effort are crucial for faculties, scholars, and institutions, the observed results can help developers of the recommendation systems in maximizing the user experience.

References

M. W. Chughtai, A. Selamat, I. Ghani, & J. J. Jung, “Retracted: E-Learning recommender systems based on goal-based hybrid filtering,” International Journal of Distributed Sensor Networks, vol. 10, issue 7, 912130, 2014. https://doi.org/10.1155/2014/912130.

M. I. Dascalu, C. N. Bodea, M. N. Mihailescu, E. A. Tanase, & P. Ordoñez de Pablos, “Educational recommender systems and their application in lifelong learning,” Behavior & Information Technology, vol. 35, issue 4, pp. 290–297, 2016. https://doi.org/10.1080/0144929X.2015.1128977.

J. Lu, D. Wu, M. Mao, W. Wang, & G. Zhang, “Recommender system application developments: A survey,” Decision Support Systems, vol. 74, pp. 12–32, 2015. https://doi.org/10.1016/j.dss.2015.03.008.

G. Adomavicius, & A. Tuzhilin, “Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions,” IEEE Transactions on Knowledge and Data Engineering, vol. 6, pp. 734–749, 2005. https://doi.org/10.1109/TKDE.2005.99.

E. R. Núñez-Valdéz, J. M. C. Lovelle, O. S. Martínez, V. García-Díaz, , P. O. De Pablos, & C. E. M. Marín, “Implicit feedback techniques on recommender systems applied to electronic books,” Computers in Human Behavior, vol. 28, issue 4, pp. 1186–1193, 2012. https://doi.org/10.1016/j.chb.2012.02.001.

J. Aguilar, P. Valdiviezo-Díaz, & G. Riofrio, “A general framework for intelligent recommender systems,” Applied Computing and Informatics, vol. 13, issue 2, pp. 147–160, 2017. https://doi.org/10.1016/j.aci.2016.08.002.

F. Ricci, L. Rokach, and B. Shapira, Introduction to Recommender Systems Handbook, Springer, 2011, ch. 1, pp. 1–35. https://doi.org/10.1007/978-0-387-85820-3_1.

H. M. Selim, “An empirical investigation of student acceptance of course websites,” Computers & Education, vol. 40, no. 4, pp. 343–360, 2003. https://doi.org/10.1016/S0360-1315(02)00142-2.

T. S. Ahmed, M. B. Kamal, A. Nik Suryani, and B. T. A. Tunku, “Investigating students’ attitude and intention to use social software in higher institution of learning in Malaysia,” Multicultural Education and Technology Journal, vol. 5, no. 3, pp. 194–208, 2011. https://doi.org/10.1108/17504971111166929.

M. Kang and W. Shin, “An empirical investigation of student acceptance of synchronous e-learning in an online university,” Journal of Educational Computing Research, vol. 52, no. 4, pp. 475–495, 2015. https://doi.org/10.1177/0735633115571921.

C. Hughes and S. Leekam, “What are the links between theory of mind and social relations? Review, reflections and new directions for studies of typical and atypical development,” Social Development, vol. 13, no. 4, pp. 590–619, 2004. https://doi.org/10.1111/j.1467-9507.2004.00285.x.

Z. Zhu, M. Yu, and P. Riezebos, “A research framework of smart education,” Learning Environments, vol. 3, no. 4, 2016. https://doi.org/10.1186/s40561-016-0026-2.

K. Swearingen and R. Sinha, “Beyond algorithms: An HCI perspective on recommender systems,” in ACM SIGIR Workshop on Recommender Systems, vol. 13, pp. 393–408, 2001.

M. Chuttur, “Overview of the technology acceptance model: Origins, developments and future directions,” Working Papers on Information Systems, vol. 9, no. 37, pp. 1–22, 2009.

F. D. Davis, “User acceptance of information technology: System characteristics, user perceptions and behavioral impacts,” International Journal of Man-Machine Studies, vol. 38, pp. 475-487, 1993. https://doi.org/10.1006/imms.1993.1022.

H. M. Huang and S. S. Liaw, “An analysis of learners’ intentions toward virtual reality learning based on constructivist and technology acceptance approaches,” International Review of Research in Open and Distributed Learning, vol. 19, no. 1, pp. 91–115, 2018. https://doi.org/10.19173/irrodl.v19i1.2503.

V. Potkonjak, M. Gardner, V. Callaghan, P. Mattila, C. Guetl, V. M. Petrovic, et al., “Virtual laboratories for education in science, technology, and engineering: A review,” Computers & Education, vol. 95, pp. 309–327, 2016. https://doi.org/10.1016/j.compedu.2016.02.002.

T. Farrell and N. Rushby, “Assessment and learning technologies: An overview,” British Journal of Educational Technology, vol. 47, no. 1, pp. 106–120, 2016. https://doi.org/10.1111/bjet.12348.

G. A. B. Gil and F. J. Garciapenalvo, “Learner course recommendation in e-learning based on swarm intelligence,” Journal of Universal Computer Science, pp. 2737–2755, 2008.

J. Lin, H. Pu, Y. Li, and J. Lian, “Intelligent recommendation system for course selection in smart education,” Procedia Computer Science, vol. 129, pp. 449–453, 2018. https://doi.org/10.1109/ICDM.2011.134.

G. Zameer and A. A. Leema, “A framework for recommender system to provide personalization in an e-learning system,” International Journal of Web-based Learning and Teaching Technologies, vol. 13, no. 3, pp. 51–68, 2018. https://doi.org/10.4018/IJWLTT.2018070104.

G. Zameer and A. A. Leema, “Course recommendation based on query classification approach,” International Journal of Web-based Learning and Teaching Technologies, vol. 13, no. 3, pp. 69–83, 2018. https://doi.org/10.4018/IJWLTT.2018070105.

N. Marangunić and A. Granić, “Technology acceptance model: A literature review from 1986 to 2013,” Universal Access in the Information Society, vol. 14, no. 1, pp. 81–95, 2015. https://doi.org/10.1007/s10209-014-0348-1.

M. Hubert, M. Blut, C. Brock., C. Backhaus, & T. Eberhardt, “Acceptance of smartphone-based mobile shopping: mobile benefits, customer characteristics, perceived risks and the impact of application context,” Psychology and Marketing, vol. 34, issue 2, pp. 175-194, 2017. https://doi.org/10.1002/mar.20982.

A. Asosheh, S. Bagherpour, and N. Yahyapour, “Extended acceptance models for recommender system adaption, case of retail and banking service in Iran,” WSEAS Transactions on Business and Economics, vol. 5, no. 5, pp. 189–200, 2008.

R. Hu and P. Pu, “Acceptance issues of personality-based recommender systems,” in Proceedings of ACM RecSys'09, New York, NY, USA: ACM, pp. 221–224, 2009. https://doi.org/10.1145/1639714.1639753.

H. Y. Lee, H. Ahn, and I. Han, “VCR: Virtual community recommender using the technology acceptance model and the user’s needs type,” Expert Systems with Applications, vol. 33, no. 4, pp. 984–995, 2007. https://doi.org/10.1016/j.eswa.2006.07.012.

D. Baier and E. Stüber, “Acceptance of recommendations to buy in online retailing,” Journal of Retailing and Consumer Services, vol. 17, no. 3, pp. 173–180, 2010. https://doi.org/10.1016/j.jretconser.2010.03.005.

M. G. Armentano, R. Abalde, S. Schiaffino, and A. Amandi, “User acceptance of recommender systems: Influence of the preference elicitation algorithm,” Proceedings of the 9th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), pp. 72–76, 2014. https://doi.org/10.1109/SMAP.2014.18.

F. D. Davis, “Perceived usefulness, perceived ease of use, and user acceptance of information technology,” MIS Quarterly, vol. 13, no. 3, pp. 319–340, 1989. https://doi.org/10.2307/249008.

M. S. H. D. Abidi and M. N. Khan, “An analysis into UTAUT based research models for IT implementation,” Studies in Indian Place Names, vol. 40, no. 71, pp. 2011–2027, 2020.

V. Venkatesh and F. Davis, “A theoretical extension of the technology acceptance model: Four longitudinal field studies,” Management Science, vol. 46, no. 2, pp. 186–204, 2000. https://doi.org/10.1287/mnsc.46.2.186.11926.

K. Renaud and J. Van Biljon, “Predicting technology acceptance and adoption by the elderly: A qualitative study,” Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries: Riding the Wave of Technology, New York, NY: ACM, pp. 210–219, 2008. https://doi.org/10.1145/1456659.1456684.

L. W. Leong, O. Ibrahim, M. Dalvi-Esfahani, H. Shahbazi, and M. Nilashi, “The moderating effect of experience on the intention to adopt mobile social network sites for pedagogical purposes: An extension of the technology acceptance model,” Education and Information Technologies, vol. 23, pp. 2477–2498, 2018. https://doi.org/10.1007/s10639-018-9726-2.

L. Stoel and K. Hye Lee, “Modeling the effect of experience on student acceptance of web-based courseware,” Internet Research, vol. 13, pp. 364–374, 2003. https://doi.org/10.1108/10662240310501649.

H. P. Shih, “Extended technology acceptance model of Internet utilization behavior,” Information & Management, vol. 41, pp. 719–729, 2004. https://doi.org/10.1016/j.im.2003.08.009.

Z. Zouhair, “Surveying learners’ attitudes toward a Saudi e-learning system,” International Journal of Information and Electronics Engineering, vol. 12, 2012. https://doi.org/10.7763/IJIEE.2012.V2.206.

V. Venkatesh, M. Morris, G. Davis, and F. Davis, “User acceptance of information technology: Toward a unified view,” MIS Quarterly, vol. 27, pp. 425–478, 2003. https://doi.org/10.2307/30036540.

P. Legris, J. John, and C. Pierre, "Why do people use information technology? A critical review of the technology acceptance model,” Information & Management, vol. 40, no. 3, pp. 191–204, 2003. https://doi.org/10.1016/S0378-7206(01)00143-4.

R. H. Shroff, C. C. Deneen, & E. M. Ng, “Analysis of the technology acceptance model in examining students' behavioral intention to use an e-portfolio system,” Australasian Journal of Educational Technology, vol. 27, pp. 600–618, 2011. https://doi.org/10.14742/ajet.940.

Y. Yanxia and W. Xiangling, “Modeling the intention to use machine translation for student translators: An extension of technology acceptance model,” Computers & Education, vol. 133, pp. 116–126, 2019. https://doi.org/10.1016/j.compedu.2019.01.015.

R. A. Sánchez and A. D. Hueros, “Motivational factors that influence the acceptance of Moodle using TAM,” Computers in Human Behavior, vol. 26, pp. 1632–1640, 2010. https://doi.org/10.1016/j.chb.2010.06.011.

A. A. Jemain, A. Al-Omari, and K. Ibrahim, “Multistage median ranked set sampling for estimating the population median,” Journal of Mathematics and Statistics, vol. 3, pp. 58–64, 2007. https://doi.org/10.3844/jmssp.2007.58.64.

P. M. Bentler and C. P. Chou, “Practical issues in structural modeling,” Sociological Methods & Research, vol. 16, no. 1, pp. 78–117, 1987. https://doi.org/10.1177/0049124187016001004.

J. C. Anderson and D. W. Gerbing, “Structural equation modeling in practice: A review and recommended two-step approach,” Psychological Bulletin, vol. 49, no. 2, pp. 411–423, 1988. https://doi.org/10.1037//0033-2909.103.3.411.

D. E. Rupp, R. S. Ruodan, P. S. Daniel, L. P. Elizabeth, Y. K. Tae-Yeol, and N. T. Thierry, “Corporate social responsibility and employee engagement: The moderating role of CSR-specific relative autonomy and individualism,” Journal of Organizational Behavior, vol. 39, no. 5, 2018. https://doi.org/10.1002/job.2282.

C. Fornell and D. F. Larcker, “Evaluating structural equation models with unobservable variables and measurement error,” Journal of Marketing Research, vol. 18, no. 1, pp. 39–47, 1981. https://doi.org/10.2307/3151312.

H. C. Chen, C. C. Hsu, C. H. Chang, and Y. M. Huang, “Applying the technology acceptance model to evaluate the learning companion recommendation system on Facebook,” Proceedings of the IEEE Fourth International Conference on Technology for Education (T4E), pp. 160–163, 2012. https://doi.org/10.1109/T4E.2012.36.

S. Cacciamani, D. Villani, A. Bonanomi, C. Carissoli, G. M. Olivari, L. Morganti, et al., “Factors affecting students' acceptance of tablet PCs: A study in Italian high schools,” Journal of Research on Technology in Education, vol. 50, no. 2, pp. 120–133, 2018. https://doi.org/10.1080/15391523.2017.1409672.

I. Esteban-Millat, F. J. Martínez-López, M. Pujol-Jover, J. C. Gázquez-Abad, and A. Alegret, “An extension of the technology acceptance model for online learning environments,” Interactive Learning Environments, vol. 26, no. 7, pp. 895–910, 2018. https://doi.org/10.1080/10494820.2017.1421560.

A. Tarhini, K. Hone, and X. Liu, “Measuring the moderating effect of gender and age on e-learning acceptance in England: A structural equation modeling approach for an extended technology acceptance model,” Educational Computing Research, vol. 51, no. 2, pp. 163–184, 2014. https://doi.org/10.2190/EC.51.2.b.

C. Weng and C. Tsai, “Social support as a neglected e-learning motivator affecting trainee's decisions of continuous intentions of usage,” Australasian Journal of Educational Technology, vol. 31, no. 2, pp. 177–192, 2015. https://doi.org/10.14742/ajet.1311.

A. Al-Azawei, “Investigating the effect of learning styles in a blended e-learning system: An extension of the technology acceptance model (TAM),” Australasian Journal of Educational Technology, vol. 33, no. 2, pp. 1–23, 2017. https://doi.org/10.14742/ajet.2741.

G. Wong, “The behavioral intentions of Hong Kong primary teachers in adopting educational psychology,” Educational Technology Research & Development, vol. 64, pp. 313–338, 2016. https://doi.org/10.1007/s11423-016-9426-9.

D. Kenny and A. Way, “Teaching machine translation and translation technology: A contrastive study,” Proceedings of the Machine Translation Summit VII, Teaching MT Workshop, pp. 13–17, Santiago de Compostela, Spain, 2001.

T. Teo, F. Huang, and C. K. W. Hoi, “Explicating the influences that explain intention to use technology among English teachers in China,” Interactive Learning Environments, vol. 26, no. 4, pp. 460–475, 2018. https://doi.org/10.1080/10494820.2017.1341940.

Downloads

Published

2025-03-31

How to Cite

Gulzar, Z., Padmavathy, P., Almahri, F. A. J., Srinivas, J., & Pasha, M. M. (2025). Learners’ Adoption of Course Recommendation Systems by Integrating External Factors and Technology Acceptance Model. International Journal of Computing, 24(1), 102-114. https://doi.org/10.47839/ijc.24.1.3881

Issue

2025, Volume 24, Issue 1

Section

Articles

License

International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:
•    Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
•    Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
•    Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.