Towards Improving E-Commerce Customer Review Analysis for Arabic Language Opinion Mining

Authors

  • Nouri Hicham
  • Habbat Nassera

Keywords:

hybrid deep learning, sentiment analysis, Arabic language, classification, AraBERT

Abstract

In recent years, the rapid development of Internet-related technologies has facilitated the widespread adoption of online purchasing as a convenient means of satisfying consumer needs. Conducting sentiment analysis on user reviews on e-commerce platforms can substantially improve customer satisfaction. In order to resolve this issue, we propose a novel model for sentiment analysis that employs hybrid deep learning ensembles, combining RNN and TreeLSTM with AraBERT as the word embedding. Our research concentrates on creating a hybrid deep-learning model to predict Arabic sentiment accurately. We employ deep learning models with various word embeddings, such as RNN, LSTM, BiLSTM, TreeLSTM, RNN-LSTM, RNN-BiLSTM, and RNN-TreeLSTM. Multiple open-access datasets are used to evaluate the efficacy of the proposed model, including the BRAD dataset, the ARD dataset, and merged datasets containing 610,600 items. The experimental findings indicate that our proposed model is well-suited for evaluating the sentiments expressed in Arabic texts. Our strategy starts with extracting features using the Arabert model, followed by developing and training five hybrid deep-learning models. We attained a significant accuracy improvement of 0.9409 when comparing our method to traditional and hybrid deep learning techniques. This demonstrates that our proposed model precisely analyzes sentiment. These findings are important for enhancing the comprehension of emotions conveyed in Arabic text and have practical implications for various applications, especially e-commerce. By accurately assessing sentiment, businesses can better comprehend customer preferences and enhance consumer satisfaction by enhancing their offerings.

References

A. O. J. Ibitoye, and O. F.W. Onifade, “Utilizing RoBERTa Model for Churn Prediction through Clustered Contextual Conversation Opinion Mining,” Int. J. Intell. Syst. Appl., vol. 15, no. 6, pp. 1–8, 2023, https://doi.org/10.5815/ijisa.2023.06.01.

S. Sultana, S. Rahman Eva, N. Hasan Moon, A. Islam Jony, and D. Nandi, “A Comparison of Opinion Mining Algorithms by Using Product Review Data,” Int. J. Inf. Eng. Electron. Bus., vol. 14, no. 4, pp. 28–38, 2022, https://doi.org/10.5815/ijieeb.2022.04.04.

H. Elzayady, K. M. Badran, and G. I. Salama, “Arabic Opinion Mining Using Combined CNN – LSTM Models,” Int. J. Intell. Syst. Appl., vol. 12, no. 4, pp. 25–36, 2020, https://doi.org/10.5815/ijisa.2020.04.03.

N. Hicham, S. Karim, N. Habbat, “Customer sentiment analysis for Arabic social media using a novel ensemble machine learning approach,” IJECE, vol. 13, no 4, pp. 4504, 2023, https://doi.org/10.11591/ijece.v13i4.pp4504-4515.

N. Hicham, S. Karim, N. Habbat, “Enhancing Arabic sentiment analysis in e-commerce reviews on social media through a stacked ensemble deep learning approach,” MMEP, vol. 10, no 3, pp. 790‑798, 2023, https://doi.org/10.18280/mmep.100308.

N. Hicham, S. Karim, and N. Habbat, “An efficient approach for improving customer sentiment analysis in the Arabic language using an Ensemble machine learning technique,” Proceedings of the 2022 5th International Conference on Advanced Communication Technologies and Networking (CommNet), 2022, pp. 1–6. https://doi.org/10.1109/CommNet56067.2022.9993924.

A. Al-Hashedi et al., “Ensemble classifiers for Arabic sentiment analysis of social network (Twitter data) towards COVID-19-related conspiracy theories,” Applied Computational Intelligence and Soft Computing, vol. 2022, pp. 1‑10, 2022, https://doi.org/10.1155/2022/6614730.

G. Alwakid, T. Osman, M. E. Haj, S. Alanazi, M. Humayun, N. U. Sama, “MULDASA: Multifactor lexical sentiment analysis of social-media content in nonstandard Arabic social media,” Applied Sciences, vol. 12, no. 8, pp. 3806, 2022, https://doi.org/10.3390/app12083806.

S. Albahli, “Twitter sentiment analysis: An Arabic text mining approach based on COVID-19,” Front. Public Health, vol. 10, pp. 966779, 2022, https://doi.org/10.3389/fpubh.2022.966779.

M. Heikal, M. Torki, N. El-Makky, “Sentiment analysis of Arabic tweets using deep learning,” Procedia Computer Science, vol. 142, pp. 114‑122, 2018, https://doi.org/10.1016/j.procs.2018.10.466.

A. Alharbi, M. Kalkatawi, M. Taileb, “Arabic sentiment analysis using deep learning and ensemble methods,” Arab J Sci Eng, vol. 46, no 9, pp. 8913‑8923, 2021, https://doi.org/10.1007/s13369-021-05475-0.

A. Oussous, A. A. Lahcen, S. Belfkih, “Impact of text pre-processing and ensemble learning on Arabic sentiment analysis,” Proceedings of the 2nd International Conference on Networking, Information Systems & Security, NISS19, Rabat, Morocco: ACM Press, 2019, pp. 1‑9. https://doi.org/10.1145/3320326.3320399.

S. Al-Saqqa, N. Obeid, A. Awajan, “Sentiment analysis for Arabic text using ensemble learning,” Proceedings of the 2018 IEEE/ACS 15th IEEE International Conference on Computer Systems and Applications (AICCSA), Aqaba, October 2018, pp. 1‑7. https://doi.org/10.1109/AICCSA.2018.8612804.

S. Al-Azani E.-S. M. El-Alfy, “Using word embedding and ensemble learning for highly imbalanced data sentiment analysis in short Arabic text,” Procedia Computer Science, vol. 109, pp. 359‑366, 2017, https://doi.org/10.1016/j.procs.2017.05.365.

C. Sitaula, A. Basnet, A. Mainali, T. B. Shahi, “Deep learning-based methods for sentiment analysis on Nepali COVID-19-related tweets,” Computational Intelligence and Neuroscience, vol. 2021, pp. 1‑11, 2021, https://doi.org/10.1155/2021/2158184.

C. Sitaula, T. B. Shahi, “Multi-channel CNN to classify Nepali Covid-19 related tweets using hybrid features,” 2022, https://doi.org/10.1007/s12652-023-04692-9.

A. Dahou, S. Xiong, J. Zhou, M. H. Haddoud, P. Duan, “Word Embeddings and Convolutional Neural Network for Arabic Sentiment Classification" p. 11.

J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” arXiv, 2019. [Online]. Available at: http://arxiv.org/abs/1810.04805.

M. Artetxe, H. Schwenk, “Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond,” 2018, https://doi.org/10.1162/tacl_a_00288.

A. Sherstinsky, “Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network,” 2018, doi: 10.48550/ARXIV.1808.03314.

S. Hochreiter, J. Schmidhuber, “Long short-term memory,” Neural Computation, vol. 9, no 8, pp. 1735‑1780, 1997, https://doi.org/10.1162/neco.1997.9.8.1735.

Z. Huang, W. Xu, K. Yu, “Bidirectional LSTM-CRF models for sequence tagging,” 2015, doi: 10.48550/ARXIV.1508.01991.

K. S. Tai, R. Socher, C. D. Manning, “Improved semantic representations from tree-structured long short-term memory networks,” 2015, https://doi.org/10.3115/v1/P15-1150.

A. Elnagar, O. Einea, “BRAD 1.0: Book reviews in Arabic dataset,” Proceedings of the 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA), 2016, p. 1‑8. https://doi.org/10.1109/AICCSA.2016.7945800.

“Arabic 100k reviews,” [Online]. Available at: https://www.kaggle.com/datasets/abedkhooli/arabic-100k-reviews

M. A. Muslim et al., “New model combination meta-learner to improve accuracy prediction P2P lending with stacking ensemble learning,” Intelligent Systems with Applications, vol. 18, article 200204, 2023. https://doi.org/10.1016/j.iswa.2023.200204.

M. M. Abdelgwad, T. H. A. Soliman, A. I. Taloba, and M. F. Farghaly, “Arabic aspect based sentiment analysis using bidirectional GRU based models,” Journal of King Saud University – Computer and Information Sciences, vol. 34, no. 9, pp. 6652–6662, 2022, https://doi.org/10.1016/j.jksuci.2021.08.030.

Downloads

Published

2024-10-03

How to Cite

Hicham, N., & Nassera, H. (2024). Towards Improving E-Commerce Customer Review Analysis for Arabic Language Opinion Mining. International Journal of Computing, 23(3), 387-395. Retrieved from https://computingonline.net/computing/article/view/3657

Issue

Section

Articles