Abstract
In past few years, the popularity of social media has increased drastically, sentiment analysis on the reviews, comments and opinions from social media has become more active in research area. A high grade, sentiment analysis portrays the opinion about the real time objects, topics, products and tweet reviews. The social trends or customer opinion is better understood with sentiment analysis. The state-of-art methods in analyzing the sentiments are based on textual features and with different neural network models. In this paper, we demonstrate and generalize a model combining bi-directional long short term memory (LSTM) and convolutional neural network (CNN), as bi-directional LSTM used to hold the temporal data for part-of-speech (PoS) tagging and CNN to extract the potential features. The experiment results validate our combined model performance with individual models. Our combined model indicates performance accurately and efficiently, achieving a reduced execution time and increased accuracy rate 98.6% in sentiment analysis is achieved by using combined bi-directional LSTM-CNN technique as when compared with traditional techniques.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahmed, S., & Danti, A. (2016). Effective sentimental analysis and opinion mining of web reviews using rule based classifiers. In Computational intelligence in data mining (Vol. 1, pp. 171–179). New Delhi: Springer.
Boia, M., Faltings, B., Musat, C.-C., & Pu, P. (2013). A): Is worth a thousandwords: How people attach sentiment to emoticons and words in tweets. In Proc. Int. Conf. Social Comput., p. 345.
Deng, L., Hinton, G., & Kingsbury, B. (2013). New types of deep neural network learning for speech recognition and related applications: an overview. In 2013 IEEE Int. Conf. Acoust. Speech Signal Process, p. 85998603
Ghag, Shah, K. (2013). Comparative analysis of the techniques for sentiment analysis. In Proc. Int. Conf. Adv. Technol. Eng., Jan. 2013, pp. 1–7
Greff, K., Srivastava, R. K., Koutník, J., Steunebrink, B. R., & Schmidhuber, J. (2015). LSTM: A search space odyssey. arXiv2015, arXiv:1503.040692.
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016). Deep learning for visual understanding: A review. NeuroComputing,187, 2748.
Hu, Y., Yi, Y., Yang, T., & Pan, Q. (2018). Short text classification with a convolutional neural networks based method. In 15th International Conference on Control, Automation, Robotics and Vision (ICARCV) IEEE Xplore.
Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), pp. 1746–1751.
Kowsari, K., Brown, D. E., Heidarysafa, M., & Meimandi, K. J. (2018). HDLTex: Hierarchical deep learning for text classification. In IEEE Xplore 16th IEEE International Conference on Machine Learning and Applications (ICMLA).
Lei, T., Barzilay, R., & Jaakkola, T. (2015). Molding cnns for text: Non-linear, non-consecutive convolutions. arXiv 2015, arXiv:1508.04112
Li, C., Guo, K., & Mei, Q. (2017). Deep memory networks for attitude identification. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 671–680
Liu, B. (2015). Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge: The Cambridge University Press.
Ma, Y., Peng, H., & Cambria, E. (2018). Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In AAAI Publications, Thirty-Second AAAI Conference on Artificial Intelligence, April 2018.
Matthew, D. Z. (2013). ADAM: An adaptive learning rate method. In arXiv:1212.5701 [cs.LG].
Mohsen, F., & Erik, R. (2013). Multi-class sentiment analysis with clustering and score representation. In IEEE 13th International Conference on Data Mining Workshops, March 2013.
Mouthami, K., Nirmala Devi, K., & MuraliBhaskaran, V. (2013). Sentiment analysis and classification based on textual reviews. In Published, Information Communication and Embedded Systems, Vol. (ICICES), IEEE
Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Found and Trends in Information.,2, 1–135.
Ruder, S. (2017). An overview of gradient descent optimization algorithms. arXiv:1609.04747v2 [cs.LG].
Severyn, A., & Moschitti, A. (2015) Twitter sentiment analysis with deep convolutional neural networks. In Proc. 38th Int. ACM SIGIR Conf. Res.Dev. Inf. Retr. - SIGIR 15, pp. 959962, 2015
Shayaa, S., Jaafar, N. I., & Bahri, S. (2018). Sentiment analysis of big data: methods. In IEEE Access on Applications, and Open Challenges, Vol. 6, June 2018, pp. 37807–37827
Shobana, G., Vigneshwara, B., & Maniraj Sai, A. (2018). Twitter sentimental analysis. International Journal of Recent Technology and Engineering (IJRTE).
Srira, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., & Demirbas, M. (2016). Short text classification in Twitter to improve information filtering. In Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., pp. 841–842
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014). Learning sentiment-specific word embedding for Twitter sentiment classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp. 1555–1565
Wang, Y., Huang, M., Zhu, X., & Zhao, L. (2016). Attention-based LSTM for aspect level sentiment classification. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 606–615.
Wong, F. M. F., Tan, C. W., Sen, S., & Chiang, M. (2016). Quantifying political leaning from tweets, retweets, and retweeters. IEEE Transactions on Knowledge and Data Engineering,28(8), 2158–2172.
Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015 - 2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst.
Yeole, A. V., Chavan, P. V., & Nikose, M. C. (2015). Opinion mining for emotions determination. In ICIIECS 2015–2015 IEEE Int. Conf. Innov. Information, Embed. Commun. Syst. 2015
Yin, W., Kann, K., Yu, M., & Schütze, H. (2017). Comparative study of CNN and RNN for natural language processing. Computing Research Repository (CoRR), Vol. abs/1702.01923.
Zhu, Y., Gao, X., Zhang, W., Liu, S., & Zhang, Y. (2018). A bi-directional LSTM-CNN model with attention for aspect-level text classification. Future Internet,10(12), 116.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Senthil Kumar, N.K., Malarvizhi, N. Bi-directional LSTM–CNN Combined method for Sentiment Analysis in Part of Speech Tagging (PoS). Int J Speech Technol 23, 373–380 (2020). https://doi.org/10.1007/s10772-020-09716-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10772-020-09716-9