Skip to main content
Springer Nature Link
Log in

Covid-19 Vaccine Sentiment Analysis During Second Wave in India by Transfer Learning Using XLNet

  • Conference paper
  • First Online:
Pattern Recognition and Artificial Intelligence (ICPRAI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13364))

Abstract

The Covid-19 pandemic has created a world-wide crisis from the perspectives of health and economy. Vaccination is one of the prime means by which herd immunity could be developed. Social media platforms such as Twitter has played a major role in building public opinion as the vaccination drive got underway in several countries. In this paper, we present a tweet-based sentiment analysis of the two popularly administered vaccines in India Covishield and Covaxin during the second wave of the pandemic in India, from March 2021 to September 2021, which was attributed to the Delta mutant of the coronavirus. We use unlabeled Covid-19 vaccine-related tweets downloaded from a large-scale dataset from March 2021 to September 2021, and employ transfer learning for classifying the unlabeled tweets. The contributions of this paper are: - sentiment analysis of unlabeled vaccine-related tweets by training a transformer model on pre-trained XLNet (transformer) features derived from a labeled non-Covid Twitter dataset, a time-line of public sentiments for the two vaccines administered in India, and word clouds of high-frequency adjective unigrams after sentiment analysis, as evidence.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 117.69
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 158.24
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://www.kaggle.com/gpreda/all-covid19-vaccines-tweets.

References

  1. Rosenbaum, L.: Escaping catch-22—overcoming Covid vaccine hesitancy. N. Engl. J. Med. 384(14), 1367–1371 (2021)

    Article  Google Scholar 

  2. Yousefinaghani, S., Dara, R., Mubareka, S., Papadopoulos, A., Sharif, S.: An analysis of Covid-19 vaccine sentiments and opinions on Twitter. Int. J. Infect. Dis. 108, 256–262 (2021)

    Google Scholar 

  3. Krishnan, G.S., Sowmya Kamath, S., Sugumaran, V.: Predicting vaccine hesitancy and vaccine sentiment using topic modeling and evolutionary optimization. In: Métais, E., Meziane, F., Horacek, H., Kapetanios, E. (eds.) Natural Language Processing and Information Systems, NLDB 2021. LNCS, vol. 12801, pp. 255–263. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-80599-9_23

  4. Bl, M., Midha, S., Ramana Murthy Oruganti, V.: Sentiment analysis in Indian sub-continent during Covid-19 second wave using twitter data. In: 2021 IEEE 9th Region 10 Humanitarian Technology Conference (R10-HTC), pp. 1–6. IEEE (2021)

    Google Scholar 

  5. Liu, S., Li, J., Liu, J.: Leveraging transfer learning to analyze opinions, attitudes, and behavioral intentions toward Covid-19 vaccines: social media content and temporal analysis. J. Med. Internet Res. 23(8), e30251 (2021)

    Article  Google Scholar 

  6. To, Q.G., et al.: Applying machine learning to identify anti-vaccination tweets during the Covid-19 pandemic. Int. J. Environ. Res. Public Health 18(8), 4069 (2021)

    Article  Google Scholar 

  7. Nguyen, T.T., Nguyen, Q.V.H., Nguyen, D.T., Hsu, E.B., Yang, S., Eklund, P.: Artificial intelligence in the battle against coronavirus (Covid-19): a survey and future research directions. arXiv preprint arXiv:2008.07343 (2020)

  8. Vashishtha, S., Susan, S.: Fuzzy interpretation of word polarity scores for unsupervised sentiment analysis. In: 2020 11th İnternational Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1–6. IEEE (2020)

    Google Scholar 

  9. Hutto, C., Gilbert, E.: VADER: a parsimonious rule-based model for sentiment analysis of social media text. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 8(1) (2014)

    Google Scholar 

  10. Loria, S., Keen, P., Honnibal, M., Yankovsky, R., Karesh, D., Dempsey, E.: Textblob: simplified text processing. In: Secondary TextBlob: Simplified Text Processing, vol. 3 (2014)

    Google Scholar 

  11. Koto, F., Adriani, M.: A comparative study on twitter sentiment analysis: Which features are good? In: Biemann, C., Handschuh, S., Freitas, A., Meziane, F., Métais, E. (eds.) NLDB 2015. LNCS, vol. 9103, pp. 453–457. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19581-0_46

    Chapter  Google Scholar 

  12. Ghosh, M., Gupta, K., Susan, S.: Aspect-based unsupervised negative sentiment analysis. In: Hemanth, J., Bestak, R., Chen, J.I.Z. (eds.) Intelligent Data Communication Technologies and Internet of Things, pp. 335–344. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-9509-7_29

  13. Vashishtha, S., Susan, S.: Highlighting keyphrases using senti-scoring and fuzzy entropy for unsupervised sentiment analysis. Expert Syst. Appl. 169, 114323 (2021)

    Article  Google Scholar 

  14. Hu, T., et al.: Revealing public opinion towards Covid-19 vaccines using Twitter data in the United States: a spatiotemporal perspective. medRxiv (2021)

    Google Scholar 

  15. Na, T., Cheng, W., Li, D., Lu, W., Li, H.: Insight from NLP analysis: Covid-19 vaccines sentiments on social media. arXiv preprint arXiv:2106.04081 (2021)

  16. Liu, S., Liu, J.: Public attitudes toward Covid-19 vaccines on English-language Twitter: a sentiment analysis. Vaccine 39(39), 5499–5505 (2021)

    Article  Google Scholar 

  17. Marcec, R., Likic, R.: Using Twitter for sentiment analysis towards AstraZeneca/Oxford, Pfizer/BioNTech and Moderna Covid-19 vaccines. Postgrad. Med. J., 1–7 (2021)

    Google Scholar 

  18. Sattar, N.S., Arifuzzaman, S.: Covid-19 vaccination awareness and aftermath: public sentiment analysis on twitter data and vaccinated population prediction in the usa. Appl. Sci. 11(13), 6128 (2021)

    Article  Google Scholar 

  19. Ghasiya, P., Okamura, K.: Investigating covid-19 news across four nations: a topic modeling and sentiment analysis approach. IEEE Access 9, 36645–36656 (2021)

    Google Scholar 

  20. Nigam, K., McCallum, A.K., Thrun, S., Mitchell, T.: Text classification from labeled and unlabeled documents using EM. Mach. Learn. 39(2), 103–134 (2000)

    Google Scholar 

  21. Zhang, L., Fan, H., Peng, C., Rao, G., Cong, Q.: Sentiment analysis methods for hpv vaccines related tweets based on transfer learning. In: Healthcare, vol. 8(3), p. 307. Multidisciplinary Digital Publishing Institute (2020)

    Google Scholar 

  22. Müller, M., Salathé, M., Kummervold, P.E.: Covid-twitter-bert: a natural language processing model to analyse covid-19 content on twitter. arXiv preprint arXiv:2005.07503 (2020)

  23. Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., Le, Q.V.: XLNet: generalized autoregressive pretraining for language understanding. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems, pp. 5753–5763 (2019)

    Google Scholar 

  24. Rane, A., Kumar, A.: Sentiment classification system of twitter data for US airline service analysis. In: 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), vol. 1, pp. 769–773. IEEE (2018)

    Google Scholar 

  25. Sweidan, A.H., El-Bendary, N., Al-Feel, H.: Sentence-level aspect-based sentiment analysis for classifying adverse drug reactions (ADRs) using hybrid ontology-XLNet transfer learning. IEEE Access 9, 90828–90846 (2021)

    Google Scholar 

  26. He, X., Li, V.O.: Show me how to revise: ımproving lexically constrained sentence generation with XLNet. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35(14), pp. 12989–12997 (2021)

    Google Scholar 

  27. Goel, R., Vashisht, S., Dhanda, A., Susan, S.: An empathetic conversational agent with attentional mechanism. In: 2021 International Conference on Computer Communication and Informatics (ICCCI), pp. 1–4. IEEE (2021)

    Google Scholar 

  28. Dai, Z., Yang, Z., Yang, Y., Carbonell, J.G., Le, Q., Salakhutdinov, R.: Transformer-XL: attentive language models beyond a fixed-length context. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 2978–2988 (2019)

    Google Scholar 

  29. Koo, J., Lee, J.H., Pyo, J., Jo, Y., Lee, K.: Exploiting multi-modal features from pre-trained networks for Alzheimer's dementia recognition. arXiv preprint arXiv:2009.04070 (2020)

  30. Goel, R., Susan, S., Vashisht, S., Dhanda, A.: Emotion-aware transformer encoder for empathetic dialogue generation. In: 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), pp. 1–6. IEEE Computer Society (2021)

    Google Scholar 

  31. Susan, S., Keshari, J.: Finding significant keywords for document databases by two-phase Maximum Entropy Partitioning. Pattern Recogn. Lett. 125, 195–205 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, Delhi Technological University, New Delhi, India

    Anmol Bansal, Seba Susan, Arjun Choudhry & Anubhav Sharma

Authors
  1. Anmol Bansal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seba Susan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arjun Choudhry
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anubhav Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seba Susan .

Editor information

Editors and Affiliations

  1. Télécom SudParis, Palaiseau, France

    Mounîm El Yacoubi

  2. École de Technologie Supérieure, Montreal, QC, Canada

    Eric Granger

  3. Hong Kong Baptist University, Kowloon, Kowloon, Hong Kong

    Pong Chi Yuen

  4. Indian Statistical Institute, Kolkata, India

    Umapada Pal

  5. Université Paris Cité, Paris, France

    Nicole Vincent

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bansal, A., Susan, S., Choudhry, A., Sharma, A. (2022). Covid-19 Vaccine Sentiment Analysis During Second Wave in India by Transfer Learning Using XLNet. In: El Yacoubi, M., Granger, E., Yuen, P.C., Pal, U., Vincent, N. (eds) Pattern Recognition and Artificial Intelligence. ICPRAI 2022. Lecture Notes in Computer Science, vol 13364. Springer, Cham. https://doi.org/10.1007/978-3-031-09282-4_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-09282-4_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-09281-7

  • Online ISBN: 978-3-031-09282-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation