Document Type
Article
Abstract
Over the past few years, the ubiquitous usage of internet to broadcast information worldwide, has proved to be one of the best methods in making people aware about their surroundings. This has also led towards storage of vast amount of data in user interactive websites. Several news channels apart from live streaming, are using internet in such ways to convey their information. And these methods have not only benefited people to acquire regular updates but have also impacted their lives in many ways during the world awakening pandemic like COVID-19. Currently, in this pandemic situation, many leaders including federal and state government officials have shown great concern towards society by providing statements such as preventive measures, which were regularly recorded and elaborated in the form of stories by the news channels in their own websites. But, in general, the type of statement given by a leader will always affect people’s opinion and behavior, which also happened during this pandemic. There were variations in number of cases of COVID-19 based upon a region leader’s statements as per timeline and the people’s modulating lifestyle there. This kind of relationship has motivated us towards analyzing the COVID-19 data based on sentiment and emotion involved in leader’s statements, giving rise to an idea of web scraping to obtain their statements and stories from news channels. The main aim of this paper is to enlighten about different techniques and libraries used for web scraping, some challenges while designing a web scraper and finally arrive at an efficient methodology using them to extract news headlines and stories and create a new dataset that can be used in sentiment and emotion analysis. In future work, we will present the results of our experiments with the downloaded datasets.
Publication Date
7-2-2021
Language
English
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Recommended Citation
Thota, Poojitha and Elmasri, Ramez, "Web Scraping of COVID-19 News Stories to Create Datasets for Sentiment and Emotion Analysis" (2021). Association of Computing Machinery Open Access Agreement Publications. 20.
https://mavmatrix.uta.edu/utalibraries_acmoapubs/20