Text Classification by Genre Based on Rhythm Features
https://doi.org/10.18255/1818-1015-2021-3-280-291
Abstract
The article is devoted to the analysis of the rhythm of texts of different genres: fiction novels, advertisements, scientific articles, reviews, tweets, and political articles. The authors identified lexico-grammatical figures in the texts: anaphora, epiphora, diacope, aposiopesis, etc., that are markers of the text rhythm. On their basis, statistical features were calculated that describe quantitatively and structurally these rhythm features.
The resulting text model was visualized for statistical analysis using boxplots and heat maps that showed differences in the rhythm of texts of different genres. The boxplots showed that almost all genres differ from each other in terms of the overall density of rhythm features. Heatmaps showed different rhythm patterns across genres. Further, the rhythm features were successfully used to classify texts into six genres. The classification was carried out in two ways: a binary classification for each genre in order to separate a particular genre from the rest genres, and a multi-class classification of the text corpus into six genres at once. Two text corpora in English and Russian were used for the experiments. Each corpus contains 100 fiction novels, scientific articles, advertisements and tweets, 50 reviews and political articles, i.e. a total of 500 texts. The high quality of the classification with neural networks showed that rhythm features are a good marker for most genres, especially fiction. The experiments were carried out using the ProseRhythmDetector software tool for Russian and English languages. Text corpora contains 300 texts for each language.
Supporting agencies: The reported study was funded by RFBR, project number 19-07-00243
About the Authors
Ksenia Vladimirovna Lagutina
P.G. Demidov Yaroslavl State University
Russian Federation
Russian Federation
Postgraduate student.
14 Sovetskaya str., Yaroslavl 150003
Nadezhda Stanislavovna Lagutina
P.G. Demidov Yaroslavl State University
Russian Federation
Russian Federation
PhD, associate professor.
14 Sovetskaya str., Yaroslavl 150003
Elena Igorevna Boychuk
Yaroslavl State Pedagogical University named after K.D. Ushinsky
Russian Federation
Russian Federation
PhD, associate professor.
108/1 Respublikanskaya str., Yaroslavl 150000
References
1. J. Worsham and J. Kalita, “Genre identification and the compositional effect of genre in literature”, in Proceedings of the 27th international conference on computational linguistics, 2018, pp. 1963–1973.
2. M. N. Melissourgou and K. T. Frantzi, “Genre identification based on SFL principles: The representation of text types and genres in English language teaching material”, Corpus Pragmatics, vol. 1, no. 4, pp. 373–392, 2017.
3. L. A. Kochetova and V. V. Popov, “Research of Axiological Dominants in Press Release Genre based on Automatic Extraction of Key Words from Corpus”, Nauchnyi dialog, no. 6, 2019, In Russian.
4. S. E. Murphy, “Shakespeare and his contemporaries: Designing a genre classification scheme for Early English Books Online 1560-1640”, ICAME Journal, pp. 59–82, 2019.
5. R. Malhotra and A. Sharma, “Quantitative evaluation of web metrics for automatic genre classification of web pages”, International Journal of System Assurance Engineering and Management, vol. 8, no. 2, pp. 1567–1579, 2017.
6. D. DEJICA, “Understanding Technical and Scientific Translation: A Genre-based Approach”, Scientific Bulletin of the Politehnica University of Timisoara. Transactions on Modern Languages/Buletinul Stiintific al Universitatii Politehnica din Timisoara. Seria Limbi Moderne, vol. 19, no. 1, pp. 56–66, 2020.
7. V. Thakur and A. C. Patel, “An Improved Dictionary Based Genre Classification Based on Title and Abstract of E-book Using Machine Learning Algorithms”, in Proceedings of Second International Conference on Computing, Communications, and Cyber-Security, Springer, 2021, pp. 323–337.
8. A. Cimino, M. Wieling, F. Dell’Orletta, S. Montemagni, and G. Venturi, “Identifying predictive features for textual genre classification: the key role of syntax”, Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017, pp. 107–112, 2017.
9. K. Lagutina, A. Poletaev, N. Lagutina, E. Boychuk, and I. Paramonov, “Automatic extraction of rhythm figures and analysis of their dynamics in prose of 19th-21st centuries”, Proceedings of the 26th Conference of Open Innovations Association FRUCT, pp. 247–255, 2020.
10. K. Lagutina, N. Lagutina, E. Boychuk, V. Larionov, and I. Paramonov, “Authorship verification of literary texts with rhythm features”, Proceedings of the 28th Conference of Open Innovations Association FRUCT, pp. 240–251, 2021.
11. A. Onan, “An ensemble scheme based on language function analysis and feature engineering for text genre classification”, Journal of Information Science, vol. 44, no. 1, pp. 28–47, 2018.
12. A. M. El-Halees, “Arabic Text Genre Classification”, Journal of Engineering Research and Technology, vol. 4, no. 3, pp. 105–109, 2017.
13. I. A. Batraeva, A. D. Nartsev, and A. S. Lezgyan, “Using the analysis of semantic proximity of words in solving the problem of determining the genre of texts within deep learning”, Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie vychislitelnaja tehnika i informatika, no. 50, pp. 14–22, 2020, In Russian.
14. V. B. Barahnin, O. Y. Kozhemyakina, E. V. Rychkova, I. S. Pastushkov, and Y. S. Borzilova, “Izvlechenie leksicheskih i metroritmicheskih priznakov, harakternyh dlya zhanra i stilya i ih kombinacij v processe avtomatizirovannoj obrabotki tekstov na russkom yazyke”, Sovremennye informacionnye tekhnologii i IT-obrazovanie, vol. 14, no. 4, pp. 888–895, 2018, In Russian.
15. O. A. Mitrofanova and A. D. Moskvina, “On the Role of Prepositional Statistics for Genre Identification of Russian texts”, International Journal of Open Information Technologies, vol. 8, no. 11, pp. 91–96, 2020, In Russian.
16. L. G. Gorbich and A. A. Zhivoderov, “Using statistical indexes to distinguish between scientific and popular science texts on the example of the works of A. E. Fersman”, Software & Systems, vol. 33, no. 4, pp. 720–725, 2020, In Russian.
17. A. R. Dubovik, “Automatic text style identification in terms of statistical parameters”, Komp’yuternaya lingvistika i vychislitel’nye ontologii, no. 1, pp. 29–45, 2017, In Russian.
18. A. Y. Antonova, E. S. Klyshinskij, and E. V. YAgunova, “Opredelenie stilevyh i zhanrovyh harakteristik kollekcij tekstov na osnove chasterechnoj sochetaemosti”, Otkrytye sistemy, vol. 3, pp. 80–85, 2011, In Russian.
19. M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks”, Information processing & management, vol. 45, no. 4, pp. 427–437, 2009.
20. L. Kozlova, “Sravnitel’naya tipologiya anglijskogo i russkogo yazykov”, Barnaul: AltGPU, no. 20019, p. 180, 2019, In Russian.
21. A. Wierzbicka, The semantics of grammar. John Benjamins Publishing, 1988, vol. 18, p. 617.
Review
For citations:
Lagutina K.V., Lagutina N.S., Boychuk E.I. Text Classification by Genre Based on Rhythm Features. Modeling and Analysis of Information Systems. 2021;28(3):280-291. (In Russ.) https://doi.org/10.18255/1818-1015-2021-3-280-291
Views:
713
Email this article 