Latent Feature Word Representations to Enhance Topic Models for Text Mining Algorithms
Thayyaba Khatoon Mohammed1, M. Gayatri2, M. Sandeep3, V. S. K. Reddy4
1Dr Thayyaba Khatoon Mohammed, Professor, Malla Reddy College of Engineering & Technology, Hyderabad, India.
2M. Gayatri, Associate Professor, Malla Reddy College of Engineering & Technology, Hyderabad, India.
3M. Sandeep, Associate Professor, Malla Reddy College of Engineering & Technology, Hyderabad, India.
4Dr.VSK Reddy, Principal &Professor, Malla Reddy College of Engineering & Technology, Hyderabad, India.
Manuscript received on November 02, 2019. | Revised Manuscript received on November 15, 2019. | Manuscript published on December 30, 2019. | PP: 4816-4821 | Volume-9 Issue-2, December, 2019. | Retrieval Number: B2503129219/2019©BEIESP | DOI: 10.35940/ijeat.B2503.129219
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Dealing with large number of textual documents needs proven models that leverage the efficiency in processing. Text mining needs such models to have meaningful approaches to extract latent features from document collection. Latent Dirichlet allocation (LDA) is one such probabilistic generative process model that helps in representing document collections in a systematic approach. In many text mining applications LDA is useful as it supports many models. One such model is known as Topic Model. However, topic models LDA needs to be improved in order to exploit latent feature vector representations of words trained on large corpora to improve word-topic mapping learnt on smaller corpus. With respect to document clustering and document classification, it is essential to have a novel topic models to improve performance. In this paper, an improved topic model is proposed and implemented using LDA which exploits the benefits of Word2Vec tool to have pre-trained word vectors so as to achieve the desired enhancement. A prototype application is built to demonstrate the proof of the concept with text mining operations like document clustering.
Keywords: Text mining, document clustering, LDA, topic modeling, Word2Vec.