ParallelTopics: A probabilistic approach to exploring document collections.
Dou, Wenwen.
Wang, Xiaoyu.
Chang, Remco.
Ribarsky, William.
2011.
- Scalable and effective analysis of large text corpora remains a challenging problem as our ability to collect textual data continues to increase at an exponential rate. To help users make sense of large text corpora, we present a novel visual analytics system, Parallel-Topics, which integrates a state-of-the-art probabilistic topic model Latent Dirichlet Allocation (LDA) with interactive visualization. ... read moreTo describe a corpus of documents, ParallelTopics first extracts a set of semantically meaningful topics using LDA. Unlike most traditional clustering techniques in which a document is assigned to a specific cluster, the LDA model accounts for different topical aspects of each individual document. This permits effective full text analysis of larger documents that may contain multiple topics. To highlight this property of the model, ParallelTopics utilizes the parallel coordinate metaphor to present the probabilistic distribution of a document across topics. Such representation allows the users to discover single-topic vs. multi-topic documents and the relative importance of each topic to a document of interest. In addition, since most text corpora are inherently temporal, ParallelTopics also depicts the topic evolution over time. We have applied ParallelTopics to exploring and analyzing several text corpora, including the scientific proposals awarded by the National Science Foundation and the publications in the VAST community over the years. To demonstrate the efficacy of ParallelTopics, we conducted several expert evaluations, the results of which are reported in this paper. © 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.read less
- Dou, Wenwen, Xiaoyu Wang, Remco Chang, and William Ribarsky. "ParallelTopics: A Probabilistic Approach to Exploring Document Collections." 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) (October 2011). doi:10.1109/vast.2011.6102461.
- ID:
- sj139c73r
- To Cite:
- TARC Citation Guide EndNote
- Usage:
- Detailed Rights
