Search for collections on Wintec Research Archive

Using Bisect K-Means Clustering Technique in the Analysis of Arabic Documents

Citation: UNSPECIFIED.

Full text not available from this repository.

Abstract

In this article, I have investigated the performance of the bisect K-means clustering algorithm compared to the standard K-means algorithm in the analysis of Arabic documents. The experiments included five commonly used similarity and distance functions (Pearson correlation coefficient, cosine, Jaccard coefficient, Euclidean distance, and averaged Kullback-Leibler divergence) and three leading stemmers. Using the purity measure, the bisect K-means clearly outperformed the standard K-means in all settings with varying margins. For the bisect K-means, the best purity reached 0.927 when using the Pearson correlation coefficient function, while for the standard K-means, the best purity reached 0.884 when using the Jaccard coefficient function. Removing stop words significantly improved the results of the bisect K-means but produced minor improvements in the results of the standard K-means. Stemming provided additional minor improvement in all settings except the combination of the averaged Kullback-Leibler divergence function and the root-based stemmer, where the purity was deteriorated by more than 10%. These experiments were conducted using a dataset with nine categories, each of which contains 300 documents.

Item Type: Journal article
Subjects: Q Science > QA Mathematics > QA76 Computer software
Depositing User: Diab Abuaiadah
Date Deposited: 24 Feb 2016 01:46
Last Modified: 21 Jul 2023 04:19
URI: http://researcharchive.wintec.ac.nz/id/eprint/4319

Actions (login required)

View Item
View Item