UM  > 科技學院  > 電腦及資訊科學系
A Lightweight Data Preprocessing Strategy with Fast Contradiction Analysis for Incremental Classifier Learning
Simon Fong1; Robert P. Biuk-Aghai1; Yain-whar Si1; Bee Wah Yap2
2015
Source PublicationMathematical Problems in Engineering
ISSN1024-123X
Volume2015
Abstract

A prime objective in constructing data streaming mining models is to achieve good accuracy, fast learning, and robustness to noise. Although many techniques have been proposed in the past, efforts to improve the accuracy of classification models have been somewhat disparate. These techniques include, but are not limited to, feature selection, dimensionality reduction, and the removal of noise from training data. One limitation common to all of these techniques is the assumption that the full training dataset must be applied. Although this has been effective for traditional batch training, it may not be practical for incremental classifier learning, also known as data stream mining, where only a single pass of the data stream is seen at a time. Because data streams can amount to infinity and the so-called big data phenomenon, the data preprocessing time must be kept to a minimum. This paper introduces a new data preprocessing strategy suitable for the progressive purging of noisy data from the training dataset without the need to process the whole dataset at one time. This strategy is shown via a computer simulation to provide the significant benefit of allowing for the dynamic removal of bad records from the incremental classifier learning process.

DOIhttps://doi.org/10.1155/2015/125781
URLView the original
Indexed BySCI
Language英语
WOS Research AreaEngineering ; Mathematics
WOS SubjectEngineering, Multidisciplinary ; Mathematics, Interdisciplinary Applications
WOS IDWOS:000352424900001
PublisherHINDAWI LTD, ADAM HOUSE, 3RD FLR, 1 FITZROY SQ, LONDON, W1T 5HF, ENGLAND
全文获取链接
引用统计
被引频次[WOS]:2   [WOS记录]     [WOS相关记录]
Document TypeJournal article
专题DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorSimon Fong
Affiliation1.Department of Computer and Information Science, University of Macau, Macau
2.Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
推荐引用方式
GB/T 7714
Simon Fong,Robert P. Biuk-Aghai,Yain-whar Si,et al. A Lightweight Data Preprocessing Strategy with Fast Contradiction Analysis for Incremental Classifier Learning[J]. Mathematical Problems in Engineering,2015,2015.
APA Simon Fong,Robert P. Biuk-Aghai,Yain-whar Si,&Bee Wah Yap.(2015).A Lightweight Data Preprocessing Strategy with Fast Contradiction Analysis for Incremental Classifier Learning.Mathematical Problems in Engineering,2015.
MLA Simon Fong,et al."A Lightweight Data Preprocessing Strategy with Fast Contradiction Analysis for Incremental Classifier Learning".Mathematical Problems in Engineering 2015(2015).
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
Google Scholar
中相似的文章 Google Scholar
[Simon Fong]的文章
[Robert P. Biuk-Aghai]的文章
[Yain-whar Si]的文章
Baidu academic
中相似的文章 Baidu academic
[Simon Fong]的文章
[Robert P. Biuk-Aghai]的文章
[Yain-whar Si]的文章
Bing Scholar
中相似的文章 Bing Scholar
[Simon Fong]的文章
[Robert P. Biuk-Aghai]的文章
[Yain-whar Si]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。