UM
Efficient Detection of Soft Concatenation Mapping
Liu, Hao; Xiao, Jiang; Tan, Haoyu; Luo, Qiong; Zhao, Jintao; Ni, Lionel M.
2018-11
Source PublicationIEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
ISSN1041-4347
Volume30Issue:11Pages:2106-2119
AbstractIn modern big data warehouse systems, we observe a common phenomenon that a column of data values can be derived from one or several other columns by transforming and concatenating these columns. We call this relationship between columns a Soft Concatenation Mapping (SCM). SCMs imply significant redundancy in the schema or data, and therefore can be exploited for data integration or data compression. In this paper, we formalize the problem of SCM detection and prove it is NP-hard. We then propose efficient approximate algorithms to detect all SCMs or an optimal set of SCMs in a table. Our experiments on both real-world and synthetic datasets show promising results.
KeywordBig data management data profiling soft concatenation mapping
DOI10.1109/TKDE.2018.2812822
URLView the original
Indexed BySCI
Language英语
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Information Systems ; Engineering, Electrical & Electronic
WOS IDWOS:000446795900007
PublisherIEEE COMPUTER SOC
The Source to ArticleWOS
Fulltext Access
Citation statistics
Cited Times [WOS]:1   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Recommended Citation
GB/T 7714
Liu, Hao,Xiao, Jiang,Tan, Haoyu,et al. Efficient Detection of Soft Concatenation Mapping[J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING,2018,30(11):2106-2119.
APA Liu, Hao,Xiao, Jiang,Tan, Haoyu,Luo, Qiong,Zhao, Jintao,&Ni, Lionel M..(2018).Efficient Detection of Soft Concatenation Mapping.IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING,30(11),2106-2119.
MLA Liu, Hao,et al."Efficient Detection of Soft Concatenation Mapping".IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING 30.11(2018):2106-2119.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liu, Hao]'s Articles
[Xiao, Jiang]'s Articles
[Tan, Haoyu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liu, Hao]'s Articles
[Xiao, Jiang]'s Articles
[Tan, Haoyu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liu, Hao]'s Articles
[Xiao, Jiang]'s Articles
[Tan, Haoyu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.