Crawling Hidden Objects with kNN Queries
Yan H.3; Gong Z.2; Zhang N.4; Huang T.1; Zhong H.1; Wei J.1
Source PublicationIEEE Transactions on Knowledge and Data Engineering

Many websites offering Location Based Services (LBS) provide a k NN search interface that returns the top-k nearest-neighbor objects (e.g., nearest restaurants) for a given query location. This paper addresses the problem of crawling all objects efficiently from an LBS website, through the public k NN web search interface it provides. Specifically, we develop crawling algorithm for 2D and higher-dimensional spaces, respectively, and demonstrate through theoretical analysis that the overhead of our algorithms can be bounded by a function of the number of dimensions and the number of crawled objects, regardless of the underlying distributions of the objects. We also extend the algorithms to leverage scenarios where certain auxiliary information about the underlying data distribution, e.g., the population density of an area which is often positively correlated with the density of LBS objects, is available. Extensive experiments on real-world datasets demonstrate the superiority of our algorithms over the state-of-the-art competitors in the literature.

KeywordData Crawling Hidden Databases Knn Queries Location Based Services
URLView the original
Indexed BySCI
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Information Systems ; Engineering, Electrical & Electronic
WOS IDWOS:000372543500006
Fulltext Access
Citation statistics
Cited Times [WOS]:0   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
Affiliation1.Institute of Software Chinese Academy of Sciences
2.Universidade de Macau
3.University of Science and Technology of China
4.George Washington University
Recommended Citation
GB/T 7714
Yan H.,Gong Z.,Zhang N.,et al. Crawling Hidden Objects with kNN Queries[J]. IEEE Transactions on Knowledge and Data Engineering,2016,28(4):912-924.
APA Yan H.,Gong Z.,Zhang N.,Huang T.,Zhong H.,&Wei J..(2016).Crawling Hidden Objects with kNN Queries.IEEE Transactions on Knowledge and Data Engineering,28(4),912-924.
MLA Yan H.,et al."Crawling Hidden Objects with kNN Queries".IEEE Transactions on Knowledge and Data Engineering 28.4(2016):912-924.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yan H.]'s Articles
[Gong Z.]'s Articles
[Zhang N.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yan H.]'s Articles
[Gong Z.]'s Articles
[Zhang N.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yan H.]'s Articles
[Gong Z.]'s Articles
[Zhang N.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.