UM
A Fully Dynamic Multi-Mode CMOS Vision Sensor with Mixed-Signal Cooperative Motion Sensing and Object Segmentation for Adaptive Edge Computing
Zhong,Xiaopeng1; Law,Man Kay2; Tsui,Chi Ying1; Bermak,Amine3
2020-06-01
Source PublicationIEEE Journal of Solid-State Circuits
ISSN0018-9200
Volume55Issue:6Pages:1684-1697
AbstractThis article presents a low-power multi-mode CMOS vision sensor with mixed-signal in-sensor computation capabilities targeting the next-generation wireless sensing applications. To support the always-on and scene-adaptive edge computing scenarios with low power and low bandwidth, the sensor is reconfigurable for three operation modes, namely: 1) motion sensing (MS); 2) object segmentation (OS); and 3) full imaging (FIM). A mixed-signal cooperative scheme of frame differencing (FD) and background subtraction (BS) is proposed to achieve high-accuracy MS with varying object sizes and speeds. The mixed-signal BS-based OS can minimize both object localizing and imaging efforts for object analysis upon motion triggering, while FIM enables complete scene recording for the identified object of interest. The complete CMOS vision sensor is implemented through reconfigurable and fully dynamic mixed-signal processing at both pixel and column levels cooperatively to achieve low power and compact area. Fabricated in a 0.18- { {\mu }}\text{m} CMOS, the 256 {\times } 216 chip prototype achieves the cooperative MS with only 2.36 {\mu }\text{W} at 15 frames/s, when composed of 14 FD frames (147 nJ/frame) and 1 BS frame (302 nJ/frame). The OS mode consumes 1.442.04 {\mu }\text{J} /frame at 0%100% object occupancy, linearly corresponding to 41%16% power saving when compared with the conventional digital OS. The FIM mode operates with only 1.41 {\mu }\text{J} /frame for complete scene recording. The achieved energy efficiencies for all operation modes compare favorably with the state of the art.
KeywordBackground subtraction (BS) CMOS vision sensor cooperative motion sensing (MS) edge computing frame differencing (FD) fully dynamic in-sensor computation mixed-signal processing object segmentation (OS) wireless sensor networks (WSNs)
DOI10.1109/JSSC.2019.2961848
URLView the original
Language英语
Fulltext Access
Citation statistics
Cited Times [WOS]:0   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Corresponding AuthorZhong,Xiaopeng
Affiliation1.Department of Electronic and Computer Engineering,Hong Kong University of Science and Technology,Hong Kong,Hong Kong
2.State Key Laboratory of Analog and Mixed-Signal VLSI,University of Macau,Macao
3.Information and Computing Technology Division,College of Science and Engineering,Hamad Bin Khalifa University,Doha,Qatar
Recommended Citation
GB/T 7714
Zhong,Xiaopeng,Law,Man Kay,Tsui,Chi Ying,et al. A Fully Dynamic Multi-Mode CMOS Vision Sensor with Mixed-Signal Cooperative Motion Sensing and Object Segmentation for Adaptive Edge Computing[J]. IEEE Journal of Solid-State Circuits,2020,55(6):1684-1697.
APA Zhong,Xiaopeng,Law,Man Kay,Tsui,Chi Ying,&Bermak,Amine.(2020).A Fully Dynamic Multi-Mode CMOS Vision Sensor with Mixed-Signal Cooperative Motion Sensing and Object Segmentation for Adaptive Edge Computing.IEEE Journal of Solid-State Circuits,55(6),1684-1697.
MLA Zhong,Xiaopeng,et al."A Fully Dynamic Multi-Mode CMOS Vision Sensor with Mixed-Signal Cooperative Motion Sensing and Object Segmentation for Adaptive Edge Computing".IEEE Journal of Solid-State Circuits 55.6(2020):1684-1697.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhong,Xiaopeng]'s Articles
[Law,Man Kay]'s Articles
[Tsui,Chi Ying]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhong,Xiaopeng]'s Articles
[Law,Man Kay]'s Articles
[Tsui,Chi Ying]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhong,Xiaopeng]'s Articles
[Law,Man Kay]'s Articles
[Tsui,Chi Ying]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.