簡易檢索 / 詳目顯示

研究生: 張家福
Chang, Chia-Fu
論文名稱: 即時監測果蠅行為之事件觸發式仿神經微系統
Event-Triggered Neuromorphic Microsystems for Real-time Monitoring of Fly Behavior
指導教授: 陳新
Chen, Hsin
口試委員:
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電子工程研究所
Institute of Electronics Engineering
論文出版年: 2010
畢業學年度: 98
語文別: 中文
論文頁數: 80
中文關鍵詞: 位址事件表現低溫多晶矽仿神經影像追蹤計算式感應器果蠅行為
外文關鍵詞: AER, LTPS, neuromorphic, visual tracking, computational sensor, fly behavior
相關次數: 點閱:2下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本論文提出一個可以即時監測果蠅行為之事件觸發式仿神經微系統。在像素電路上,分別利用5μm低溫多晶矽的製程於玻璃基板以及0.35μm CMOS製程於矽基板實現了具調適功能(adaptation)且在光線變弱時可偵測並轉換成數位訊號的讀出電路,當光線由亮變暗時,此像素電路會自動調適背景光線的變化,並且輸出一個數位訊號,適應的功能還可以讓光線由亮變暗後僅輸出一個訊號,而不會因為光線持續是暗的狀態而持續的送出數位訊號。在設計上考慮到工業技術研究院低溫多晶矽製程的NMOS技術尚未完全成熟,因此在低溫多晶矽製程的電路實現上使用了PMOS-only的設計。
    在系統上,採用0.35μm CMOS製程實現8×8的陣列。陣列上每個像素輸出訊號透過仿神經系統常用的位址事件表現(address event representation,AER)方式來將訊號轉換成像素的位址,優點是僅需要處理有光線變化的像素,相較於傳統掃描方式是逐一將像素訊號讀出,因此可以加快速度,減少耗能。此陣列除了即時的影像追蹤外,還具有興趣視窗(window of interesting,WOI)的功能,可以任意設定此陣列上具感測功能的區域。此功能的優點可以排除不感興趣的區域以降低資料的容量,並可計算感興趣範圍內的移動物體數目,同時可在多物體影像追蹤上將不感興趣的物體去除,讓視窗鎖定並隨著感興趣的目標物移動。在同時多個目標物情況下,此功能提供我們選擇出單一目標物並即時給予刺激的應用。


    The event-triggered neuromorphic microsystems are established to achieve the real-time monitoring for fruit fly behaviors. The microsystems are implemented by low temperature polysilicon (LTPS) process with PMOS-only design on glass substrate and TSMC 0.35 μm CMOS process on silicon substrate, respectively. In pixel circuits, the sensor adapts to the background illuminance and responds the negative illuminance transient to a digital signal. The output signals from pixel circuits are fed to the address event representation (AER) circuit usually applied in neuromorphic microsystems and then multiplexed onto a common address bus where the address encodes the location of the sending pixel. Furthermore, the system contains a window-of-interesting (WOI) function and this act allows to operate in two function modes, selection mode and tracking mode. Selection mode allows to choose an arbitrary area in the sensor array while disable the other area. The other is the tracking mode which contains a 3x3 area can lock onto a moving fly and continuously provide the location and visual information. At the same time, the tracking mode provides an approach to stimulate and track one chosen fly among the several flies. This WOI function is very useful in studying the behaviors of fruit flies.

    致謝..................................................... I 中文摘要................................................. II Abstract .............................................. III 內文目錄............................................... IV 圖目錄................................................. Ⅵ 表目錄.................................................. Ⅸ 第一章 序論 1.1 動機..................................................1 1.2 研究貢獻..............................................1 1.3 章節介紹..............................................2 第二章 文獻回顧 2.1果蠅行為實驗與果蠅影像處理分析介紹.................... 4 2.2 適應性光學暫態反應像素電路.........................7 2.2.1光學暫態感應器............................... ......7 2.2.2非同步事件觸發式暫態影像讀出電路..................11 2.3位址事件表現......................................... 13 2.4興趣視窗 (window of interest,WOI) 與影像追蹤原理簡介17 2.5低溫多晶矽製程(Low Temperature PolySilicon,LTPS)簡介…19 2.6 總結…………………………………………………………… 24 第三章以低溫多晶矽製程設計果蠅行為監測微系統 3.1友達光電公司低溫多晶矽製程的光二極體量測結果 ………… 25 3.2 系統架構 …………………………………………………28 3.3電路設計………………………………………………………..29 3.3.1 像素電路………………………………………………………29 3.3.2 仲裁電路………………………………………………………32 3.3.3 編碼電路………………………………………………………34 3.4 系統模擬結果…………………………………………………...35 3.5 量測結果………………………………………………………...36 3.5.1工業技術研究院低溫多晶矽製程的光二極體量測結果……37 3.5.2像素電路量測結果……………………………………………38 3.6 外接光電晶體及LED燈系統測試……………………………….42 3.7 總結……………………………………………………………...43 第四章 可調視窗式影像追蹤陣列 4.1 電路架構………………………………………...45 4.1.1 系統架構………………………………………………………45 4.1.2 像素電路………………….…………………………………47 4.1.3 位址事件表現電路(Address-Event Representation ) ........................................51 4.1.4 興趣視窗(window of interest ,WOI) 控制電路… 54 4.2 系統晶片…….………………………………………………61 4.3 量測結果………………………………………………………63 4.3.1台積電0.35μm CMOS製程光二極體量測結果………………63 4.3.2 系統量測結果………………………………………………64 4.4 微系統晶片應用於果蠅實驗結果………….………………… 74 4.5 總結……………………………………………….……………75 第五章 結論與未來工作 5.1 結論…………………………………………………………….76 5.2 未來工作………………………………………………………..77 參考文獻……………………………………………………………………… 78

    [1]R. Strauss and M. Heisenberg, "Coordination of legs during straight walking and turning in Drosophila melanogaster, "Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology, vol. 167, pp. 403-412, 1990.

    [2] RB. Ramazani, HR. Krishnan, SE.Bergeson, NS. Atkinson, "Computer auto- mated movement detection for the analysis of behavior, "Journal of neuroscience methods, vol. 162, 171– 179, 2007.

    [3] JE. Zimmerman, DM. Raizen, MH. Maycock, G. Maislin, AI. Pack, "A video method to study Drosophila sleep ," Sleep, vol. 31, pp. 1587-1598, 2008.

    [4] H. Dankert, L. Wang, E. D. Hoopfer, D. Anderson,P.Perona, "Automated monitoring and analysis of social behavior in Drosophila,"Nature methods, vol. 6, pp. 297-303, 2009.

    [5] R. Serrano-Gotarredona, M. Oster, P. Lichtester, A. L. Barranco, R. P. Vicente, F. G. Rodriguze, L. C. Mesa, R. Berner, M. R. Perzez, T. Delbruck, S. C. Liu, R. Douglas, P. Hafliger, G. J. Moreno, A. C. Ballcels, T.S. Gotarredona, "CAVIAR: a 45k neuron, 5M synapse, 12G connects/s AER hardware sensory- processing- learning-actuating system for high-speed visual object recognition and tracking," IEEE Transactions on Neural Networks, vol. 20, pp. 1417-1438, 2009.

    [6] R. Vogelstein, E. Cauwenberghs, R. E. Cumnings, "A multichip neuromorphic system for spike-based visual information processing," Neural computation, vol. 19, pp. 2281-2300, 2007.

    [7] T. Serre, "Learning a dictionary of shape-components in visual cortex:Com- parison with neurons, humans and machines," MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, Tech. Rep. MIT- CSAIL-TR -2006-028 CBCL-260, 2006.

    [8] S. Thorpe, D. Fize, and C. Marlot, "Speed of processing in the human visual system," Nature, vol. 381, pp. 520–522, 1996.

    [9] L. Itti, "Quantifying the contribution of low-level saliency to human eye
    movements in dynamic scenes, " Visual cognition, vol. 12, pp.1093-1123, 2005.

    [10]J. Kramer, "An integrated optical transient sensor," IEEE Transactions on Circuits and Systems II Analog and Digital Signal Processing, vol. 49, pp. 612-628, 2002.

    [11]J. Kramer," An on/off transient imager with event-driven, asynchronous read-out," In: International Symposium on Circuits and Systems, ISCAS 2002, Phoenix, AZ, USA, pp. 165–168, 2002.

    [12] P. Lichtsteiner, T. Delbruck, J. Kramer, "Improved on/off temporally differentiating address-event imager, " In: IEEE International Conference on Electronics, Circuits and Systems ICECS 2004, Tel Aviv, Israel, vol. 11, pp. 211–214, 2004.

    [13] K .A. Boahen, "Communicating neuronal ensembles between neuromorphic chips," in Neuromorphic Systems Engineering: Neural Networks in Silicon, T S Lande, Ed., chapter 11. Kluwer Academic Pub., 1998.

    [14] J. Lazzaro, J. Wawrzynek , "A Multi-Sender Asynchronous Extension to the
    AER protocol," Advanced Research in VLSI conference, 1995.

    [15]K. Boahen, "A Burst-Mode Word-Serial Address-Event Link¡XII: Receiver Design," IEEE Transactions on Circuits and Systems I, vol. 51, pp. 1281-1291, 2004.

    [16]K. Boahen, "A burst-mode word-serial address-event link-I: Transmitter design," IEEE Transactions on Circuits and Systems I, vol. 51, pp. 1269-1280, 2004.

    [17]K. Boahen, "Communicating neuronal ensembles between neuromorphic chips," Neuromorphic systems engineering, pp. 229-259, 1998.

    [18]K. Boahen, "Point-to-point connectivity between neuromorphic chips using address events," IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, vol. 47, pp. 416-434, 2000.

    [19] V. Brajovic and T. Kanade, “Sensory attention: A computational sensor paradigmfor low-latency, adaptive vision,” IEEE Trans. Robotics Automation, Sept. 1997.
    [20]V. Brajovic and T. Kanade, "Computational sensor for visual tracking with attention," IEEE Journal of Solid-State Circuits, vol. 33, pp. 1199-1207, 1998.

    [21] 梁馨宜,電晶體通道寬度對低溫複晶矽薄膜元件可靠度影響之研究,碩士
    論文,國立清華大學,2007。

    [22] 陳柏廷,改善低溫複晶矽薄膜電晶體均勻性之元件架構與校正電路之研究,碩士論文,國立交通大學,2006。

    [23] T. M. Wang, Y. H. Li, M. D. Ker, "On-glass digital-to-analog converter with
    gamma correction for panel data driver, " Proceedings IEEE International
    Conference on Electronics, Circuits, and Systems, pp202-205, 2008.

    [24] M. D. Ker, C. K. Deng, J. L. Huang, "On-panel output buffer with offset compensation technique for data driver in LTPS technology," Journal of Display Technololgy, vol. 2, pp. 153-159, 2006.

    [25] E. Culurciello, R. Etienne-Cumming, K.A.Boahan, "A biomorphic digital image sensor," IEEE Journal of Solid-State Circuits, vol. 38, pp. 281-294, 2003.

    [26] P. Lichtsteiner, C. Posch,T. Delbruck, "A 128x128 120dB 15us latency asynchronous temporal contrast vision sensor," IEEE Journal of Solid State Circuits, vol. 43, pp. 566-576, 2008.

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE