研究生: |
邢維翰 Hsing, Wei Han |
---|---|
論文名稱: |
穿戴式生理感測裝置之整合應用平台 An Integrated Wearable Application Platform with Physiological Sensors |
指導教授: |
馬席彬
Ma, Hsi Pin |
口試委員: |
楊家驤
Yang, Chia Hsiang 黃元豪 Huang, Yuan Hao |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 通訊工程研究所 Communications Engineering |
論文出版年: | 2015 |
畢業學年度: | 104 |
語文別: | 英文 |
論文頁數: | 85 |
中文關鍵詞: | 穿戴式裝置 |
外文關鍵詞: | wearable device |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在論文中,我們提出以穿戴式生理感測裝置為基礎,整合出相關的應用平台。 我們使用穿戴式裝置收集心電訊號和呼吸訊號,第一種穿戴式裝置是由前端電路、FPGA控制器和藍芽模組所構成的。另一種穿戴式裝置是使用三軸加速度計和麥克風來收集呼吸訊號和鼾聲音訊。我們將訊號處理在手機上實踐,並在Android系統中設計app,方便使用者操作。
為了更快速、方便地分析生理訊號,我們選擇雲端系統來做為計算的平台,我們使用的雲端系統為Apache Storm,可以將資料透過無線網路上傳至雲端伺服器。藉由這些雲端計算的優點,我們提出一個有關情緒辨識的應用,透過穿戴式裝置收集生理訊號並整合雲端計算,完成訊號分析的工作。我們選擇的分類器:支持向量機,可將不同種類的訊號作分類,最終的分類準確率為58.3%。
除了以上的應用,我們也將穿戴式裝置延伸至其他應用。心腦互動的應用是透過心電訊號及腦波訊號得知手術前後的生理差異,並依據其差異判別使用者的情緒反應,特別使用顏色來區分緊張與放鬆的情緒差異。睡眠呼吸障礙患者的監測平台是利用三軸加速度計和麥克風收集生理訊號,將手機當作監測的平台,觀察患者的呼吸狀態及判定呼吸中止症的發生。最後我們提出一個結合呼吸訊號與娛樂的應用。
In this thesis, an integrated wearable application platform with physiological sensors are presented. We use the wearable devices to collect the electrocardiography (ECG) respiration (RESP) signals. The first wearable device is a prototype with analog front-end, FPGA controller and Bluetooth module. The other wearable device is using accelerometers and a microphone to collect respiration signals and snore sound. The mobile phone is a platform for dealing with the digital signal processing. We design an Android app with convenient user interface for every application.
In order to get more convenient to analyse these biomedical signals, we choose cloud computing system to be our computing platform. We implement the cloud computing by Apache Storm, which can transmit the data by streaming via 3G/Wi-Fi. Depending on the advantages of the cloud computing, we develop an application with the wearable device for the emotion recognition. The extracted-features of biomedical signals are implemented with methods by the cloud computing. The support vector machine (SVM) is a classifier for classifying the data set into the correct classes. The accuracy of the classification is 58.3 %.
Besides the detecting emotion recognition system, this wearable device can be applied in various applications. The heart and brain crosstalk system is an application of using ECG and Electroencephalography (EEG) signals to observe the patients’ surgery recovery. The special part is that the mental status of the patients can use colors scale to represent. The home monitoring system for sleep-disordered breathing is an application to monitor the patients
who is obstructive sleep apnea (OSA) and uses the accelerometers and microphones to detect the symptoms of disease. We modify the monitor platform from using MATLAB to Android mobile phone. The last application is using the same wearable device to collect RESP signals and then develop an entertaining app game.
[1] W. B. Cannon, Bodily changes in pain, hunger, fear and rage, an account of recent researches into the function of emotional excitement. New York and London, D. Appleton
and Company, 1915.
[2] L. F. Barrett, “Are emotions natural kinds?” Perspectives on Psychological Science, vol. 1, no. 1, pp. 28–58, 2006.
[3] G. Stemmler, “Physiological processes during emotion,” The regulation of emotion, pp.33–70, 2004.
[4] H. Holzapfel and C. Fuegen, “Integrating emotional cues into a framework for dialogue management,” in Proc. 4th IEEE Int. Conf. Multimodal Interfaces. Washington, DC,
USA: IEEE Computer Society, 2002, p. 141.
[5] C. Peter and A. Herbon, “Emotion representation and physiology assignments in digital systems,” Interacting with Computers, vol. 18, no. 2, pp. 139 – 170, 2006.
[6] S. D. Kreibig, “Autonomic nervous system activity in emotion: A review,” Biological Psychology, vol. 84, no. 3, pp. 394 – 421, 2010.
[7] T. Aue, A. Flykt, and K. R. Scherer, “First evidence for differential and sequential efferent effects of stimulus relevance and goal conduciveness appraisal,” Biological Psychology, vol. 74, no. 3, pp. 347 – 357, 2007.
[8] B. Baldaro, M. W. Battacchi, M. Codispoti, G. Tuozzi, G. Trombini, R. Bolzani, and D. Palomba, “Modifications of electrogastrographic activity during the viewing of brief
film sequences,” Perceptual and Motor Skills, vol. 82, no. 3c, pp. 1243–1250, Jun. 1996.80 BIBLIOGRAPHY
[9] P. Rainville, A. Bechara, N. Naqvi, and A. R. Damasio, “Basic emotions are associated with distinct patterns of cardiorespiratory activity,” International Journal of Psychophysiology, vol. 61, no. 1, pp. 5 – 18, 2006, psychophiosology and Cognitive Neuroscience.
[10] E. Vianna and D. Tranel, “Gastric myoelectrical activity as an index of emotional arousal,” International Journal of Psychophysiology, vol. 61, no. 1, pp. 70 – 76, 2006, psychophiosology and Cognitive Neuroscience.
[11] R. W. Levenson, P. Ekman, K. Heider, and W. V. Friesen, “Emotion and autonomic nervous system activity in the minangkabau of west sumatra,” US, pp. 972–988, 1992.
[12] B. L. Fredrickson and R. W. Levenson, “Positive emotions speed recovery from the cardiovascular sequelae of negative emotions,” Cognition and Emotion, vol. 12, no. 2,
pp. 191–220, 1998.
[13] L. A. Theall-Honey and L. A. Schmidt, “Do temperamentally shy children process emotion differently than nonshy children? behavioral, psychophysiological, and gender differences in reticent preschoolers,” Dev. Psychobiol., vol. 48, no. 3, pp. 187–196, Apr. 2006.
[14] G. JJ, R. W. Frederickson BL FAU Levenson, and L. RW, “The psychophysiology of crying,” Psychophysiology, vol. 31, pp. 460–468, 1994.
[15] J. Rottenberg, F. H. Wilhelm, J. J. Gross, and I. H. Gotlib, “Vagal rebound during resolution of tearful crying among depressed and nondepressed individuals,”Psychophysiol-
ogy, vol. 40, no. 1, pp. 1–6, Jan. 2003.
[16] I. C. Christie and B. H. Friedman, “Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach,” International Journal of Psychophysiology, vol. 51, no. 2, pp. 143 – 153, 2004.
[17] J. L. Tsai, R. W. Levenson, and L. L. Carstensen, “Autonomic, subjective, and expressive responses to emotional films in older and younger chinese americans and european americans,” US, pp. 684–693, 2000.
[18] B. F, “Autonomic response patterns during voluntary facial action,” Psychophysiology, vol. 33, no. 0048-5772 (Linking), pp. 123–131, 1996.
[19] J. A. Etzel, E. L. Johnsen, J. Dickerson, D. Tranel, and R. Adolphs, “Cardiovascular and respiratory responses during musical mood induction,” International Journal of Psychophysiology, vol. 61, no. 1, pp. 57 – 69, 2006.
[20] P. Jonsson and M. Sonnby-Borgstrom, “The effects of pictures of emotional faces on tonic and phasic autonomic cardiac control in women and men,” Biological Psychology,
vol. 62, no. 2, pp. 157 – 173, 2003.
[21] J. Gruber, S. L. Johnson, C. Oveis, and D. Keltner, “Risk for mania and positive emotional responding: Too much of a good thing?” Emotion, vol. 8, no. 1, pp. 23–33, 2008.
[22] S. R. Waldstein, W. J. Kop, L. A. Schmidt, A. J. Haufler, D. S. Krantz, and N. A. Fox, “Frontal electrocortical and cardiovascular reactivity during happiness and anger,” Biological Psychology, vol. 55, no. 1, pp. 3 – 23, 2000.
[23] T. Ritz, M. Thons, S. Fahrenkrug, and B. Dahme, “Airways, respiration, and respiratory sinus arrhythmia during picture viewing,” Psychophysiology, vol. 42, no. 5, pp. 568–578, Sep. 2005.
[24] D. Novak, M. Mihelj, and M. Munih, “A survey of methods for data fusion and system adaptation using autonomic nervous system responses in physiological computing,”Interacting with Computers, vol. 24, no. 3, pp. 154 – 172, 2012.
[25] S. D. Kreibig, A. C. Samson, and J. J. Gross, “The psychophysiology of mixed emotional states: Internal and external replicability analysis of a direct replication study,”Psychophysiol, vol. 52, no. 7, pp. 873–886, Jul. 2015.
[26] W. Wang, X. Huang, J. Zhao, and Y. Shen, “Physiological signals based day-dependence analysis with metric multidimensional scaling for sentiment classification in wearable sensors,” Journal of Engineering and Technological Sciences, vol. 47, no. 1, pp. 104–116, 2015.
[27] K. Kim, S. Bang, and S. Kim, “Emotion recognition system using short-term monitoring of physiological signals,” Medical and Biological Engineering and Computing, vol. 42, no. 3, pp. 419–427, 2004.
[28] H. Men, Y. Wu, Y. Gao, X. Li, and S. Yang, “Application of support vector machine to pattern classification,” in ICSP 2008. 9th Int. Conf. Signal Processing, Oct 2008, pp.1612–1615.
[29] F. Nasoz, K. Alvarez, C. Lisetti, and N. Finkelstein, “Emotion recognition from physiological signals using wireless sensors for presence technologies,” Cognition, Technology & Work, vol. 6, no. 1, pp. 4–14, 2004.
[30] V. Kolodyazhniy, S. D. Kreibig, J. J. Gross, W. T. Roth, and F. H. Wilhelm, “An affective computing approach to physiological emotion specificity: Toward subject-independent and stimulus-independent classification of film-induced emotions,” Psychophysiology, vol. 48, no. 7, pp. 908–922, Jul. 2011.
[31] E. L. van den Broek, V. Lis`y, J. H. Janssen, J. H. Westerink, M. H. Schut, and K. Tuinenbreijer, Affective man-machine interface: unveiling human emotions through biosignals. Springer Berlin Heidelberg, 2010.
[32] C. Setz, B. Arnrich, J. Schumm, R. La Marca, G. Troster, and U. Ehlert, “Discriminating stress from cognitive load using a wearable eda device,” IEEE Transactions on Information Technology in Biomedicine, vol. 14, no. 2, pp. 410–417, March 2010.
[33] C. Katsis, N. Katertsidis, G. Ganiatsas, and D. Fotiadis, “Toward emotion recognition in car-racing drivers: A biosignal processing approach,” IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 38, no. 3, pp. 502–512, May
2008.
[34] L. Pastor-Sanz, C. Vera-Munoz, G. Fico, and M. T. Arredondo, “Clinical validation of a wearable system for emotional recognition based on biosignals,” Journal of Telemedicine and Telecare, vol. 14, no. 3, pp. 152–154, 2008.
[35] S. Fuhrhop, S. Lamparth, and S. Heuer, “A textile integrated long-term ECG monitor with capacitively coupled electrodes,” in 2009 IEEE Biomedical Circuits and Systems
Conference (BioCAS 2009), Nov 2009, pp. 21–24.
[36] C.-C. Chan, W.-C. Chou, C.-W. Chen, Y.-L. Ho, Y.-H. Lin, and H.-P. Ma, “Energy efficient diagnostic grade mobile ECG monitoring,” in 2012 IEEE 10th Int. New Circuits
and Systems Conference (NEWCAS), June 2012, pp. 153–156.
[37] R. Fensli, E. Gunnarson, and O. Hejlesen, “A wireless ECG system for continuous event recording and communication to a clinical alarm station,” in 26th IEEE Annu. Int. Conf.
Engineering in Medicine and Biology Society, vol. 1, Sept 2004, pp. 2208–2211.
[38] D. Simunic, S. Tomac, and I. Vrdoljak, “Wireless ECG monitoring system,” in 2009 1st Int. Conf. Wireless Communication, Vehicular Technology, Information Theory and
Aerospace and Electronic Systems Technology, May 2009, pp. 73–76.
[39] J. Malmivuo and R. Plonsey, Bioelectromagnetism: principles and applications of bioelectric and biomagnetic fields. Oxford university press, 1995.
[40] C. Van Mieghem, M. Sabbe, and D. Knockaert, “The clinical value of the ecg in noncardiac conditions,” Chest, vol. 125, no. 4, pp. 1561–1576, 2004.
[41] J. Wtorek, A. Bujnowski, M. Lewandowska, J. Ruminski, and M. Kaczmarek, “Simultaneous monitoring of heart performance and respiration activity,” in 2010 3rd Conf.
Human System Interactions (HSI), May 2010, pp. 661–665.
[42] W. Srisawat, “Implementation of real time feature extraction of ecg using discrete wavelet transform,” in 2013 10th Int. Conf. Electrical Engineering/Electronics, Com-
puter, Telecommunications and Information Technology (ECTI-CON), May 2013, pp. 1–5.
[43] Low-Power, 2-Channel, 24-Bit Analog Front-End for Biopotential Measurements, Texas Instruments, 2012, rev. B.
[44] G. Pizzuti, S. Cifaldi, and G. Nolfe, “Digital sampling rate and ecg analysis,” Journal of Biomedical Engineering, vol. 7, no. 3, pp. 247 – 250, 1985.
[45] XILINX, ”Spartan-3AN FPGA Family Data Sheet,” XC3S400AN datasheet, Apr. 2011[Revised Sept. 2012].
[46] Hotlife. (2014) Bluetooth UART Module Menu. [Online]. Available: http://www.hotlife.com.tw/specification/HL-MD08R-C2A UsersManual CHT.pdf.
[47] “Android interfaces and architecture.” [Online]. Available: https://source.android.com/devices/index.html#Android%20system%20architecture/.
[48] J.-W. Jhuang, “A patch-sizewearable ecg/respiration recording platform with dsp capability,” Master’s thesis, Department of Electrical Engineering, National Tsing Hua
University, Hsinchu, Taiwan, September 2014.
[49] S. Zhang, S. Zhang, X. Chen, and X. Huo, “Cloud computing research and development trend,” in 2010. ICFN ’10. Second Int. Conf. Future Networks, Jan 2010, pp. 93–97.
[50] I. Tsagklis, “Advantages and disadvantages of cloud computing-cloud computing pros and cons.” [Online]. Available: http://www.javacodegeeks.com/2013/04/
advantages-and-disadvantages-of-cloud-computing-cloud-computing-pros-and-cons.html/.
[51] Polrid, “5 examples of cloud computing.” [Online]. Available: http://www.technobuffalo.com/2010/01/17/five-examples-of-cloud-computing/.
[52] “Apache storm.” [Online]. Available: https://storm.apache.org/.
[53] J. S. van der Veen, “Installing a storm cluster on centos hosts.” [Online]. Available:
http://jansipke.nl/installing-a-storm-cluster-on-centos-hosts/.
[54] “Jcraft, code the craft, craft the code.” [Online]. Available: http://www.jcraft.com/jsch/.
[55] Task Force of the European Society of Cardiology the North American Society of Pacing and Electrophysiology, “Heart rate variability: Standards of measurement, physiological interpretation, and clinical use,” Circulation, vol. 93, no. 5, pp. 1043–1065, Mar. 1996.
[56] H.-C. Chiu, Y.-H. Lin, M.-T. Lo, S.-C. Tang, T.-D. Wang, H.-C. Lu, Y.-L. Ho, H.-P. Ma, and C.-K. Peng, “Complexity of cardiac signals for predicting changes in alpha-waves after stress in patients undergoing cardiac catheterization,” Scientific Reports, vol. 5,
Aug. 2015.
[57] C.-W. Wang, “A prototype of home-monitoring system for patents with sleep-disordered breathing,” Master’s thesis, Department of Electrical Engineering, National Tsing Hua
University, Hsinchu, Taiwan, July 2014.
[58] ANALOG DEVICES, Small, Low Power, 3 Axis Accelerometer, ADXL335. [Online].
Available: https://www.sparkfun.com/datasheets/Components/SMD/adxl335.pdf.
[59] InvenSense, ADMP504, Microphone. [Online]. Available: http://www.farnell.com/datasheets/1794373.pdf.
[60] D. Phan, S. Bonnet, R. Guillemaud, E. Castelli, and N. Pham Thi, “Estimation of respiratory waveform and heart rate using an accelerometer,” in 30th IEEE Annu. Int. Conf.
Engineering in Medicine and Biology Society, Aug 2008, pp. 4916–4919.
[61] A. Bates, M. Ling, J. Mann, and D. Arvind, “Respiratory rate and flow waveform estimation from tri-axial accelerometer data,” in 2010 Int. Conf. Body Sensor Networks (BSN), June 2010, pp. 144–150.