本研究目的為發展稱為Z-Pen的人機互動裝置，Z-Pen是由一支特殊的觸控筆與觸控顯示器，或覆蓋透明觸控板的顯示器組合而成。Z-Pen可將顯示螢幕前的真實3D空間與螢幕後面的虛擬世界的整合，讓螢幕形同一個開放或可穿透的窗口，使用者可直接透過此窗口伸入虛擬空間，並以絕對定位方式和與電腦生成的3D圖像互動。本研究的重點是角度偵測機構的開發，使新一代的Z-Pen 2.0相較前代Z-Pen增加兩個自由度，並且與Unity軟體結合，藉由Unity的介面開發、測試和展示真實空間與虛擬空間結合及互動的概念。本研究採行一種雙觸點方式偵測觸控筆的方向和傾角，分析了使用三種不同類型觸控板時可能的設計方法，並執行相關測試，最終設計並製作出用於3M觸控板上的Z-Pen 2.0原型機。本研究也導出真實空間與虛擬空間的座標轉換關係，用以將虛擬空間座標投射至螢幕上及觸控板上。本研究用Unity軟體建構出觸控筆從真實空間延伸入螢幕後方虛擬空間的數位虛擬端，並設計虛擬空間場景，初步測試與展示了Z-Pen 2.0原型機系統的功能。

關鍵字：3D電腦繪圖、觸控筆、角度偵測、人機互動裝置

This research relates to the development of a human-computer interaction concept called Z-Pen, which is a combination of a special stylus with a touch display (or a display with a transparent touch overlay) and features operational functions such as direct 3D pointing and interaction with computer generated 3D images by an absolute positioning fashion and a sense of merge of the real 3D space in front of the display screen and the virtual world behind the screen as if the screen is an open or penetrable window. This research focuses on the development of an angular detection mechanism, which adds 2 degrees of freedom to a previous design, and an inter-face with the Unity software, which is to facilitate development, test and demonstration of the real-to-virtual world merging interaction idea. A two-touch approach was devised for angular detection of the direction and inclination of the stylus. Design options were analyzed and tests were conducted on three different types of touch displays. A prototype stylus was then designed and built to work on a 3M touch overlay. Coordinate mapping for the real-to-virtual world merging was developed to project coordinates of the virtual space to the display screen and to the touch overlay. A digital virtual end was programmed and implemented as an extension of the physical stylus into the virtual world. Preliminary example images and operation scenarios were designed to test and demonstrate the functions of the prototype system.

Key words: 3D drawing, Touch stylus, Angle detection, Human-computer interaction device

[1] 謝劼，「Z探棒：創新3D人機互動裝置」，國立清華大學碩士論文，2016

[2] 謝宛庭、黃靖涵，2016年動機系專題成果展之照片及影片

[3]曹哲之，國科會專題研究計畫書「具多重顯示模式的全向3D顯示器與體積3D互動人機系統」，NSC 102-2218-E-007-009-MY2 ，2013 (未公開文件)。

[4] Jonah A. Harley, Li-Quan Tan, Debanjan Mukherjee, Steven Porter Hotelling, “Stylus orientation detection”, U.S. Patent 8638320B2, Jan 28, 2014

[5] Tsuguya Yamanami, Takahiko Funahashi, Toshiaki Senda, “Position detecting appa-ratus”, U.S. Patent 4878553, July 2, 1991

[6] Wacom, 「畫筆的運作方式」，Wacom company website, retirved Nov 2018, from
https://www.wacom.com/zh-hk/enterprise/business-solutions/resources-and-information/emr-benefits

[7] Yuval Stern, “Stylus tilt tracking with a digitizer”, U.S. Patent 20150123923A1, May 7, 2015

[8] Anonymous, 「深入解析觸控筆工作原理」，Surface Fans Club, May 31, 2017, re-tirved Nov 2018, from
https://surfacefans.club/?p=1633

[9] Yasuo Oda, Masaki Yagi, Yoshihisa Sugiyama, “Position pointer”, U.S. Patent 20180164906A1, Jun 14, 2018

[10] DLC, “Capacitive Touch”, DLC company website, retirved Nov 2018, from
http://www.dlcdisplay.com/technology/columnsId=55&&i=11&comContentId=11.html

[11] Littelfuse, “Reed Relays HE700 Datasheet”, retirved Sep 2018, from
https://m.littelfuse.com/~/media/electronics/datasheets/reed_relays/littelfuse_reed_relays_he700_datasheet.pdf.pdf

[12] Jonah A. Harley, David I. Simon, “Active stylus”, U.S. Patent 20150103049A1, Apr 16, 2015

[13] Mamoru Ogata, Osamu Nagase, “Position indicator”, U.S. Patent 9898105B2, Feb 20, 2018

[14] Hideo Nakaya, “Tilt derivation device and method”, U.S. Patent 20180224952A1, Aug 9, 2018

[15] Yuval Stern, “Stylus tilt tracking with a digitizer”, U.S. Patent 20150123923A1, May 7, 2015

[16] Charles Whipple Case, JR., Jonathan Westhues, Tianzhu Qiao, “Position, tilt, and twist detection for stylus”, U.S. Patent 20180196574A1, Jul 12, 2018

[17] 吳亞峰，「你也能完成VR場景：用Unity實作3D虛擬實境遊戲」，佳魁資訊，2016

[18] 柯博文，「Unity 3D跨平臺遊戲製作的15堂課」，松崗資產管理，2015

[19] 羅盛譽，「Unity 5.x遊戲開發實戰 : 掌握第一線專業關鍵技術」， 博碩文化，2016

[20] Brian Eun, “AES vs EMR: Active Pen Technology Explained”, Nov 2016, retirved Nov 2018, from
http://www.tabletpcreview.com/feature/active-pen-technology-explained-aes-vs-emr/

[21] Brian Eun, “Active Pen Technology Explained: Wacom vs N-trig”, Nov 2016, retirved Nov 2018, from
http://www.tabletpcreview.com/feature/active-pen-technology-explained-wacom-n-trig/