ocation System Desn Experiments Coodusio 南京大学 Depth Aware Finger Tapping on Virtual Display Ke Sunt, Wei Wangt, Alex X.Liutt, Haipeng Dait Nanjing Universityt, Michigan State University Mobisys'18 June 3, 2018 Ke Sun, et al Mobisys'18 June 3.2018 Depth Aware Finger Tapping on Virtual Display 1/22
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Motivation System Design Experiments Conclusion Depth Aware Finger Tapping on Virtual Display Ke Sun† , Wei Wang† , Alex X.Liu†‡, Haipeng Dai† Nanjing University† , Michigan State University‡ Mobisys’18 June 3, 2018 Ke Sun, et al. Mobisys’18 June 3, 2018 Depth Aware Finger Tapping on Virtual Display 1 / 22
Motivaticn System Degn Experiments Coodusio 动京大盛 Motivation Traditional tapping-based interaction: o Require physical devices o Limit the freedom of user hands ·口0,4至·子2刀00 Ke Sun,et al. Mobisys'18 June 3.2018 Depth Aware Finger Tapping on Virtual Display 2/22
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Motivation System Design Experiments Conclusion Motivation Traditional tapping-based interaction: Require physical devices Limit the freedom of user hands Ke Sun, et al. Mobisys’18 June 3, 2018 Depth Aware Finger Tapping on Virtual Display 2 / 22
Motivaticn System Degn Experiments Coodusio 和京大盛 Motivation Tapping-in-the-air: o Hands are free to interact with other objects Depth measurements provide different levels of feedbacks 4口…94至子·2刀00 Ke Sun,et al Mobisys'18 June 3.2018 Depth Aware Finger Tapping on Virtual Display 3/22
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Motivation System Design Experiments Conclusion Motivation Tapping-in-the-air: Hands are free to interact with other objects Depth measurements provide different levels of feedbacks Ke Sun, et al. Mobisys’18 June 3, 2018 Depth Aware Finger Tapping on Virtual Display 3 / 22
Motivation System Degn Experiments Coodusio 动京大盛 Limitation of Prior Arts Customized depth-cameras o Low accuracy: Centimeter-level accuracy (without different levels feedback) High lantency: Low frame rate and high computational requirements ·口0,4至·子2刀00 Ke Sun,et al Mobisys'18 June 3.2018 Depth Aware Finger Tapping on Virtual Display 4/22
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Motivation System Design Experiments Conclusion Limitation of Prior Arts Customized depth-cameras Low accuracy: Centimeter-level accuracy (without different levels feedback) High lantency: Low frame rate and high computational requirements Ke Sun, et al. Mobisys’18 June 3, 2018 Depth Aware Finger Tapping on Virtual Display 4 / 22
Motivation System Degn Experiments Coodusio 动京大盛 Problem Statement Can we suppport tapping-in-the-air without depth-cameras? and meet these design goals o High accuracy(mm-level) Low latency (20 ms) Different levels feedback(finger bending angle) Low computational cost (works on mobile devices) 4口0,4t4子2刀00 Ke Sun,et al. Mobisys'18 June 3.2018 Depth Aware Finger Tapping on Virtual Display 5/22
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Motivation System Design Experiments Conclusion Problem Statement Can we suppport tapping-in-the-air without depth-cameras? and meet these design goals High accuracy (mm-level) Low latency (< 20 ms) Different levels feedback (finger bending angle) Low computational cost (works on mobile devices) Ke Sun, et al. Mobisys’18 June 3, 2018 Depth Aware Finger Tapping on Virtual Display 5 / 22