FlexSense: A Transparent Self-Sensing Deformable Surface
We present FlexSense, a new thin-film, transparent sensing surface based on printed piezoelectric sensors, which can reconstruct complex deformations without the need for any external sensing, such as cameras. Done in collaboration with Media Interaction Lab, Hagenberg, Austria, and the Institute of Surface Technologies and Photonics, Joanneum Research, FlexSense provides a fully self-contained setup which improves mobility and is not affected from occlusions. Using only a sparse set of sensors, printed on the periphery of the surface substrate, we devise two new algorithms to fully reconstruct the complex deformations of the sheet, using only these sparse sensor measurements. An evaluation shows that both proposed algorithms are capable of reconstructing complex deformations accurately. We demonstrate how FlexSense can be used for a variety of 2.5D interactions, including as a transparent cover for tablets where bending can be performed alongside touch to enable magic lens style effects, layered input, and mode switching, as well as the ability to use our device as a high degree-of-freedom input controller for gaming and beyond. ΓÇï
Other Videos By Microsoft Research
2016-08-18 | RichReview |
2016-08-18 | John Platt Plenty Excited About AI |
2016-08-18 | Sensing Techniques for Tablet+Stylus Interaction |
2016-08-18 | Biological Computation Visualisations |
2016-08-18 | Social Media Predictions |
2016-08-18 | Printing Interactivity |
2016-08-18 | Tenison Road: data and life on the street |
2016-08-18 | Assess MS |
2016-08-18 | Azure Machine Learning |
2016-08-18 | The Motion Keyboard |
2016-08-18 | FlexSense: A Transparent Self-Sensing Deformable Surface |
2016-08-18 | Dyadic Projected Spatial Augmented Reality |
2016-08-18 | Handpose: Fully Articulated Hand Tracking |
2016-08-18 | In-Air Gestures Around Unmodified Mobile Devices |
2016-08-18 | Ziria |
2016-08-18 | RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units |
2016-08-18 | RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document Review |
2016-08-18 | Probabilistic Inference in Excel |
2016-08-18 | Handpose: fully articulated hand tracking |
2016-08-18 | Share your photos, not your phone, with Microsoft Xim |
2016-08-18 | Finding species |