Force Feedback for Mobile Devices

(Fortissimo and more)

We developed an effective and simple technique to add force feedback to any mobile computing device by using the accelerometer data and attaching a small foam padding to the device. We call this technique Fortissimo.

We also explored other ways to enhance the expressivity of the devices by adding inexpensive hardware to them. These allow a more realistic feel to the device, especially when doing a musical performance.

We developed a technology that uses the front camera of the devices to recognize different hand gestures. These gestures (and the distance to the camera) are attached to various synthesis parameters. We called thi prototype AirSynth.

Related Publications

Fortissimo: Force-Feedback for Mobile Devices
Tae Hong Park, Oriol Nieto
Fortissimo: Force-Feedback for Mobile Devices
Proceedings of the 2013 New Instruments for Musical Expression (NIME), Daejeon, Korea 2013

Hand Gesture Recognition in Mobile Devices : Enhancing The Musical Experience
Oriol Nieto, Dennis Shasha
Hand Gesture Recognition in Mobile Devices : Enhancing The Musical Experience
Proc. of the 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France, 2013

Even More Tactile Feedback For Mobile Devices
Tae Hong Park, Langdon Crawford, Oriol Nieto
Even More Tactile Feedback For Mobile Devices
Proc. of the 39th International Computer Music Conference Perth, Australia, 2013