Wiimote-based 3D user interfaces

wiimote2The goal is to design a semi-immersive medical imaging environment which uses a Wiimote, the primary controller for the Nintendo WiiTM console, as the only input device. The Wiimote is an input device that, by virtue of its features, can be considered as an absolute novelty among 3D user interfaces. The presence of both an infrared camera and a three-axes accelerometer makes it possible to use it in many ways following different interaction metaphors.

We modeled the user’s interaction by using a finite state machine. In the manipulation state, the 3D object can be rotated, translated or cropped. The object in the virtual space will rotate along the same axis and with the same angle as of the input device. During the 3D interaction with the Wiimote, the system can be in two states: Pointing or Manipulation. According to the interaction state, user actions have different effects.


  • L. Gallo, A. Minutolo, and G. De Pietro, “A user interface for VR-ready 3D medical imaging by off-the-shelf input devices”, Computers in Biology and Medicine, vol. 40, no. 3, pp. 350–358, 2010. doi:10.1016/j.compbiomed.2010.01.006
  • L. Gallo, G. De Pietro, A. Coronato, and I. Marra, “Toward a natural interface to virtual medical imaging environments”, in AVI '08: Proceedings of the working conference on Advanced Visual Interfaces, (New York, NY, USA), pp. 429-432, ACM Press, 2008. doi:10.1145/1385569.1385651
  • L. Gallo, G. De Pietro, and I. Marra, “User-friendly inspection of medical image data volumes in virtual environments”, in CISIS 2008: Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems, (Los Alamitos, CA, USA), pp. 749-754, IEEE Computer Society, 2008. doi:10.1109/CISIS.2008.33
  • L. Gallo, G. De Pietro, and I. Marra, “3D interaction with volumetric medical data: experiencing the Wiimote”, in Ambi-Sys '08: Proceedings of the 1st international conference on Ambient Media and Systems, (Brussels, Belgium), pp. 1-6, ICST, 2008. doi:10.1145/1363163.1363177