Virtual Reality devices for advanced graphics control and simulation
NOTE: THE SITE USES FLASH, ENSURE FLASH
ENABLED BROWSER IS USED
Introduction
Virtual Reality is a creation of a highly interactive computer based multimedia environment in which the user becomes a participant with the computer in a "virtually real" world We are living in an era characterized by 3D virtual systems created by computer graphics. In the concept called Virtual Reality (VR), the virtual reality engineer is combining computer, video, image-processing, and sensor technologies so that a human can enter into and react with spaces generated by computer graphics.
Here we create a cheap affordable VR haptic device with force feedback or with facility to add force feedback in the future. This device can be used to interact with the synthetic imagery generated by an advanced graphics hardware used for military simulations and advanced games. We essentially look at two types of devices, one a VR glove that can be used to interact with virtual objects in the virtual world and the other a Virtual weapon which can be used in Infantry weapon training simulation system which requires the 3D tracking of weapons in real-time. A survey of various readymade tracking systems using different technologies was carried out, though these systems provide low to high degree of accuracy but these are very expensive starting at around 1500/- dollars and costing up to more than 30,000/- dollars for the high end ones. The low end ones are neither accurate nor easy to implement and riddled with problems. After analysing such systems we zeroed upon some cost-effective solutions which we could use to build such devices. After a detailed analysis we propose a VR glove and a 3D tracking system for weapons using MEMS Linear Accelerometers and MEMS Gyroscope. The proposed models will allow interaction with virtual objects through a VR hand and 3D tracking of moving weapons in near real-time, (fig below) with a reasonable degree of accuracy to be used in a variety of simulations and gaming.
Shows indoor 3D shooting simulation
Advanced 3D surround simulation environment
Shows 2D shooting with wired tracking device
Prototypes
VR glove - The glove is wearable by any individual fig below. It is capable of interaction with 3D virtual objects inside the computer screen and able to manipulate them with reasonable accuracy. Our proof of concept software is able to manipulate a virtual hand inside the computer screen controlled by the motion of the actual human hand. Complete finger information as well as orientation information is processed locally using suitable microcontrollers and sent to the computer either wired/wirelessly for further processing.
VR weapon - The weapon is a modification to a toy gun which sends its orientation data to the computer in real time. The gun uses MEMS (Micro Electro Mechanical sensors), gyroscopes and accelerometers as required giving accurate 6DOF referencing information to be passed on to the computer fig above. The wired/wireless solution depends on COTS implementations readily available. We look at pixel level accuracy in tracking but a accuracy of at least 1mm on screen of 10 by 8 ft (maximum 10 m from weapon) is achievable. The refresh rate of the sensors is more than 100Hz though higher refresh rates are highly desirable for greater accuracy and error free operation. Drift and other associated problems of Gyroscopes are effectively controlled. The hardware is generic in nature and emulate a mouse controller with programmable buttons.
| Crude VR hand with force feedback |
Gloves modified for haptic feedback