HandGun

Handgun is a First person shooter Game which shows how we can move from clumsy mouse and keyboard controls in FPS to more intuitive control mechanisms using Intel's RealSense Technology.

In the game, the hand itself is used as a gun. Shape the hand into a gun and move it in the real world to aim inside the virtual world. Perform a well-known shooting gesture with the hand to shoot inside the game.

The final game is to support the use of two guns with both hands, use of different guns like bazooka, sniper, machine guns etc. depending on the shapes and gestures of both hands. The player will be able to move about in the final game by leaning in the desired directions.

GAMES

My Contribution

I have redesigned Unity Technology's survival shooter to build this project.

The Original Complete Third person shooter project is avalialbe at Unity Asset Store : https://www.assetstore.unity3d.com/en/#!/content/21028.
I have developed on top of the project to redesign it int an FPS to play with Intel's Realsense Technology.

Tools and Techniques Used

Unity 3D Game Engine

C# Programming Language

Intel RealSense SDK

Here is how the game works from behind

Once the user stretches her hands towards the screen , The RealSense front Facing Camera, the camera continuously captures its depth information and generates segmented images of the hands, and ignores the background.

Using the BlobExtractor function, the program detects the hand. From there, the center point of the hand, the top point, side points etc. are detected. The program uses these to recognize the shape.

The center point of the hand is mapped to the virtual world coordinate and the game camera and gun are accordingly rotated.

The program continuously monitors for shape changes. If a shape change corresponds to the quick and sharp upward tilting of the hands, we know that a shot has been fired.A bullet shoots in the game.