Using motion-detection algorithms, the BriefCam software separates the background (static or non-moving objects) from the moving objects, tracking and analysing any motion within the frame.
That lets the Meta 1 track your gestures, individual fingers and walls or other physical surfaces, all of which are processed in the PC with motiontracking tech to give the illusion of virtual objects anchored to the real world.