He sculpted characters from 7.5 cm to 38 cm (3 inches to 15 inches) tall and photographed them one frame at a time in continuous poses, thus creating the illusion of motion.
That lets the Meta 1 track your gestures, individual fingers and walls or other physical surfaces, all of which are processed in the PC with motion tracking tech to give the illusion of virtual objects anchored to the real world.