If the shadow inventory was composed of many vacant homes then we would expect them to move rapidly out of the shadows and onto the normal market as the existing inventory fell.
In a fraction of a second, the program traders can move the market, get in and out, and normal retail investors are left in the dust, suffering major losses before they even know what hit them.