If you experience this problem, I suggest you refrain from ever using the visual pager, and instead simply click on the numbered buttons to switch from one virtual desktop to another.
Users can still switch to a more traditional desktop mode by clicking on an icon, but the environment lacks the start menu button offered since Windows 95.