When you do something like this there is a chance, albeit a small one that you can screw up your device- if you're worried about this, don't do it.

ENGADGET: pt's "how to Tuesday" Overclocking your Pocket PC

They typically screw into a plate on the grave marker and are secured with a small chain.

WSJ: Bronze Vases at Cemeteries Become Target for Thieves