We've poked around the app for a few minutes, and it does feel peppy compared to what we experienced with Facebook (while it was available, anyway) -- the only oddity that's arisen lies with the map functionality, which opens a Google Maps page within the Vita's browser rather than its Maps app.
ENGADGET: Foursquare PS Vita app hits US PlayStation Store, gives you another reason to consider 3G