Contributing factors could be anything from the time in the day that the activity was scheduled, over scheduling every single moment of the day (especially on a retreat), holding the event outside of work hours, or just picking activities for the team that may not be what the group really wants to do.

FORBES: 3 Bad Team-Building Exercises For Businesses