Carragher crucially beat Utrecht striker Ricky van Wolfswinkel to a Mulenga cross and another threatening delivery from the right was spilled by Reina before Martin Skrtel cleared.
The visitors survived a late chance when Mulenga put a shot narrowly wide after Martin Kelly failed to intercept a Van Wolfswinkel flick-on as Utrecht maintained their pressure.