Off-the-record references are generally the most revealing, but you can still get solid information from the ones the candidate provides.

FORBES: The Best Interview Questions You Never Ask