It was always thought that Tottenham's plans to build a new 56, 250-seater stadium on and around the current WhiteHartLane site was their preferred choice.
Mr Caborn, sports minister under the previous Labour government, said it would be "daft" to knock the Olympic Stadium down and then rebuild it - and said Tottenham should build closer to its WhiteHartLane home.