It was torn down in 1963 and replaced with the current, smaller Penn Station, notable for its blandness topped with the familiar, circular Madison Square Garden, among the first buildings of its kind to be built above the platforms of an active railroad station.
WSJ: Plans languish for overhaul of NYC's Penn Station