Some exceptions to this are in the super dense space where PCI Express and ethernet are virtually on the chip, or solutions from guys like Calxeda, which minimizes power and eliminates the need for any comms box at the top of the rack.
FORBES: The Threat I/O Virtualization poses to Cisco, Juniper and Brocade