Canonical originally planned to replace the aging X with another display server called Wayland, but the developers apparently couldn't bend the compositing-friendly protocol to their cross-device whims.
The final layers of security include a pair of authentication certificates residing on the handsets, as well as requiring users to log-in with a password before they can use the SIP (Session Initiation Protocol) server.