According to a fascinating post by Judith Weingarten ( Whose Christmas Is It, Anyway?), it appears it was the Roman emperors in the 4th century that decided to one-up Christians by co-opting the date.
FORBES: Christmas and the Adoption of the Pagan Solstice