The bones themselves were likely obtained both through collecting those found on the ground and by killing the large beasts directly themselves.

FORBES: Archaeologists Find Neanderthal Dwelling Made from Mammoth Bones