We have a pretty good idea that they're made of dirty ice, but beyond that, we don't really know the details of what they're made of.

NPR: NASA 'Deep Impact' Probe Targets Comet

When the ice sheets were thick and advancing, more pebbles, stones, and dirty sediment would have been carried into the core by the moving ice.

ECONOMIST: The South Pole as location and metaphor