The clothing fibers carry fragrance, perspiration, hair, invisible food stains, all of which over time can turn into protein that attractsinsects that lay eggs and will chew up your clothes.
For example, the best-selling items in SkyMall's history were a nose hair trimmer and a mosquito magnet (a net that attracts and traps insects), quantity-wise and dollar-wise, respectively.