They do not hold confidential customer data like credit card info. (In fact, the companies that need to keep confidential data, like financial and health services firms, are still not embracing cloud based systems as of yet.) But for the rest of us, CRM systems are basically places that store activities, appointments, emails, notes and phone calls.
The software has the intelligence to determine how data in one source (like customer names) are related to data in another (like customer transactions) and to reformat info to reconcile presentation differences (like a middle initial).