Bringing this experience with search and the open source community to bear on emerging big data needs, LucidWorks launched in May a big databeta project.
Up until that day in early February, based on the raw transaction data we had observed during our beta period, we incorrectly considered raw data fairly harmless.
The tool, which is still in beta, culls textual data from a range of social media sites, including blogs, social networks, photo-sharing and video-networking sites.