This means that the data from storm-to-storm, and region-to-region, may be inconsistent and needs to be corrected and normalized with present-day knowledge and standardized categories.
At an Accel venture capital conference recently, 98 percent of the attendees knew about Hadoop, Flume, and Storm (big data for Twitter), but Wall Street is just starting to ask about them, he said.
Seasoned storm trackers provide critical field data that can't be gleaned from high-powered Doppler radar, veteran meteorologists say.
While the apocalyptic view that we face an imminent inflationary depression may be reading too much into the tea leaves, relying on bad data is like flying blind in a storm.
FORBES: Distorted Government Statistics Endanger Our Economic Health
Once the storm hit the east coast, data scientists got busy tracking its impact.
Deaths from the latest storm ended the nation's longest break between tornado fatalities since detailed records began being kept in 1950, according to the Storm Prediction Center and National Climatic Data Center.
They're using data collected by the weather service during the storm, to try to understand the surge, try to understand the wave heights, and they're going to create a computer model, as opposed to the scale model of a city, for the storm as it came up from the south and the Gulf of Mexico, and see if they can recreate the exact conditions.
The data showed that the conditions were perfect for a monstrous storm in the northern Atlantic Ocean.
The June outage was caused by an electrical storm and had its origin in the same data centers.
William Frey, a researcher with the Brookings Institution, which has kept detailed records and analysis of the city's population since the storm, said his analysis of 2006 census data released this month shows that those in the 25- to 35-year-old age range were least likely to be present in the city by July of last year.
CNN: New Orleans' new arrivals: Young, educated and infused with hope
Despite the data, it was difficult to convince the public of the severe storm on the horizon because Boston was enjoying beautiful sunny weather on that late October weekend, Case said.
Analysts don't expect the storm's effects to show up immediately in the economic data.
"When the storm clouds of Europe pull back a bit, the economic data in the U.S. kind of shine through, " said Stephen Wood, chief market strategist at Russell Investments.
But his data aren't comprehensive enough to make definitive predictions for various categories of storm intensity.
The collection contains data on about 900 bird species, some of which -- the Guadalupe storm-petrel, Labrador duck, Guadalupe caracara, great auk, Carolina parakeet and passenger pigeon -- have gone extinct.
Infochimps, already providing a cloud-based platform for data-science-as-a-service, announced the integration of Storm and Kafka.
Focus of the market place is turning from the major storm that pummeled the U.S. east coast, to critical economic data that is scheduled to come out of China and the U.S. yet this week.
Miller also is reanalyzing the data to see if there are variations when sunlight was blocked by a weeks-long dust storm on Mars, with the idea being that biological systems would have acted differently to the environmental change than geologic ones.
MSN: Viking robots found life on Mars in 1976, scientists say
Other data have suggested Sandy slowed factory production, increased layoffs and closed some shops in the weeks after the storm, but rebuilding efforts likely added growth later in the time period.
Emerging technologies such as Storm and Kafka are designed to provide real-time streaming analytics, which is critical for volume data feeds such as social networks.
FORBES: Is Big Data Right for Your Business? President Obama Thinks So.
TC4 project will generate new data on the icy cirrus clouds that are formed in the upper atmosphere by heat-driven, or convective, storm systems that coalesce over warm waters in the tropics.
应用推荐