Organizational Data Mining

Book excerpt: Mountains of business data are piling up in organizations every day. These organizations collect data from multiple sources, both internal and external. These sources include legacy systems, customer relationship management and enterprise resource planning applications, online and e-commerce systems, government organizations and business suppliers and partners. A recent study from the University of California at Berkeley found the amount of data organizations collect and store in enterprise databases doubles every year, and slightly more than half of this data will consist of "reference information," which is the kind of information strategic business applications and decision support systems demand (Kestelyn, 2002). Terabyte-sized (1,000 megabytes) databases are commonplace in organizations today, and this enormous growth will make petabyte-sized databases (1,000 terabytes) a reality within the next few years (Whiting, 2002). By 2004 the Gartner Group estimates worldwide data volumes will be 30 times those of 1999, which translates into more data having been produced in the last 30 years than during the previous 5,000 (Wurman, 1989).