Data preparation requires two different types of activities: first, finding and assembling the data set, and second, manipulating the data to enhance its utility for mining. The first activity involves the miner in many procedural and administrative activities. The second requires appropriately applying automated tools. However, manipulating the data cannot begin until the data to be used is identified and assembled and its basic structure and features are understood. In this chapter we look at the process of finding and assembling the data and assessing the basic characteristics of the data set. This lays the groundwork for understanding how to best manipulate the data for mining.
What does this groundwork consist of? As the ancient Chinese proverb says: ?A journey of a thousand miles begins with a single step.? Basic data preparation requires three such steps: data discovery, data characterization, and data set assembly.
?
Data discovery consists of discovering and actually locating the data to be used.
?
Data characterization describes the data in ways useful to the miner and begins the process of understanding what is in the data?that is, is it reliable and suitable for the purpose?
?
Data set assembly builds a standard representation for the incoming data so that it can be mined?taking data found to be reliable and suitable and, usually by building a table, preparing it for adjustment and actual mining.
These three stages produce the data assay .
Copyright Morgan Kauffmann Publishers, Inc. 1999 under license agreement with Books24x7