Electronic commerce is emerging as the killer domain for data mining
technology.
The following are five desiderata for success. Seldom are they they all
present in one data mining application.
- Data with rich descriptions. For example, wide customer records with many
potentially useful fields allow data mining algorithms to search beyond obvious
correlations.
- A large volume of data. The large model spaces corresponding to rich data
demand many training instances to build reliable models.
- Controlled and reliable data collection. Manual data entry and integration
from legacy systems both are notoriously problematic; fully automated
collection is considerably better.
- The ability to evaluate results. Substantial, demonstrable return on
investment can be very convincing.
- Ease of integration with existing processes. Even if pilot studies show
potential benefit, deploying automated solutions to previously manual processes
is rife with pitfalls. Building a system to take advantage of the mined
knowledge can be a substantial undertaking. Furthermore, one often must deal
with social and political issues involved in the automation of a previously
manual business process.