Machines that Learn to Play Games

Book excerpt: The mind-set that has dominated the history of computer game playing relies on straightforward exploitation of the available computing power. The fact that a machine can explore millions of variations sooner than the sluggish human can wink an eye has inspired hopes that the mystery of intelligence can be cracked, or at least side-stepped, by sheer force. Decades of the steadily growing strength of computer programs have attested to the soundness of this approach. It is clear that deeper understanding can cut the amount of necessary calculations by orders of magnitude. The papers collected in this volume describe how to instill learning skills in game playing machines. The reader is asked to keep in mind that this is not just about games -- the possibility that the discussed techniques will be used in control systems and in decision support always looms in the background.