Copyright 1996-2001 by Donald R. Tveter, commercial use is prohibited. Short quotations are permitted if proper attribution is given. This material CAN be posted elsewhere on the net if the posted files are not altered in any way but please let me know where it is posted. The main location is: http://dontveter.com/bpr/bpr.html |
Temporal difference is very much like backprop and may be used for many similar problems. Its claim to fame is the backgammon playing program by Tesauro although it can be used for other applications as well. The original article on this subject is by Rich Sutton. TD has been applied to games however this article says it could be applied to economic time series and other applications (has anyone seen any?). A thesis by Isbell considers its use in games.