M. Koolen, Wouter and van Erven, Tim (2010) Freezing and Sleeping.
Full text access: Open
A problem posed by Freund is how to efficiently track a small pool of experts out of a much larger set. This problem was solved when Bousquet and Warmuth introduced their mixing past posteriors (MPP) algorithm in 2001. In Freund's problem the experts would normally be considered black boxes. However, in this paper we re-examine Freund's problem in case the experts have internal structure that enables them to learn. In this case the problem has two possible interpretations: should the experts learn from all data or only from the subsequence on which they are being tracked? The MPP algorithm solves the first case. Our contribution is to generalise MPP to address the second option. The results we obtain apply to any expert structure that can be formalised using (expert) hidden Markov models. Curiously enough, for our interpretation there are \emph{two} natural reference schemes: freezing and sleeping. For each scheme, we provide an efficient prediction strategy and prove the relevant loss bound.
This is a Submitted version This version's date is: 27/8/2010 This item is not peer reviewed
https://repository.royalholloway.ac.uk/items/ba3aefb4-71fc-e8d8-8126-602e7a4d2dc7/7/
Deposited by Research Information System (atira) on 23-Jul-2014 in Royal Holloway Research Online.Last modified on 23-Jul-2014