Aside: Feels like a sequential allocation problem. Classic in
statistics.
- You want to find out which drug is most effective. Only so many
trials you can run. Need to spend the trials on the most effective
drug.
Slot-machine has k arms. Arm i pays a dollar with probability
pi and nothing with probability 1-pi.
Next: Bandit Example
Up: INTRODUCTION
Previous: Locality Assumption