Social Reinforcement Learning: Light Seminar

Rutgers University
Spring 2005
Michael L. Littman
Matthew Stone

Time: Wednesday 3pm-4:30pm
Place: CoRE A (Room 301)
Semester: Spring 2005

Course number: Index # 49857 (04)

In this seminar we will examine ways of using feedback from interacting with another agent to make better decisions. We'll read papers on human-computer interaction and multiagent reinforcement learning and brainstorm about cool problems where we can build engaging interactive things.

Problems include: imitation, baby conversation, coordinating action in time (playing catch or peek-a-boo). Cool interactive toys include: an interactive graphics and vision setup, multiple mobile robots.

Biologically-inspired questions include: "Can chimps deceive?", "How do wolves hunt?", "Why do monkeys imitate each other?", "What social feelings do people have?", "What social signals do people attend to and learn from?"


[DISCUSSED: 1/26/05]: C. Breazeal and B. Scassellati (2002). "Robots that imitate humans," Trends in Cognitive Science, 6, pp. 481-487. pdf.

[DISCUSSED: 2/2/05]: C. G. Atkeson and S. Schaal (1997), ``Robot Learning From Demonstration'', Machine Learning: Proceedings of the Fourteenth International Conference (ICML '97), Edited by Douglas H. Fisher, Jr. pp. 12-20, Morgan Kaufmann, San Francisco, CA. pdf

[DISCUSSED: 2/9/05]: Chen Yu, Dana H. Ballard and Richard N. Aslin (2003), "The role of embodied intention in early lexical acquisition", 25th Annual Meeting of Cognitive Science Society (CogSci 2003), Boston, MA. [The Marr Prize winner for best student paper ]. pdf

[DISCUSSED: 2/16/05]: Matthew Stone (2004), "Communicative intentions and conversational processes in human-human and human-computer dialogue", in Trueswell and Tanenhaus, eds., Approaches to Studying World-Situated Language Use, MIT Press, pages 39-70. pdf.

[DISCUSSED: 2/23/05]: Matthew Stone (2004), "Intention, interpretation and the computational structure of language", Cognitive Science 28(5):781-809. pdf.

[DISCUSSED: 3/2/05]: Gal Y, Pfeffer A, Marzo F, Grosz BK (2004). "Learning social preferences in games". National Conference on Artificial Intelligence (AAAI), San Jose, California, 226-231. pdf.

[DISCUSSED: 3/9/05]: Y. Nakano, G. Reinstein, T. Stocky and J. Cassell (2003), "Towards a model of face-to-face grounding". Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, 2003. pdf.

[DISCUSSED: 3/23/05]: Chalkiadakis G and Boutilier C (2003), "Coordination in Multiagent Reinforcement Learning: A Bayesian Approach". AAMAS 2003. pdf.

[DISCUSSED: 3/30/05]: Sanfey AG, Rilling JK, Aronson JA, Nystrom LE & Cohen JD (2003). The neural basis of economic decision making in the ultimatum game. Science, 300, 1755-1757. pdf.

[DISCUSSED: 4/6/05]: Nass, C. and Moon, Y. (2000). Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56(1):81-103. pdf.

[DISCUSSED: 4/13/05]: Isbell C, Kearns M, Kormann D, Singh S, Stone P (2000). Cobot in LambdaMOO: A Social Statistics Agent, AAAI. pdf.

[DISCUSSED: 4/13/05]: Isbell C, Shelton C, Kearns M, Singh S, Stone P (2001). A Social Reinforcement Learning Agent. Agents. pdf.

[DISCUSSED: 4/20/05]: Damasio A., Looking for Spinoza: Joy, Sorrow and the Feeling Brain, Chapters 3 & 4, pages 83-179 (but eminently skimmable), Harcourt, 2003.

[TO DISCUSS: 4/27/05]: Tomasello M, Carpenter M, Call J, Behne T, and Moll H (to appear), "Understanding and sharing intentions, The origins of cultural cognition". Behavioral and Brain Science. web.

Sidner, C.L.; Kidd, C.D.; Lee, C.H.; Lesh, N.B. (2004), "Where to Look: A Study of Human-Robot Engagement", ACM International Conference on Intelligent User Interfaces (IUI), ISBN: 1-58113-815-6, pp. 78-84. TR web page.

S. Kopp, T. Sowa, I. Wachsmuth (2004). "Imitation games with an artificial agents: From mimicking to understanding shape-related iconic gestures". In Camurri, Volpe (Eds.): Gesture-Based Communication in Human-Computer Interaction (LNAI 2915), pp. 436-447, Berlin: Springer-Verlag. pdf.

Montague PR, Berns GS, Cohen JD, McClure SM, Pagnoni G, Dhamala M, Wiest MC, Karpov I, King RD, Apple N, Fisher RE (2002). Hyperscanning: Simultaneous fMRI during linked social interactions. NeuroImage. 16(4), 1159-64. pdf.