Multi-Agent Systems Research PhD Workshop 2009 -- Reading List

Useful article in preparation for your workshop presentation: How to present a research paper? by Matthew O. Jackson.

Day 1: Mon Nov 2 Morning Room: T3-40	Introduction to Multi-Agent Systems Research: Intelligent Agents, Agent architectures, and Agent Modeling Required readings:
9:00-12:00	Lecture: Wolf Ketter, Introduction to Intelligent Agents and Multi-Agent Systems -- Lecture Notes
	Additional material: Chapter 2 of Russell and Norvig, "Artificial Intelligence. A modern approach" is devoted to agent architectures. for more definitions of what an agent is, read: Stan Franklin and Art Graesser "Is it an Agent, or just a Program?: A Taxonomy for Autonomous Agent," Proc. of the Third International Workshop on Agent Theories, Architectures, and Languages, published as Intelligent Agents III, Springer-Verlag, 1997, pp 21-35. For a cognitive perspective on agents, read: Ronald J. Brachman, "Systems That Know What They're Doing," IEEE Intelligent Systems, vol 17, n 6, Nov-Dec 2002. For a basic and short introduction to game theory read David K. Levine, What is Game Theory? Department of Economics, UCLA or the short but more detailed paper David K. Levine Game Theory or the longer but easy to read class notes Roger McCain, " Strategy and Conflict: An Introductory Sketch of Game Theory" For a long paper on adjustable autonomy, read: Scerri, P., Pynadath, D.V., Tambe, M. (2002) " Towards Adjustable Autonomy for the Real World", JAIR, Volume 17, pages 171-228.
Day 1: Mon Nov 2 Afternoon Room: T3-40	Reaching Agreements: Mechanism Design and Online Auctions Required readings:
13:00-16:00	Lecture: Eric van Heck -- Lecture Notes
16:00-16:30	Paper: T. Sandholm, Algorithm for Optimal Winner Determination in Combinatorial Auctions. Artificial Intelligence, Vol 135, pp 1-54, 2002. Presented by Yixin Lu -- Lecture Notes
16:30-17:00	Paper: Bapna, R. and Goes, P. and Gupta, A. and Jin, Y. User heterogeneity and its impact on electronic auction market design: An empirical exploration, MIS Quarterly, 28(1): 2004, 21--43. Presented by Meditya Wasesa -- Lecture Notes
	Additional material on Mechanism Design and Auctions: Electronic Market Hypothesis: Malone, Yates, and Benjamin, ELECTRONIC MARKETS AND ELECTRONIC HIERARCHIES, CACM, Volume 30 Number 6, June 1987. The classical survey on combinatorial auctions: Sven de Vries and Rakesh Vohra, Combinatorial auctions: a survey, 2000. A description of bidding languages and how they affect the complexity of combinatorial auctions is in Noam Nisan, " Bidding and Allocation in Combinatorial Auctions," Tech Report, Institute of Computer Science, Hebrew University, 2000. for a detailed description of the FCC spectrum auctions, read Robert Weber, Making More from Less: Strategic Demand Reduction in the FCC Spectrum Auctions, The Journal of Economics and Management Strategy 6(3), 1997. Martin Pesendorfer, A Study of Collusion in First-Price Auctions, Review of Economic Studies, Volume 67, Number 3, pp 381-411, July 2000. For a description of an extensive test suite for combinatorial auctions, read: Leyton-Brown, Shoham. " Test Suite for Combinatorial Auctions" Chapter 18 in Combinatorial Auctions, P. Cramton, Y. Shoham, R. Steinberg (eds.), MIT Press, 2006. For a description of real applications of combinatorial auctions, read Tuomas Sandholm, Expressive Commerce and Its Application to Sourcing: How We Conducted $35 Billion of Generalized Combinatorial Auctions. AI Magazine, 28(3), 45-58, Fall 2007. The patent for the ZIP algorithms. Luke Hunsberger and Barbara J. Grosz, 2000. A Combinatorial Auction for Collaborative Planning, (ps) Proc 4th Int'l Conf. on Multi-Agent Systems, Boston, MA pp. 151-158.
Day 2: Tue Nov 3 Morning Room: T3-14	Agents and Economic Decision-Making Required reading:
9:00-11:00	Lecture: John Collins -- Lecture Notes
11:00-11:30	Paper: Craig Tovey, Tutorial on Computational Complexity, Interfaces, pp 30-61, 2002. Please read sections 1, 2, 4, 8. Paper: Daniel Ariely, George Loewenstein, and Drazen Prelec, Tom Sawyer and the myth of fundamental value, Journal of Economic Behavior and Organization v60 pp 1-10, 2006. Presented by Zhihua Li -- Lecture Notes
11:30-12:00	Paper: Jon Doyle, Rationality and its Roles in Reasoning, Computational Intelligence v8 #2, pp 376-409, 1992. Presented by Alexander Hogenboom -- Lecture Notes
	Additional material on Economic Decision-making: Sara Robinson Computer Scientists Find Unexpected Depths In Airfare Search Problem SIAM/Journal for Society for Industrial and Applied Mathematics July/August 2000 Mike Wellman, The Economic Approach to Artificial Intelligence, ACM Computing Surveys v28 #4, 1996. Stuart Russell and Eric Wefald, Do the Right Thing: Studies in Limited Rationality, MIT Press, 1991 M. Bratman, D. Israel, M Pollack, Plans and resource-bounded practical reasoning, Computational intelligence 4 #4, page 349-355, 1988. H. A. Simon, Theories of Bounded Rationality, in The legacy of Herbert Simon in economic analysis, Edward Elgar Publications, 2001. J. Conlisk, Why bounded rationality?, Journal of Economic literature 34 #2, page 669-700, 1996. Fehr, E. and Tyran, J., Limited rationality and strategic interaction: the impact of the strategic environment on nominal inertia, ECONOMETRICA 76 #2, page 353-394, 2008.
Day 2: Tue Nov 3 Afternoon Room: T3-14	Coordination and Bargaining/Negotiation Required reading:
13:00-14:00	Paper: Jeffrey S. Rosenschein and Gilad Zlotkin, Designing Conventions for Automated Negotiation, AI Magazine, 15(3): Fall 1994, 29-46
	Paper: Inon Zuckerman, Sarit Kraus, and Jeffrey S. Rosenschein. Using Focal Point Learning to Improve Tactic Coordination in Human-Machine Interactions, IJCAI 2007, Hyderabad, India, January 2007, pages 1563-1568. Presented by Marleen Schouten -- Lecture Notes
14:00-16:30	Lecture by Catholijn Jonker -- Lecture Notes
16:30-17:00	Paper: Koen Hindriks, Catholijn Jonker and Dmytro Tykhonov, Negotiation Dynamics: Analysis, Concession Tactics, and Outcomes", IAT'07, ISBN 0-7695-3027-3, IEEE/WIC/ACM international conference on intelligent agent technology, pp. 427-433, 2007 Paper: P. Faratin, C. Sierra, and N. Jennings, Using Similarity Criteria to Make Negotiation Trade-Offs, Journal of Artificial Intelligence, 142 (2), 2003, pp. 205-237. Presented by Gianfranco Lucchese -- Lecture Notes Paper 1 and Lecture Notes Paper 2
	Additional material on Coordination and Negotiation: an earlier paper on negotiation which has received the Influential Paper Award for 2007: J. S. Rosenschein and M. R. Genesereth, "Deals Among Rational Agents" 9th IJCAI, Los Angeles, Ca, August 1985, pages 91-99. an earlier paper on focal points: M. Fenster, S. Kraus and J. Rosenschein. Coordination without Communication: Experimental Validation of Focal Point Techniques, 1st Int'l Conf on Multiagent Systems, pp 102--108, June 1995, Ca, USA. and a much longer paper on focal points: S. Kraus, J. S. Rosenschein and M. Fenster Exploiting Focal Points Among Alternative Solutions: Two Approaches, Annals of Mathematics and Artificial Intelligence, 28(1-4):187-258, 2000. Additional material to the talk by Catholijn Jonker: Koen Hindriks and Dmytro Tykhonov, "Opponent Modelling in Automated Multi-Issue Negotiation", AAMAS'08, 2008.
Day 3: Wed Nov 4 Morning Room: T3-14	Multiagent Organizations Required reading:
9:00-11:00	Lecture: Mark Hoogendoorn -- Lecture Notes
11:00-11:30	Paper: M. Wooldridge, N. R. Jennings, and D. Kinny.The Gaia Methodology for Agent-Oriented Analysis and Design. In Journal of Autonomous Agents and Multi-Agent Systems, 3(3):285-312, 2000. Presented by Frederik Hogenboom -- Lecture Notes
11:30-12:00	Paper: Hoogendoorn, M., Jonker, C.M., Schut, M.C., and Treur, J., Modeling Centralized Organisation of Organizational Change. Jounal of Computational and Mathematical Organisation Theory, vol. 13, 2007, pp. 147-184. Presented by Yinyi Ma -- Lecture Notes
	Additional material on Multiagent Organizations: Ferber, J. and Gutknecht, O., A meta-model for the analysis and design of organizations in multi-agent systems., Proceedings of the Third International Conference on Multi-Agent Systems (ICMAS'98), IEEE Computer Society Press, pp. 128-135. Ferber, J., Gutknecht, O., Jonker, C.M., Mueller, J.P., and Treur, J.Organization Models and Behavioural Requirements Specification for Multi-Agent Systems. In: Y. Demazeau, F. Garijo (eds.), Multi-Agent System Organisations. Proc. of the 10th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW'01. .
Day 3: Wed Nov 4 Afternoon Room: T3-14	Agent-based Simulation of Financial Markets Required reading:
13:00-15:00	Lecture: Uzay Kaymak -- Lecture Notes
15:00-15:30	Paper: Katalin Boer, Uzay Kaymak, and Jaap Spiering. FROM DISCRETE-TIME MODELS TO CONTINUOUS-TIME, ASYNCHRONOUS MODELING OF FINANCIAL MARKETS Computational Intelligence 2007. Presented by Jai Bhatia -- Lecture Notes
15:30-16:00	Paper: A. O. I. Hoffmann, W. Jager and J. H. Von Eije. Social Simulation of Stock Markets: Taking It to the Next Level Journal of Artificial Societies and Social Simulation. Presented by -- Lecture Notes
16:00-17:30	Lecture by Susana M Vieira on: ACO, natural agents applied to feature selection. (This is a combined ERIM/LARGE talk.) Lecture Notes
	Additional material: Blake LeBaron Agent-based Computational Finance. Working Paper, Brandeis University, 2005. Nicholas T. Chany, Blake LeBaronz, Andrew W. Loyy, and Tomaso Poggiozz Agent-Based Models of Financial Markets: A Comparison with Experimental Markets. Working Paper, MIT, 2000.
Day 4: Mon Dec 7 Morning Room: T3-40	Emergent Behaviors Required reading:
9:00-9:30	Lecture: Wolf Ketter.
9:30-10:00	Joshua Epstein. Agent-Based Computational Models And Generative Social Science. Complexity 4/5, John Wiley, 1999. Presented by Marleen Schouten -- Lecture Notes
10:00-10:30	Paper: Alexander Babanov, Wolfgang Ketter, and Maria Gini. An Evolutionary Framework for Determining Heterogeneous Strategies in Multi-Agent Marketplaces, ERIM Research Report Series, 2008. Presented by Gianfranco Lucchese -- Lecture Notes
10:30-11:30	Guest lecture by Ludo Waltman -- Lecture Notes
11:30-12:00	Paper: L. Tesfatsion. Agent-based computational economics. ISU Economics Working Paper 1, Iowa State University, 2003. Presented by Zhihua Li -- Lecture Notes
	Additional material: Here are some of the many papers on robot swarms: Justin Werfel, Yaneer Bar-Yam, Radhika Nagpal, Building Patterned Structures with Robot Swarms, Int'l. Joint Conference on Artificial Intelligence (IJCAI '05), August 2005. Jimming Cheng, Winston Cheng, Radhika Nagpal, Robust and Self-repairing formation control for swarms of mobile agents National Conference on Artificial Intelligence (AAAI '05), July 2005. Jonathan Bachrach, Radhika Nagpal, Micheal Salib, Howard Shrobe, Experimental Results and Theoretical Analysis of a Self-Organizing Global Coordinate System for Ad Hoc Sensor Networks, Telecommunications Systems Journal, Special Issue on Wireless System Networks, Kluwer Academic Publishing, 2003. M. Nowak and R. May. Evolutionary games and spatial chaos. Nature, 359, 826-829, 1992. A paper on a physics-oriented model for achieving cooperation in large-scale systems: O. Shehory, S. Kraus and O. Yadgar. Emergent cooperative goal-satisfaction in large scale automated-agent systems, Artificial Intelligence Journal, 110(1):1-55, 1999. for a short paper on flocking behaviors and how "By tapping into social cues, individuals in a group may gain access to higher-order computational capacities that mirror the group's responses to its environment." read I. Couzin (2007). Collective Minds Nature, Vol 445, p. 715.
Day 4: Mon Dec 7 Afternoon Room: T3-40	Part 1: Preferences and Recommender Agents Part 2: Application: Agents in Supply-Chain Management Simulation Required reading:
13:00-14:00	Lecture: Wolf Ketter
14:00-14:30	Paper: Kurt Dresner and Peter Stone. A Multiagent Approach to Autonomous Intersection Management. Journal of Artificial Intelligence Research, 31:591-656, March 2008. Presented by Yinyi Ma -- Lecture Notes
14:30-15:00	Paper: Ravi Arona, Arun Sundararajan, and Siva Viswanathan. Intelligent agents in electronic markets for information goods: customization, preference revelation and pricing. Decision Support Systems, Volume 41, Issue 4, Pages: 764--786, 2006. Presented by Yixin Lu -- Lecture Notes
15:00-15:30	Paper: Pearl Pu, and Li Chen. User-Involved Preference Elicitation for Product Search and Recommender Systems. AI Magazine, (29)4:93-102, 2008. Presented by Frederik Hogenboom -- Lecture Notes
15:30-16:00	Paper: Darius Braziunas, Craig Boutilier. Elicitation of Factored Utilities. AI Magazine, (29)4:79-92, 2008. Presented by Jai Bhatia -- Lecture Notes
16:00-16:30	Paper: Wolfgang Ketter, John Collins, Maria Gini, Alok Gupta, and Paul Schrater. Detecting and Forecasting Economic Regimes in Multi-Agent Automated Exchanges. Decision Support Systems, 47(4):307-318, 2009. Presented by Alexander Hogenboom -- Lecture Notes
16:30-17:00	Paper: Gediminas Adomavicius, Alok Gupta, and Dmitry Zhdanov. Designing Intelligent Software Agents for Auctions with Limited Information Feedback. Information Systems Research, 20(4), 2009. Presented by Meditya Wasesa -- Lecture Notes
	Additional material: Bart Peintner, Paolo Viappiani, and Neil Yorke-Smith. Preferences in Interactive Systems: Technical Challenges and Case Studies. AI Magazine, (29)4:13-24, 2008. Ronen I. Brafman and Carmel Domshlak. Preference Handling - An Introductory Tutorial. AI Magazine, (30)1:58-86, 2009. Toby Walsh. Representing and Reasoning with Preferences. AI Magazine, (28)4:59-70, 2007. Jung S.Y., Hong J., and Kim T. A Statistical Model for User Preference. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, Vol. 17, No. 6, June 2005. Paul Scerri, A Farinelli, Steven Okamoto, Milind Tambe. Allocating tasks in extreme teams. 4th Int'l Conference on Autonomous Agents and Multiagent Systems (AAMAS), July 2005 Milind Tambe, E. Bowring, E. Pearce, P. Varakantham, P. Scerri, and D. V. Pynadath. Electric Elves: What went wrong and why. AI Magazine, (29)2:23--32, 2009. P. Berry, M. Gervasio, T. Uribe, M. Pollack, M. Moffitt. A Personalized Time Management Assistant, AAAI 2005 Spring Symposium Series, Stanford, CA, Mar 2005. For more details on the provacy loss describes in the Electric Elves paper read R. T. Maheswaran, J. P. Pearce, P. Varakantham, E. Bowring and M. Tambe. Valuation of Possible States (vps): A Unifying Quantitative Framework for Analysis of Privacy Loss in Collaboration. Proc. 4th Int'l Conference on Autonomous Agents and Multi-Agent Systems, Utrecht, The Netherlands, 2005. Another approach to resource allocation: Aram Galstyan, Shashikiran Kolar, and Kristina Lerman. Resource allocation games with changing resource capacities. 2nd Int'l Conf. on Autonomous Agents and Multiagent Systems, pp 145-152, 2003. Coalition formation for allocation of tasks O. Shehory and S. Kraus. Feasible Formation of Stable Coalitions among Autonomous Agents in Non-super-additive Environments, Computational Intelligence, 15(3):218--251, 1999.
Day 5: Tue Dec 8 Morning Room: T3-36	Project and Proposal Presentations Required reading:
9:00-12:00	PhD Project Presentations
Day 5: Tue Dec 8 Afternoon Room: T3-36	Project and Proposal Presentations Required reading:
13:00-16:00	PhD Project Presentations
16:00-17:00	Wolf Ketter -- Workshop wrap-up