Main Page
From Autonomous Multirobot Systems
Contents |
Autonomous Multi-Robot Systems Spring 2012
Administrative
- web:http://www.intelligentappliances.org/multirobot/
- piazza http://piazza.com/class#spring2012/cs76318803mrs4632
- Professor: Tucker Balch CCB 317
- TA: Brian Hrolenok
- BioSim help: Hai Shang
- Tuesday/Thursday 3:00-4:30 Klaus 2443
- T-square site: TBD
- Link to 2008 course, 2010 course
Topics
Hierarchical robot control; Behavior-based robot control; Sensors and perception; Navigation and path planning; Localization; Reinforcement learning; Communication; Diversity.
Students should have strong programming skills.
Main Components of Course
First third, Basics:
- Basics of behavior-based control for robots
- Basics of multi-robot systems
- Project: Simple multi-robot system, ASCII soccer (C programming language)
Second third, Research:
- Survey of important literature
- Each student chooses a group of papers on a multi-agent or multi-robot topic
- Each student leads a 30 minute discussion of their topic
Last third, Build Multi-Robot Systems:
- Several projects using BioSim, Java based multi agent simulation system (Java)
- Key component is experimental evaluation of the performance of these systems.
Grading Components & Expectations
- Basic projects: 30%
- Presentation: 30% (re-do allowed)
- Multi-robot projects: 30%
- Quizzes: 10% (easy questions about the content of presentations)
If you take the course P/F you only need to do the presentation and quiz component.
Resources
Some papers and pointers:
- motor schema formulations
- motor schemas for formation control
- Voting paper by Rosenblatt
- Voting paper by USC folks
- Q-learning on wikipedia
- Q-learning paper by Kaelbling, Littman, Moore
- Bao presentation regarding Clay: Clay
- Hai présentation regarding software for project: [1]
Software we'll be using:
Prerequisite
Strong programming skills. We will be using Unix, C, Java.
Midterm Preparation
- Know
- Arkin paper on motor schemas
- motor schema formulations
- article about diversity (sections 1, 2, & 3)
- paper on Reinforcement Learning (sections 1.1, 1.2, 3.1, 4.2)
Schedule
| January | |||
| Tuesday | January 10 | Class overview | |
| Thursday | January 12 | Sense Think Act cycle multirobot lecture 1 | |
| Tuesday | January 17 | Class overview (repeat for France) More on ascii soccer | |
| Thursday | January 19 | ascii soccer workshop | |
| Tuesday | January 24 | Topic | |
| Thursday | January 26 | Topic | |
| Tuesday | January 31 | Topic | |
| Thursday | February 2 | Topic | |
| Tuesday | February 7 | Topic | |
| Thursday | February 9 | Topic | |
| Tuesday | February 14 | Topic | |
| Thursday | February 16 | Topic | |
| Tuesday | February 21 | Topic | |
| Thursday | February 23 | Topic | |
| Tuesday | February 28 | Ant Navigation via pheromones. Social Potentials | |
| Thursday | March 1 | Topic | |
| Tuesday | March 6 | Communication in multi-robot teams. | |
| Thursday | March 8 | Motter (emergent behavior in swarms): presentation
The self-organizing exploratory pattern of the argentine ant
J. -L. Deneubourg, S. Aron, S. Goss and J. M. Pasteels;
Study of group food retrieval by ants as a model for multi-robot collective transport strategies. S. Berman, Q. Lindsey, M. Sakar, V. Kumar and S. Pratt | |
| Tuesday | March 13 | Aziz (multi-agent learning):presentation On Optimizing Interdependent Skills: A Case Study in Simulated 3D Humanoid Robot Soccer
Daniel Urieli, Patrick MacAlpine, Shivaram Kalyanakrishnan, Yinon Bentor, Peter Stone; Cooperative Multi-Agent Learning: The State of the Art. Liviu Panait and Sean Luke | |
| Thursday | March 15 |
Molina (formation control):presentation | |
| Tuesday | March 20 | Spring Break | |
| Thursday | March 22 | Spring Break | |
| Tuesday | March 27 |
Apte (swarm design): | |
| Thursday | March 29 | Ponnau (collaborative exploration) France Value-based action selection for exploration and dynamic target observation with robot teams
Stroupe, A.W.; Ravichandran, R.; Balch, T.;
Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA | |
| Tuesday | April 3 | Topic: Quiz (Balch Travel) | |
| Thursday | April 5 | Bao presentation regarding Clay: Clay Hai présentation regarding software for project: [2] | |
| Tuesday | April 10 |
Wang (task assignment) | |
| Thursday | April 12 |
Sephus (emergent behavior in biological swarms) | |
| Tuesday | April 17 |
Ong (multi-robot SLAM) (prefers April) | |
| Thursday | April 19 |
Quitmeyer (social insects collective decision making) | |
| Tuesday | April 24 |
Sung Lee (formation control): | |
| Thursday | April 26 |
Maurice (swarm design): | |
| Week | April 30 - May 4 | Final Exam Week |
|
Projects
- 2012_Project_1, Part 1 is due Monday January 23 at 11:55PM
- 2012_Project_1, Part 2 is due Friday January 27 at 11:55PM
- 2012_Project_2, is due Saturday, February 11, at 11:55PM
- 2012_Project_3, is due Thursday, April 12, at 11:55PM
- 2012_Project_4, is due Weds, May 2, at 11:55PM
- 2012_Quiz_2, is due Friday, May 4, at 11:55PM
- Presentation template: template.pptx or in pdf template.pdf
Content We May Use
- multirobot lecture 0
- multirobot lecture 1
- multirobot lecture 2
- Diversity Part 1
- Diversity Part 2
- article about diversity (sections 1, 2, 3, 4, & 7)
- Behavior Based Control Part 1
- motor schema formulations
- Behavior Based Control Part 2
- Introduction to MASON,
- Reinforcement Learning: media:RL-slides.pdf
- RRTs
- Intro to multi robot / multi objective visit tasks. PRIM Algorithm details
- Ants & ERRTs
- Paper on communication (with sections to read)
- Reinforcement Learning paper
- MASON assignment
- Shang Hai MASON slides
- midterm (take home)
Previous Assignments We May Use
- 2010Fall Project 1 Part 1
- 2010Fall Project 1 Part 2
- 2010Fall Project 2
- 2010Fall Project 3
- 2010Fall Project 4
- 2010Fall Project 5
- 2010Fall Project 6
Evaluation
Grading will be based on projects and tests as follows as follows:
- Midterm exam: 10%
- Final exam: 10%
- Programming assignments: 70%
- Paper presentation: 10%
