Course Overview

This graduate course gives a broad overview of various models for combining human and machine intelligence to solve computational problems. Through weekly seminars and a class project, we will examine three roles that humans play in computational systems -- humans as computers, humans as teachers, and humans as collaborators. This research-focused course covers literature from a variety of research areas, and includes topics such as human computation and crowdsourcing, learning by demonstration, mixed initiative systems, active learning from human teachers, interactive machine learning, human-in-the-loop security, etc. There are 3 P's to the course: Pitches, Presentations, Project.

1. Pitches

For the first month of the course, we will rapidly cover four distinct types of human-in-the-loop systems -- human-robot interaction, brain-computer interfaces, crowdsourcing, and interactive machine learning. We will introduce these four topics, through reading of papers, guest lectures, and project pitches. Prior to each class, students must read the 2-3 assigned readings, and prepare a 3-minute project pitch (3 slides in PDF format - Questions, Approach, Expected Outcomes). During class, students will present their project pitch, followed by a discussion with the guest speaker.

2. Presentations

After choosing their course project, each student will prepare a 15-minute presentation on a paper related to their course project, followed by a discussion. The discussion will revolve around how the limitation of the prior, and how the course project will attempt to extend beyond those limitations.

3. Project

The class project is a major component of this course. Students will work in groups on a project where they will design, prototype and/or evaluate a human-in-the-loop system, on one of the four topics. There will be a few lectures on HCI methodologies, such as rapidly protytping, user studies and online experimentation. The project will have four deliverables: (a) a 1-page preliminary proposal, (b) a 6-page paper draft written in conference proceedings format (without results), and (c) a 10-page final paper (with results), and (d) a project poster session. Students are encouraged to submit their work as short papers, workshop papers, or full conference papers.

Attendance and Classroom Etiquette

You are expected to attend every class. Your participation grade will be based, in part, on how many classes you missed. Special consideration can be made for a few exceptions (e.g., academic travel, ilnesses and family emergencies). However, you must discuss your anticipated absence with the instructor, and provide the necessary justification and documentation. During class, students are strongly discouraged to use their laptops and mobile devices.


Students will be evaluated on the quality of their participation (both online and in-class) and project write-up and poster.