Social Statistics Agent. Autonomous Agents
and Multi-Agent Systems 13( 3): 327–354.
Jameson, A. 2009. Adaptive Interfaces and
Agents. Human-Computer Interaction: Design
Issues, Solutions, and Applications, 105. Boca
Raton, FL: CRC Press.
Kamar, E.; Hacker, S.; and Horvitz, E. 2012.
Combining Human and Machine Intelligence in Large-Scale Crowdsourcing. In
Proceedings of the International Conference on
Autonomous Agents and Multi-Agent Systems
(AAMAS 2012). Richland, SC: International
Foundation for Autonomous Agents and
Kaochar, T.; Peralta, R. T.; Morrison, C. T.;
Fasel, I. R.; Walsh, T. J.; and Cohen, P. R.
2011. Towards Understanding How
Humans Teach Robots. In User Modeling,
Adaption and Personalization, Lecture Notes
in Computer Science Volume 6787, 347–
352. Berlin: Springer. dx.doi.org/10.1007/
Kapoor, A.; Lee, B.; Tan, D.; and Horvitz, E.
2010. Interactive Optimization for Steering
Machine Classification. In Proceedings of the
SIGCHI Conference on Human Factors in Computing Systems, 1343–1352. New York: Association for Computing Machinery.
Knox, W. B., and Stone, P. 2013. Learning
Non-Myopically from Human-Generated
Reward. In Proceedings of the 2013 International Conference on Intelligent User Interfaces,
191–202. New York: Association for Computing Machinery. dx.doi.org/10.1145/
Knox, W. B., and Stone, P. 2012. Reinforcement Learning from Human Reward: Discounting in Episodic Tasks. In Proceedings of
the 2012 IEEE International Workshop on
Robots and Human Interactive Communications
(RO-MAN), 878–885. Piscataway, NJ: Institute for Electrical and Electronics Engineers.
Kulesza, T.; Stumpf, S.; Burnett, M.; and
Kwan, I. 2012. Tell Me More?: The Effects of
Mental Model Soundness on Personalizing
an Intelligent Agent. In Proceedings of the
SIGCHI Conference on Human Factors in Computing Systems, 1–10. New York: Association
for Computing Machinery.
Kulesza, T.; Stumpf, S.; Wong, W. K.; Burnett, M. M.; Perona, S.; Ko, A.; and Oberst,
I. 2011. Why-Oriented End-User Debugging
of Naive Bayes Text Classification. ACM
Transactions on Interactive Intelligent Systems
1( 1): 2. dx.doi.org/10.1145/2030365.
Law, E., and von Ahn, R. 2009. Input-Agreement: A New Mechanism for Data
Collection Using Human Computation
Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
(CHI 2009). New York: Association for Computing Machinery.
Moggridge, B., and Smith, G. C.
2007. Designing Interactions, Volume 17.
Cambridge, MA: The MIT Press.
Norman, D. A. 1994. How Might People
Interact with Agents. Communications of the
ACM 37( 7): 68–71. dx.doi.org/10.1145/
Norman, D. A. 1988. The Design of Everyday Things. New York: Basic Books.
Porter, R.; Theiler, J.; and Hush, D.
2013. Interactive Machine Learning in Data
Exploitation. Technical Report. Los Alamos
National Laboratories, Los Alamos, NM.
Pu, P., and Chen, L. 2009. User-Involved
Preference Elicitation for Product Search
and Recommender Systems. AI Magazine
29( 4): 93.
Rashid, A. M.; Ling, K.; Tassone, R. D.;
Resnick, P.; Kraut, R.; and Riedl, J. 2006.
Motivating Participation by Displaying the
Value of Contribution. In Proceedings of the
SIGCHI Conference on Human Factors in Computing Systems, 955–958. New York: Association for Computing Machinery.
Rosenthal, S. L., and Dey, A. K. 2010.
Towards Maximizing the Accuracy of
Human-Labeled Sensor Data. In Proceedings
of the 15th International Conference on Intelligent User Interfaces, 259–268. New York:
Association for Computing Machinery.
Settles, B. 2010. Active Learning Literature
Survey. Technical Report, Department of
Computer Science, University of Wisconsin,
Madison, Madison, WI.
Shneiderman, B.; Plaisant, C.; Cohen, M.;
and Jacobs, S. 2009. Designing the User Interface: Strategies for Effective Human-Computer
Interaction, 5th edition. Reading, MA: Addi-son-Wesley.
Stumpf, S.; Rajaram, V.; Li, L.; Burnett, M.;
Dietterich, T.; Sullivan, E.; Drummond, R.;
and Herlocker, J. 2007. Toward Harnessing
User Feedback for Machine Learning. In
Proceedings of the 12th International Conference
on Intelligent User Interfaces, 82–91. New
York: Association for Computing Machinery. dx.doi.org/10.1145/1216295.1216316
Talbot, J.; Lee, B.; Kapoor, A.; and Tan, D. S.
2009. EnsembleMatrix: Interactive Visualization to Support Machine Learning with Multiple Classifiers. In Proceedings of the 27th
International Conference on Human Factors in
Computing Systems, 1283–1292. New York:
Association for Computing Machinery.
Thomaz, A. L., and Breazeal, C. 2008.
Teachable Robots: Understanding Human
Teaching Behavior to Build More Effective
Robot Learners. Artificial Intelligence 172( 6):
Vig, J.; Sen, S.; and Riedl, J. 2011. Navigating the Tag Genome. In Proceedings of the
16th International Conference on Intelligent
User Interfaces, 93–102. New York: Association for Computing Machinery.
Winograd, T. 1996. Bringing Design to Software. New York: Association for Computing
Saleema Amershi is a researcher in the
Computer Human Interactive Learning
(CHIL) group at Microsoft Research. Her
research lies at the intersection of human-computer interaction and machine learning. In particular, her work involves designing and developing new techniques to
support effective end-user interaction with
interactive machine-learning systems.
Amershi received her Ph.D. in computer science from the University of Washington’s
Computer Science and Engineering Department in 2012.
Maya Cakmak is an assistant professor at
the University of Washington, Computer
Science and Engineering Department,
where she directs the Human-Centered
Robotics lab. She received her Ph.D. in
robotics from the Georgia Institute of Technology in 2012. Her research interests are in
human-robot interaction and end-user programming. Her work aims to develop assistive robots that can be programmed and
controlled by end users, in the context of
W. Bradley Knox recently completed a
postdoctoral researcher position at the MIT
Media Lab. His research interests span
machine learning, human-robot interaction, and psychology, especially machine-learning algorithms that learn through
human interaction. Knox received a Ph.D.
in computer science at the University of
Texas at Austin and a BS in psychology from
Texas A&M University.
Todd Kulesza is a computer science Ph.D.
candidate at Oregon State University, working under the guidance of Margaret Burnett.
His research interests are in human interactions with intelligent systems, with a focus
on enabling end users to personalize such
systems efficiently and effectively.