Guo, G.; Metallinou, A.; Khatri, C.; Raju, A.; Venkastech, A.;
and Ram, R. 2017. Topic-Based Evaluation for Conversational Bots. Paper presented at the NIPS 2017 Workshop on
Conversational AI — Today’s Practice and Tomorrow’s
Potential. Long Beach, CA, December 8.
Guss, W. H.; Bartlett, J.; Kuznetsov, P.; Patil, P. 2017. Eigen:
A Step Towards Conversational AI. Alexa Prize Proceedings.
Seattle, WA: Amazon.
Hochreiter, S., and Schmidhuber, J. 1997. Long Short-Term
Memory. Neural Computation 9( 8): 1735–80.
Ji, J.; Wang, Q.; Battad, Z.; Gou, J.; Zhou, J.; Divekar, R.l;
Carlson, C.; Si, M.. 2017. A Two-Layer Dialogue Framework
for Authoring Social Bots. Alexa Prize Proceedings. Seattle,
WA: Amazon.
Kiros, R.; Zhu, Y.; Salakhutdinov, R.; Zemel, R. S.; Torralba,
A.; Urtasun, R.; and Fidler, S. 2015. Skip-Thought Vectors. In
Annual Conference on Neural Information Processing Systems.
Advances in Neural Information Processing Systems 28. Red
Hook, NY: Curran Associates, Inc.
Krause, B.; Damonte, M.; DobreM.; Duma, D.; Fancellu, F.;
Kahembwe, E.; Cheng, J.; Fainberg, J.; Webber, B. 2017. Edina: Building an Open Domain Socialbot with Self-Dialogues. Alexa Prize Proceedings. Seattle, WA: Amazon.
Kumar, A.; Gupta, A.; Chan, J.; Tucker, S.; Hoffmeister, B.;
Dreyer, M; Peshterliev, S.; Gandhe, A.; Filiminov, D.; Ras-trow, A.; Monson, C.; and Kuymar, A. 2017. Just ASK: Building an Architecture for Extensible Self-Service Spoken Language Understanding. arXiv preprint arXiv:1711.00549
[ cs.CL]. Ithaca, NY: Cornell University Library.
Levesque, H. J. 2017. Common Sense, the Turing Test, and the
Quest for Real AI: Reflections on Natural and Artificial Intelligence. Cambridge, MA: The MIT Press.
Liu, H.; Lin, T.; Sun, H.; Lin, W.; Chang, C.-W.; Zhong, T.;
Rudnicky, A. 2017. RubyStar: A Non-Task-Oriented Mixture
Model Dialog System. Alexa Prize Proceedings. Seattle, WA:
Amazon.
Manning, C. D.; Surdeanu, M.; Bauer, J.; Finkel, J.; Bethard,
S. J.; and McClosky, D. 2014. The Stanford CoreNLP Natural Language Processing Toolkit. In Proceedings of the 52nd
Annual Meeting of the Association for Computational Linguistics, System Demonstrations, 55–60. Stroudsburg, PA: Association for Computational Linguistics.
Papaioannou, I.; Curry, A.; Part, J.; Shalyminov, I.; Xu, X.;
Yu, Y.; Dusek, O.; Rieser, V.; Lemon, O. 2017. Alana: Social
Dialogue Using an Ensemble Model and a Ranker Trained
on User Feedback. Alexa Prize Proceedings. Seattle, WA: Amazon.
Pichl, J.; Marek, P.; Konrád, J.; Matulík, P.; Nguyen, H. L.;
Sedivy, J. 2017. Alquist: The Alexa Prize Socialbot. Alexa
Prize Proceedings. Seattle, WA: Amazon.
Prabhumoye, S.; Botros, F.; Chandu, K.; Choudhary, S.;
Keni, E.; Malaviya, C.; Manzini, T.; Pasumarthi, R.; Poddar,
S.; Ravichander, A.; Yu, Z.; Black. A. 2017. Building CMU
Magnus from User Feedback. Alexa Prize Proceedings. Seattle,
WA: Amazon.
Serban, I.; Sankar, C.; Zhang, S.; Lin, Z.; Subramanian, S.;
Kim, T.; Chandar, S.; Ke, N. R.; Rajeswar, S.; de Brebisson,
A.; Sotelo, J. M. R.; Suhubdy, D.; Michalski, V.; Nguyen A.;
and Bengio, Y. 2017. The Octopus Approach to the Alexa
Competition: A Deep Ensemble-Based Socialbot. Alexa Prize
Proceedings. Seattle, WA: Amazon.
Serban, I. V.; Sordoni, A.; Lowe, R.; Charlin, L.; Pineau, J.;
Courville, A.; and Bengio, Y. 2016. A Hierarchical Latent
Variable Encoder-Decoder Model for Generating Dialogues.
arXiv preprint arXiv:1605.06069[ cs.CL]. Ithaca, NY: Cornell
University Library.
Sukhbaatar, S.; Szlam, A.; Weston, J.; and Fergus, R. 2015.
Weakly Supervised Memory Networks. arXiv preprint arX-
iv:1503.08895[ cs.NE]. Ithaca, NY: Cornell University
Library.
Surowiecki, J. 2004. The Wisdom of Crowds: Why the Many
Are Smarter Than the Few and How Collective Wisdom Shapes
Business. New York: Doubleday.
Sutskever, I.; Vinyals, O.; and Le, Q. V. 2014. Sequence to
Sequence Learning with Neural Networks. In Annual Conference on Neural Information Processing Systems, Advances in
Neural Information Processing Systems 27, 3104–12. Red
Hook, NY: Curran Associates, Inc.
Turing, A. M. 1950. Computing Machinery and Intelligence. Mind 59(236): 433–460.
Venkatesh, A.; Khatri, C.; Ram, A.; Guo, F.; Gabriel, R.;
Nagar, A.; Prasad, R.; Cheng, M.; Hedayatnia, B.; Metallinou,
A.; Goel, R.; Yang, S.; and Raju, A. 2017. On Evaluating and
Comparing Conversational Agents. Paper presented at the
NIPS 2017 Workshop on Conversational AI — Today’s Practice and Tomorrow’s Potential. Long Beach, CA, December
8.
Vinyals, O., and Le, Q. 2015 A Neural Conversational Model. Paper presented at the ICML Deep Learning Workshop.
Lille, France, July 10.
Walker, M. A.; Litman, D. J.; Kamm, C. A.; and Abella, A.
1997. PARADISE: A Framework for Evaluating Spoken Dialogue Agents. arXiv preprint arXiv:cmp-lg/9704004 [ cs.CL].
Ithaca, NY: Cornell University Library.
Weizenbaum, J. 1966. Eliza — A Computer Program for the
Study of Natural Language Communication Between Man
and Machine. Communications of the ACM 9( 1): 36–45.
Wright, D. R. 2005. Finite State Machines: CSC215 Class
Notes. Unpublished Class Notes. Raleigh, NC: North Carolina State University.
Yi, S.; Jung, K.. 2017. A Chatbot by Combining Finite State
Machine, Information Retrieval, and Bot-Initiative Strategy.
A Two-Layer Dialogue Framework for Authoring Social Bots.
Alexa Prize Proceedings. Seattle, WA: Amazon.
Chandra Khatri is an AI scientist at Amazon Lab126 with a
research and development team responsible for making
Alexa conversational. Currently, he is the leading scientist
for Alexa Prize competition. Some of his recent work
involves open-domain dialogue planning and evaluation,
conversational speech recognition, conversational natural
language understanding, and topic modeling. Prior to
Alexa, Khatri was a research scientist at eBay in an applied
science group. At eBay, he led various deep learning and
NLP initiatives, such as automatic text summarization and
automatic content generation within the ecommerce
domain. He holds degrees in machine learning and computational science and engineering from the Georgia Institute
of Technology and the Birla Institute of Technology and Science.
Anu Venkatesh is a technical program manager on the
Alexa AI team and is responsible for execution of the Alexa
Prize, a university competition to advance conversational
