puter Science 9388, 574–583. Berlin: Springer.
Ruping, S. 2006. Learning Interpretable Models. Ph.D. dissertation, Department of Informatics, Dortmund University
of Technology, Dortmund, Germany ( d-nb.info/99749
Salas, E.; DiazGranados, D.; Klein, C.; Burke, C. S.; Stagl, K.
C.; Goodwin, G. F.; and Halpin, S. M. 2008. Does Team
Training Improve Team Performance? A Meta-Analysis.
Human Factors 50( 6): 903–933. doi.org/10.1518/00187
Salas, E.; Dickinson, T.; Converse, S. A.; and Tannenbaum, S.
I. 1992. Toward an Understanding of Team Performance and
Training. In Teams: Their Training and Performance, ed. R. W.
Swezey and E. Salas, 3–29. Norwood, NJ: ABLEX.
Salas, E.; Wildman, J. L.; and Piccolo, R. F. 2009. Using Simulation-Based Training to Enhance Management Education.
Academy of Management Learning and Education 8( 4): 559–
Sanchez, J.; Rogers, W. A.; Fisk, A. D.; and Rovira, E. 2011.
Understanding Reliance on Automation: Effects of Error
Type, Error Distribution, Age and Experience. Theoretical
Issues in Ergonomics Science 15( 2): 134–160. doi.org/10.1080/
Sheng, C.; Tian, Y.; and Chen, M. 2010. Relationships
Among Teamwork Behavior, Trust, Perceived Team Support,
and Team Commitment. Social Behavior and Personality
38( 10): 1297–1305. doi.org/10.2224/sbp.2010.38.10.1297
Stubbs, K.; Wettergreen, D.; and Hinds, P. J. 2007. Autonomy and Common Ground in Human-Robot Interaction: A
Field Study. IEEE Intelligent Systems 22( 2): 42–50. doi.org/10.
Uggirala, A.; Gramopadhye, A. K.; Melloy, B. J.; and Toler, J.
E. 2004. Measurement of Trust in Complex and Dynamic
Systems Using a Quantitative Approach. International Journal of Industrial Ergonomics 34( 3): 175–186. doi.org/10.1016/
US Air Force. 2014. America’s Air Force: A Call to the Future.
Washington, DC: United States Air Force. Online: airman.
Volpe, C. E.; Cannon-Bowers, J. A.; Salas, E.; and Spector, P.
E. 1996. The Impact of Cross-Training on Team Functioning:
An Empirical Investigation. Human Factors 38( 1): 87–100.
Wang, L.; Jamieson, G. A.; and Hollands, J. G. 2009. Trust
and Reliance on an Automated Combat Identification System. Human Factors 51( 3): 281–291. doi.org/10.1177/
Warwick, G. 2014. Certifiable Trust Required to Take
Autonomous Systems Past Unmanned. Aviation Week and
Space Technology, August 11. Online: aviationweek.com/
Wilkinson, C.; Lynch, J.; and Bharadwaj, R. 2013. Final
Report — Regulatory Considerations for Adaptive Systems.
NASA/CR–2013-218010. Washington, DC: National Aeronautics and Space Administration.
Yosinski, J.; Clune, J.; Nguyen, A.; Fuchs, T.; and Lipson, H.
2015. Understanding Neural Networks through Deep Visualization. Unpublished Paper. arXiv preprint arX-
iv:1506.06579. Ithaca, NY: Cornell University Library.
Joseph B. Lyons is the technical advisor for the Human
Trust and Interaction Branch within the 711 Human Performance Wing at Wright-Patterson AFB, OH. Lyons
received his Ph.D. in industrial and organizational psychology from Wright State University in Dayton, OH, in 2005.
Some of Lyons’s research interests include human-machine
trust, interpersonal trust, leadership, and social influence.
Lyons has worked for the Air Force Research Laboratory as a
civilian researcher since 2005, and between 2011–2013 he
served as the program officer at the Air Force Office of Scientific Research where he created a basic research portfolio
to study both interpersonal and human-machine trust.
Lyons has published in a variety of peer-reviewed journals
such as Human Factors, Journal of Applied Social Psychology,
Journal of Psychology, The Leadership Quarterly, Stress and
Health, Anxiety Stress and Coping, Journal of Change Management, International Journal of Industrial Ergonomics, Personality and Individual Differences, Team Performance Management,
and Military Psychology.
Matthew A Clark is the branch chief for the Autonomous
Controls Branch, AFRL/RQQA. Clark started his career in the
Air Force Research Lab in 1998 supporting large-scale aircraft
component thermal, acoustic, and static combined environment structural testing. In 2000 and 2010, respectively,
he received his bachelor’s and master’s degrees in electrical
engineering from Wright State University in Dayton, OH. In
2010, Clark served at the Air Force Material Command headquarters providing support for the test and evaluation infrastructure, strategic planning, and operational cyber security,
receiving the Exemplary Civilian Service Award. In 2011 he
returned to the Air Force Research Laboratory to work on the
verification and validation of autonomous control systems
and applications. His research interests include verifiable
intelligent control systems and run-time assurance of intelligent systems.
Alan Wagner is a senior research scientist at Georgia Institute of Technology’s Research Institute and is a member of
the Institute of Robotics and Intelligent Machines. Wagner’s
research has won several awards including being selected by
the Air Force Young Investigator Program. His research on
deception has gained significant notoriety in the media,
resulting in articles in the Wall Street Journal, New Scientist
Magazine, and the journal Science, and is described as the
13th most important invention of 2010 by Time Magazine.
His research has also won awards within the human-robot
interaction community, such as the best paper award at ROMAN 2007. He received his Ph.D. in computer science from
Georgia Institute of Technology. He also holds a master’s
degree in computer science from Boston University and a
bachelor’s degree in psychology from Northwestern University.
Matthew J. Schuelke is a senior human factors engineer for
SRA International working under contract with the Human
Trust and Interaction Branch within the 711 Human Performance Wing at Wright-Patterson AFB, OH. Schuelke
received his Ph.D. in industrial and organizational psychology from the University of Oklahoma in 2010 where he performed training and leadership research funded from
sources such as the Defense Advanced Research Projects
Agency, the National Science Foundation, and the Army
Research Institute. Schuelke is published in journals such as
the Journal of Applied Psychology, Leadership Quarterly, and
Multivariate Behavioral Research.