Blue-highlighted publications are significant HCI innovations

Green-highlighted publications are significant medical education innovations

 

Journal and Conference Publications

 2008

Quarles, J., Lampotang, S., Fischler, I., Fishwick, P., and B. Lok, “A Mixed Reality System for Enabling Collocated After Action Review" (To appear) 7th IEEE and ACM International Symposium on Mixed and Augmented Reality - ISMAR 2008, Sept 15-18, Cambridge, UK.

Presented after-action review of a system using mixed reality by both students and educators

PDF

 

Rossen, B., Johnsen, K., Deladisma, A., Lind, D., and B. Lok.  Virtual Humans Elicit Skin-Tone Bias Consistent with Real-World Skin-Tone Biases” (To appear) Intelligent Virtual Agents 2008, Sept. 1-3, Tokyo, JP.

User study results show that biases in the real world (psychology metrics) are correlated with biases in the virtual world (observer rated).

 

PDF

 

Rodriguez, H., B. Lok, D. Lind, D. Beck, "Audio Analysis of Human/Virtual-Human Interaction" Intelligent Virtual Agents 2008, Sept. 1-3, Tokyo, JP. Explored analysis and visualization of audio data when speaking with Virtual Humans.

PDF

Kotranza, A., D. Lind, C. Pugh, and B. Lok, “Virtual Human + Tangible Interface = Mixed Reality Human. An Initial Exploration with a Virtual Breast Exam Patient” IEEE Virtual Reality 2008, March 8-12, Reno, NV, 99-106. Best Paper Award, IEEE VR2008

Presented a mixed reality human (virtual human that affords touch) and the impact on social behaviors.

 

PDF

Quarles, J., Lampotang, S., Fischler, I., Fishwick, P., and B. Lok, “Mixed Reality Merges Abstract and Concrete Knowledge” IEEE Virtual Reality 2008, March 8-12, Reno, NV, 27-34.

Presented the Augmented Anesthesia Machine and how the resulting mixed reality visualization enhanced learning.

 

PDF

Quarles, J., Lampotang, S., Fischler, I., Fishwick, P., and B. Lok, “Tangible User Interfaces Compensate for Low Spatial Cognition” IEEE 3D User Interfaces 2008, March 8-9, Reno,NV, 11-18.

User study that showed mixed reality interfaces can compensate for low user small-scale or large-scale spatial cognition, thus complementing model learning and hands-on learning approaches.

 

PDF

Raij, A., and B. Lok, “IPSVIZ: An After-Action Review Tool for Human-Virtual Human Experiences” IEEE Virtual Reality 2008, March 8-12, Reno, NV, 91-98.

Proposed after-action reviews of human-virtual human experiences and discussed results of user study.

 

PDF

Johnsen, K. and B. Lok, “An Evaluation of Immersive Displays for Virtual Human Experiences” (short paper) IEEE Virtual Reality 2008, March 8-12, Reno, NV, 133-136.

User study that showed how immersion effects how people perceive themselves in H-VH interactions.

 

PDF

Deladisma, A., Johnsen, K., Raij, A., Rossen, B., Kotranza, A., Kalapurakal, M., Szlam, S., Bittner, J., Sinwson, D., Lok, B., and D. Lind, “Medical Student Satisfaction using a Virtual Patient System to Learn History-Taking and Communication Skills” Medicine Meets Virtual Reality (MMVR) 16.

Medical students reported on the educational value and their acceptance of an immersive virtual patient experience.

 

PDF

 

 

               

2007

Ferdig, R., Coutts, J., DiPietro, J., Lok, B., and N. Davis. “Innovative Technologies for Multicultural Education Needs”, Multicultural Education and Technology Journal, 1(1), 47-63.

Covers several ongoing projects that leverage technology to teach, learn, and address multicultural concepts.

PDF

Johnsen, K., Raij, A., Stevens, A., D. Lind and B. Lok (2007). "The Validity of a Virtual Human Experience for Interpersonal Skills Education" in Proceedings of the SIGCHI conference on Human Factors in Computing Systems, ACM Press, New York, NY, 2007, 1049-1058.

Tested the validity of a virtual patient experience by comparing the same student interactions with a standardized patient.  The resulting moderate correlation argues for the use of virtual patients in educational curricula.

 

PDF

Deladisma, A., Cohen, M., Stevens, A., Wagner, P., Lok, B., Bernard, T., Oxendine, C., Schumacher, L., Johnsen, K., Dickerson, R., Raij, A., Wells, R., Duerson, M., Harper, J., and D. Lind. “Do Medical Students Respond Empathetically to a Virtual Patient?” in The American Journal of Surgery. Vol 193, Issue 6, 2007. 756-760.

Examined the quantity and quality of empathetic responses to virtual patient initiated challenges.

 

PDF

 

Raij, K. Johnsen, R. Dickerson, B. Lok, M. Cohen, M. Duerson, R. Pauley, A. Stevens, P. Wagner, and D. Lind. "Comparing Interpersonal Interactions with a Virtual Human to those with a Real Human," IEEE Transactions on Visualization and Computer Graphics, Vol .13, No. 3, 443-457, May/June 2007.

Special issue invitation of VR2006 paper.  Includes results of a follow up study (total n=50) that evaluated VPs vs. SPs.  The studies employed self-rated, expert-rated, and behavioral measures to clearly identify how interacting with a VP is similar to and different from interacting with a SP.

 

PDF

2006

Lok, B., Ferdig, R., Raij, A., Johnsen, K., Dickerson, R., Coutts, J., Stevens, A., and D. Lind “Applying Virtual Reality in Medical Communication Education: Current Findings and Potential Teaching and Learning Benefits of Immersive Virtual Patients”, Journal of Virtual Reality, Spring London, Vol. 10, No. 3-4, 185-195.

Evaluating virtual human interactions from an educational theory perspective, this paper recaps the first 100 VH experiences and then discusses them within the context of educational theories of content development, sense of ownership, active participation, social interaction, artifact creation, and reflection and feedback. 

 

PDF

Lok, B. “Teaching Communication Skills with Virtual Humans” (Invited Article) IEEE Computer Graphics and Applications, Vol 26, No. 3, 10-13.

This invited article (appearing as an article on VR research) summarizes the first four studies (n=60) and generalizes what we know about VH technology, what it can do, and where we can take it. 

PDF

Raij, A, Johnsen, K, Dickerson, R., Lok, B., Cohen, M., Stevens, A., Bernard, T., Oxendine, C., Wagner, P., Lind, D (2006). “Interpersonal Scenarios: Virtual ≈ Real?” IEEE Virtual Reality 2006, 59-66.

A between-subjects user study (n=17) that highlighted how interacting with a virtual human was similar to – and different from – interacting with a real human.  In a nutshell, similar: content, not similar: delivery.

PDF

Color

Dickerson, R., Johnsen, K., Raij, A., Lok, B., Stevens, A., Bernard, T., and D. Lind "Virtual Patients: Assessment of Synthesized Versus Recorded Speech," Medicine Meets Virtual Reality 14, 114-119.

This paper evaluated the impact of using synthesized versus recorded speech for the virtual patient on student perception.  While the conversations had similar content (questions were asked at the same frequency), perceptions of the virtual patient were lower when using synthesized speech.  

 

PDF

 

Johnsen, K., Dickerson, R., Raij, A., Harrison, C., Lok, B., Stevens, A., and D. Lind. “Evolving an Immersive Medical Communication Skills Trainer,” Journal on Presence: Teleoperators and Virtual Environments, Vol 15, No. 1, 33-46.

Special issue invitation of VR2005 paper.  Discusses the initial virtual patients system and then evaluates the impact of improving tracking (IR tracking instead of color tracking), script robustness, and speech understanding.

PDF

 

Stevens, A., Hernandez, J., Johnsen, K., Dickerson, R., Raij, A., Harrison, C., DiPietro, M., Allen, B., Ferdig, R., Foti, S., Jackson, J., Shin, M., Cendan, J., Watson, R., Duerson, M., Lok, B., Cohen, M., Wagner, P., and D. Lind.  “The Use of Virtual Patients to Teach Medical Students Communication Skills.”  The American Journal of Surgery, Jun; 191(6):806-811.

Presented immersive virtual patients as an augmentation to standardized patient program and communication skills education curriculum.

 

PDF

 

Kotranza, A., Quarels, J., Wang, X., and B. Lok (2006). “Mixed Reality: Are Two Hands Better Than One?” ACM Symposium on Virtual Reality Software and Technology (VRST) 2006, Nov. 1-3, Limassol, Cyprus.

 

Compares preference and task performance of completing mixed reality tasks using two hands versus one hand.

PDF

 

 

2005

Johnsen, K., Dickerson, R., Raij, A., Lok, B., Jackson, J., Shin, M., Hernandez, J., Stevens, A., and D. Lind. “Experiences in Using Immersive Virtual Characters to Educate Medical Communication Skills,” IEEE Virtual Reality 2005, Bonn, Germany, March 2005, 179-186.

This paper presents an immersive virtual human system that can simulate a patient-doctor interaction and the results of a pilot study (n=7). 

 

PDF

 

Dickerson, R., Johnsen, K., Raij, A., Lok, B., Hernandez, J., Stevens, A., and D. Lind. “Evaluating a Script-Based Approach to Simulating Patient-Doctor Interaction,” SCS 2005 International Conference on Human-Computer Interface Advances for Modeling and Simulating (SIMCHI ’05), 79-84.

This paper evaluates the speech recognition performance for a real world H-VH interaction.  The performance for a constrained application was ~ 70% matching for utterances.

 

PDF

 

Wang, X., Kotranza, A., Quarels, J., Lok, B., and D. Allen (2005). “A Pipeline for Rapidly Incorporating Real Objects into a Mixed Environment,” (short paper) 4th IEEE and ACM International Symposium on Mixed and Augmented Reality, Vienna, Austria, 170-173.

Presents an approach to quickly get real objects as interfaces to virtual environments through laser scanning, attaching colored markers, and then tracking the real object.

 

PDF

 

 

Wang, X., Kotranza, A., Quarels, J., Lok, B., and D. Allen (2005). “Rapidly Incorporating Real Objects for Evaluation of Engineering Designs in a Mixed Reality Environment.” New Directions in 3D User Interfaces Workshop, IEEE Virtual Reality 2005, Bonn, Germany.

Proposes the use of mixed reality to evaluate engineering designs.  Mixed realities ability to allow users to handle real objects would help overcome some of the limitations to simulating hands-on engineering tasks.

PDF

 

 

 

Medical Presentations

 2008

Deladisma, A., Imam, T., Kotranza, A., Raij, A., Bittner, J., Lok, B., Pugh, C., and D. Lind. “The Use of Mixed Reality Humans to Teach Clinical Skills” to be presented at 47th Annual Conference on Research in Medical Education (RIME), October 31-November 5th, 2008, San Antonio, TX.

PDF

Cendan, J., Miller, B., Wang, X., Horton, J., and B. Lok. “Development of Virtual Patient with Fixed Cranial Nerve Pathology.”  Presented at the Southern Group on Education Affairs 2008.

Using virtual patients to present abnormal findings.

PDF

Craig, J., Deladisma, A., Gupta, M., Bittner, J., Johnsen, K., Lok, B., and D. Lind. "Novel Integration of a Life-Sized, Immersive Virtual Instructor with a Mannequin-Based Procedural Simulator to Teach Central Venous Catheterization." Presented at the 8th Annual International Meeting on Simulation in Healthcare. San Diego, CA. Jan 13-16, 2008.

A virtual instructor provided instruction and feedback on a student’s interaction with a mannequin.

PDF

Gupta, M., Deladisma, A., Kotranza, A., Craig, J., Bittner, J., Johnsen, K., Lok, B., and D. Lind. "The Use of a Virtual Character-Enhanced Simulator to Teach Breast History and Examination Skills." Presented at the 8th Annual International Meeting on Simulation in Healthcare. San Diego, CA. Jan 13-16, 2008.

Mixed reality patients integrates a mannequin, physical simulator, and virtual human to simulate intimate exams.

PDF

Deladisma, A., Gupta, M., Kotranza, A., Bittner, J., Imam, T., Swinson, D., Nesbit, R., Lok, B., Pugh, C., D. Lind. "A Pilot Study to Integrate an Immersive Virtual Patient with a Breast Complaint and Breast Exam Simulator into a Medical Student Surgery Clerkship." Presented at Association from Surgical Education Surgical Education Week 2008.

Proposes the integration of virtual patients and mixed reality patients to improve intimate exam simulation fidelity and communication skill education.

 

PDF

 

2007

Mack, D., Deladisma, A., Bernard, T., Oxendine, C., Lok, B., and D. Lind.  “Virtual Patients Reduce Anxiety and Enhance Learning when Teaching Medical Student Sexual-History Taking Skills”, Society for Simulation in Healthcare.

Research Abstract Award 2nd place Education

Talking to a virtual patient about a breast complaint reduces physiological measures of anxiety (blood pressure and heart rate) when then talking to a standardized patient about a breast complaint.

 

PDF

 

Deladisma, A., Mack, D., Bernard, T., Oxendine, C. Szlam, S., Wagner, P., Kruse, E., Lok, B., and D. Lind.  “Virtual Patients Reduce Anxiety and Enhance Learning when Teaching Medical Student Sexual-History Taking Skills”, Association for Surgical Education 2007 Surgical Education Week.

Same as Society for Simulation in Healthcare abstract

 

2006

Lind, D. and B. Lok (2006). The Role of Virtual Patients in Medical Education: Teaching Tool Versus Technological Trend. (Invited Article) Focus on Surgical Education 2006, 23(1), 28-29.

Discusses how to integrate technology research with medical education.

 

PDF

 

 

Cohen, M., Stevens, A., Wagner, P., Lok, B., Bernard, T., Oxendine, C. Schumacher, L., Johnsen, K., Dickerson, R., Raij, A., Ross, R. Duerson, M., Parimala, J., and D.S. Lind. “How Comparable are Medical Student Empathetic Interactions in a Similar Virtual Patient/Standardized Patient Abdominal Pain Scenario?” Southern Group on Education Affairs 2006.

Objectively measures empathetic responses to virtual humans (n=33) versus standardized patients (n=25)

 

PDF

 

Cohen, M., Stevens, A., Wagner, P., Lok, B., Bernard, T., Oxendine, C., Schumacher, L., Johnsen, K., Dickerson, R., Raij, A., Wells, R., Duerson, M., Harper, J., and D. Lind. “Do Medical Students Respond Empathetically to a Virtual Patient?” Association for Surgical Education 2006 Surgical Education Week.

Expert-rated empathetic responses to virtual humans (n=20) versus standardized patients (n=8)

 

PDF

 

Deladisma, A., Cohen, M., Stevens, A., Wagner, P., Lok, B., Bernard, T., Oxendine, C., Schumacher, L., Johnsen, K., Dickerson, R., Raij, A., Wells, R., Duerson, M., Harper, J., and D. Lind. “Do Medical Students Respond Empathetically to a Virtual Patient?” Georgia Chapter of the American College of Surgeons

Clinical Research Award 2nd place, Same as ASE abstract.

 

 

Bernard, T., Stevens, A., Wagner, P., Bernard, N., Shcumacher, L., Johnsen, K., Dickerson, R., Raij, A., Lok, B., Duerson, M., Cohen, M., and D. Lind “A Multi-Institutional Pilot Study to Evaluate the Use of Virtual Patients to Teach Health Professions Students History-Taking and Communication Skills.” Society of Medical Simulation Meeting 2006, Vol. 1, No. 2, 1-2.

Covers the logistics and difficulties of implementing standardized virtual patient experiences at multiple institutions.

 

PDF

 

Stevens, A., Cohen, M., Johnsen, K., Dickerson, R., Raij, A., Wells, R., Oxendine, C., Wagner, P., Bernard, T., Cendan, J., Duerson, M., Pauly, R., Lok, B., and D. Lind, “Implementing a Virtual Patient (VP) into the Medical School Curriculum at the University of Florida (UF) “ Southern Group on Education Affairs 2006.

Discusses how virtual patient technology can be integrated into a standardized patient-based curriculum.

PDF

2005

Stevens, A., Hernandez, J., Johnsen, K., Dickerson, R., Raij, A., Jackson, J., Shin, M., Cendan, J., Duerson, M., Lok, B., and D. Lind “The Use of Virtual Patients to Teach Medical Students Communication Skills,” Association of Surgical Education 2005 Surgical Education Week.

Same as American Journal of Surgery 2006 article.

 

 

 

 

Stevens, A., Hernandez, J., Johnsen, K., Dickerson, R., Raij, A., Jackson, J., Shin, M., Cendan, J., Duerson, M., Lok, B., and D. Lind “The Use of Virtual Patients to Teach Medical Students Communication Skills,” Southern Group on Education Affairs 2005.

Preliminary report of the efficacy of immersive virtual patients system for teaching communication skills.

PDF