There has been a recent resurgence of Vietnam-era Veterans seeking Veteran Affairs (VA) services ... more There has been a recent resurgence of Vietnam-era Veterans seeking Veteran Affairs (VA) services for post-traumatic stress disorder (PTSD). Multiple studies have reported positive outcomes using Virtual Reality Exposure Therapy (VRET) with Iraq/Afghanistan Veteran PTSD patients, but there have been fewer investigations into the acceptability and feasibility of VRET with older Veterans. We have extended an established VRET system, BRAVEMIND, to include Vietnam relevant content following a user-centered iterative design methodology. This paper will present the BRAVEMIND Vietnam VRET system, including setup, content, and technical architecture along with the findings of an initial focus group with Vietnam Veterans. These Veterans rated this system to be acceptable as a treatment tool for combat-related PTSD and provided valuable first-person accounts of their time in Vietnam to help guide the evolution of the VR content.
We present a versatile system for training job interviewing skills that focuses specifically on s... more We present a versatile system for training job interviewing skills that focuses specifically on segments of the population facing increased challenges during the job application process. In particular, we target those with Autism Spectrum Disorder (ADS), veterans transitioning to civilian life, and former convicts integrating back into society. The system itself follows the SAIBA framework and contains several interviewer characters, who each represent a different type of vocational field, (e.g. service industry, retail, office, etc.) Each interviewer can be set to one of three conversational modes, which not only affects what they say and how they say it, but also their supporting body language. This approach offers varying difficulties, allowing users to start practicing with interviewers who are more encouraging and accommodating before moving on to personalities that are more direct and indifferent. Finally, the user can place the interviewers in different environmental settings (e.g. conference room, restaurant, executive office, etc.), allowing for many different combinations in which to practice.
Communications in computer and information science, 2020
The overall goal of VRN is to develop a novel technology solution at Children’s Hospital Los Ange... more The overall goal of VRN is to develop a novel technology solution at Children’s Hospital Los Angeles (CHLA) to overcome barriers that prevent the recruitment of diverse patient populations to clinical trials by providing both caregivers and children with an interactive educational experience. This system consists of 1) an intelligent agent called Zippy that users interact with by keyboard or voice input, 2) a series of videos covering topics including Privacy, Consent and Benefits, and 3) a UI that guides users through all available content. Pre- and post-questionnaires assessed willingness to participate in clinical research and found participants either increased or maintained their level of willingness to participate in research studies. Additionally, qualitative analysis of interview data revealed participants rated the overall interaction favorably and believed Zippy to be more fun, less judgmental and less threatening than interacting with a human. Future iterations are in-progress based on the user-feedback.
ABSTRACT War is one of the most challenging environments that a human can experience. The cogniti... more ABSTRACT War is one of the most challenging environments that a human can experience. The cognitive, emotional, and physical demands of a combat environment place enormous stress on even the best-prepared military personnel. The OEF-OIF (Operation Enduring Freedom-Operation Iraqi Freedom) combat theatre, with its ubiquitous battlefronts, ambiguous enemy identification, and repeated extended deployments, was anticipated to produce significant numbers of military personnel with post-traumatic stress disorder (PTSD) and other mental disorders. Recent studies are now confirming this expectation. Among the many approaches that have been used to treat PTSD, exposure therapy appears to have the best-documented therapeutic efficacy. Such treatment typically involves the graded and repeated imaginal reliving of the traumatic event within the therapeutic setting and is believed to provide a low-threat context in which the patient can begin to therapeutically process trauma-relevant emotions as well as decondition the learning cycle of the disorder via a habituation/extinction process. While the efficacy of imaginal exposure has been established in multiple studies with diverse trauma populations, many patients are unwilling or unable to effectively visualize the traumatic event. To address this problem, researchers have recently turned to the use of virtual reality (VR) to deliver exposure therapy by immersing patients in simulations of trauma-relevant environments that allow for precise control of stimulus conditions. This chapter presents an overview of PTSD exposure therapy, a description of VR, and the rationale for how this technology has been applied as a tool to deliver exposure therapy along with a brief review of current research. We then provide a description of the current Virtual Iraq exposure therapy system and treatment protocol and present initial results from an open clinical trial with active duty military personnel and a brief case study. The chapter concludes with a summary of future directions in which VR technology can be further applied to more comprehensively address a range of PTSD-relevant issues. KeywordsClinical interface–exposure therapy–extinction–habituation–PTSD–virtual reality
Addressing the significant mental and physical healthcare needs of Veterans requires innovative s... more Addressing the significant mental and physical healthcare needs of Veterans requires innovative strategies to enhance access to evidence-based care. The integration of Virtual Human (VH) agents into Mobile Health (mHealth) applications presents a promising opportunity to overcome barriers associated with suicide prevention and connect with Veterans. The Battle Buddy (BB) project was conceived as a mobile wellness and suicide prevention application, empowering Veterans with an always-available resource concierged by an engaging and supportive conversational VH agent. Human-centered design is essential in the development of all interactions focused on the persuasive strategies of (1) personalization, (2) self-monitoring, (3) tunneling, (4) suggestion, and (5) expertise. Veterans can interact with the BB VH during daily check-ins, learn about mental health and wellness strategies, participate in interactive activities, increase self-awareness of their current status, and build and work safety plans in times of suicidal crisis. BB is designed to provide the Veteran with easy access to a suicide prevention ecosystem in which a wealth of evidenced-based interventions will be delivered in a non-stigmatizing fashion by a computer-based dialogue system with virtual embodiment, utilizing various multi-modal language cues such as text, speech, animated facial expressions, and gestures to interact with users. This paper explores our human-centered design process for the BB feature set to target the negative effects of social isolation and loneliness, conditions that challenge Veteran healthcare and suicide prevention.
The incidence of posttraumatic stress disorder (PTSD) in returning OEF/OIF military personnel is ... more The incidence of posttraumatic stress disorder (PTSD) in returning OEF/OIF military personnel is creating a significant healthcare challenge. This has served to motivate research on how to better develop and disseminate evidence-based treatments for PTSD. One emerging form of treatment for combat-related PTSD that has shown promise involves the delivery of exposure therapy using immersive Virtual Reality (VR). Initial outcomes from open clinical trials have been positive and fully randomized controlled trials are currently in progress to further validate this approach. Based on our research group's initial positive outcomes using VR to emotionally engage and successfully treat persons undergoing exposure therapy for PTSD, we have begun development in a similar VR-based approach to deliver stress resilience training with military service members prior to their initial deployment. The Stress Resilience In Virtual Environments (STRIVE) project aims to create a set of combat simulations (derived from our existing Virtual Iraq/Afghanistan exposure therapy system) that are part of a multi-episode narrative experience. Users can be immersed within challenging combat contexts and interact with virtual characters within these episodes as part of an experiential learning approach for training a range of psychoeducational and cognitive-behavioral emotional coping strategies believed to enhance stress resilience. The STRIVE project aims to present this approach to service members prior to deployment as part of a program designed to better prepare military personnel for the types of emotional challenges that are inherent in the combat environment. During these virtual training experiences users are monitored physiologically as part of a larger investigation into the biomarkers of the stress response. One such construct, Allostatic Load, is being directly investigated via physiological and neuro-hormonal analysis from specimen collections taken immediately before and after engagement in the STRIVE virtual experience.
Proceedings of the AAAI Conference on Artificial Intelligence
We present the SimSensei system, a fully automatic virtual agent that conducts interviews to asse... more We present the SimSensei system, a fully automatic virtual agent that conducts interviews to assess indicators of psychological distress. We emphasize on the perception part of the system, a multimodal framework which captures and analyzes user state for both behavioral understanding and interactional purposes.
Introduction Resilience is the ability to maintain or quickly return to a stable physical and psy... more Introduction Resilience is the ability to maintain or quickly return to a stable physical and psychological equilibrium despite experiencing stressful events. Flexibility of the autonomic nervous system is particularly important for adaptive stress responses and may contribute to individual differences in resilience. Power spectrum analysis of heart rate variability (HRV) allows measurement of sympathovagal balance, which helps to evaluate autonomic flexibility. The present study investigated HRV as a broad index of resilience. Materials and Methods Twenty-four male participants from the Army National Guard Special Forces completed psychological measures known to relate to resilience and had HRV measured while undergoing stressful virtual environment scenarios. Pearson product-moment correlations were used to explore the relationships between HRV and resilience factors. All research was conducted with the oversight of the Human Subjects Review Committee of Fuller Theological Seminar...
There has been a recent resurgence of Vietnam-era Veterans seeking Veteran Affairs (VA) services ... more There has been a recent resurgence of Vietnam-era Veterans seeking Veteran Affairs (VA) services for post-traumatic stress disorder (PTSD). Multiple studies have reported positive outcomes using Virtual Reality Exposure Therapy (VRET) with Iraq/Afghanistan Veteran PTSD patients, but there have been fewer investigations into the acceptability and feasibility of VRET with older Veterans. We have extended an established VRET system, BRAVEMIND, to include Vietnam relevant content following a user-centered iterative design methodology. This paper will present the BRAVEMIND Vietnam VRET system, including setup, content, and technical architecture along with the findings of an initial focus group with Vietnam Veterans. These Veterans rated this system to be acceptable as a treatment tool for combat-related PTSD and provided valuable first-person accounts of their time in Vietnam to help guide the evolution of the VR content.
We present a versatile system for training job interviewing skills that focuses specifically on s... more We present a versatile system for training job interviewing skills that focuses specifically on segments of the population facing increased challenges during the job application process. In particular, we target those with Autism Spectrum Disorder (ADS), veterans transitioning to civilian life, and former convicts integrating back into society. The system itself follows the SAIBA framework and contains several interviewer characters, who each represent a different type of vocational field, (e.g. service industry, retail, office, etc.) Each interviewer can be set to one of three conversational modes, which not only affects what they say and how they say it, but also their supporting body language. This approach offers varying difficulties, allowing users to start practicing with interviewers who are more encouraging and accommodating before moving on to personalities that are more direct and indifferent. Finally, the user can place the interviewers in different environmental settings (e.g. conference room, restaurant, executive office, etc.), allowing for many different combinations in which to practice.
Communications in computer and information science, 2020
The overall goal of VRN is to develop a novel technology solution at Children’s Hospital Los Ange... more The overall goal of VRN is to develop a novel technology solution at Children’s Hospital Los Angeles (CHLA) to overcome barriers that prevent the recruitment of diverse patient populations to clinical trials by providing both caregivers and children with an interactive educational experience. This system consists of 1) an intelligent agent called Zippy that users interact with by keyboard or voice input, 2) a series of videos covering topics including Privacy, Consent and Benefits, and 3) a UI that guides users through all available content. Pre- and post-questionnaires assessed willingness to participate in clinical research and found participants either increased or maintained their level of willingness to participate in research studies. Additionally, qualitative analysis of interview data revealed participants rated the overall interaction favorably and believed Zippy to be more fun, less judgmental and less threatening than interacting with a human. Future iterations are in-progress based on the user-feedback.
ABSTRACT War is one of the most challenging environments that a human can experience. The cogniti... more ABSTRACT War is one of the most challenging environments that a human can experience. The cognitive, emotional, and physical demands of a combat environment place enormous stress on even the best-prepared military personnel. The OEF-OIF (Operation Enduring Freedom-Operation Iraqi Freedom) combat theatre, with its ubiquitous battlefronts, ambiguous enemy identification, and repeated extended deployments, was anticipated to produce significant numbers of military personnel with post-traumatic stress disorder (PTSD) and other mental disorders. Recent studies are now confirming this expectation. Among the many approaches that have been used to treat PTSD, exposure therapy appears to have the best-documented therapeutic efficacy. Such treatment typically involves the graded and repeated imaginal reliving of the traumatic event within the therapeutic setting and is believed to provide a low-threat context in which the patient can begin to therapeutically process trauma-relevant emotions as well as decondition the learning cycle of the disorder via a habituation/extinction process. While the efficacy of imaginal exposure has been established in multiple studies with diverse trauma populations, many patients are unwilling or unable to effectively visualize the traumatic event. To address this problem, researchers have recently turned to the use of virtual reality (VR) to deliver exposure therapy by immersing patients in simulations of trauma-relevant environments that allow for precise control of stimulus conditions. This chapter presents an overview of PTSD exposure therapy, a description of VR, and the rationale for how this technology has been applied as a tool to deliver exposure therapy along with a brief review of current research. We then provide a description of the current Virtual Iraq exposure therapy system and treatment protocol and present initial results from an open clinical trial with active duty military personnel and a brief case study. The chapter concludes with a summary of future directions in which VR technology can be further applied to more comprehensively address a range of PTSD-relevant issues. KeywordsClinical interface–exposure therapy–extinction–habituation–PTSD–virtual reality
Addressing the significant mental and physical healthcare needs of Veterans requires innovative s... more Addressing the significant mental and physical healthcare needs of Veterans requires innovative strategies to enhance access to evidence-based care. The integration of Virtual Human (VH) agents into Mobile Health (mHealth) applications presents a promising opportunity to overcome barriers associated with suicide prevention and connect with Veterans. The Battle Buddy (BB) project was conceived as a mobile wellness and suicide prevention application, empowering Veterans with an always-available resource concierged by an engaging and supportive conversational VH agent. Human-centered design is essential in the development of all interactions focused on the persuasive strategies of (1) personalization, (2) self-monitoring, (3) tunneling, (4) suggestion, and (5) expertise. Veterans can interact with the BB VH during daily check-ins, learn about mental health and wellness strategies, participate in interactive activities, increase self-awareness of their current status, and build and work safety plans in times of suicidal crisis. BB is designed to provide the Veteran with easy access to a suicide prevention ecosystem in which a wealth of evidenced-based interventions will be delivered in a non-stigmatizing fashion by a computer-based dialogue system with virtual embodiment, utilizing various multi-modal language cues such as text, speech, animated facial expressions, and gestures to interact with users. This paper explores our human-centered design process for the BB feature set to target the negative effects of social isolation and loneliness, conditions that challenge Veteran healthcare and suicide prevention.
The incidence of posttraumatic stress disorder (PTSD) in returning OEF/OIF military personnel is ... more The incidence of posttraumatic stress disorder (PTSD) in returning OEF/OIF military personnel is creating a significant healthcare challenge. This has served to motivate research on how to better develop and disseminate evidence-based treatments for PTSD. One emerging form of treatment for combat-related PTSD that has shown promise involves the delivery of exposure therapy using immersive Virtual Reality (VR). Initial outcomes from open clinical trials have been positive and fully randomized controlled trials are currently in progress to further validate this approach. Based on our research group's initial positive outcomes using VR to emotionally engage and successfully treat persons undergoing exposure therapy for PTSD, we have begun development in a similar VR-based approach to deliver stress resilience training with military service members prior to their initial deployment. The Stress Resilience In Virtual Environments (STRIVE) project aims to create a set of combat simulations (derived from our existing Virtual Iraq/Afghanistan exposure therapy system) that are part of a multi-episode narrative experience. Users can be immersed within challenging combat contexts and interact with virtual characters within these episodes as part of an experiential learning approach for training a range of psychoeducational and cognitive-behavioral emotional coping strategies believed to enhance stress resilience. The STRIVE project aims to present this approach to service members prior to deployment as part of a program designed to better prepare military personnel for the types of emotional challenges that are inherent in the combat environment. During these virtual training experiences users are monitored physiologically as part of a larger investigation into the biomarkers of the stress response. One such construct, Allostatic Load, is being directly investigated via physiological and neuro-hormonal analysis from specimen collections taken immediately before and after engagement in the STRIVE virtual experience.
Proceedings of the AAAI Conference on Artificial Intelligence
We present the SimSensei system, a fully automatic virtual agent that conducts interviews to asse... more We present the SimSensei system, a fully automatic virtual agent that conducts interviews to assess indicators of psychological distress. We emphasize on the perception part of the system, a multimodal framework which captures and analyzes user state for both behavioral understanding and interactional purposes.
Introduction Resilience is the ability to maintain or quickly return to a stable physical and psy... more Introduction Resilience is the ability to maintain or quickly return to a stable physical and psychological equilibrium despite experiencing stressful events. Flexibility of the autonomic nervous system is particularly important for adaptive stress responses and may contribute to individual differences in resilience. Power spectrum analysis of heart rate variability (HRV) allows measurement of sympathovagal balance, which helps to evaluate autonomic flexibility. The present study investigated HRV as a broad index of resilience. Materials and Methods Twenty-four male participants from the Army National Guard Special Forces completed psychological measures known to relate to resilience and had HRV measured while undergoing stressful virtual environment scenarios. Pearson product-moment correlations were used to explore the relationships between HRV and resilience factors. All research was conducted with the oversight of the Human Subjects Review Committee of Fuller Theological Seminar...
Uploads
Papers by Albert Rizzo