The aim of this study was to explore how Narrative Theatre, a narrative-centered digital learning... more The aim of this study was to explore how Narrative Theatre, a narrative-centered digital learning environment, supported the writing processes of 3 struggling adolescent male writers. We utilized a multicase study approach to capture 3 sixth-grade participants’ experiences with the digital learning environment before, during, and after writing. The case studies provided detailed portraits of the writers as well as insights into their digital writing processes related to student interest, student ability, and value for writing. The across-case analysis revealed 3 themes (i.e., choice, scaffolding, and self-efficacy) that illustrated how the digital learning environment contributed to the students’ writing experiences. Future research and development will focus on the addition of text animation for student products and the degree to which this feature further contributes to engagement and proficiency with struggling writers.
Abstract One of the most important developments in the software industry in recent years has been... more Abstract One of the most important developments in the software industry in recent years has been the merger of the entertainment and educational software markets. An intriguing possibility for edutainment software is the introduction of intelligent life-like characters. By coupling inferential capabilities with well-crafted animated creatures, it becomes possible to create animated pedagogical agents that provide communicative functionalities with strong visual impact.
The majority of computer science education research to date has focused on purely cognitive stude... more The majority of computer science education research to date has focused on purely cognitive student outcomes. Understanding the motivational states experienced by students may enhance our understanding of the computer science learning process, and may reveal important instructional interventions that could benefit student engagement and retention. This article investigates issues of student motivation as they arise during one-on-one human tutoring in introductory computer science.
Abstract To explain complex phenomena, an explanation system must be able to select information f... more Abstract To explain complex phenomena, an explanation system must be able to select information from a formal representation of domain knowledge, organize the selected information into multisentential discourse plans, and realize the discourse plans in text. Although recent years have witnessed signi cant progress in the development of sophisticated computational mechanisms for explanation, empirical results have been limited.
Design-centered learning environments offer great promise for providing effective, grounded learn... more Design-centered learning environments offer great promise for providing effective, grounded learning experiences. Learners are given a set of design criteria and a library of components which they use to design artifacts that will satisfy the specified criteria. Despite their appeal, design-centered learning environments are plagued with complexities that can overwhelm learners.
Coherent gestures, locomotion, and speech in life-like pedagogical agents
ABSTRACT Life-like animated interface agents for knowledge-based leaming environments can provide... more ABSTRACT Life-like animated interface agents for knowledge-based leaming environments can provide timely, customized advice to support students' problem solving. Because of their strong visual presence, they hold significant promise for substantially increasing students' enjoyment of their learning experiences. A key problem posed by life-like agents that inhabit artificial worlds is &i&c believability.
Abstract Self-efficacy is an individual's belief about her ability to perform well in a given sit... more Abstract Self-efficacy is an individual's belief about her ability to perform well in a given situation. Because self-efficacious students are effective learners, endowing intelligent tutoring systems with the ability to diagnose self-efficacy could lead to improved pedagogy. Self-efficacy is influenced by (and influences) affective state. Thus, physiological data might be used to predict a student's level of self-efficacy.
Twenty-First Century Skills and Game-Based Learning
Abstract Growing number of people around the world engage in playing computer games, yet the educ... more Abstract Growing number of people around the world engage in playing computer games, yet the educational system has yet to find substantial ways to capitalize on the potential of game-based learning for academic purposes. The purpose of this paper is to draw a connection between two important 21st century skills, ie, complex communication and expert problem solving, and game-based learning.
Abstract Document drafting is a key component of legal expertise. Effective legal document drafti... more Abstract Document drafting is a key component of legal expertise. Effective legal document drafting requires knowledge both of legal domain knowledge and of the structure of legal discourse. Automating the task of legal document drafting therefore requires explicit representation of both these types of knowledge. This paper proposes an architecture that integrates these two disparate knowledge sources in a modular architecture under which representation and control are optimized for each task.
ABSTRACT Interactive 3D learning environments can provide rich problemsolving experiences with un... more ABSTRACT Interactive 3D learning environments can provide rich problemsolving experiences with unparalleled visual impact. In these environments, students interactively solve problems by directing their avatars to navigate through complex worlds, transport entities from one location to another, and manipulate devices. However, realtime camera control is critical to their successful deployment.
Mixed-initiative problem solving lies at the heart of knowledge-based learning environments. Whil... more Mixed-initiative problem solving lies at the heart of knowledge-based learning environments. While learners are actively engaged in problem-solving activities, learning environments should monitor their progress and provide them with feedback in a manner that contributes to achieving the twin goals of learning effectiveness and learning efficiency. Mixed-initiative interactions are particularly critical for constructivist learning environments in which learners participate in active problem solving.
Abstract Dynamically providing students with clear explanations of complex spatial concepts is cr... more Abstract Dynamically providing students with clear explanations of complex spatial concepts is critical for a broad range of knowledge-based educational and training systems. This calls for a realtime solution that can dynamically create 3D animated explanations that artfully integrate well-chosen speech with rich visualizations.
Abstract. Lifelike animated agents for knowledge-based learning environments can provide timely, ... more Abstract. Lifelike animated agents for knowledge-based learning environments can provide timely, customized advice to support learners' problem-solving activities. By drawing on a rich repertoire of emotive behaviors to exhibit contextually appropriate facial expressions and emotive gestures, these agents could exploit the visual channel to more effectively communicate with learners.
Abstract Animated pedagogical agents offer great promise for knowledge-based learning environment... more Abstract Animated pedagogical agents offer great promise for knowledge-based learning environments. In addition to coupling feedback capabilities with a strong visual presence, these agents play a critical role in motivating students. The extent to which they exhibit life-like behaviors strongly increases their motivational impact, but these behaviors must always complement and never interfere with students' problem solving.
In this paper we examine ways in which work on the A ective Reasoner, being developed at DePaul U... more In this paper we examine ways in which work on the A ective Reasoner, being developed at DePaul University, can be integrated into two extant tutoring systems, the Soar Training Expert for Virtual Environments (STEVE) at the Information Sciences Institute, and the Design-a-Plant (Herman the Bug) project, at North Carolina State University. In the paper we present preliminary design elements of an architecture for including personality and emotional responsiveness in virtual tutoring agents.
Abstract Recent years have witnessed rapid progress in explanation generation. Despite these adva... more Abstract Recent years have witnessed rapid progress in explanation generation. Despite these advances, the quality of prose produced by explanation generators warrants significant improvement. Revision-based explanation generation offers a promising means for improving explanations at runtime. In contrast to singledraft explanation generation architectures, a revision-based generator could dynamically create, evaluate, and refine multiple drafts of explanations.
Advances in 3D graphics technology have accelerated the construction of dynamic 3D environments. ... more Advances in 3D graphics technology have accelerated the construction of dynamic 3D environments. Despite their promise for scientific and educational applications, much of this potential has gone unrealized because runtime camera control software lacks user-sensitivity. Current environments rely on sequences of viewpoints that directly require the user's control or are based primarily on actions and geometry of the scene. Because of the complexity of rapidly changing environments, users typically cannot manipulate objects in environments while simultaneously issuing camera control commands. To address these issues, we have developed UCAM, a realtime camera planner that employs cinematographic user models to render customized visualizations of dynamic 3D environments. After interviewing users to determine their preferred directorial style and pacing, UCAM examines the resulting cinematographic user model to plan camera sequences whose shot vantage points and cutting rates are tailored to the user in realtime. Evaluations of UCAM in a dynamic 3D testbed are encouraging.
Lifelike animated agents for knowledge-based learning environments can provide timely, customized... more Lifelike animated agents for knowledge-based learning environments can provide timely, customized advice to support leaners' problem-solving activities. By drawing on a rich repertoire of emotive behaviors to exhibit contextually appropriate facial expressions and emotive gestures, these agents could exploit the visual channel to more effectively communicate with learners.
The aim of this study was to explore how Narrative Theatre, a narrative-centered digital learning... more The aim of this study was to explore how Narrative Theatre, a narrative-centered digital learning environment, supported the writing processes of 3 struggling adolescent male writers. We utilized a multicase study approach to capture 3 sixth-grade participants’ experiences with the digital learning environment before, during, and after writing. The case studies provided detailed portraits of the writers as well as insights into their digital writing processes related to student interest, student ability, and value for writing. The across-case analysis revealed 3 themes (i.e., choice, scaffolding, and self-efficacy) that illustrated how the digital learning environment contributed to the students’ writing experiences. Future research and development will focus on the addition of text animation for student products and the degree to which this feature further contributes to engagement and proficiency with struggling writers.
Abstract One of the most important developments in the software industry in recent years has been... more Abstract One of the most important developments in the software industry in recent years has been the merger of the entertainment and educational software markets. An intriguing possibility for edutainment software is the introduction of intelligent life-like characters. By coupling inferential capabilities with well-crafted animated creatures, it becomes possible to create animated pedagogical agents that provide communicative functionalities with strong visual impact.
The majority of computer science education research to date has focused on purely cognitive stude... more The majority of computer science education research to date has focused on purely cognitive student outcomes. Understanding the motivational states experienced by students may enhance our understanding of the computer science learning process, and may reveal important instructional interventions that could benefit student engagement and retention. This article investigates issues of student motivation as they arise during one-on-one human tutoring in introductory computer science.
Abstract To explain complex phenomena, an explanation system must be able to select information f... more Abstract To explain complex phenomena, an explanation system must be able to select information from a formal representation of domain knowledge, organize the selected information into multisentential discourse plans, and realize the discourse plans in text. Although recent years have witnessed signi cant progress in the development of sophisticated computational mechanisms for explanation, empirical results have been limited.
Design-centered learning environments offer great promise for providing effective, grounded learn... more Design-centered learning environments offer great promise for providing effective, grounded learning experiences. Learners are given a set of design criteria and a library of components which they use to design artifacts that will satisfy the specified criteria. Despite their appeal, design-centered learning environments are plagued with complexities that can overwhelm learners.
Coherent gestures, locomotion, and speech in life-like pedagogical agents
ABSTRACT Life-like animated interface agents for knowledge-based leaming environments can provide... more ABSTRACT Life-like animated interface agents for knowledge-based leaming environments can provide timely, customized advice to support students' problem solving. Because of their strong visual presence, they hold significant promise for substantially increasing students' enjoyment of their learning experiences. A key problem posed by life-like agents that inhabit artificial worlds is &i&c believability.
Abstract Self-efficacy is an individual's belief about her ability to perform well in a given sit... more Abstract Self-efficacy is an individual's belief about her ability to perform well in a given situation. Because self-efficacious students are effective learners, endowing intelligent tutoring systems with the ability to diagnose self-efficacy could lead to improved pedagogy. Self-efficacy is influenced by (and influences) affective state. Thus, physiological data might be used to predict a student's level of self-efficacy.
Twenty-First Century Skills and Game-Based Learning
Abstract Growing number of people around the world engage in playing computer games, yet the educ... more Abstract Growing number of people around the world engage in playing computer games, yet the educational system has yet to find substantial ways to capitalize on the potential of game-based learning for academic purposes. The purpose of this paper is to draw a connection between two important 21st century skills, ie, complex communication and expert problem solving, and game-based learning.
Abstract Document drafting is a key component of legal expertise. Effective legal document drafti... more Abstract Document drafting is a key component of legal expertise. Effective legal document drafting requires knowledge both of legal domain knowledge and of the structure of legal discourse. Automating the task of legal document drafting therefore requires explicit representation of both these types of knowledge. This paper proposes an architecture that integrates these two disparate knowledge sources in a modular architecture under which representation and control are optimized for each task.
ABSTRACT Interactive 3D learning environments can provide rich problemsolving experiences with un... more ABSTRACT Interactive 3D learning environments can provide rich problemsolving experiences with unparalleled visual impact. In these environments, students interactively solve problems by directing their avatars to navigate through complex worlds, transport entities from one location to another, and manipulate devices. However, realtime camera control is critical to their successful deployment.
Mixed-initiative problem solving lies at the heart of knowledge-based learning environments. Whil... more Mixed-initiative problem solving lies at the heart of knowledge-based learning environments. While learners are actively engaged in problem-solving activities, learning environments should monitor their progress and provide them with feedback in a manner that contributes to achieving the twin goals of learning effectiveness and learning efficiency. Mixed-initiative interactions are particularly critical for constructivist learning environments in which learners participate in active problem solving.
Abstract Dynamically providing students with clear explanations of complex spatial concepts is cr... more Abstract Dynamically providing students with clear explanations of complex spatial concepts is critical for a broad range of knowledge-based educational and training systems. This calls for a realtime solution that can dynamically create 3D animated explanations that artfully integrate well-chosen speech with rich visualizations.
Abstract. Lifelike animated agents for knowledge-based learning environments can provide timely, ... more Abstract. Lifelike animated agents for knowledge-based learning environments can provide timely, customized advice to support learners' problem-solving activities. By drawing on a rich repertoire of emotive behaviors to exhibit contextually appropriate facial expressions and emotive gestures, these agents could exploit the visual channel to more effectively communicate with learners.
Abstract Animated pedagogical agents offer great promise for knowledge-based learning environment... more Abstract Animated pedagogical agents offer great promise for knowledge-based learning environments. In addition to coupling feedback capabilities with a strong visual presence, these agents play a critical role in motivating students. The extent to which they exhibit life-like behaviors strongly increases their motivational impact, but these behaviors must always complement and never interfere with students' problem solving.
In this paper we examine ways in which work on the A ective Reasoner, being developed at DePaul U... more In this paper we examine ways in which work on the A ective Reasoner, being developed at DePaul University, can be integrated into two extant tutoring systems, the Soar Training Expert for Virtual Environments (STEVE) at the Information Sciences Institute, and the Design-a-Plant (Herman the Bug) project, at North Carolina State University. In the paper we present preliminary design elements of an architecture for including personality and emotional responsiveness in virtual tutoring agents.
Abstract Recent years have witnessed rapid progress in explanation generation. Despite these adva... more Abstract Recent years have witnessed rapid progress in explanation generation. Despite these advances, the quality of prose produced by explanation generators warrants significant improvement. Revision-based explanation generation offers a promising means for improving explanations at runtime. In contrast to singledraft explanation generation architectures, a revision-based generator could dynamically create, evaluate, and refine multiple drafts of explanations.
Advances in 3D graphics technology have accelerated the construction of dynamic 3D environments. ... more Advances in 3D graphics technology have accelerated the construction of dynamic 3D environments. Despite their promise for scientific and educational applications, much of this potential has gone unrealized because runtime camera control software lacks user-sensitivity. Current environments rely on sequences of viewpoints that directly require the user's control or are based primarily on actions and geometry of the scene. Because of the complexity of rapidly changing environments, users typically cannot manipulate objects in environments while simultaneously issuing camera control commands. To address these issues, we have developed UCAM, a realtime camera planner that employs cinematographic user models to render customized visualizations of dynamic 3D environments. After interviewing users to determine their preferred directorial style and pacing, UCAM examines the resulting cinematographic user model to plan camera sequences whose shot vantage points and cutting rates are tailored to the user in realtime. Evaluations of UCAM in a dynamic 3D testbed are encouraging.
Lifelike animated agents for knowledge-based learning environments can provide timely, customized... more Lifelike animated agents for knowledge-based learning environments can provide timely, customized advice to support leaners' problem-solving activities. By drawing on a rich repertoire of emotive behaviors to exhibit contextually appropriate facial expressions and emotive gestures, these agents could exploit the visual channel to more effectively communicate with learners.
Uploads
Papers by James Lester