The US Army War College conducted an extensive asynchronous threaded discussion on US national se... more The US Army War College conducted an extensive asynchronous threaded discussion on US national security policy and the future of NATO with 20 sections and approximately 300 participants. The collaborative discussion generated 6 MB of high quality text ...
International Journal of Computer Supported Collaborative Learning, Dec 13, 2010
We have developed a set of tools for improving online collaborative learning including an automat... more We have developed a set of tools for improving online collaborative learning including an automated expert that monitors and moderates discussions, and additional tools to evaluate contributions, semantically search all posted comments, access a library of hundreds of digital books and provide reports to instructors. The technology behind these tools is Latent Semantic Analysis (LSA), a machine learning technology that understands the meaning of words and text in ways that agree highly with human judgments. These tools ...
The effectiveness of emerging technology in helping to develop the tacit or experience-based know... more The effectiveness of emerging technology in helping to develop the tacit or experience-based knowledge needed for effective leadership performance was demonstrated in an on-line environment for discussion and training. One hundred and twenty-seven military students participated in three 20-minute discussions in one of three learning environments: standard classroom; standard on-line discussion; and discussion assisted by semantic technology. Consistent with expectations, semantic technology-supported learning resulted in greater discussion participation and training performance with discussion participation mediating the relationship between the learning environment and training satisfaction. An interaction between learning goal orientation (LGO) and learning environment on tacit knowledge performance showed that face-to-face conditions may help those with low LGO. Implications for improving tacit knowledge acquisition and technology-supported leadership development practices are di...
Teams have always been important in military operations, but the nature of military teamwork is c... more Teams have always been important in military operations, but the nature of military teamwork is changing to accommodate an increasing number of missions in stability, security, transition, and reconstruction (SSTR). These missions often require that diverse, distributed experts from multinational forces, non-governmental organizations, and other government agencies work together. Although team member diversity should improve mission performance by increasing access to a broader pool of knowledge, it is more likely to increase conflict and decrease trust, which may result in less information exchange, a lack of shared situation awareness, little team commitment, and ultimately poor team performance. Collaborative technologies generally focus on establishing physical interoperability among distributed team members, to the exclusion of technologies that promote cognitive interoperability. The Army Research Laboratory is investing in technologies to augment collaboration. The first tool is diagnostic, designed to assess cultural preferences and provide instruction on effective interaction strategies. The second tool uses Latent Semantic Analysis, a natural language and machine learning technology to monitor, moderate, evaluate, and provide feedback on team processes based on team communication. An initial capability of these tools was demonstrated in a Sudanese simulation; a revised system will be used in U.S. and Singaporean experiments.
The effectiveness of emerging technology in helping to develop the tacit or experience-based know... more The effectiveness of emerging technology in helping to develop the tacit or experience-based knowledge needed for effective leadership performance was demonstrated in an on-line environment for discussion and training. One hundred and twenty-seven military students participated in three 20-minute discussions in one of three learning environments: standard classroom; standard on-line discussion; and discussion assisted by semantic technology. Consistent with expectations, semantic technology-supported learning ...
The increasingly complex environment of the 21st century demands unprecedented knowledge, skills ... more The increasingly complex environment of the 21st century demands unprecedented knowledge, skills and abilities for people from all walks of life. One powerful solution that blends the science of learning with the technological advances of computing is Virtual ...
14. ABSTRACT (Maximum 200 words): Stability, security, transition, and reconstruction (SSTR) oper... more 14. ABSTRACT (Maximum 200 words): Stability, security, transition, and reconstruction (SSTR) operations are a core U.S. military mission (United States Department of Defense, 2005). The objective of these missions is to help establish order with the aim of attaining a sustainable peace while advancing U.S. interests. To conduct SSTR operations, U.S. military forces work with a host of partners representing non-governmental aid organizations and other U.S. government agencies, as well as international agencies and multinational military forces. These partners may share an overarching goal, but differ significantly in how the goal or goals should be achieved. The purpose of this effort was to investigate the implications of organizational and national culture on SSTR operations and to define requirements for performance support and training. With a focus on the provincial reconstruction team (PRT), we specified cultural identities (beyond nationality) that influence interagency operations, used consensus-building as a metaphor for understanding SSTR planning, and linked cultural differences to SSTR planning tasks and collective skill breakdowns. A prototype, automated system to enhance interagency collective performance in SSTR operations was demonstrated. The system integrated latent semantic analysis with cultural reference materials, readiness assessments, rehearsal opportunities and individual skill development exercises. Follow on work is planned to refine our understanding of interagency collaboration and implement and test an interagency consensus forum.
Technology can make Asynchronous Learning Networks more accessible, useful, and effective. Here w... more Technology can make Asynchronous Learning Networks more accessible, useful, and effective. Here we examine two new automated tools:(1) embedded assessment of participant contributions, and (2) classification of comments into policy and planning/coordinating categories. Both tools use Latent Semantic Analysis (LSA), a machine learning algorithm for text understanding (see Landauer, Foltz, & Laham, 1998, An introduction to latent semantic analysis, Discourse Processes, 25).
The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), 2008
Nearly 50% of accidental deaths in the Army during 2006 occurred in privately-owned vehicles--mor... more Nearly 50% of accidental deaths in the Army during 2006 occurred in privately-owned vehicles--more than from any other source. As a result, the Army has been actively pursuing ways of reducing POV deaths and injuries among soldiers by improving driver training programs. An extensive literature has examined the link between driving hazards and risk assessment with crash metrics. Drivers begin by identifying a hazard, and then must assess the risk and decide whether or not they can handle it. More experienced drivers are ...
Monitoring teams of decision-makers in complex military environments requires effective tracking ... more Monitoring teams of decision-makers in complex military environments requires effective tracking of individual Soldier and team performance. An untapped source of timely and diagnostic performance information lies in ongoing communications among Soldiers operating as a team. With the right analyses the communication data can be connected to both the team's and each individual's performance, abilities and knowledge. The DARCAAT program developed and tested a toolset for automating team assessment and near real-time alarms. The toolset uses Automated Speech Recognition and Statistical Natural Languagebased techniques for embedding automatic, continuous, and cumulative analysis of team communication in training and operational environments. Based on the toolset, applications were developed that apply the metrics and models to support After Action Reviews (AARs) and real-time alarms.
The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), 2008
Assessing teams in complex military environments requires effective tracking of individual and te... more Assessing teams in complex military environments requires effective tracking of individual and team performance. Indeed, performance measures must be both accurate and timely in order to provide effective real-time alarms. However, current methods of monitoring team and group performance often rely on delayed outcomes or global metrics that are insufficiently detailed to detect failures until recovery is impossible, and are often unable to reveal the causes of failures. An untapped source of timely and diagnostic information lies ...
The US Army War College conducted an extensive asynchronous threaded discussion on US national se... more The US Army War College conducted an extensive asynchronous threaded discussion on US national security policy and the future of NATO with 20 sections and approximately 300 participants. The collaborative discussion generated 6 MB of high quality text ...
The After Action Review (AAR) process provides a powerful methodology that in the context of trai... more The After Action Review (AAR) process provides a powerful methodology that in the context of training maximizes the benefits of exercises by enabling a unit to learn from experience by systematically reflecting on their strengths and weaknesses. We have developed a tool that supports the AAR process, essentially extending an Observer Controller's (O/C) reach automatically. This tool was developed with two training contexts in mind: live STX lane convoy training at the National Training Center (NTC) and simulated convoy training using DARWARS Ambush! at the Mission Support Training Facility at Fort Lewis. At NTC, live radio communication is captured during training, while with Ambush! communication using voice over IP (VOIP) is recorded. The tool automatically converts recorded speech to text and then analyzes the text, using advanced statistical machine learning technologies, to determine a unit's performance and identify critical incidents, leading indicators, and other training events that could be included in an AAR.
The US Army War College conducted an extensive asynchronous threaded discussion on US national se... more The US Army War College conducted an extensive asynchronous threaded discussion on US national security policy and the future of NATO with 20 sections and approximately 300 participants. The collaborative discussion generated 6 MB of high quality text ...
International Journal of Computer Supported Collaborative Learning, Dec 13, 2010
We have developed a set of tools for improving online collaborative learning including an automat... more We have developed a set of tools for improving online collaborative learning including an automated expert that monitors and moderates discussions, and additional tools to evaluate contributions, semantically search all posted comments, access a library of hundreds of digital books and provide reports to instructors. The technology behind these tools is Latent Semantic Analysis (LSA), a machine learning technology that understands the meaning of words and text in ways that agree highly with human judgments. These tools ...
The effectiveness of emerging technology in helping to develop the tacit or experience-based know... more The effectiveness of emerging technology in helping to develop the tacit or experience-based knowledge needed for effective leadership performance was demonstrated in an on-line environment for discussion and training. One hundred and twenty-seven military students participated in three 20-minute discussions in one of three learning environments: standard classroom; standard on-line discussion; and discussion assisted by semantic technology. Consistent with expectations, semantic technology-supported learning resulted in greater discussion participation and training performance with discussion participation mediating the relationship between the learning environment and training satisfaction. An interaction between learning goal orientation (LGO) and learning environment on tacit knowledge performance showed that face-to-face conditions may help those with low LGO. Implications for improving tacit knowledge acquisition and technology-supported leadership development practices are di...
Teams have always been important in military operations, but the nature of military teamwork is c... more Teams have always been important in military operations, but the nature of military teamwork is changing to accommodate an increasing number of missions in stability, security, transition, and reconstruction (SSTR). These missions often require that diverse, distributed experts from multinational forces, non-governmental organizations, and other government agencies work together. Although team member diversity should improve mission performance by increasing access to a broader pool of knowledge, it is more likely to increase conflict and decrease trust, which may result in less information exchange, a lack of shared situation awareness, little team commitment, and ultimately poor team performance. Collaborative technologies generally focus on establishing physical interoperability among distributed team members, to the exclusion of technologies that promote cognitive interoperability. The Army Research Laboratory is investing in technologies to augment collaboration. The first tool is diagnostic, designed to assess cultural preferences and provide instruction on effective interaction strategies. The second tool uses Latent Semantic Analysis, a natural language and machine learning technology to monitor, moderate, evaluate, and provide feedback on team processes based on team communication. An initial capability of these tools was demonstrated in a Sudanese simulation; a revised system will be used in U.S. and Singaporean experiments.
The effectiveness of emerging technology in helping to develop the tacit or experience-based know... more The effectiveness of emerging technology in helping to develop the tacit or experience-based knowledge needed for effective leadership performance was demonstrated in an on-line environment for discussion and training. One hundred and twenty-seven military students participated in three 20-minute discussions in one of three learning environments: standard classroom; standard on-line discussion; and discussion assisted by semantic technology. Consistent with expectations, semantic technology-supported learning ...
The increasingly complex environment of the 21st century demands unprecedented knowledge, skills ... more The increasingly complex environment of the 21st century demands unprecedented knowledge, skills and abilities for people from all walks of life. One powerful solution that blends the science of learning with the technological advances of computing is Virtual ...
14. ABSTRACT (Maximum 200 words): Stability, security, transition, and reconstruction (SSTR) oper... more 14. ABSTRACT (Maximum 200 words): Stability, security, transition, and reconstruction (SSTR) operations are a core U.S. military mission (United States Department of Defense, 2005). The objective of these missions is to help establish order with the aim of attaining a sustainable peace while advancing U.S. interests. To conduct SSTR operations, U.S. military forces work with a host of partners representing non-governmental aid organizations and other U.S. government agencies, as well as international agencies and multinational military forces. These partners may share an overarching goal, but differ significantly in how the goal or goals should be achieved. The purpose of this effort was to investigate the implications of organizational and national culture on SSTR operations and to define requirements for performance support and training. With a focus on the provincial reconstruction team (PRT), we specified cultural identities (beyond nationality) that influence interagency operations, used consensus-building as a metaphor for understanding SSTR planning, and linked cultural differences to SSTR planning tasks and collective skill breakdowns. A prototype, automated system to enhance interagency collective performance in SSTR operations was demonstrated. The system integrated latent semantic analysis with cultural reference materials, readiness assessments, rehearsal opportunities and individual skill development exercises. Follow on work is planned to refine our understanding of interagency collaboration and implement and test an interagency consensus forum.
Technology can make Asynchronous Learning Networks more accessible, useful, and effective. Here w... more Technology can make Asynchronous Learning Networks more accessible, useful, and effective. Here we examine two new automated tools:(1) embedded assessment of participant contributions, and (2) classification of comments into policy and planning/coordinating categories. Both tools use Latent Semantic Analysis (LSA), a machine learning algorithm for text understanding (see Landauer, Foltz, & Laham, 1998, An introduction to latent semantic analysis, Discourse Processes, 25).
The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), 2008
Nearly 50% of accidental deaths in the Army during 2006 occurred in privately-owned vehicles--mor... more Nearly 50% of accidental deaths in the Army during 2006 occurred in privately-owned vehicles--more than from any other source. As a result, the Army has been actively pursuing ways of reducing POV deaths and injuries among soldiers by improving driver training programs. An extensive literature has examined the link between driving hazards and risk assessment with crash metrics. Drivers begin by identifying a hazard, and then must assess the risk and decide whether or not they can handle it. More experienced drivers are ...
Monitoring teams of decision-makers in complex military environments requires effective tracking ... more Monitoring teams of decision-makers in complex military environments requires effective tracking of individual Soldier and team performance. An untapped source of timely and diagnostic performance information lies in ongoing communications among Soldiers operating as a team. With the right analyses the communication data can be connected to both the team's and each individual's performance, abilities and knowledge. The DARCAAT program developed and tested a toolset for automating team assessment and near real-time alarms. The toolset uses Automated Speech Recognition and Statistical Natural Languagebased techniques for embedding automatic, continuous, and cumulative analysis of team communication in training and operational environments. Based on the toolset, applications were developed that apply the metrics and models to support After Action Reviews (AARs) and real-time alarms.
The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), 2008
Assessing teams in complex military environments requires effective tracking of individual and te... more Assessing teams in complex military environments requires effective tracking of individual and team performance. Indeed, performance measures must be both accurate and timely in order to provide effective real-time alarms. However, current methods of monitoring team and group performance often rely on delayed outcomes or global metrics that are insufficiently detailed to detect failures until recovery is impossible, and are often unable to reveal the causes of failures. An untapped source of timely and diagnostic information lies ...
The US Army War College conducted an extensive asynchronous threaded discussion on US national se... more The US Army War College conducted an extensive asynchronous threaded discussion on US national security policy and the future of NATO with 20 sections and approximately 300 participants. The collaborative discussion generated 6 MB of high quality text ...
The After Action Review (AAR) process provides a powerful methodology that in the context of trai... more The After Action Review (AAR) process provides a powerful methodology that in the context of training maximizes the benefits of exercises by enabling a unit to learn from experience by systematically reflecting on their strengths and weaknesses. We have developed a tool that supports the AAR process, essentially extending an Observer Controller's (O/C) reach automatically. This tool was developed with two training contexts in mind: live STX lane convoy training at the National Training Center (NTC) and simulated convoy training using DARWARS Ambush! at the Mission Support Training Facility at Fort Lewis. At NTC, live radio communication is captured during training, while with Ambush! communication using voice over IP (VOIP) is recorded. The tool automatically converts recorded speech to text and then analyzes the text, using advanced statistical machine learning technologies, to determine a unit's performance and identify critical incidents, leading indicators, and other training events that could be included in an AAR.
Uploads
Papers by Noelle Lavoie