Skip to main content
Springer Nature Link
Log in

Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10947))

Included in the following conference series:

  • 6572 Accesses

Abstract

We model collaborative problem solving outcomes using data from 37 triads who completed a challenging computer programming task. Participants individually rated their group’s performance, communication, cooperation, and agreeableness after the session, which were aggregated to produce group-level measures of subjective outcomes. We scored teams on objective task outcomes and measured individual students’ learning outcomes with a posttest. Groups with similar personalities performed better on the task and had higher ratings of communication, cooperation, and agreeableness. Importantly, greater deviation in teammates’ perception of group performance and higher ratings of communication, cooperation, and agreeableness negatively predicted individual learning. We discuss findings from the perspective of group work norms and consider applications to intelligent systems that support collaborative problem solving.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 74.89
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 94.94
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. PISA 2015 Collaborative Problem Solving Framework (2015)

    Google Scholar 

  2. Dillenbourg, P.: What do you mean by collaborative learning? In: Collaborative-learning Cognitive and Computational Approaches, vol. 1, pp. 1–15 (1999)

    Google Scholar 

  3. Kerr, N.L., Tindale, R.S.: Group performance and decision making. Ann. Rev. Psychol. 55, 623–655 (2004)

    Article  Google Scholar 

  4. Du Boulay, B.: Artificial intelligence as an effective classroom assistant. IEEE Intell. Syst. 31, 76–81 (2016)

    Article  Google Scholar 

  5. Lou, Y., Abrami, P.C., D’Apollonia, S.: Small group and individual learning with technology: a meta-analysis. Rev. Educ. Res. 71, 449–521 (2001)

    Article  Google Scholar 

  6. Vijayaratnam, P.: Developing higher order thinking skills and team commitment via group problem solving: a bridge to the real world. Proc. Soc. Behav. Sci. 66, 53–63 (2012)

    Article  Google Scholar 

  7. Alavi, M.: Computer-mediated collaborative learning: an empirical evaluation. MIS Q. 18, 159–174 (1994)

    Article  Google Scholar 

  8. Borghoff, U.M., Schlichter, J.H.: Computer-supported cooperative work. Comput. Support. Coop. Work 27, 87–141 (2000)

    Article  Google Scholar 

  9. Fenwick, G.D., Neal, D.J.: Effect of gender composition on group performance. Gender Work Organ. 8, 205–225 (2001)

    Article  Google Scholar 

  10. Savicki, V., Kelley, M., Lingenfelter, D.: Gender and group composition in small task groups using computer-mediated communication. Comput. Hum. Behav. 12, 209–224 (1996)

    Article  Google Scholar 

  11. Gruenfeld, D.H., Mannix, E.A., Williams, K.Y., Neale, M.A.: Group composition and decision making: how member familiarity and information distribution affect process and performance. Organ. Behav. Hum. Decis. Process. 67, 1–15 (1996)

    Article  Google Scholar 

  12. McManus, M.M., Aiken, R.M.: Supporting effective collaboration: using a rearview mirror to look forward. Int. J. Artif. Intell. Educ. 26, 365–377 (2016)

    Article  Google Scholar 

  13. Rosen, Y.: Computer-based assessment of collaborative problem solving: exploring the feasibility of human-to-agent approach. Int. J. Artif. Intell. Educ. 25, 380–406 (2015)

    Article  Google Scholar 

  14. Linnenbrink-Garcia, L., Rogat, T.K., Koskey, K.L.K.K.: Affect and engagement during small group instruction. Contemp. Educ. Psychol. 36, 13–24 (2011)

    Article  Google Scholar 

  15. Tenenberg, J., Roth, W.-M., Socha, D.: From I-awareness to we-awareness in CSCW. Comput. Support. Coop. Work (CSCW) 25, 235–278 (2016)

    Article  Google Scholar 

  16. Chang, C.-J., Chang, M.-H., Chiu, B.-C., Liu, C.-C., Fan Chiang, S.-H., Wen, C.-T., Hwang, F.-K., Wu, Y.-T., Chao, P.-Y., Lai, C.-H., Wu, S.-W., Chang, C.-K., Chen, W.: An analysis of student collaborative problem solving activities mediated by collaborative simulations. Comput. Educ. 114, 222–235 (2017)

    Article  Google Scholar 

  17. Crossley, S., Dascalu, M., McNamara, D.S., Baker, R., Trausan-Matu, S.: Predicting success in massive open online courses (MOOCs) using cohesion network analysis. In: International Conference on Computer-Supported Collaborative Learning. International Society of the Learning Sciences, Philadelphia (2017)

    Google Scholar 

  18. Yoo, J., Kim, J.: Can online discussion participation predict group project performance? Investigating the roles of linguistic features and participation patterns. Int. J. Artif. Intell. Educ. 24, 8–32 (2014)

    Article  Google Scholar 

  19. Adamson, D., Dyke, G., Jang, H., Rosé, C.P.: Towards an agile approach to adapting dynamic collaboration support to student needs. Int. J. Artif. Intell. Educ. 24, 92–124 (2014)

    Article  Google Scholar 

  20. Hmelo-Silver, C.E., Barrows, H.S.: Facilitating collaborative knowledge building. Cogn. Instruc. 26, 48–94 (2008)

    Google Scholar 

  21. Olivera, F., Straus, S.G.: Group-to-individual transfer of learning: cognitive and social factors. Small Group Res. 35, 440–465 (2004)

    Article  Google Scholar 

  22. Wilkinson, I.A.G.G., Fung, I.Y.Y.Y.: Small-group composition and peer effects. Int. J. Educ. Res. 37, 425–447 (2002)

    Article  Google Scholar 

  23. Cummings, J.N.: Work groups, structural diversity, and knowledge sharing in a global organization. Manag. Sci. 50, 352–364 (2004)

    Article  Google Scholar 

  24. Langfred, C.W.: Is group cohesiveness a double-edged sword? An investigation of the effects of cohesiveness on performance. Small Group Res. 29, 124–143 (1998)

    Article  Google Scholar 

  25. Gully, S.M., Devine, D.J., Whitney, D.J.: A meta-analysis of cohesion and performance: effects of level of analysis and task interdependence. Small Group Res. 26, 497–520 (1995)

    Article  Google Scholar 

  26. Evans, C.R., Dion, K.L.: Group cohesion and performance: a meta-analysis. Small Group Res. 22, 175–186 (1991)

    Article  Google Scholar 

  27. Harrison, D.A., Price, K.H., Bell, M.P.: Beyond relational demography: time and the effects of surface-and deep-level diversity on work group cohesion. Acad. Manag. J. 41, 96–107 (1998)

    Google Scholar 

  28. Fernández Dobao, A., Blum, A., Dobao, A.F., Blum, A.: Collaborative writing in pairs and small groups: learners’ attitudes and perceptions. System 41, 365–378 (2013)

    Article  Google Scholar 

  29. Barsade, S.G., Gibson, D.E.: Group affect: its influence on individual and group outcomes. Current Dir. Psychol. Sci. 21, 119–123 (2012)

    Article  Google Scholar 

  30. Ku, H.-Y.Y., Tseng, H.W., Akarasriworn, C.: Collaboration factors, teamwork satisfaction, and student attitudes toward online collaborative learning. Comput. Hum. Behav. 29, 922–929 (2013)

    Article  Google Scholar 

  31. Behfar, K.J., Mannix, E.A., Peterson, R.S., Trochim, W.M.: Conflict in small groups: the meaning and consequences of process conflict. Small Group Res. 42, 127–176 (2011)

    Article  Google Scholar 

  32. Pai, H.-H.H., Sears, D.A., Maeda, Y.: Effects of small-group learning on transfer: a meta-analysis. Educ. Psychol. Rev. 27, 79–102 (2015)

    Article  Google Scholar 

  33. Code Studio. https://studio.code.org/s/mc/stage/1/puzzle/1

  34. Fraser, N.: Ten things we’ve learned from Blockly. In: Proceedings of the 2015 IEEE Blocks and Beyond Workshop, pp. 49–50 (2015)

    Google Scholar 

  35. Gosling, S.D., Rentfrow, P.J., Swann, W.B.: A very brief measure of the Big-Five personality domains. J. Res. Pers. 37, 504–528 (2003)

    Article  Google Scholar 

  36. Stake, J.E., Eisele, H.: Gender and personality. In: Chrisler, J., McCreary, D. (eds.) Handbook of Gender Research in Psychology, pp. 19–40. Springer, New York (2010)

    Chapter  Google Scholar 

  37. Shashaani, L.: Gender differences in computer attitudes and use among college students. J. Educ. Comput. Res. 16, 37–51 (1997)

    Article  Google Scholar 

  38. Beyer, S., Rynes, K., Perrault, J., Hay, K., Haller, S.: Gender differences in computer science students. ACM SIGCSE Bull. 35, 49–53 (2003)

    Article  Google Scholar 

  39. Spencer, S.J., Steele, C.M., Quinn, D.M.: Stereotype threat and women’s math performance. J. Exp. Soc. Psychol. 35, 4–28 (1999)

    Article  Google Scholar 

  40. Barron, B.: Achieving coordination in collaborative problem-solving groups. J. Learn. Sci. 9, 403–436 (2000)

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank David Blair, Eugene Choi, Mae Raab, and Samantha Scaglione for their invaluable help. This research was supported by the National Science Foundation (NSF DUE-1745442) and the Institute of Educational Sciences (IES R305A170432). Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the funding agencies.

Author information

Authors and Affiliations

  1. University of Colorado Boulder, Boulder, CO, 80309, USA

    Angela Stewart & Sidney K. D’Mello

Authors
  1. Angela Stewart
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sidney K. D’Mello
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Angela Stewart .

Editor information

Editors and Affiliations

  1. Carnegie Mellon University, Pittsburgh, PA, USA

    Carolyn Penstein Rosé

  2. University of Technology, Sydney, NSW, Australia

    Roberto Martínez-Maldonado

  3. University of Duisburg-Essen, Duisburg, Germany

    H. Ulrich Hoppe

  4. UCL Institute of Education, London, UK

    Rose Luckin

  5. UCL Institute of Education, London, UK

    Manolis Mavrikis

  6. UCL Institute of Education, London, UK

    Kaska Porayska-Pomsta

  7. Carnegie Mellon University, Pittsburgh, PA, USA

    Bruce McLaren

  8. University of Sussex, Brighton, UK

    Benedict du Boulay

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Stewart, A., D’Mello, S.K. (2018). Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10947. Springer, Cham. https://doi.org/10.1007/978-3-319-93843-1_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93843-1_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93842-4

  • Online ISBN: 978-3-319-93843-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation