Learning and Sharing Creative Skills With Short Videos: A Case Study of User Behavior in Tiktok and Bilibili
Learning and Sharing Creative Skills With Short Videos: A Case Study of User Behavior in Tiktok and Bilibili
net/publication/335335984
Learning and Sharing Creative Skills with Short Videos: A Case Study of User
Behavior in TikTok and Bilibili
CITATIONS READS
45 23,503
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Qiyang Zhou on 15 November 2019.
SHORT VIDEOS, ranging from a few seconds to a few minutes, have become a popular form
of learning and sharing creative skills such as cooking, drawing, and crafting. Short videos in
social media platforms are reshaping the experience of learning creative skills with visually
engaging materials and communication features to socialize with other users who have
similar interest. However, regardless of their popularity and potential, user behaviors in short
video platforms have been under investigated yet when it comes to learning and practice
creative skills. This study analyzed 1) viewers' comments on selected drawing skill sharing
videos (which resulted in four themes of viewer activities and three types of viewer attitudes)
and 2) creators' activities (which resulted in frequent user models by regression analysis and
dendrogram analysis) in Bilibili and TikTok. User interviews complement the findings from the
quantitative user data to identify the gap between user behavior and expectation in practicing
and sharing drawing skills in short-video sharing platforms. The multi-dimensional data about
user behaviors and expectations are synthesized into five different personas and user journey
maps, leading to the discussion of design recommendations to support creative practice in
short video sharing platforms.
Keywords: short videos; social media; learning and sharing skills; user studies
Copyright © 2019. Copyright of this paper is the property of the author(s). Permission is granted to reproduce
copies of the works for purposes relevant to the IASDR conference, provided that the author(s), source and
copyright notice are included on each copy. For other uses, please contact the author(s).
1.1 Short Video Sharing Platforms
Short video platforms have become a popular form of social media applications among
millennials for sharing entertaining contents (Patrick, 2018). Most short video platforms are
mobile applications, where users can create, edit, share, and view short videos. Short videos
have a standardized short duration ranging from few seconds to few minutes; the relative
convenience of content generation, rapid content transmission, and emphasis on sociality
are the distinct attributes of short video platforms (Zhao & Wang, 2015).
TikTok is a popular short video platform, introduced in China and fast growing with over a
half billion users from all around world (Zhong, 2018). The platform enables many short
video specific features such as “Duet” (to create a duet video with another user) and “React”
(to comment with a video) to encourage new collaborative and immersive user experiences.
Bilibili is a Chinese video-sharing website, which was derived from a Japanese video-sharing
website, Niconico, currently with more than 200 million users (Wang, 2016). Videos could
last from few seconds to few hours in Bilibili. Besides short video specific platforms, other
social media platforms also integrate short videos as one of the UGC sharing media forms.
Instagram has released the “Instagram story” feature, which is a personal feed of photos and
videos within Instagram and can only exist for 24 hours (Instagram, 2019). The duration of
each story is limited to 15 seconds. The feature has reached a great success with more than
400 million active users out of its total 1 billion users (Ahmad, 2018).
1.2 Knowledge and Skill Sharing in Videos
Based on the success of entertainment-oriented short video sharing platforms, knowledge
sharing has also become important part of their services. The categories of shared
knowledge on TikTok vary from creative skills and personal experience to explicit knowledge
such as science, technology, and culture (CBNData, 2017). Su (2018) found that users
would have a positive attitude on TikTok because they can learn many skills beneficial in
their daily lives. Learning in the form of shorter video will significantly encourage learners to
take part in task-relevant activities and reduce task-irrelevant activities (Szpunar, 2013).
Videos have been broadly used in knowledge sharing from social media to Massive Online
Open Class (MOOC) platforms. Studies show that viewers are more engaged with
knowledge sharing videos shorter than 3 minutes on MOOC platforms (Guo et al., 2014);
videos less than 5 minutes are likely to succeed in providing a better knowledge-obtaining
experience for users by improving their learning attitude, effectiveness, and engagement
(Hsin & Cigas, 2013). Other studies offered insights to improve users’ learning experience in
video-based MOOC platforms: the ease of access to knowledge in the comment section will
help viewers better understand the content of the video (Monserrat et al., 2014); users on
collaborative video platforms are more willing to share their opinions and knowledge than on
traditional forum platforms (Wu et al., 2018).
• What are user expectations from posting and watching skill-sharing short videos?
• How do they learn and practice creative skills in short video sharing platforms?
• What may be gaps between their expectations and actual experience in short video
sharing platforms regarding learning and practicing creative skills?
• How can we understand user behaviors and improve their experiences of learning,
practicing, and sharing creative skills in short video sharing platforms?
3) User Profile and Activity Analysis: We traced the public profile and activity data of
the users identified from the comment analysis. 13 kinds of user data were collected
from 198 Bilibili users [Table 1] and 8 kinds of data from 81 TikTok users [Table 2].
No personal information was further collected or associated with the online public
profile. With Tableau 9 and Excel formulas, we conducted regression analysis to find
out any statistically significant relations between some user data and dendrogram
analysis to identify influential factors (i.e., knot) and cluster distinct user groups with
those knots as their main characteristics (Qu et al., 2015). The dendrogram was
resulted in 52 clusters in Bilibili and 16 clusters in TikTok that divide distinct user
groups according to their levels of participation in content creation and sharing.
4) Pilot Interview: We contacted 81 users who are grouped in the 16 primary clusters
in TikTok for a pilot in-depth interview; 12 of them voluntarily responded back. They
shared more details about their purposes of viewing and sharing drawing videos,
experiences in TikTok, and expectations regarding their creative practice in short
video platforms by direct messages in TikTok, not sharing any other personal
information (In average 300 messages exchanged for 30 minutes per interview).
Responders’ ages range from 13 to 25 with their backgrounds from middle school
student, to graduate student, to user experience designer, and to software developer.
5) User Persona and Journey Map: We conducted thematic analysis of the interview
responses and generated five themes by highlighting worth-noted points from them
inductively (Boyatzis, 1998). Each theme is developed into a persona and user
journey map with specific experience phases in short video sharing platforms. Design
recommendations are discussed to support various user expectations regarding
creative practice in consideration of the users’ broader life styles and goals.
1
https://www.bilibili.com/video/av21462790?t=47
2
https://www.bilibili.com/video/av33688833
3
http://v.douyin.com/2W2KHH/
4
http://v.douyin.com/2WAhEj/
5
http://v.douyin.com/2WDGwN/
6
https://www.instagram.com/p/BqkllsRl2ca/
7
https://www.instagram.com/p/BqlRqofgaVQ/
8
https://www.instagram.com/p/Bb-F36qAgVl/
9
https://www.tableau.com/
Table 1 Users' data category on Bilibili (*Top Three Knots)
Data Category User Data Justification
Knowledge
conversion, Drawing-related
N/A
creation, and posts
sharing activities
3 Research Findings
This section summarizes the findings from the comment analysis, user profile and activity
analysis, and pilot in-depth interviews. In this course of multi-dimensional data analysis,
primary user groups are specified to further investigate their behaviors related to learn,
practice, and share drawing skills in short video sharing platforms.
3.1 Four Comment Categories and Three Commenting Attitudes
Madden et al. (2013) categorized YouTube comments into three categories based on their
relevance to the videos: 1) comments related to video content, 2) comments related to video
context, and 3) general comments that do not relate to video content or context. Building
upon this general categorization scheme, we specified the three comment categories with a
focus on user participation in learning and sharing drawing skills. Below are the reframed
comment categories that represent four different types of comments:
• Feedback type: Comments asking for more information about how to apply the video
to practice or feedback to the commenter’s work created based on the instruction of
the posted video. (e.g., “I got stuck in drawing ellipse.”)
• Opinion type: Comments assessing the quality of the posted video, stating the
commenter’s subjective, often critical, point-of-view. (e.g., “this is useless”)
Apart from the content types, the collected comments showed three different attitudes that
reflect the commenter’s engagement in learning and sharing drawing skills:
• Irrelevant attitude: Comments not related to video content or context and irrelevant
to the subject or topic of the video, showing ambiguous or no learning intention.
Table 3 shows that the general conversation type of comment is most prevalent (mostly
taking a judgmental and negative attitude), while the feedback type of comments is the least
in most videos (mostly taking a constructive and positive attitude). The opinion type of
comments often shows an irrelevant attitude to learning and practicing creative skills. The
overall statistics imply that most comments are intended simply to start a conversation and
interact with other users, not necessarily to learn and practice creative skills. Design
opportunities lie in supporting this relatively small but highly motivated group of users by
prioritizing to reveal and reward their constructive, content specific comments from the
majority of irrelevant ones.
Table 3 The percentage data of the comments categorized by the two classification schemes.
General
Total Information Feedback Opinion
Conversation
Constructive,
29% 42.81% 29.94% 14.97% 28.14%
Positive
Judgemental,
52% 15.56% 0.0% 19.70% 64.40%
Negative
Irrelevant 19% 20.81% 0.9% 54.75% 26.70%
3.2 Three User Groups: Content Browsers, Learner Creators, and Creators
We selected another drawing video respectively from TikTok10 and Bilibili11 and validated our
comment classification scheme by applying it to analyze the comments from the two videos.
We also identified active users who made information and feedback types of comments with
a constructive and positive attitude to each video; tracked their public profile and activity data
to investigate their behaviors related to drawing practice in each platform: 13 kinds of data
from 198 Bilibili users [Table 1] and 8 kinds of data from 81 TikTok users [Table 2]. First,
regression analysis revealed how the two platforms afford different user experiences of
creative skill sharing:
• In Bilibili, the number of each user’s video posts and the number of the user’s image
posts are highly associated with each other (with r > 0.7; R2 = 0.52; p<0.0001).
Users who post work in one format is likely to post in another format. Meanwhile, the
total number of image posts (1,257) significantly exceeds that of video posts (193).
Also, the number of likes received per video post (i.e., L/P), comments received per
video post (i.e., C/P), and view counts per video post (i.e., V/P) present a statistically
significant correlation, while the number of users’ video posts, L/P, C/P, and V/P are
not statically associated. It indicates that users tend to show their appreciation to a
video post through multiple reactions after viewing it. However, productive users do
not necessarily receive prolific recognitions corresponding to their creative effort.
• In TikTok, the number of shares per post (i.e., S/P), L/P, and C/P present a
statistically significant positive association. It indicates that viewers more likely
reward the video uploader with multiple reactions than once. The number of each
user’s followers does not statistically associate with the user’s L/P, C/P and S/P. This
may be due to TikTok’s decentralized video recommendation mechanism, which
pushes to reveal more user-generated contents to other users, equally regardless of
the number of followers. In this way, video posts of the users who comment to
another post are more likely to receive as much recognition as influencers who have
much more followers on TikTok than on other platforms.
Second, dendrogram analysis resulted in 52 clusters in Bilibili (1 – 29 users per cluster) and
16 in TikTok (1 – 17 users per cluster) that divide distinct user groups in each platform. The
mean number of users in all clusters from both platforms is 3. Based on this mean value of
3, clusters that have more than 3 users are counted as primary user groups, which resulted
10
https://www.bilibili.com/video/av40642497/
11
http://v.douyin.com/jHaCWU/
in 15 primary user groups on Bilibili [Figure 2] and 7 primary groups on TikTok [Figure 3].
The top three knots that cluster primary user groups in each platform are marked in Table 1
and 2. We combined those primary clusters from both platforms into three user groups
according to their browsing, reacting, and sharing patterns related to drawing practice [Table
4]: 1) Content Browsers, 2) Learner Creators, and 3) Creators.
Table 4 Data of percentages of the three user groups on Bilibili and TikTok.
Platform Content Browser Learner Creator Creator Total Number
Bilibili 30% 33% 5% 198
TikTok 36.7% 20.7% 19.5% 81
As a pilot interview, we sent direct messages to the users from the three primary groups in
TikTok (total of 81) for open-ended questions about their experience of learning and
practicing creative skills through short videos. 12 of them voluntarily responded back: 2 out
of 12 users are from the Content Browser Group; 4 out of 12 users are from the Learner
Creator Group; 6 out of 12 users are from the Creator group. Their responses are
summarized according to each group’s purposes, experiences and expectations in learning
and sharing their drawing practice in TikTok.
The Learner Creator Group think learning by watching TikTok videos is efficient because of
their short durations and rich contents. They are also satisfied with the video quality on
TikTok and expect to discover more. They often apply what they watched and create their
own drawings but rarely post because they are afraid of receiving negative and
untrustworthy evaluation by public.
The Creator Group like the decentralized content distribution mechanism of TikTok as it
exposes their work to more users. While it is easy to watch short videos, they often find it
hard for them to create one because of its limited duration. A more guided process to plan
and edit their drawing session in a short duration would be useful.
All three groups have complaints about current commenting and searching features in
TikTok. They think the current comments section fail to provide an efficient way of retrieving
and archiving key information from videos. Also, it was a common response that short video
sharing platforms need practical and ethical guidance in posting and reacting to user
generated contents to create quality contents and supportive online communities of practice.
Through the thematic analysis, the coded themes of the interview data from the two
respondents in the Content Brower Group participated are similar and merged to create user
persona 1: Content Browser. Also, the coded themes of the interview data from the four
users in the Learner Creator are similar and merged to create user persona 2: Learner
Creator. Additionally, we found differences in the coded themes of the data from the six
users in the Creator group; further categorized them to develop 3 personas: Fan Art Creator
(N=3), Recognition-Seeking Creator (N=2), and Influential Creator (N=1).
Based on different behaviors of the five personas, we re-mapped the findings from the user
profile and activity data to specify the phases that each user persona would experience in a
short video sharing platform for their drawing practice. We also integrated the key phases of
user journeys across the five personas and discussed the design recommendations for each
phase in the integrated journey map [Figure 4]: 1) Creative Practice Through Social
Interaction, 2) Video Previews and Comment Categories, 3) Personal Tracking, Assessment,
and Guidance for Creative Practice.
Figure 4. Five personas, user integrated journey map, and the implementation of the three design opportunities.
This study further tracked and analyzed public data from Bilibili and TikTok users that can
reflect knowledge-related activities. Using regression analysis, we uncovered that as Bilibili
supports creating and uploading multi-media file formats, users who post more videos are
more likely to post more images as well. Users prefer to post their drawing creations in
image format versus video format since sharing drawings by images is easier. Another result
showed that TikTok is a decentralized UGC community, where users receive reactions and
feedback based on the quality and quantity of their work, regardless of the number of
followers they have. These findings are further discussed above as design strategies to
facilitate user creation and interaction in short-video platforms. This study also finds three
major user groups through the patterns of users’ data by dendrogram: Content Browser
group, Learner Creator group and Creator group. The percentage of Creator group (19.5%)
on TikTok is greater than on Bilibili (5%), showing that more TikTok users create and share
their work as diverse posts are revealed to public regardless of the popularity of creators.
Based on the user group categories synthesized by the quantitative research, this study also
conducted pilot interviews with 12 TikTok users via direct messages to further understand
experience of knowledge learning and sharing through the platform. The results are
synthesized into five distinct types of personas and user journey and experience phases for
each persona, concluding with three design recommendations: 1) promote creative
practice through social interaction, 2) provide video previews and comment
categories, and 3) support for personal tracking, assessing, and guiding creative
practice. In summary, the findings of this study imply the potential of new learning models
with short videos and social media platforms. The five personas and their user journey maps
will provide a constructive foundation to design new platform services and experiences for
collaborative learning of creative skills. The methods used for analyzing and identifying
distinct user groups could be applied to other online user experience research in the future.
Still, this study has access to only public user data and it is hard to generalize the findings.
Also, we do not have a concrete understanding about the expectations and behaviors of
passive users who only watch videos for personal practice but do not engage in any online
activities. Broader user recruiting and face-to-face interview could lead to in-depth
conversations regarding users’ expectations and suggestions for improving their learning
experience in short video sharing platforms. In future work, the personas and user journey
maps could be validated with more comprehensive data from a larger sample and also
applied for ideating and developing new short video platform services to support creative
practice.
6. References
Ahmad, S. (2018, June 30). Instagram Stories Crosses 400 Million Active Users. GuruFocus.com.
Retrieved February 15, 2019, from https://www.gurufocus.com/news/702700/instagram-stories-
crosses-400-million-active-users
Bowley, R. C. (2009). A comparative case study: Examining the organizational use of social
networking sites (Doctoral dissertation, The University of Waikato).
Boyatzis, R. E. (1998). Transforming qualitative information: Thematic analysis and code
development. sage.
CBNdata. (2017). 2017 duanshipin hangye dashuju dongcha [The insights of short video industries in
2017], 2017. Retrieved from https://cbndata.com/report/397/detail?isReading=report&page=1
Dron, J., & Anderson, T. (2014). Teaching crowds: Learning and social media. Athabasca University
Press.
Eteläpelto, A., & Lahti, J. (2008). The resources and obstacles of creative collaboration in a long-term
learning community. Thinking skills and creativity, 3(3), 226-240.
Fosnot, C. T., & Perry, R. S. (1996). Constructivism: A psychological theory of
learning. Constructivism: Theory, perspectives, and practice, 2, 8-33.
Guo, P. J., Kim, J., & Rubin, R. (2014, March). How video production affects student engagement: An
empirical study of MOOC videos. In Proceedings of the first ACM conference on Learning@
scale conference (pp. 41-50). ACM.
Hsin, W. J., & Cigas, J. (2013). Short videos improve student learning in online education. Journal of
Computing Sciences in Colleges, 28(5), 253-259.
Instagram (2019). Instagram Help Center: Stories. Retrieved March 21 2019, from:
help.instagram.com/1660923094227526.
Kaplan, A. M., & Haenlein, M. (2010). Users of the world, unite! The challenges and opportunities of
Social Media. Business horizons, 53(1), 59-68.
Madden, A., Ruthven, I., & McMenemy, D. (2013). A classification scheme for content analyses of
YouTube video comments. Journal of documentation, 69(5), 693-714.
Manca, S., & Ranieri, M. (2016). Facebook and the others. Potentials and obstacles of social media
for teaching in higher education. Computers & Education, 95, 216-230.
Mao, J. (2014). Social media for learning: A mixed methods study on high school students’ technology
affordances and perspectives. Computers in Human Behavior, 33, 213-223.
Monserrat, T. J. K. P., Li, Y., Zhao, S., & Cao, X. (2014, April). L. IVE: an integrated interactive video-
based learning environment. In Proceedings of the SIGCHI Conference on Human Factors in
Computing Systems (pp. 3399-3402). ACM.
Panahi, S., Watson, J., & Partridge, H. (2012). Social media and tacit knowledge sharing: Developing
a conceptual model. World academy of science, engineering and technology, (64), 1095-1102.
Patrick, M. S. (2018, August 25). TikTok video app has become a petri dish for youth culture. The
Japan Times, p.1. Retrieved from
https://www.japantimes.co.jp/news/2018/08/25/national/media-national/tiktok-video-app-
become-petri-dish-youth-culture/#.XIda5ohKjid
Polanyi, M. (2009). The tacit dimension. University of Chicago press.
Pruitt, J., & Adlin, T. (2010). The persona lifecycle: keeping people in mind throughout product design.
Elsevier.
Qu, X., Jain, A., Rajput, N. N., Cheng, L., Zhang, Y., Ong, S. P., ... & Persson, K. A. (2015). The
Electrolyte Genome project: A big data approach in battery materials discovery. Computational
Materials Science, 103, 56-67.
Richardson, A. (2010). Using customer journey maps to improve customer experience. Harvard
Business Review, 15(1), 2-5.
Su, T., (2018). Research on influencing factors of the new generation user’s behavior intention toward
mobile short video App. (Master’s thesis, Jinan University)
Szpunar, K. K., Khan, N. Y., & Schacter, D. L. (2013). Interpolated memory tests reduce mind
wandering and improve learning of online lectures. Proceedings of the National Academy of
Sciences, 110(16), 6313-6317.
Wahlroos, J. K. (2010). Social media as a form of organizational knowledge sharing. A case study on
employee participation at Wärtsilä. Master, Department of Social Research, Faculty of Social
Sciences, University of Helsinki, Helsinki.
Wang Y (2016, May 25). China is obsessed with Japanese anime, and investors are paying attention.
Forbes.com. Retrieved December 14 2018, from
https://www.forbes.com/sites/ywang/2016/05/25/china-is-obsessed-with-japanese-anime-and-
investors-are-paying-attention-2/#3c5341f52947
Wu, Q., Sang, Y., Zhang, S., & Huang, Y. (2018, January). Danmaku vs. forum comments:
understanding user participation and knowledge sharing in online videos. In Proceedings of the
2018 ACM Conference on Supporting Groupwork (pp. 209-218). ACM.
Zhao, Y., & Wang, Y. (2015). Duanshipin de chuanbo xianzhuang fenxi [The research on the
dissemination of short videos]. Research on Digital Media, 32(3), 54-58.
Zhong, R. (2018, October 29). China's King of Internet Fluff Wants to Conquer the World. The New
York Times, p.1. Retrieved from https://www.nytimes.com/2018/10/29/technology/bytedance-
app-funding-china.html