Scoping Review Methodology: 1. Identifying The Research Question
Scoping Review Methodology: 1. Identifying The Research Question
Scoping Review Methodology: 1. Identifying The Research Question
Despite their similarities, the scoping review methodology distinguishes itself from the
traditional systematic review approach in terms of its nature and purpose as outlined by Brien and
colleagues [1] (see Table 1). The scoping review allows the researcher to map the existing literature
on a certain topic in a systematic and comprehensive way. The findings of the scoping review may
then in turn provide the ideal basis for a systematic literature review.
Given the interdisciplinary nature and purpose of this study, we chose to follow the five-
stage framework of the scoping review methodology as proposed by Arksey and O’Malley [2]. Aiming
to link the available evidence from various disciplines to the healthcare context our research
question was broad in nature, which in turn required post hoc adjustments of the initial inclusion and
exclusion criteria. Further, as we were aiming to map the field study quality was not prioritized.
Research Protocol
following Arksey and O’Malley [2]. The research questions were developed and refined in a
collaborative effort of the research team (JA, CZ, SR).
1
2. Study Identification
The search strategy was developed by the research team (JA, CZ, SR). In an effort to balance
feasibility with comprehensiveness of the scoping process, we decided to focus on scientific articles
published in English. Publications in other languages as well as grey literature were important
sources that informed data extraction and analysis.
It should also be noted that while theoretical and conceptual work served as a foundation
and important guidance to the research process and interpretation of the findings, only empirical
studies are reported in the findings of the scoping review.
Due to the heterogeneity of the field in terms of disciplines and terminology, our search
strategy might have failed to capture some relevant studies. We tried to minimize this risk by
conducting a preliminary review of the literature to inform both our search strategy as well as study
selection criteria.
Keywords:
“open innovation” OR “idea challenge” OR “crowd sourcing” OR “crowd-sourcing” OR
(innovation AND “internet user”) OR (innovation AND (“social media” OR facebook OR
twitter)) OR “user co-creation” OR “open innovation community” or “internet community”
OR “web-based community” OR “online community” OR “online innovation community”
1995-2014, English
After elimination of incomplete files and duplicates, the remaining files were converted to RIS
format and were imported into EPPI reviewer 4, a web-based software tool for research synthesis.
3. Study selection
The research team (JA, CZ, SR) engaged in an iterative process to refine the inclusion and exclusion
criteria. Inter-coder reliability was assessed for 20% of the records and yielded 90% correspondence.
Studies were excluded if they examined online communities that did not involve user innovation
activities (e.g. dating communities) or that did not focus on end-user (consumer involvement) but
rather employee or supplier integration. Studies reporting on offline initiatives to integrate
consumers in the innovation process, studies investigating innovation intermediaries or
crowdfunding practices were also excluded.
2
4. Charting the Data
Two researchers (JA, CZ) developed and refined the data charting form (Table 2). Data extraction was
performed by JA.
References
1. Brien SE, Lorenzetti DL, Lewis S, Kennedy J, Ghali WA (2010) Overview of a formal scoping review
on health system report cards. Implement Sci 5: 2.
2. Arksey H, O'Malley L (2005) Scoping studies: towards a methodological framework. International
journal of social research methodology 8: 19-32.