Articol 2
Articol 2
Articol 2
Abstract
The aim of monitoring is to keep a finger on the pulse. In this article, we focus on a drug
monitoring system (DMS): a local research system, continuously collecting data on hard
drugs, drug users, and related issues. The methodology of the drug monitoring system
combines qualitative and quantitative methods, i.e., community fieldwork, interviews
with key informants and a bi-annual drug user survey. The system has been developed
inductively: theory and methods were developed from daily practice. The present article
aims to provide a scientific and methodological foundation for a DMS. We incorporated
questions with respect to internal and external validity. The following strategies have been
applied to meet the criteria of ‘trustworthiness’: triangulation, prolonged engagement,
persistent observation, member checks, peer debriefing, negative case analyses, thick
description, and reflexive journal. Methodological triangulation used in a complementary
model appears to be an important tool.
Keywords: Monitoring, (hard) drugs scene, triangulation
Introduction
Monitoring can be seen as a method of signalizing trends and developments.
An important characteristic of monitoring is its power to combine an
epidemiologic and social science approach. It demands a targeted combination
of quantitative methods, including the repeated measurement of standardized
core indicators, as well as qualitative methods on questions dictated by the
empirical social reality at the current time and place. Monitoring gathers
interpreted in its context (setting) (Zinberg, 1984). Data for the DMS are mainly
collected by means of reports from community fieldworkers, interviews with key
informants, and a bi-annual drug user survey. These methods will be described
later.
The DMS is incorporated in a report of Netherlands Organization for Health
Research and Development about monitoring systems on alcohol and drugs in
The Netherlands (Cruts, Lempens, Ketelaars, Van Laar, & Van de Mheen,
2004). Compared to other monitors in The Netherlands it is unique in its
combination of qualitative and quantitative methods. In addition, most monitors
are targeted at the general population. The DMS is one of the few monitors that is
targeted at hard drug users.
In theory the DMS only evaluates local drug policy. Therefore, in the
Netherlands Drug Monitor (Van Laar, Cruts, Verdurmen, & Van Ooyen, 2006),
it plays a role in signalizing trends in certain local situations that may also occur at
other places or at the national level. The DMS evaluates national drug policy as
far as the national drug policy influences the local situation.
Community Key
fieldwork informants
Check results
- Topics - Topics
- Hypotheses - Hypotheses
- Sampling
Survey
used are snowball sampling, network sampling, and targeted sampling (for more
details, see Coumans & Spreen 2003; Barendregt, Van der Poel, & Van de
Mheen, 2005).
The questionnaire is partly based on the Addiction Severity Index (Hendriks
et al., 1991). The duration of one interview ranges from 30 min to 1.5 h. Analyses
are conducted by means of SPSS software and comprise simple statistical
procedures, such as ‘descriptives’, ‘frequencies’, ‘cross tabulations’ and ‘t-tests’.
For every bi-annual survey a new sample is taken.
An informed consent procedure was incorporated. We handed out written
information about the research project to the respondents. Informed consent was
obtained by filling in the questionnaire. A signature was required for the response
reward. Since we did not ask the name and address of the respondent, privacy and
anonymity was guaranteed.
Key informants
A network of key informants reports regularly about phenomena and develop-
ments in and involving drug use, on the basis of their work, position, and
membership of a group, or expert experience. They belong to representatives of
care providers, local policy makers, police, different groups of users, and groups
related to users (e.g., drug dealers). Each year one or two rounds of formal
interviews take place (individual or in focus groups), in which the general
monitoring items are complemented with a certain focus, e.g., ‘mobility’ or
‘health’. In addition, key informants report on an informal basis about their
findings based on observations of and conversations with members of the study
populations.
The network consists of about 10–15 key informants. The interviews last on
average 1 h and are done with the help of a pre-structured checklist. All interviews
are tape-recorded and typed out verbatim. The most informative interviews,
in the sense of focus or perspective of the key informants, are coded and analyzed
with the software program Ethnograph (Seidel, 1998).
Drug monitoring: Triangulation of methods 465
Community fieldwork
Community fieldworkers are drug users or ex-drug users who report about events
and phenomena of the drug scene. They are familiar with the common concepts
and operations from their knowledge and experience with the scene and have easy
access to the targeted research group. They carry out a great part of the DMS
fieldwork, and interview drug users for the bi-annual survey. Community
fieldworkers play an important role in the DMS. They: (1) describe and localize
the population of hard drug users on the local level, (2) make and keep contact
with (groups of) users, or to speak generally, develop a ‘research alliance’ between
hard drug users and the research team, and (3) are helpful in interpretation of the
research data (Blanken & Barendregt, 1998; Blanken, Barendregt, & Zuidmulder,
2000; Van de Mheen, 2000).
Drug users’ participation means that some of them are selected on the basis of
their background, knowledge, and experience with drug use and the concurrent
lifestyle. Community fieldworkers are hired on a freelance basis and, after a short
training, the development of their ethnographic skills is subject to continuous
attention of the researcher. The community fieldworkers and the researcher
observe and interact with the drug users in their own natural environment.
After each field session these observations and interactions are written down in
the so-called field notes. In order to distinguish personal thoughts and questions
from pure observations or interactions, the field note also contains reflections on
these experiences. After writing up the entire field note, the text is structured
according to the three elements of observation, interaction, and reflection.
Each field note is evaluated with the researcher and at the end of each field note
the fieldworker is required to formulate at least one question about the content
of the note. These questions serve as guidance for future fieldwork sessions.
The field notes are entered in Microsoft Word and analyzed with the software
program Ethnograph (Seidel, 1998). For the coding of the data a standardized
code list has been developed that can be adapted for locally determined purposes.
According to Sterk (2003, p. 3): ‘the applied nature of drug research is ideal for
critical ethnography, in which the individuals who are part of the study, through
their participation, gain a better understanding of their reality and also insights for
potential change’.
Qualitative methodology has made an enormous development in the last
decades. This development started with the publication of Glaser and Strauss
(1967), which explains the ‘grounded theory’, followed by more publications
about qualitative methods and analysis (e.g., Chenitz & Swanson, 1986;
Denzin, 1978; Miles & Huberman, 1984). Qualitative methods are useful in the
exploratory stages of the research project, where they will help to clarify or even set
the research question, provide conceptualization, and generate hypotheses for
later research. They may also be used to interpret, qualify or illuminate the
findings of quantitative research and to test hypotheses. Qualitative methods are
very useful to help policy makers understand the context in which policy will be
implemented (Murphy, Dingwall, Greatbatch, Parker, & Watson, 1998).
Qualitative research methods are applied (at least in the DMS) in different
ways, combined with quantitative methods. First, qualitative research is used
as a precursor to quantitative research. Second, it can be used to explain
unanticipated or inconclusive findings from quantitative studies. Third,
qualitative research is used to generate hypotheses (Murphy & Dingwall,
1998). Qualitative methods can also be used independently, i.e., not combined
with quantitative methods; however, that is not the case in the DMS.
The importance of qualitative methods in understanding the dynamic nature of
the drug scene and relating problems has become evident from the literature
(Lambert, Ashery, & Needle, 1995). Also in public health and epidemiology
the monopoly of quantitative research has been replaced by a growing attention
for qualitative research (Bourgois, 2002; Jones, 1995; Mackenbach, 2001;
Savage, 2000). Classical epidemiology can be seen as a ‘black box’: it
produces figures that do not provide insights in the mechanisms of causality
(Mackenbach, 2001). In (social) drug research quantitative and qualitative
researchers have a great deal to offer each other. Bourgois (2002) formulates this
as follows: ‘The absence of a dialogue between epidemiological and qualitative
researchers – especially ethnographers who engage in cultural anthropology’s
version of participant–observation methods – is a failure from the perspective
of both pragmatic positivism of public health and also the critical theory of
anthropology’.
Recently, Neale, Allen and Coombes (2005) emphasized the importance of
qualitative research methods within the addictions. They showed that the
strengths of qualitative addiction research are many and diverse, and that they
have particular advantages in studying hidden and hard-to-reach populations.
Validity or ‘trustworthiness’
According to Lincoln and Guba (1985), we use different terms to refer to the
naturalistic (or qualitative) equivalents of the validity criteria that are used
Drug monitoring: Triangulation of methods 467
in quantitative research. All these different terms refer to the overall criterion
of ‘trustworthiness’.
The equivalent of internal validity in quantitative research can be found in
credibility: the probability that the findings will be found to be credible and
to be approved by the ‘constructors of the multiple realities being studied’
(Lincoln & Guba, 1985, p. 301). The equivalent of external validity can be
described as transferability, or: to what extent can we transfer the findings to
other contexts? Strictly speaking it is impossible to reach external validity by
qualitative research (Lincoln & Guba, 1985). However, we argue that
transferability is achieved by the generalization of theoretical statements,
which may guide policy makers but have to be tested through application
in other contexts. Dependability in qualitative research accounts for the
quantitatively used criterion of reliability in terms of (in) stability and
‘factors of phenomenal or design induced changes’ (Lincoln & Guba, 1985
p. 300). Confirmability is the qualitative equivalent of objectivity; it
emphasizes the characteristics of the data, instead of the characteristics of the
researcher.
In the DMS, according to Lincoln and Guba (1985), several strategies are
performed to meet the trustworthiness criteria. To meet the criterion of credibility
and dependability, we used triangulation, prolonged engagement, persistent
observation, member checks, peer debriefing, and negative case analyses.
To account for the criterion of transferability, we applied ‘thick description’,
and confirmability was accounted for by writing a reflexive journal.
These techniques are described later; we start with triangulation since it applies
to the DMS as a whole.
Triangulation
Triangulation is the combination of different sources leading to better knowledge
or, according to Nutbeam (1999), it gathers evidence from different sources: the
more consistent the evidence from different sources, the more the validity of the
results can be presumed. In other words: triangulation is a method applying more
than one approach to answer the same question.
Commonly, the following forms of triangulation are distinguished (a.o. Denzin,
1978):
– Triangulation of data: different sources of information are used deriving from,
e.g., client dossiers, minutes of meetings, publications, and interviews with key
informants.
– Triangulation of researchers: more than one researcher is involved in data
collection and analysis. This may be useful if researchers have different
theoretical or methodological backgrounds.
– Triangulation of methods: different methods (usually quantitative and
qualitative) are used to study the research subject, e.g., focus groups,
individual interviews, participant observations.
468 H. van de Mheen et al.
Conclusions
This article presents a theoretical framework and justification for the method-
ology of (particularly) drug monitoring. We defined a monitoring system as a
‘management information system’, based on scientific methods. The aim is to
keep a finger on the pulse, and thereby signal trends and developments.
The methodology of the DMS combines qualitative and quantitative methods,
i.e., community fieldwork, interviews with key informants and a bi-annual drug
user survey. Qualitative research methods, especially ethnographic research,
appear to be appropriate methods for research among ‘hidden populations’, and
thus for the DMS.
We showed that, although our DMS was not developed from an a priori theory,
there is a sound scientific methodological basis for the results it has yielded and
Drug monitoring: Triangulation of methods 471
will yield. The system has been developed inductively: theory and methods were
developed from daily practice. Questions with respect to internal and external
validity are incorporated in the system, by applying the criteria of Lincoln and
Guba (1985): credibility, transferability, dependability, and confirmability,
all referring to the overall criterion of ‘trustworthiness’. We showed that in a
DMS it is possible to include strategies to meet the criteria of ‘trustworthiness’:
triangulation, prolonged engagement, persistent observation, member checks,
peer debriefing, negative case analyses, thick description, and a reflexive journal.
Especially the technique of triangulation is an important tool in a DMS.
In our system we used methodological triangulation in a complementary
model. That means that information gathered with one method is used to
supplement the results from other methods, and to provide background
information for, or to study in depth the results from, other methods. We believe
that this model is more appropriate in drug monitoring than the validation model,
in which the aim is to duplicate findings (checking validity) by use of other
methods.
Generalizability or transferability is shown to be of importance in qualitative
research where the theoretical statements are applicable to other target
populations. In our case, theoretical concepts of marginalization and hardening
which are important in the drug scene under study (Coumans, Knibbe,
& Van de Mheen, in press), can also be applied to populations of, e.g., alcoholics
or homeless people.
We conclude that it is possible to develop an integrated drug information
system, in which data collected from different sources and by different methods
are subsequently evaluated, that has a scientific methodological basis. The results
inform local policy makers about the dynamics of the local drug scene. The drug
monitoring system is not targeted to evaluate the effectiveness of local drug
policy. Although it can give global indications whether a local drug policy
reached its goals, it can never give evidence for a causal relationship. A DMS can
provide policy makers and care providers with accurate and relevant
information about developments and trends in (hard) drug use, which serves
a more evidence-based local drug policy, also with respect to treatment and
prevention.
References
Barendregt, C., van der Poel, A., & van de Mheen, H. (2005). Tracing selection effects in three
non-probability samples. European Addiction Research, 11, 124–131.
Barendregt, B., van der Poel, A., & van de Mheen, H. (2006). The rise of the mobile phone in the
hard drug scene in Rotterdam. Journal of Psychoactive Drugs, 38, 77–87.
Blanken, P., & Barendregt, C. (1998). Veranderingen in de aanbod – en vraagzijde van de
illegale drugsmarkt in Rotterdam: Enkele resultaten van het Rotterdams Drug Monitoring
Systeem 1995–1997. (Changes in supply and demand on the illegal drug market. Some
results from the Rotterdam Drug Monitoring System 1995–1997). IVO bulletin, 1(1), 1–11,
[in Dutch].
472 H. van de Mheen et al.
Blanken, P., Barendregt, C., & Zuidmulder, L. (2000). Community fieldwork: Bringing users into
research action. In: Understanding and responding to drug use: The role of qualitative research.
Lisbon: EMCDDA.
Bourgois, P. (2002). Anthropology and epidemiology on drugs: The challenges
of cross-methodological and theoretical dialogue. International Journal of Drug Policy, 13,
259–269.
Chenitz, W. C., & Swanson, J. M. (1986). From practice to grounded theory. Qualitative research
in nursing. California: Addison-Wesley Publishing Company.
Coumans, A. M., & Spreen, M. (2003). Drug use and the role of homelessness in the process
of marginalization. Substance Use & Misuse, 38, 311–338.
Coumans, A. M., Knibbe, R. K., & van de Mheen, H. (in press). Street level effects of local drug
policy on marginalisation and hardening: An ethnographic study among chronic drug users.
Journal of Psychoactive Drugs.
Cruts, A. A. N., Lempens, A. L. F., Ketelaars, A. P. M., van Laar, M. W., & van de Mheen, H.
(2004). Monitoring van alcohol en drugs onder de loep. Een onderzoek naar opbrengst
en lacunes van informatiesystemen op het gebied van alcohol en drugs. (Monitoring of
alcohol and drugs on the map: A study on outcome and lacunas of information
systems in the field of alcohol and drugs). Utrecht/Rotterdam, Trimbos Institute/IVO, 2004
[in Dutch].
Denzin, N. K. (1978). The research act. Chicago: Aldine.
Geetz, C. (1973). Thick description: Toward an interpretative theory of culture. In C. Geertz (Ed.),
The interpretation of cultures. (pp. 3–30). Selected Essays. New York: Basic Books.
Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative
research. New York: Aldine.
Griffiths, P., Vingoe, L., Hunt, N., Mounteney, J., & Hartnoll, R. (2000). Drug information
systems, early warning, and new drug trends: Can drug monitoring systems
become more sensitive to emerging trends in drug consumption? Substance Use & Misuse, 35,
811–844.
Hendriks, V. M., Meer, C. W., & Blanken, P. (1991). De Addiction Severity Index: ASI (R).
Handleiding bij training en afname (The Addiction Severity Index (R). Manual for training and
administration). Rotterdam: IVO [in Dutch].
Hendriks, V. M., Blanken, P., Adriaans, N. F. P., & Vollemans, L. C. (1994). Continue
gegevensverzameling over druggebruik: de opzet van een locaal drug monitoring system (DMS).
(Continuous data collection about drug use: The design of a local drug monitoring system
(DMS)). Rotterdam: IVO [in Dutch].
Jones, R. (1995). Why do qualitative research? British Medical Journal, 311, 2.
Kelle, U. (2001). Sociological explanations between micro and macro and the integration of
qualitative and quantitative methods. Forum: Qualitative Social Research [on line journal] 2(1).
http://qualitative-research.net/fgs/fgs-eng.htm.
Lambert, E. Y. (Ed) (1990). The collection and interpretation of data from hidden populations.
NIDA Research Monograph 98. Rockville: NIDA.
Lambert, E. Y., Ashery, R. S., & Needle, R. H. (Eds) (1995). Qualitative methods in drug abuse
and HIV research. NIDA Research Monograph 157. Rockville: NIDA.
Lincoln, Y.S., & Guba, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage Publications.
Mackenbach, J. P. (2001) Paradigma, succes en toekomst van de maatschappelijke gezondheidszorg
(Paradigm, success and future of public health). TSG, 79, 522–529 [in Dutch].
Maxell, J. A. (1998). Designing a qualitative study. In Leonard Blickman & Debra J. Rog (Eds),
Handbook of applied social research methods. Thousand Oaks: Sage.
Miles, M. B., & Huberman, A. M. (1984). Qualitative data analysis. A source back of new methods.
Newbury Park, CA: Sage Publications.
Morse, J. M. (1991). Approaches to qualitative-quantitative methodological triangulation.
Nursing Research, 40, 120–123.
Morse, J. (2000). Qualitative generalisibility. Qualitative Health Research, 9, 5–6.
Drug monitoring: Triangulation of methods 473