Data Collection

Data Collection, Verification and
Interpretation
• Data collection
– Instrumentation
– Research questions
• Data analysis
• Interpretation of findings
Data Collection
• Why Statistics? A Manager Needs to Know Statistics
in order to:
– Properly present and describe information
– Draw conclusions about populations based on sample information
– Understand Statistical relationship (causality)
– Improve processes
– Obtain reliable forecasts
What is your study?
Case study?
Developmental research?
Experimental study?
Data collection
• Research questions • Instrumentation
– What for? Do-able?
– Enough – Which is the instrument?
– Types of instruments – Types of data needed
– Triangulation
– Types (& literature)
• Questionnaire survey
• Interview
– Structured
– Semi-structured
– Open
• Video-recording
• Observation and note-
taking
• Documents
– Software involved?
Questionnaire survey
Questions: direct? Likert scale

Interviews
Transcripts and audio-recording

Observation and note-taking
Video recording
Why?
Documents
And others…
Validity, reliability of data
Why?
How to improve?
Assumptions?
D a ta an a lys is
D a ta
Q u a lita tive In s tru m e nts ne ed ed C o d ing

Q u an tita tive L ite ra tu re P a tte rns
B o th S o ftw a re
True or False?
• Complex analysis impresses people.
• I am generally able to analyze and interpret
the data I gather
Data analysis and interpretation
• Think about analysis EARLY
• Start with a plan
• Code, enter, clean
• Analyze
• Interpret
• Reflect
– What did we learn?
– What conclusions can we draw?
– What are our recommendations?
– What are the limitations of our analysis?
Why do I need an analysis plan?
• To make sure the questions and your
data collection instrument will get the
information you want.
• To align your desired “report” with the
results of analysis and interpretation.
• To improve reliability--consistent
measures over time.
Key components of a data analysis
plan
• Purpose of the evaluation
• Questions
• What do you hope to learn from the
question
• Analysis technique
• How data will be presented
Analyzing and Interpreting
Quantitative Data
• Quantitative Data is
Presented in a numerical format
Collected in a standardized manner
e.g. surveys, closed-ended interviews, tests
Analyzed using statistical techniques
True or False?
• Quantitative data we gather are more
generalizable than qualitative data.
• Stating limitations weakens the evaluation
Analyzing Survey Data
Do you want to report…
• how many people answered a, b, c, d?
• the average number or score?
• a change in score between two points
in time?
• how people compared?
• how many people reached a certain
level?
Common descriptive statistics
• Count (frequencies)
• Percentage
• Mean
• Mode
• Median
• Range
• Standard deviation
• Variance
• Ranking
Other Statistics
• Statistical Significance
• Factor Analysis
• Etc.
• generally require randomization, large

samples, and/or control groups
Getting your data ready
• Assign a unique identifier
• Organize and keep all forms
(questionnaires, interviews,
testimonials)
• Check for completeness and accuracy
• Remove those that are incomplete or
do not make sense
Data entry
• You can enter your data
– By hand
– By computer
Data entry by computer
• By Computer
– Excel (spreadsheet)
– Microsoft Access (database mngt)
– Quantitative analysis: SPSS (statistical
software)
– Qualitative analysis: In ViVo, etc.
Key Concepts
• A population (universe) is the collection of all

items or things under consideration
– A parameter is a summary measure that describes a
characteristic of the entire population
• A sample is a portion of the population selected
for analysis
– A statistic is a summary measure computed from a
sample to describe a characteristic of the population
Key Concepts, Continued
• Descriptive statistics (art)-- Collecting,

summarizing, and describing (presenting)
data from a sample or a population
• Inferential statistics – The process of using
sample statistics to draw conclusion about
the population parameters
Example: Descriptive Statistics
• Collect data
– e.g., Survey
• Present data
– e.g., Tables and graphs
• Characterize data
– e.g., Sample mean = X i
n
Example: Inferential Statistics
• Estimation
– e.g., Estimate the
population mean weight
using the sample mean
weight
• Hypothesis testing
– e.g., Test the claim that the
population mean weight is
120 pounds
Sources of data
• Before collection of data , a decision maker
needs to:
– Prepare a clear and concise statement of purpose
– Develop a set of meaningful measurable specific
objective
– Determine the type of analyses needed
– Determine what data is required
Sources of Data, Continued
• Primary Data Collection
– Experimental Design
– Conduct Survey
– Observation (focus group)
• Secondary Data Compilation/Collection
– Mostly governmental or industrial, but also
individual sources
Types of Data
• Random Variable – Values obtained are not
controlled by the researcher (theoretically
values differ from item to item)
• Data from a RV are either:
– Quantitative
• Continuous (measuring)
• Discrete (Counting)
– Qualitative (categorical)
• Nominal
• Ordinal
Types of Probability Sampling
• Items in the sample are chosen based on
known probabilities
Probability Samples
Simple
Systematic Stratified Cluster
Random
Types of Sampling Methods
• Non-Probability Sampling -- Items included are
chosen without regard to their probability of
occurrence.
i. Judgment
ii. Quota
iii. Chunk
iv. Convenience
• Probability Sampling – Items are chosen based on a
known probability. Let N=size of the population and
n=desired sample size
i. With replacement -- Prob. of each item and any round =(1/N)
ii. Without replacement -- Prob. of each item =(1/N), 1/(N-1), …1/[N-
(n-1)]
Types of Probability Samples, Con’t
• Simple Random Sample -- Every individual or item
from the frame has an equal chance of being selected. In
addition, any selected sample has the same chance of
being selected as any other.
– Samples obtained from table of random numbers or computer
random number generators
• Systematic Samples -- Divide frame of N individuals

into groups of k individuals: k=N/n. Randomly select one
individual from the 1st group. Then Select every kth
individual thereafter
Types of Probability Samples, Con’t
• Stratified samples -- Divide population into subgroups (called

strata) according to some common characteristic. A simple random
sample is selected from each subgroup. Samples from subgroups are
combined into one
• Cluster Samples -- Population is divided into several “clusters,”
each representative of the population. Then, a simple random sample of
clusters is selected
– All items in the selected clusters can be used, or items can be chosen
from a cluster using another probability sampling technique
Evaluation of a Survey
• What is the purpose of the survey?
• Is the survey based on a probability sample?
• Coverage error – appropriate frame?
• Nonresponse error – follow up
• Measurement error – good questions elicit
good responses
• Sampling error – always exists

Data Collection

Uploaded by

Copyright:

Available Formats

Data Collection

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Data Collection

Uploaded by

Copyright:

Available Formats

Data Collection, Verification and

Questions: direct? Likert scale

Transcripts and audio-recording

Q u a lita tive In s tru m e nts ne ed ed C o d ing

• generally require randomization, large

• A population (universe) is the collection of all

• Descriptive statistics (art)-- Collecting,

• Systematic Samples -- Divide frame of N individuals

• Stratified samples -- Divide population into subgroups (called

You might also like