Data
Collection Methods for Program Evaluation: Observation
Observation is way of
gathering data by watching behavior, events, or noting physical characteristics
in their natural setting. Observations can be overt (everyone knows they are
being observed) or covert (no one knows they are being observed and the observer
is concealed).
Observations can also be either
direct or indirect. Direct observation is when you watch interactions,
processes, or behaviors as they occur; for example,. Indirect observations are
when you watch the results of interactions, processes, or behaviors.
When
should you use observation for evaluation?
·
When
you are trying to understand an ongoing process or situation.
If you
want evaluating the situation you can use observation for get the information.
·
When
you are gathering data on individual behaviors or interactions between people.
If you
are want analysis individual behavior you can use observation.
·
When
data collection from individuals is not a realistic option.
If respondents are unwilling or
unable to provide data through questionnaires or interviews, observation is a
method that requires little from the individuals for whom you need data.
How do you plan for observations?
·
Determine
the focus.
Think
about the evaluation question(s) you want to answer through observation and
select a few areas of focus for your data collection.
·
Design
a system for data collection. Once
you have focused your evaluation think about the specific items for which you
want to collect data and then determine how you will collect the information
you need.
·
Recording
sheets and checklists
·
Observation
guides list the
interactions, processes, or behaviors to be observed with space to record
open-ended narrative data.
·
Field
notes are the
least standardized way of collecting observation data and do not include preset
questions or responses. Field notes are open-ended narrative data that can be
written or dictated onto a tape recorder.
·
Select
the sites. Select
an adequate number of sites to help ensure they are representative of the
larger population and will provide an understanding of the situation you are
observing.
·
Select
the observers. You
may choose to be the only observer or you may want to include others in
conducting observations. Stakeholders, other professional staff members,
interns and graduate students, and volunteers are potential observers.
What
are the advantages of observation?
- Collect data where and when an event or activity is occurring.
- Does not rely on people’s willingness or ability to provide information.
- Allows you to directly see what people do rather than relying on what people say they did.
What are the disadvantages of observation?
- Susceptible to observer bias.
- Susceptible to the “hawthorne effect,” that is, people usually perform better when they know they are being observed, although indirect observation may decrease this problem.
- Can be expensive and time-consuming compared to other data collection methods.
- Does not increase your understanding of why people behave as they do.
