| • Science | • People | • Locations | • Timeline |
Illustrative Case Studies are descriptive; they utilize one or two instances to show what a situation is like. This helps interpret other data, especially when there is reason to believe that readers know too little about a program. These case studies serve to make the unfamiliar familiar, and give readers a common language about the topic. The chosen site should be typical of important variations, and contain a small number of cases to sustain reader's interest. There are pitfalls in presenting illustrative case studies. They require presentation of in-depth information on each illustration; there may not be time on-site for in-depth examination. The most serious problem is with the selection of instances. The case(s) must adequately represent the situation or program. Where significant diversity exists, it may not be possible to select a typical site.
Exploratory Case Studies are condensed case studies, undertaken before implementing a large-scale investigation. Where considerable uncertainty exists about program operations, goals, and results, exploratory case studies help identify questions, select measurement constructs, and develop measures; they also serve to safeguard investment in larger studies. The greatest pitfall in the exploratory study is prematurity: the findings may seem convincing enough to be released inappropriately as conclusions. Other pitfalls include the tendency to extend the exploratory phase, and inadequate representation of diversity.
Critical Instance Case Studies examine one or a few sites for one of two purposes. A very frequent application is the examination of a situation of unique interest, with little or no interest in generalizability. A second, rarer, application entails a highly generalized or universal assertion which is called into question, and we can test it by examining one instance. This method is particularly suited for answering cause-and-effect questions about the instance of concern. The most serious pitfall in this application is inadequate specification of the evaluation question. The importance of probing the underlying concerns in a request is crucial to the appropriate application of the critical instance case study.
Program Implementation Case Studies help discern whether implementation is in compliance with its intent. These case studies are also useful when concern exists about implementation problems. Extensive, longitudinal reports of what has happened over time can set a context for interpreting a finding of implementation variability. In either case, generalization is wanted and the evaluation questions must be carefully negotiated with the customer. A requirement for good program implementation case studies is investment of sufficient time to obtain longitudinal data and breadth of information. Multiple sites are typically required to answer program implementation questions; this imposes demands on training and supervision needed for quality control. The demands of data management, quality control, validation procedures, and analytic model (within site, cross site, etc.) may lead to cutting too many corners to maintain quality.
Program Effects Case Studies can determine the impact of programs and provide inference about reasons for success or failure. Like the program implementation case study, the evaluation questions usually require generalizability and, for a highly diverse program, it may be difficult to answer the questions adequately and retain a manageable number of sites. There are methodological solutions to this problem. One is to first conduct the case studies in sites chosen for their representativeness, then verify these findings through examination of administrative data, prior reports, or a survey. Another solution is to use other methods first. After identifying findings of specific interest, case studies could then be implemented in selected sites to maximize the usefulness of the information.