Voevodins' Library _ "Focus Groups" 3rd edition / Richard A. Krueger & Mary Anne Casey ... Interview, People, Discussion, Decision Making, Development, Single-Category Design, Multiple-Category Design, Double-Layer Design, Broad-Involvement Design, Audience, Written Plan, Questioning Route, Categories of Questions, Opening Questions, Introductory Questions, Transition Questions, Key Questions, Ending Questions, Campaign, Strategies for Selecting Participants, Sampling Procedures for Focus Groups, Moderating Skills, Moderator, Discussion, Head Nodding, Question, Analysis Strategies, Long-Table Approach, Using the Computer to Help Manage the Data, Rapid Approach, Sound Approach, Principles of Reporting, Written Reports, Narrative Report, Top-Line Report, Bulleted Report, Report Letter to Participants, Oral Reports, Styles of Focus Group Research, Telephone Focus Groups, Internet Focus Groups, Media Focus Groups Voevodin's Library: Interview, People, Discussion, Decision Making, Development, Single-Category Design, Multiple-Category Design, Double-Layer Design, Broad-Involvement Design, Audience, Written Plan, Questioning Route, Categories of Questions, Opening Questions, Introductory Questions, Transition Questions, Key Questions, Ending Questions, Campaign, Strategies for Selecting Participants, Sampling Procedures for Focus Groups, Moderating Skills, Moderator, Discussion, Head Nodding, Question, Analysis Strategies, Long-Table Approach, Using the Computer to Help Manage the Data, Rapid Approach, Sound Approach, Principles of Reporting, Written Reports, Narrative Report, Top-Line Report, Bulleted Report, Report Letter to Participants, Oral Reports, Styles of Focus Group Research, Telephone Focus Groups, Internet Focus Groups, Media Focus Groups



Voyevodins' Library ... Main page    "Focus Groups" 3rd edition / Richard A. Krueger & Mary Anne Casey




Texts belong to their owners and are placed on a site for acquaintance

Analysis Strategies
This is where people get stuck. They wonder what to do with all those transcripts, tapes, and notes. It can be overwhelming. We suggest beginning analysts use the long-table approach. It is a time-tested method and breaks down the process into manageable chunks.
Long-Table Approach
The long-table approach is a low-technology option that has been used in countless analysis projects. It allows the analyst to identify themes and categorize results. It isn't an elegant or sophisticated-looking strategy, but it works. This is what you need:
* A room where you can spread out your work and it can remain undisturbed until you are done with analysis. It helps to have a long table(s). Lots of floor space will substitute nicely, if you don't mind bending down and you can keep the kids and dogs out of the area. Walls work too if you don't mind taping things to them.
* Transcripts
* Scissors
* Colored marking pens
* Colored paper for copying the transcripts
* Flip chart or newsprint paper
You are going to cut the transcripts apart. But once they are cut into individual quotes, you will also want to know where the quote came from originally. Here are a couple of tips that can help you identify where quotes came from after your transcripts are cut into hundreds of little pieces.
Tip 1: Number each line of each transcript. Most word-processing software has a feature that will do this for you. The line numbers will help you quickly locate a quote within a transcript.
Tip 2: Print transcripts on different colors of paper, thereby color coding the transcripts by audience type, category, and so on (e.g., student groups on blue, parent groups on green, etc.). Or run a blue marking pen down the left margin of each page of student groups and a green marker down the left margin of each page of the parent transcripts. (Or if you want to be even more systematic, give the first student group one blue line, the second two blue lines, and the third three blue lines. That way, you can not only tell student groups from the parent groups, but you can also tell which student group it came from.) This helps you know where quotes came from after you have cut the transcripts apart.

Make two hard copies of each transcript, one to cut up (the working transcript) and one that stays intact. Put the transcripts that are to stay intact in your files.
Arrange the working transcripts in a reasonable order. It could be in the sequence in which the groups were conducted, but more likely, it will be by categories of participants or by some demographic screening characteristics of participants. For example, if you did three groups with students, three groups with parents, and three groups with teachers, you would work with all three transcripts of one kind (e.g., students) before moving to the next. This arrangement helps you be alert to changes that may be occurring from one type of audience group to another.
Before cutting, do a quick reading of all transcripts. This quick reading is just to remind you of the whole scope and to refresh your memory of what was said in the groups.
Place the flip chart or newsprint paper on long tables, on the floor, or on the walls. Write one of the focus group questions to be analyzed on the top of each page of newsprint. If you had ten questions to analyze, you now have ten pages of newsprint surrounding you. You may also want to divide the newsprint page into categories to represent different types of focus group participants. For example, on one part of the page you could place comments from student focus groups, in another location you could place comments from parent focus groups, and in a third section you could place comments from teacher focus groups.
Now it's time to begin the cutting and categorizing.
Read each quote and answer these questions:
Point 1. Did the participant answer the question that was asked?
- IF YES go to Point 3.
- DON'T KNOW set it aside and review it later.
- IF NO go to Point 2.
(If you are undecided or unclear about any answers, then take the conservative approach and save the comments and review them later.)
Point 2. Does the comment answer a different question in the focus group?
- IF YES move it to appropriate question.
- IF NO go to Point 3.
(Caution: Don't assume that answers will follow the questions. Occasionally, participants will provide answers to questions asked earlier or to questions that have not yet been asked. When this occurs, move the comment to the appropriate location.)
Point 3. Does the comment say something of importance about the topic?
- IF YES tape it to the newsprint under the appropriate question.
- IF NO set it aside.
Tip: Don't use a lot of tape because you will want to move the quotes around later.
Point 4. Is it like something that has been said earlier?
- IF YES start grouping like quotes together. You are basically making piles (categories)* of like things.
- IF NO start a separate pile.
You are constantly comparing and making decisions. Is this similar to or different from other things?
Soon the newsprint page is filling up with participant quotes. Not everything necessarily fits neatly into categories. In focus groups, people regularly get off topic or expand in detail on an aspect of minimal importance to the study. There's a good chance that you won't use this information, and you will want to set it aside to clear the clutter, but don't toss these out. Instead, create storage areas so you can later review these quotes again. You might rearrange categories or create new categories and want to review these unused quotes to see if they fit your new categories. Sometimes the storage area is a box in the middle of the room with unused quotes.
After you've completed cutting up all the transcripts, you're ready to begin analysis of specific questions. Make sure you have all the quotes that say similar things together. Rearrange until you're satisfied. You may want to talk with someone else about how you are categorizing certain things. Or you may want to show them. When you finish putting quotes into categories, you are ready for the next step.
Go back to each newsprint page and write a descriptive summary of what each type of group said in response to the question. Write a description of what students said in response to the question. Then write a summary for the parents and then the teachers. Again, you are comparing and contrasting. How are they similar? How are they different? At this point, just describe what was said. Later you may want to go further and offer an interpretation of what it means or a recommendation.
During this process, you will need to decide how much weight or emphasis to give comments or themes. We look at several factors:
Frequency. Although we pay attention to how frequently something is said, it is a huge mistake to assume that what is said most frequently is most important. Sometimes a really key insight might have been said only once in a series of groups. You have to know enough about what you are studying to spot a gem when it comes along.
Specificity. Typically, we give more emphasis to comments that are specific-that provide detail. For example, if we were asking what people dislike about flying, we would give more weight to a quote that specifically described a time when that person lost his or her bags, what he or she did, and what happened than to a comment of "Oh, I hate it when they lose your bags."
Emotion. Also, we typically give more weight to comments or themes in which participants show emotion, enthusiasm, passion, or intensity in their answers.
Extensiveness. Frequency and extensiveness are related but different. Extensiveness is how many different people said something. Frequency is how many times something is said. We have had groups in which one person kept returning to the same theme. Although the theme was mentioned a fair amount, it was brought up by only one person. We pay attention to extensiveness.
When you are done writing a descriptive summary for each of the questions, look across the questions to see what themes cut across the questions. Are there things that come up repeatedly? If so, consider structuring your written report around these themes rather than around the questions. Or perhaps some questions can be combined.
Now take a break. Get away from the data for a couple of days. This is a chance to refocus your attention on the big picture. What prompted the study? Who's going to use the results, and have you located the information that will be helpful? How can you frame this information so it best conveys what participants shared? It's easy to get sidetracked by fascinating tidbits of minor importance. After a few days, go back to conclude the analysis.
When we write a report, we structure it around the questions or the themes. Then we use the summaries we wrote earlier to describe what was said about the question or the theme. If we are writing a narrative report, we then select quotes from those categories that illustrate what was said. The quotes are used as evidence. We look for quotes that capture the essence of what was said. They give the reader an idea of how the participants talked. We typically use about three quotes per category or theme.
When we have completed this level of analysis, then we may go on to include our interpretations or recommendations. However, we are careful to keep these sections separate from the findings section that we just completed through the process outlined above.
The long-table approach has been around a long time, but it is still effective. Quite a number of variations are possible, but the core elements are basically cutting, sorting, and arranging through comparing and contrasting.
We recommend that people who are doing their first qualitative analysis project use this process. It is systematic. It breaks the job down into doable chunks. It helps make analysis a visual process. Once you have mastered this approach to analysis, you have a better idea of how to adapt the process to meet the needs of other efforts.
Using the Computer to Help Manage the Data
Computers have been used in a variety of ways in focus group analysis. We are aware of three distinct approaches, but likely more exist. For each approach, it is assumed that you have transcripts.
One approach is simply using the word processor as another way to cut and paste. Essentially, it is using the computer to perform the long-table analysis described earlier. When used in this way, give thought to the need for tracing the source of each quote. It's easy to block and paste quotes together and then lose sight of where they came from. Sometimes knowing the source is critical. This can be solved by developing a coding system that allows you to identify each quote by group and/or participant.
A second approach is to go beyond cutting and pasting functions of word-processing programs and begin to code quotes. A number of researchers have been creative with the use of sorting, coding, and macros. Essentially, they use the capabilities of software they already use to analyze the results. This system may not be as elegant as the specialized software, but it has benefit because the researchers are already familiar with the software.
The third approach is to use the specially developed software that is designed for qualitative analysis. Two popular programs are The Ethnograph and NUD*IST. These programs open the doors for analysis possibilities that are not reasonable with other strategies. For example, these programs allow you to "nest" codes. This means that you might have a shorter quote within a longer quote, and each one can be coded differently. Earlier procedures tended to limit you to placing quotes in one location, but with these special computer programs, there is no limit. Or you might want to examine comments from participants with certain demographic characteristics that you've coded into your computer. It can be done with other analysis strategies, but it is difficult and awkward.
The advantage of these specially developed computer programs is that they help manage large sets of text. It helps an analyst look very carefully at the data. As a result, these programs are popular in academic settings, particularly graduate research. The downside is the time needed to learn and operate the program. Also, they provide a level of analysis not always needed.
Rapid Approach
Sometimes speed is a critical concern. Perhaps a decision is about to be made and rapid results are critical. Caution is always advised when speed is a driving force. When speed is urgent, veteran moderators often use several strategies, such as the following:
* Tightly focus the study
* Carefully develop the questions to foster fast analysis
* Ask fewer questions than normal
* Use flip charts to capture comments
* Give oral summaries at the end of the groups
* Use assistant moderators to provide verification
Sound Approach
This is an innovative approach that is made possible by equipment and software that allow for digitally recording the focus group. With specialized software (Sound Forge is an example), the moderator can record sound on the laptop computer and mark certain segments that show usefulness for later analysis. Then the researcher can quickly go back over the transcript, find the marker, locate the actual quote, and play back the quote. Later the quotes can be clustered, just as you would cluster written quotes, and you can embed the actual comments on reports that are prepared on CD disks. Note the article by Pierre Belisle (1998, p. 18) in Quirk's Marketing Research Review.

<< What Gets Used as the Basis for Analysis
Some Tips to Consider >>