The spring term is over

The qualitative class is over. I really enjoy it. I enjoy the materals Dr. Shulman selectc for us, enjoy the guests' presentation, and also enjoy the whole process of doing usability testing. Anything you have done is what you actually learned.

The class is over, but my interest of qulitative research just begins. The blogger will continue to record my learning shedule and notes. It is a good way to track back my ideas. During I wrote my final paper, I found it is important to take notes. It helps me clear my mind, help me to decide next steps, and help me generate more ideas to present my paper. This summer, I plan to catch up the rest materails which I have no time to read when I was busy on my final project. And keep posting my insights on this blogger.

Project Progress (week 10)

During the spring break, I did the first data collection of my project. Although there is just one participant so far, I already got some valuable experiences.

First, I got some advices about the questionnaire design. There are some misleading questions making the participant feel confused and I need to correct them. The misleading questions influenc the participant'sperceptions about the website. He checked the number iondicating high difficulty in the ranking sclae becasue he felt frustrated when searching for the answer. It might cause problems on validity of testing participants' "true" feelings about the website.

Second, there are several serious problems about the website found by the participant which were not found by me when designing the tasks. I am excited to see whether the next participant will find the same problems or some other different issues. I found myself actually "learning" from the subjects.

The first usbility testing took us two hours. It is logner than I expected. One reason is that the participant #1 is not only an experienced web user, but also has experiences of creating website and online database system. He is more sensitive to deficiencies of website design than general users and pointed out many details. The data collected from "thinking aload" is the part I feel the most valuble. The other reason is that he is my friend. So he is willing to spend more time getting familiar the website and trying to find as many problems as possible. This is the advantage to recruit people whom researchers know to be participants.

The participant #1 is not an Engligh native speaker. But I found he doesn't have difficulty to complete the test. So I decide keep using Engligh to do the test even though the participant uses the same mother tongue with me.

Here are just few things I learned from this testing. When I finish transcription, I beleive there will be more ideas coming out.

Reading Response (Week 9)

This week's G & C chapter 8 talks about interviewing. It is relevant to me because my project involves interviews. During reading this chapter, I wrote down any ideas coming up in my mind on my "qualitative research notebook."

I decide not to take notes during the interview. Because I am not a native English speaker, what I hear will need to be translated to my language in my mind for understanding. If I take notes during the interview, my concentration on the participants will be distracted. I think the better way for me is to take notes immediate after the interview session is over.

I plan to carry out my first pilot study next week, so I also read the Silver's chapter 4. It also talks about the interviews. The other concern mentioned in Silver's book for interviewing is that: we have to be careful about the "voice and experience" issues (Silver, p. 114-116). This issue causes problems if the researcher directly sees what the participants said as the facts or experiences they actually have. Sometimes it is hard to know participants' retrospective account is what it was really like.

This issue reminds me the importance of "triangulation" or "multiple methods" to enhance the credibility of the data. G & C p. 129 mentioned the other way to enhance credibility related to interview technique: to interview a number of different people in different organizational positions (if the site is in a particular organization), and the cridibility of data you gathered is enhanced if it can be confirmed from several sources.

In my project, I also take the same principle into consideration. I try to involve several data collecting methods: observation, questionnaire, interview, and screen mouse activities recording to enhance the credibility. But at fist, seeking for similarities among the data collected by different ways is not my goal. The purpose of the usability testing is trying to find problems. Even though I always got different opinions from participants, I am still successful on the purpose of "understanding the topic." Especially in the stage of pilot testing, I will keep open mind and expect for the diversity emerges.