Case Study Research – Questions in Reliability and Validity

Firmly based in context-dependent knowledge (i.e. rule-based knowledge to virtuoso/expert) Flyvbjerg (2006) presents 5 challenges to our misunderstanding of case study methodology.  While large samples of research data can develop a breadth of knowledge, individual case studies can present a larger work of depth on a specific point of study.  Various established researchers in the field of research methodology (—Campbell, 1975; Eysenck, 1976; Ragin & Becker, 1992) have seen through the challenges of reliability, theory and validity posed to case study research and begun to establish the meaningful research outcomes of the case study methodology.

The main contention found by various researchers is that the case study methodology presents issues with validity of research. As we can see from the visual reminder below, the virtuoso, or expert, comes to be an expert in a field through individual case knowledge. From specific cases that demonstrate both individuality for a study and possible connections to other research studies, a person becomes an expert in a knowledge field with the increased number of individual case studies that contain knowledge connections.

 

By challenging previous ideas of mis-understandings on case study research, it can be posited that like the natural sciences, the case study and how it is chosen is the objection really for generalizing for validity. Therefore, it is problem dependent and can use “falsification” (Popper, 1959) to generalize. Once we introduce the use of falsification to our research problem, a stronger case (no pun intended) can be made for the strength of case study research.

 

 

Pre-conceived research ideas

We all come to our research with previous knowledge and ideas. Sometimes our information is helpful for digging into the research and sometimes our pre-conceived ideas are mis-aligned or facts without all of the details.  I came across the latter this week as I got into a few articles on research method, specifically case study.

The specific reading that challenged my previous ideas on case study research from researcher Bent Flyvbjerg (2006).  Prior to my reading, I have to admit that I had a leaning towards qualitative research as a “more scientific” method of research. Built upon numbers and statistics, probability and scientific design, I thought that quantitative research would likely be the method for my own PhD research. I’ll be the first to admit that I don’t have all the right answers, and after reading Flyvbjerg’s article, my position has changed to a more open acceptability towards case study research.

Now having said that I am open to case study research, I feel that I need to qualify that statement by adding that case study research does need to include obvious rigor, falsification of the problem, clarity of narrative outcome and that the researcher has to re-examine preconceived notions (i.e. biases) and theories throughout study. For the next few posts I am going to go a bit more in depth on my findings for the method of case study research.

What pre-conceived research biases do you have as you begin your research study?

Flyvbjerg, B. (2006). Five Misunderstandings About Case-Study Research. Qualitative Inquiry, 12(2), 219–245. doi:10.1177/1077800405284363

Question for fellow researchers…

We continue to come across some great questions in our research and sometimes they are ones that may not have a finite answer, but are really helpful for keeping us in the research thought process. Here’s my question for the research cyber world:

Culture influences epistemology, but how deep is not know.  Is there another reason behind epistemological diversity in education research (i.e. beyond the being tolerant and expanding understandings)?

Overcoming Writer’s Block

I think it can be safe to say that writing comes in waves; some days are better writing days than others. Thankfully, when we have a troublesome writing day there are a couple of ways to move through the mental block and, hopefully, onto some great writing output. To that end, I’ve added a few helpful items from my reading this week (Creswell, 2011) to remind myself of how to navigate those waters when they come.

1. Find a template and use that as a guide.

Creswell (2011) has a great template example on how to write a five paragraph statement of the research problem. By referencing other literature, statistical trends and a quote or two a template can quickly become a well developed piece of writing that may inspire you onto the next writing section. 🙂

2. Read other research studies.

What better way to write well than to immerse yourself in other well-written research studies. The more we surround ourselves with great models, the more likely we will begin to take on similar traits and habits. Needing a place to start? I have found a wealth of great doctoral studies from the AECT.org site as well as through Proquest doctoral searches.

3. Just write.

We can always find a way to procrastinate but in the end it really doesn’t make us feel any better about not having gotten any writing done for the day. Just grab your computer (or pick up a pen and feel the old-school vibe!) and write something. Writing in a stream of consciousness for a few minutes might just trigger those research writing skills back in action.

Ok, speaking of procrastinating, I need to get back to my own research. 🙂

Happy researching!

Creswell, J. W. (2011). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research (4th ed.). Addison Wesley.

Deterrents to Research (Part 2)

Continuing from yesterday, here are a couple more deterrents that I came across in my readings for the week (Creswell, 2011):

4. Limited Research Skills and Abilities

We all have an even playing field that we stand on – no one is perfect. That said, as we look across that field we can see that there are is a wide range of strengths and weaknesses. Deep down we all know our own weaknesses. If there is a known research weakness, our best strategy is to learn how to research from someone who does it well. Find a colleague that you can learn from or take time to visit your research library – we all have something to learn from each other.

5. Should our problem be studied?

This deterrent is really a priority to our research as the resulting answer is an open or closed door for completing our research study. A few good questions can help us answer the looming question:

  •  Does your problem fill a gap in existing research/literature?
  • Does your problem replicate a previous study to increase the value of the field of research?
  • Does your problem go more in-depth into the existing research?
  • Does your problem give voice to marginalized people or groups?
  • Does your problem inform current practice?

If you can answer “yes” to any one of these questions, your research problem will likely be a benefit to the field of educational research.

Creswell, J. W. (2011). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research (4th ed.). Addison Wesley.

Deterrents to Research (Part 1)

This past week I came across some deterrents that researchers can come up against in their studies in a reading (Creswell, 2011). While we may not like hearing about the possible negatives of research, especially when tasked with research, I think that it can be  helpful to have advance knowledge of possible  pitfalls and know a few strategies for overcoming them.

PART 1

1. Limited access to research sites and participants/people groups.

If you may not have access to a large number of research sites or participants, begin to seek out some possible network connections for accessing your needed research site and/or participants. Some possible connectors could be your PhD supervisor, a local school board, your alma mater as well as your fellow PhD students.

2. Limited Time and Poor Time Management

We only get 24 hours in a day and it’s a non-negotiable. If it is know that there are limited time resources for research, mapping out a strategic plan for getting everything completed is a good way to start. Another helpful strategy is to create deadlines – and stick to them. Keeping accountable to to someone about meeting deadlines is also another help.

3. Limited Resources

Limited resources can mean not only limited funding, as well as access to resources (i.e. libraries, equipment, databases etc.) Early planning can help keep you on pace with what you may need for completing your research.

…more tomorrow! 🙂

—-

Creswell, J. W. (2011). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research (4th ed.). Addison Wesley.

Narrowing the Research Topic

While doing some reading this past week, I came up with a helpful visual to keep in mind while narrowing my research topic.

I think that it visualizes the development process of both how the find appropriate research questions to ask, as well as a good reminder of how to write the statement of the problem in my study.

 

Requests for suggestions

As I continue to develop this site, I am finding that organization of data will be key (i.e. relating topics for ease of navigation). To this end, I hope that if you have any suggestions on the organization, that you would kindly submit a comment.

Starter Post

This website is a work in progress and will be constantly updated with new research items and related news. Its primary focus is to be a resource for my research as well as other researchers and educators on topics relating to online music education: processes; methods; trends; historical data and research findings. To this end, I hope to locate the critical elements for creating an authentic learning environment and online music education model.

 

 

Get Adobe Flash player