Category Archives: Literature review

A 33,000 foot view: The Abstract

 Abstracts are great; abstracts are not enough!
An abstract will not give you enough information to accurately apply the study findings to practice.   An abstract typically summarizes all the other sections of the article, such as  the question the researcher wanted to answer, how the researcher collected data to answer it, and what that data showed.  This is great when you are trying to get the general picture, but you should Never assume that the abstract tells you what you need to know.
airplaneWingIsland
Abstracts can mislead you IF you do not read the rest of the article.  They are only a short 100-200 words and so the authors have to leave out key information.   You may misunderstand study results if you read only the abstract.   An abstract’s 33,000 foot level FootprintsInSand
description of a study, cannot reveal the same things that you can learn from an up-close look at details.  You want to know exactly who was in the study, exactly what the researcher did, & exactly how outcomes were measured!  You want to follow the researcher’s footprints up close, not just do a fly-over.
So…what is the takeaway?  Definitely read the abstract to get the general idea.  Then read the article beginning to end.  Don’t give up reading the full article just because some parts of the study may be hard to understand.  Just read and get what you can. Then try a re-read or get some help understanding any difficult sections.   This is an important step toward EBP.   [revised from my former blogsite]
Critical thinking:  What info is missing from this abstract at this link that you would want to know before using the findings of this pain study to practice?
http://www.ncbi.nlm.nih.gov/pubmed/25659796QUESTION

Finding the Needles in the Haystacks: Evidence Hunting Efficiently & Effectively

Searching for the right evidence is an art & a science.   In an effective search, the RN: twoOnComputer

  1. Identifies excellent key words based on a clear problem statement
  2. Systematically searches the best databases for those words
  3. Keeps a record of the search strategy.

This is actually a pretty simple time-saver because it keeps you from having to repeat searches because you can’t remember where you looked!!

Let’s take an example that we used previously.  Here’s how it was laid out in PICO (which stands for Population/problem, Intervention, Comparison intervention, & Outcome)

  • Population/problem= Postoperative patients with ileus (Patient population &Problem)
  • Intervention= Gum chewing postop (Intervention to try out)
  • Comparison intervention= NPO with gradual diet progression when bowel sounds start returning
  • Outcome= Reduce time of postop ileus with sooner return to nutritious eating

We would:magnifyingGlass

  1. Using PICO, identify key concepts (words), such as “postoperative ileus” “gum chewing” and “NPO.” Note that you can pick single words or combinations of words.
  2. Search for this set of words in the very comprehensive databases of PubMed and also in CINAHL. CINAHL is more nursing specific, and PubMed is one of the most comprehensive out there. Search from MOST RECENT to earlier.  Go for only most recent 5 years unless 5 years doesn’t give you enough articles.
  3. Keep notes of exactly which words and phrases you used to search each database

This 5 minute video shows you a GREAT way to make sure that your search is complete with minimal effort. It’s an easy-peasy tracking strategy for where you’ve already looked. https://www.youtube.com/watch?v=233DzkmimV4&list=PLE3A977BE32CF3956

CRITICAL THINKING: What are the key words of your clinical problem of interest.  (You can choose to use PICO or not.)  Plug them into PubMed.  Did you get enough articles?QUESTION

“That is so random!” But is it Representative?

What makes a good sample in research?  One thing.  And it isn’t random selection.  (Surprised?)

Portrait of a diversity Mixed Age and Multi-generation Family embracing and standing together. Isolated on white background. [url=http://www.istockphoto.com/search/lightbox/9786738][img]http://dl.dropbox.com/u/40117171/group.jpg[/img][/url]It is representativeness.  No matter how the sample was picked, it must be representative of all those in the larger population, if the researcher wants to say anything about anyone who wasn’t in the study.  Now, of course, it is true that random selection is more likely to give you a representative sample, but it is no guarantee.  Only likely.

What is random sampling?  It is when every member of the larger population has an equal chance of being selected for the study sample.  Example? Drawing names out of a hat.  It is well-accepted practice to generalize research results from a random sample to others like those being studied (assuming that all other aspects of the study are strong).

In contrast a convenience (or nonprobability) sample is when some people are more likely to be chosen to be in the study than others.  You shouldn’t generalize the results of these studies because the samples may Not represent others.

Example of when random sampling doesn’t work: Let’s say you have a mixture of red, green, & yellow apples, and you select a sample that has only yellow apples.  (The red & green ones are going to be offended!–They’re left out.)  You now have a sample that is biased in favor of yellow apples!   Your sample does Not represent the larger population of apples…even if you used random methods to get it.  If you want to apply the study to red & green & yellow apples…well….you must get some of them in your sample, too. The yellow apples might not be at all like the other types and studying just yellow might mislead you into thinking something about the red & green ones that isn’t true!   Of course you could study all the millions of apples in the world and exclude none, but that would be pretty cumbersome and expensive.   So, it’s better to go for a representative sample!

When else doesn’t random sampling create a representative sample?   If I am doing historical research, say on the Nursing Department at California State University/Northridge, then I want to hand pick the specific RNs by name who were in charge of the Department from the beginning.  Randomly selecting nurses from those who worked at the University won’t represent those leaders.

QUESTIONCritical Thinking:  Take a quick look at the linked abstracts. How were the samples selected?  How representative are the samples of a larger population of interest?  Could you generalize the results to other people, and if so to whom?

Want more information on sampline? Check this out.  It takes < 5 minutes:

https://www.youtube.com/watch?feature=endscreen&v=be9e-Q-jC-0&NR=1

“The Sky is Falling!” (or Don’t be an EBP Chicken Little)

We all know the story of Chicken Little, right?  Chicken Little is walking through the forest, an acorn falls and hits her on the head, then Chicken Little  runs about in a panic telling everyone, “The sky is falling! The sky is falling!” A lot of the animals are convinced, and the fox—who knows the truth that it was only an acorn—convinces Chicken Little & some other animals to come into his den to be safe from the falling sky. There he eats them. Interestingly the fox used the correct evidence well. Chicken Little & fox chicken littlecompany used evidence poorly and created a safety hazard for themselves!

Moral of the story? Don’t be a Chicken Little when it comes to reading and applying research to practice. Get all the facts before you share the research findings with others. Don’t read only the “acorn” of abstract, introduction, and discussion, and then assume that you know what the research study shows and that you can apply it to your work. Don’t turn an acorn into a falling sky!

How to avoid being an EBP Chicken Little? To avoid being an Evidence-Based Practice (EBP) Chicken Little, you should follow the example of Samantha in this research fairy tale: “Samantha…read the study abstract. Then, while Chicken Little and her friends waited anxiously, she read the introduction, the literature review, the research questions, the methods section, the findings, and the discussion section. Then she went back and read all the sections again. Finally, as Chicken Little hopped around her impatiently, she reread the findings. “Chicken Little, have you and your friends read the entire study?” asked Samantha.” (source: https://www.son.rochester.edu/student-resources/research-fables/chicken-little.html)

Why go to all this trouble? I’m busy. The reasons to take time and effort to read the WHOLE study are many. First, the subjects may not be at all like your own patient population—what if the researchers studied only “left-pawed albino hamsters”? Second, the research might not be a strong meta-analysis or randomized controlled trial whose results can actually be applied to other times and places—what if the researchers just watched subjects walk around, but didn’t test what makes them walk better?  A third reason is that the results might be statistically significant, but clinically irrelevant!—what if researchers were studying pain, but everyone in the study had 1-2 on the pain scale?

You don’t want to endanger patient safety by misunderstanding and misapplying research and then be “eaten alive” by adverse patient outcomes or by critics, who will see through your mistakes. Remember in the fairy tale Chicken Little and his careless friends misunderstood the facts, and hence were susceptible to being eaten by a fox.

What if you don’t know how to read research? No problem. Everyone who knows how to read research now had to learn it—no one was born knowing.  So,…you can learn it, too!  It doesn’t take magical powers.  Countless resources are online; others are in your hospital or in a university research course. If you check the box on this page to follow the EBP blog, (I hope) it will help, too. Go back and read earlier blogs on sections of a research report.

For more information on how to be an EBP Chicken Little (NOT) see the very creative research fairy tale by Jeanne Grace (copyright Rochester College) at https://www.son.rochester.edu/student-resources/research-fables/chicken-little.html

Critical thinking:

  1. After reading Grace’s fairy tale at the above link list at least three (3) things that Chicken Little might have learned, had she read the whole article!
  2. Compare an abstract with a full article, and check out the differences. Specifically compare the abstract at  http://www.ncbi.nlm.nih.gov/pubmed/2606078 with what you learn about them from the full article at http://www.ncbi.nlm.http://www.ncbi.nlm.nih.gov/pubmed/2606078nih.gov/pmc/articles/PMC4449996/. Did reading the whole article change the way you understand how orQUESTION whether the study might apply to your work? If so, how? And if not, why not?

“Is it?” “It is!” Expert opinion as valuable evidence for practice.

Remember back when you asked your mom why you should make your bed, set the table, or do some other then-distasteful task? Maybe you said, “Do I have to?”

Because I Said SoRemember her answer? Sometimes it was just: “Because I said so!” Was that enough evidence to support your practice of setting the table or making your bed?  You bet! After all she was THE expert on such things.

Likewise…is expert opinion good evidence for your practice? Yes, it is. EXPERT OPINION of individuals or committees is the 7th level of evidence for nursing practice (Melnyk & Fineout-Overholt, 2005), and should be considered.

Of course the first question that you must ask is: “Is the person/committee (who is telling you how to prevent falls, promote safety, teach patients, and so on and on) an actual EXPERT on that topic?” The answer is a matter of judgment. If the person/committee has special education, credentials, or experience or is a recognized authority on the topic about which they are giving advice, then you could reasonably conclude yes, they are experts. In that case the advice should be considered evidence for practice.    (Caution: Your judgment of their expertise matters!–don’t just follow along.  Don’t forget that person who is expert in one area may not be an expert in another.)

The 2nd question that you must ask is; “Does any research or stronger level of evidence exist on the topic?”

  • If it does NOT exist, then you should use that expert opinion in combination with scientific principles, anecdotal case reports, and theory. Or you might create some new research yourself. (Source=Iowa EBP Model)
  • If it DOES EXIST, then you should pay most attention to the stronger evidence and interpret the weaker evidence of expert opinion in that light.

QUESTIONCritical thinking:  Try your new knowledge in this example. Many educators and professionals who run journal clubs consider journal clubs effective based on feedback from participants. At least in 2008, 80% of experimental studies suggested that journal clubs helped with learning and being able to critically review a research article. However, no research is available on whether the learning from journal clubs actually translates into practice (Deenadayalan et al., 2008). You are considering a journal club. What would you decide to do and why?

For more, see:

“Watch & Learn!” – Systematic Reviews of Non-experimental Studies

Today’s top tip: Want to find the strongest research evidence for your project?   Go to http://www.ncbi.nlm.nih.gov/pubmed & add the strongest type of research designs as one of your search terms. For example, add the terms meta-analysis or systematic review to your other search terms. **********************************************

Now to the new!  What is a systematic review of descriptive studies? [Note: For information on stronger levels of research “I like my coffee (and my evidence) strong!)]Cat Fishbowl2

First, remember that in a descriptive study, the researcher merely watches or listens to see what is happening. Descriptive studies do not test interventions.

Second, a systematic review (not to be too silly) is a review that is done systematically in order to include all literature on a particular topic . The authors will tell us where they searched for studies, what search terms they used, and what years they searched. That way we can feel sure that all relevant articles are included.

Therefore, in a systematic review of descriptive studies the authors

  • Collect non-experimental studies related to the problem they are trying to solve,
  • Critically review them, &
  • Write up that analysis for you and me.

You won’t see a lot of numbers or statistics in these reviews of non-experimental studies.

Systematic review of descriptive studies are weaker than other levels of evidence in part because they are critical reviews of non-experimental studies in which the researchers only observed subjects. Those non-experimental studies that they are reviewing may be quantitative with results reported in numbers or qualitative with results reported in words.

Here’s an example with results reported in words (qualitative): Yin, Tse, & Wong (2015) systematically reviewed studies for what factors affect RNs giving PRN opioids in the postop period.   They searched publications 2000-2012 and ended up with 39 relevant studies. Within those 39 articles were descriptive studies that identified 4 basic influences on opioid PRN administration by RNs to postop patients: “(i) nurses’ knowledge and attitudes about pain management; (ii) the situation of nurses’ work practices in administrating range orders for opioid analgesics; (iii) factors that influenced nurses’ work practices; and (iv) perceived barriers to effective pain management from the nurse’s perspective.” [note: In this study a few of the 39 studies were experimental in which something was done to subjects and then outcomes measured, and Yin et al., commented separately on what those showed.]

Critical thinking: What are key differences between a meta-analysis of randomized controlled trials and a systematic review of QUESTIONdescriptive studies?

Reference found with search terms: review of descriptive studies nursing pain – Yin, H.H.,Tse, M.M., & Wong, F.K. (2015). Systematic review of the predisposing, enabling, and reinforcing factors which influence nursing administration of opioids in the postoperative period. Japan Journal of Nursing Science, doi: 10.1111/jjns.12075.

 

Cohort & Case-controlled studies: Going forward & backward

Got a clinical problem?  You probably want to solve it with evidence—STRONG evidence.   Click on this link to see one well-accepted hierarchy from strongest #1 to weakest #7 (Melnyk & Fineout-Overholt, 2005).   Today let’s look at the 4th strongest level of evidence = Case controlled or cohort studies

First a quick review

Click here for a quick review of the strongest 2 levels of evidence (#1 Systematic reviews, Meta-analyses, or Evidence-based clinical practice guidelines based on systematic review of RCTs. #2 Randomized controlled trials)

Click here for a review of the 3rd strongest type of evidence (#3Controlled trials without randomization)

Now on to the new “stuff”  strong

All 3 of the top, strongest levels of evidence are experimental studies (or include available experimental studies). That means the researcher actually does something or gives a treatment to some of the subjects and then records the outcomes. 

The weaker 4 levels of evidence are non-experimental designs. This means that the researcher merely observes & does Not do anything to subjects. So how does that work?!

First, a cohort study (non-experimental). A cohort study starts with a group of people who have something in common and then the researcher observes only & keeps collecting data from them over a long time into the future. Data collection into the future is called a prospective study. An example is the Nurses’ Health Study, in which over 20,000 nurses were identified and followed-up annually with tests and surveys for over 25 years (this study is still ongoing). These studies provide very valuable information, but are obviously very expensive and time-consuming.”(OMERAD EBM course, 2008)

Now a case-controlled study (non-experimental).  In a case controlled study the researcher observes only & collects data over time into the past (not the future). Data collection into the past is called a imagesCAH6C8NTretrospective study. Again, from the OMERAD EBM (2008) site this example: “Patients with a disease are identified who have suffered a bad outcome such as death or recurrence, and compared with patients who have the disease but haven’t suffered the bad outcome. For example, a researcher might  identify a group of breast cancer patients who have died…, and compare them with a similar group of patients with breast cancer who are still living.”

Critical thinking: Which of these would be better for casQUESTIONe-controlled study and which for cohort study.

  1. You are a runner in the Los Angeles marathon and you are interested in how that race can improve cardiovascular health among those who finish. Question: Cohort or Case controlled?
  2. Some finishers of the LA marathon die of heart attacks 20 years later; many survive another 40 years.   Question: Cohort or Case controlled?

For more info see:

 

Of Mice and Cheese: Research with Non-equivalent Groups

Last week’s blog focused on the strongest types of evidence that you might find when trying to solve a clinical problem. These are: #1 Systematic reviews, Meta-analyses, or Evidence-based clinical practice guidelines based on systematic review of RCTs; & #2 Randomized controlled trials. (For levels of evidence from strongest to weakest, see blog “I like my coffee (and my evidence) strong!”)

So after the two strongest levels of evidence what is the next strongest? #3 level is controlled trials without randomization. (Sometimes called quasi-experimental studies.)

Here’s an example of a controlled trial without randomization: I take two groups of mice and test two types of cheese to find out which one mice like best. I do NOT randomly assign the mice to groups. The experimental group #1 loved Swiss cheese, & the control group #2 refused to eat the cheddar. I assume confidently that mice LOVE Swiss cheese & do NOT like cheddar. What’s the problem with my conclusion? If you want to know, then read on!swiss cheese

In my mouse Controlled Trial Without Randomization, the groups were formed by convenience and Not randomly assigned. Thus, any difference in outcomes between groups might be related to some pre-existing difference between groups. My outcome of mice loving Swiss & hating Cheddar might have nothing to do with the experimental treatment.   In fact, I did not know that all my mice in the Swiss cheese group #1 hadn’t eaten in 2 days, and my mice in the cheddar group #2 had just had a full lunch. Ooops.

On the other hand if I had randomly assigned all the mice to two groups, then I could be relatively confident that all little differences between group members were evenly distributed to both groups, so that the groups were equivalent. My two mouse-groups would have probably ended up with a pretty even distribution of both hungry and not-so-hungry mice.   Then if my Swiss cheese group devoured the Swiss and my cheddar group rejected the cheddar, I could be more certain that mice love Swiss and dislike cheddar.

Happy evidence hunting!

How to Re-Invent the Wheel (NOT!!)

You can avoid re-inventing the wheel by checking in with top notch wheelexperts who have already examined the practice problem that you face.

In other words, it’s time to head to the library. After all that’s what the library is: the experiences and research written down by experts, who have spent a lot of time thinking about the same problem that you are facing. Really it’s pretty amazing that we have access to health professionals all over the world who are eager to help you avoid re-inventing the wheel.imagesCAGYW6WB

The best experts in the field are talking directly to you through their publications!

Of course it’s important to ask your colleagues in your own and other institutions about their ideas on the problem, but that’s not enough. You will be limited by what they happen to know; or worse you will be limited by what they don’t happen to know! Nurses on your floor can provide practical, site-specific insights, but it’s easy to see why you would want to add newest information from the top experts. That is BEST evidence.

Remember: EBP = Best evidence + Clinical judgment + Patient/family preferences/values

HOW do you find the experts in the library?

  1. The first step is to identify KEY WORDS from your PICO.
  2. Use single words or put phrases in parenthesis in your list of words (e.g., “postoperative ileus”). A librarian can help with key words, too.
  3. Google the site PubMed (PubMed is a complete database of healthcare publications)
  4. In the search box at the top of the PubMed page, type in your key words
  5. You will get a list of articles on your topic (and some related articles on the right side)
  6. Click on the box beside the ones that you want & email that list tocomputers shaking hands your facility librarian with a request to pull the complete articles for you! (Of course if you are a student with some direct access to full-text articles in a school library, then it may be quicker to get them on your own. It’s up to you, but part of your “village that it takes” might be the librarian.) [See “Take five!” if you want more on to why PubMed beats Google Scholar.]

EXAMPLE: Let’s get specific….

  • Take this problem that we have discussed before:
    • P = Postoperative patients with ileus (Population or Problem)
    • I = Gum chewing postop (Intervention to try out)
    • C = NPO with gradual diet progression when bowel sounds start returning (Comparison intervention)
    • O = Reduce time of postop ileus with sooner return to nutritious eating (Outcome that you want)
  • What are some key words from the above PICO stated problem? “Postoperative ileus” adults “gum chewing”
  • Go ahead. Pull up PubMed. Paste in the key words You should get 11 articles about gum chewing & postoperative ileus. Check the boxes of the ones you want, then…
  • Click on the “SEND TO” link near the upper right corner of the screen and email the list to the librarian with a request for full-text of the articles. (You can send to yourself, too)
  • Congratulate yourself on an EBP literature search well-started!

CRITICAL THINKING: Why wouldn’t you simply use google.com to find expert opinions?  [If you want more “data”  related to this question.  Check out“Take five!”]

FOR MORE INFO: Check out this tutorial on how PubMed works & what’s in it http://www.nlm.nih.gov/bsd/disted/pubmedtutorial/020_010.html You pay for PubMed through your taxes—get your $$ worth!

 

 

You Got A Problem With That? Try PICO*

IF….

  • The Purpose of evidence-based practice (EBP) =  BEST PATIENT CARE, &
  • The Definition of EBP = Best evidence + Clinical judgment + Patient/Family preferences & values

THEN…How do I get started with EBP to improve patient care?

One of the 1st steps is to identify clearly the clinical issue that needs solving.   One way to do that is by using PICO.*

WHAT IS PICO?   PICO is an acronym to help you clarify the clinical problem & to help you prepare to search the literature for evidence

  • P = Patient population or problem
  • I = Intervention or treatment that you want to try out & is based in best evidence
  • C = Comparison intervention or treatment (This might be some standardized care on your unit; or un-standardized care given by individual nurses based on their individual expertise)
  • O = Outcome you want to achieve.

EXAMPLE:  Let’s say you work with post-op patients and want to speed up patients’ return of normal GI function.  Right now on your unit, patients are NPO post-op progressing to ice chips and so on as their bowel sounds start returning.  But you have 2 concerns: a) some patients’ GI function seems quite slow to return; & b) quicker return to a nutritious diet may speed healing.  You read an article that gum chewing can reduce the time of postoperative ileus.  With that information, here is how your PICO problem would look:

  • P = Postoperative patients with ileus
  • I = Gum chewing postop
  • C = NPO with gradual diet progression when bowel sounds start returning
  • O = Reduce time of postop ileus with sooner return to nutritious eating

CRITICAL THINKING: Now you try it.  What is problem for patients (or nurses) on your unit? Try writing it out in a sentence or two and then put it into PICO format.  You are now on your way with beginning an EBP project that will promote the very BEST PATIENT CARE.

*Note: Some use PICOT that includes “T”.  The “T” stands for the time it will take to show an outcome.  Because the timing does not seem to me relevant to all questions I typically omit it, but you may find it helpful.  If so, use it!