Category Archives: Evidence based nursing

Self-Report Data: “To use or not to use. That is the question.”

[Note: The following was inspired by and benefited from Rob Hoskin’s post at http://www.sciencebrainwaves.com/the-dangers-of-self-report/]Penguins

If you want to know what someone thinks or feels, you ask them, right?

The same is true in research, but it is good to know the pros and cons of using the “self-report method” of collecting data in order to answer a research question.  Most often self-report is done in ‘paper & pencil’ or SurveyMonkey form, but it can be done by interview.

Generally self-report is easy and inexpensive, and sometimes facilitates research that might otherwise be impossible.  To answer well, respondents must be honest, have insight into themselves, and understand the questions.  Self-report is an important tool in much behavioral research.

But, using self-report to answer a research question does have its limits. People may tend to answer in ways that make themselves look good (social desirability bias), agree with whatever is presented (social acquiescence bias), or answer in either extreme terms (extreme response set bias) or always pick the non-commital middle Hypothesisnumbers.  Another problem will occur if the reliability  and validity of the self-report questionnaire is not established.  (Reliability is consistency in measurement and validity is the accuracy of measuring what it purports to measure.) Additionally, self-reports typically provide only a)ordinal level data, such as on a 1-to-5 scale, b) nominal data, such as on a yes/no scale, or c) qualitative descriptions in words without categories or numbers.  (Ordinal data=scores are in order with some numbers higher than others, and nominal data = categories. Statistical calculations are limited for both and not possible for qualitative data unless the researcher counts themes or words that recur.)

Gold_BarsAn example of a self-report measure that we regard as a gold standard for clinical and research data = 0-10 pain scale score.   An example of a self-report measure that might be useful but less preferred is a self-assessment of knowledge (e.g., How strong on a 1-5 scale is your knowledge of arterial blood gas interpretation?)  The use of it for knowledge can be okay as long as everyone understands that it is perceived level of knowledge.

Critical Thinking: What was the research question in this study? Malaria et al. (2016) Pain assessment in elderly with behavioral and psychological symptoms of dementia. Journal of Alzheimer’s Disease as posted on PubMed.gov questionat http://www.ncbi.nlm.nih.gov/pubmed/26757042 with link to full text.  How did the authors use self-report to answer their research question?  Do you see any of the above strengths & weaknesses in their use?

For more information: Be sure to check out Rob Hoskins blog: http://www.sciencebrainwaves.com/the-dangers-of-self-report/

 

 

Consistency wins! High reliability= Zero harm

priority“What’s important is not where an organization begins its patient safety journey, but instead the degree to which it exhibits a relentless commitment to improvement.” – TJC, 2016, p.68

The path to zero harm, according to TJC, begins with high reliability.   Reliability in research = consistency.  TJC says for zero harm we as providers must be consistent in these ways:

  • Never be satisfied with your safety record. Always be alert for danger
  • Be alert for early signs of potential danger. Don’t oversimplify your observations
  • Note small changes in the organization as having longer range or unintended effects
  • Commit to resilience so that when errors do happen, you bounce back quickly
  • When confronted by a threat, put its resolution in the hands of those with the most expertise in that area

Using evidence in practice can be part of our “relentless commitment to improvement,” especially when coupled with above 5 actions and can support zero harm to patients.   That evidence can be from research, from process improvement, from evaluation of clinical innovations, or from experts.

For more read TJC’s High Reliability: The Path to Zero Harm online at http://www.jointcommission.org/assets/1/18/HC_Exec_article.pdf  

Telling the Future: The Research Hypothesis

What is a research hypothesis?   A research hypothesis is a predicted answer; an educated guess.  It is a statement of the outcome that a researcher expects to find in an experimental study.Hypothesis

Why care?  Because it tells you precisely the problem that the research study is about!  Either the researcher’s prediction turns out to be true (supported by data) or not!
A hypothesis includes 3 key elements: 1) the population of interest, 2) the experimental treatment, & 3) the outcome expected.  It is a statement of cause and effect. The experimental treatment that the researcher manipulates is called the independent or cause variable.  The result of the study is an outcome that is called the dependent variable because it depends on the independent/cause variable.

For example, let’s take the hypothesis “Heart failure patients who receive exmeds2perimental drug X will have better cardiac function than will heart failure patients who receive standard drug Y.”  You can see that the researcher is manipulating the drug (independent variable) that patients will receive.  And patient cardiac outcomes are expected to vary—in fact cardiac function is expected to be better—for patients who receive the experimental drug X.

Ideally that researcher will randomly assign subjects to an experimental group that receives drug X and a control group that receives standard therapy drug Y.   Outcome cardiac function data will be collected and analyzed to see if the researcher’s predicted answer (AKA hypothesis) is true.

In a research article, the hypothesis is usually stated right at the end of the introduction or background section.

If you see a hypothesis, how can you tell what is the independent/cause variable and the dependent/effect/outcome variable?question   1st – Identify the population in the hypothesis—the population does not vary (& so, it is not a variable).   2nd – Identify the independent variable–This will be the one that is the cause & it will vary.  3rd – Identify the dependent variable–This will be the one that is the outcome & its variation depends on changes/variation in the independent variable.

PRACTICE:  What are the population, independent variable(s) & dependent variable(s) in these actual research study titles that reflect the research hypotheses:

FOR MORE INFORMATION:  See SlideShare by Domocmat (n.d.) Formulating hypothesis at http://www.slideshare.net/kharr/formulating-hypothesis-cld-handout

 

Is a Picture Worth 1,000 words?

Sometimes the best way to answer a research question is to have the participants draw pictures & explain them.  In fact, some have identified art as a powerful communication tool between children and researchers.   The pictures are then analyzed for themes that show up in the drawings.  No numbers or statistics are used.

Methods: When Brady (2009) wondered how children defined a “good nurse,” she asked 22 ethnically diverse, hospitalized girls and boys aged 7-12 years to draw a picture of a good nurse and a bad nurse.  After the children drew their pictures she asked them to tell her what the nurse was wearing and doing.

Results & discussion: What did the pictures say? Drawings and comments suggested that the children focused on these 5 thematic characteristics for a good nurse:  “communication; professional competence; safety; professional appearance; and virtues,” (p.543) such as honesty, listening, kindness, trustworthiness, & being reassuring & fun. 11-year-old Jason communicated some of it in GoodNurse_BadNurse2Figure 4 on page 552.   12-year-old Luke also showed a sharp contrast in Figure 7 on page 556 that is at the top of this blog.  Children valued a reciprocal relationship with their nurses, caring, and safe/professional behavior. Play was one of many things important to them.

Commentary: While the sample is not representative of a larger group and I would question the authors claim to use grounded theory, the study forms the basis for further research.  Additionally these ideas can help us listen more closely to our own pediatric patients.   It would be particularly interesting to compare these 5 themes to how adult patients of various ages describe a good nurse and a bad nurse.

Critical thinking:  How do you think these children’s perspectives compare with the perspectives of your own pediatric patient population?QUESTION

For more information: See Brady, M. (2009). Hospitalized children’s views of the good nurse, Nursing Ethics, 16(5). doi: 10.1177/0969733009106648

“Smile (or not). You’re on candid camera!” Patients’ covertly recording care

“What might happen if patients were to use digital devices such as smartphones to covertly record clinical encounters? Increasing reports of the practice of patient’s covertly recording clinical encounters suggest that these are no longer hypothetical questions.”(Tsulukidze et al, 2015).iphone camera2

Researchers in 2015 search Google & Google blog search engines to find written texts (excluding audio & video recordings) that were about patient covert recording of clinical encounters. They analyzed 62 texts from patients, clinicians, advocates, dentists, insurers, and lawyers. Four(4) themes emerged that represented the groups’ reactions.

  1. Such recording is a new behavior eliciting strong positive and negative reactions.  Comment –
    • e.g., “accept the prospect of covert recording as a product of the digital age and ensure that it does not work against you [clinicians]” (Contributor 3, editor, T40)
  2. Covert recording shows a lack of patient trust in providers or the system 
    • e.g.,…ALWAYS record EVERYTHING. These people [physicians] can lie, cheat and steal and act immorallyand do so regularly. (Contributor 13, T36)
  3. Through recording patients were asserting new control over and ownership of the clinical encounters.
    • e.g., When a patient seeks a consultation […], the information being processed is almost exclusively relating to the patient. Under the Data Protection Act, that data is therefore personal to the patient. By recording it, that patient is merely viewed as processing their own data. (Contributor 15, dental adviser, T42)
  4. Responses were confused & conflicting, with patients & providers seeking legal and ethical counsel about the recordings.
    • e.g., Would any of the practicing physicians here remove a patient from their care if you found out your patient was secretly recording you? (Contributor 22, physician, T30)   (Tsulukidze et al)

lightbuld among rocksCOMMENTARY: As with all qualitative studies, the value is on getting new, in-depth information on something that we know very little about, and their sample represented diverse perspectives.  A weakness is that the researchers used existing documents so that researchers couldn’t explore further and were limited to what these particular individuals chose to put out on a public site. Because RNs were not included, a parallel study of covert recording of RNs would be valuable.  RN-patient encounters are necessarily different from physician-patient encounters, and RNs have been rated by the public as the most trusted profession year after year in Gallup polls. I am unaware if anyone  knows the who, what, when, where, why, and how of covert recording of RNs.  Nonetheless, RNs should examine whether they would be comfortable with being recorded because we know that privacy standards, patient empowerment, and the proliferation of recording devices have changed.

CRITICAL THINKINGImagine that your most recent patient encounter had been recorded.  Clinically would you have done anything differently?  Ethically do you consider this right and good or wrong and bad?  Why?  Legally does your facility have and enforce policies/standards related to patients’ recording?   Whom in your facility would you go to for advice if you learned this was happening?  What are related patient privacy issues?  Should we fight against patients’ recording or assume that it will happen and find ways to make it work in provider/facility interests?  How would we do that?question

FOR MORE INFO: The FREE  full text is available at http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4416897/   Tsulukidze, et al., (2015,  May 1).Patients Covertly Recording Clinical Encounters: Threat or Opportunity? A Qualitative Analysis of Online Texts. PLoS One. 2015; 10(5): e0125824.

Stand & Deliver: Evidence for Empathy in Action

Patient Pain Satisfaction.  It’s a key outcome of RN empathy in action.CARE

Imagine that you are hospitalized and hurting.   During hourly rounds the RN reassures you with these words:We are going to do everything that we can to help keep your pain under control. Your pain management is our number 1 priority. Given your [condition, history, diagnosis, status], we may not be able to keep your pain level at zero. However, we will work very hard with you to keep you as comfortable as possible.” (Alaloul et al, 2015, p. 323).

Study? In 2015 a set of researchers tested effectiveness of the above pain script using 2 similar medical-surgical units in an academic medical center—1 unit was an experimental unit & 1 was a control unit.  RNs rounded hourly on both units.  handsOn the experimental unit RNs stated the script to patients exactly as written and on room whiteboards posted the script, last pain med & pain scores.  Posters of the script were also posted on the unit.   In contrast, on the control unit RN communication and use of whiteboard were dependent on individual preferences.  Researchers measured effectiveness of the script by collecting HCAHPS scores 2 times before RNs began using the script (a baseline pretest) and then 5 times during and after RNs began using it (a posttest) on both units.

Results? On the experimental units significantly more patients reported that the team was doing everything they could to control pain and that the pain was well-controlled (p≤.05). And while experimental unit scores were trending up, control unit scores trended down. Other findings were that the RNs were satisfied with the script, and that RNs having a BSN or MSN had no effect.

Conclusions/Implications?When nurses used clear and consistent communication with patients in pain, a positive effect was seen in patient satisfaction with pain management over time. This intervention was simple and effective. It could be replicated in a variety of health care organizations.” (p.321) [underline added]

Commentary: While an experiment would have created greater confidence that the script caused the improvements in patient satisfaction, an experiment would have been difficult or impossible.  Researchers could not randomly assign patients to experimental & control units.  Still, quasi-experimental research is relatively strong evidence, but it leaves the door open that something besides the script caused the improvements in HCAHPS scores.

questionCritical thinking? What would prevent you from adopting or adapting this script in your own personal practice tomorrow?  What are the barriers and facilitators to getting other RNs on your unit to adopt this script, including using whiteboards?  Are there any risks to using the script?  What are the risks to NOT using the script?

Want more info? See original reference – Alaloul, F., Williams, K., Myers, J., Jones, K.D., & Logsdon, M.C. (2015).Impact of a script-based communication intervention on patient satisfaction with pain management. Pain Management Nursing, 16(3), 321-327. http://dx.doi.org/10.1016/j.pmn.2014.08.008

“Oh Baby!” Evidence-based Naming Prevents Events

EBP Preventive Action:  Evidence-based, distinct infant naming can avoid sentinel events related to misidentification of newborns (TJC, 2015).

Problem:  Misidentification errors of NICU babies are common newborn3(Gray et al., 2006).   About 12% of the 4 million born in U.S. hospitals were admitted to NICU’s.  At birth every infant requires quick application of an armband, and when parents have not yet decided on a name the assigned name is often quite nondistinct (e.g., BabySmith).


Evidence:
A pretest/posttest of a new, more infant-specific naming system was “conducted in order to examine the effect of a distinct naming convention that incorporates the mother’s first name into the newborn’s first name (e.g., Wendysgirl) on the incidence of wrong-patient errors. We used the Retract-and-Reorder (RAR) tool, an established, automated tool for detecting the outcome of wrong-patient electronic orders. The RAR tool identifies orders placed on a patient that are retracted within 10 minutes and then placed by the same clinician on a different patient within the next 10 minutes” (Adelman et al., 2013). newborn2Their results? RAR events were reduced by 36.3%.   Their recommendations? Switch to a distinct naming system.

Using something like Judysgirl Smith is infant specific. “In the case of multiple births, the hospital adds a number in front of the mother’s first name (ex: 1Judysgirl and 2Judysgirl)” (TJC).

TJC recommends:

  • “Stop using Babyboy or Babygirl as part of the temporary name.
  • Change to a more distinct naming convention.
  • Train staff on the distinct naming convention.
  • Follow the recommendation in National Patient Safety Goal 01.01.01 and implement use of two patient identifiers at all times.
  • As soon as parents decide on their baby’s name, enter that name into the medical record instead of the temporary name.”

Commentary: While this is just one study, RNs should evaluate whether it is riskier to continue any current practice of non-distinct naming or to switch practices to distinct naming. No risks were identified to the distinct naming system & it likely requires only the resource investment of educating staff.  Adelman et al.’s (2013) study is current, moderately strong, quasi-experimental evidence that showed a significant decrease in errors that could have sentinel event outcomes. Any who make the switch should monitor outcomes. All who don’t make the switch should, too!

Critical Thinking: Examine the risks, resources, & readiness of staff in your facility to make the switch to a distinct NICU infant naming system?  question Should the naming system be extended to all infants?

Want more information?  See

Don’t Just Wish Upon Falling Stars: Take Evidence-based Action

The Joint Commission (TJC) published, Preventing falls and fall-related injuries in health care facilities, a new Sentinel Alert #55 on September 28, 2015 at http://www.jointcommission.org/assets/1/18/SEA_55.pdf

What’s the problem? Falls with serious injuries are among the top 10 events reported to TJC.   Analysis of that data shows that contributing factors are related to:

  • Inadequate assessment
  • Communication failures
  • Lack of adherence to protocols and safety practices
  • Inadequate staff orientation, supervision, staffing levels or skill mix
  • Deficiencies in the physical environment
  • Lack of leadership (page 1)

What to do?   Here are TJC recommendationsAction Plan

  1. Raise awareness of falls resulting in injury
  2. Establish an interprofessional falls committee
  3. Use a reliable, valid risk assessment tool
  4. Use EBP
    1. Standardized handoff including risk for falls
    2. One-to-one, bedside education of patients (& families?)
  5. Conduct post-fall management, which includes: a post-fall huddle; a system of honest, transparent reporting; trending and analysis of falls which can inform improvement efforts; and reassess the patient (page 2)

questionCritical thinking:  How would you apply AHRQ toolkit: Preventing Falls in Hospitals to your unit.

Want more info?   For tools, resources, & more details on above, see Joint Commission (2015, September 28). Preventing falls and fall-related injuries in health care facilities, Sentinel Event Alert, Issue 55.  Retrieved from Joint http://www.jointcommission.org/assets/1/18/SEA_55.pdf

“What was the question, again?” Hypothesis vs. Research question

imagesCAGYW6WBWhat is the difference between a hypothesis and a research question?  I suppose some will ask: “Why should I care?”  

The answer is that knowing the difference is a clue to how strong the research findings are.  Experimental studies that use hypothesis create stronger evidence for practice, than do non-experimental studies that merely answer research questions.

  • hypothesis is a predicted answer and focuses on cause-and-effect , such as “Those who take 80mg ASA every day will have lower incidence of MI’s than those who do not.”  When we know a lot about a topic already, then we can hypothesize (in other words make an educated guess about how the experiment will turn out).  A researcher may word the hypothesis in interrogative form with a question mark, but you can still recognize it as a hypothesis if it uses any terms like cause, effect, impact, increase, improve, or their synonyms and has at least 2 variables.
  • Researchers ask only a research question when they don’t know enough to guess about the cause and effect, & so they either 1) want merely to describe something or 2) to figure out whether 2 things are related to each other, but aren’t ready to identify one as causing the other. For example no one knows which came 1st, the chicken or the egg?—you can see that chickens and eggs are related 100% of the time, but you may win a Nobel prize if you can figure out which one originally caused the other.

Cause and effect (experimental, hypothesis) studies create stronger evidence for practice than do descriptive or correlational (non-experimental, question) studies.

Critical thinking question: One of the following is a hypothesis & one is a research question.  Which is wquestionhich and why?

  1.  The purpose of this study was to describe the expectations for pain relief of patients with abdominal pain and how their communication with providers relates to their overall pain relief. (Yee et al 2006)
  2.  We investigated whether a brief pain communication/education strategy would improve patient pain communication skills. (Smith et al, 2010)

“When Science Meets Sacred Cows”

Sometimes the scientific evidence is clear….but no one wants to change what they are doing.

Change is hard if providers, media, or members of the public are in love with keeping things the way they are, or have a vested interest in the status quo, or perhaps just don’t like change…or the evidence.  (Maybe we’re all a little guilty of this.)cow nosw

Check out this free, full-text editorial available through PubMed: http://www.o-wm.com/content/when-science-meets-sacred-cows  (Source: 2010 OWM).

Critical Thinking: What sacred cows should be put out to pasture in your or others’ practice?  What about using the Trendeleberg position to treat hypotension, checking foley balloons before insertion, other?  List a few areas where your organization HAS changed practice based on evidence.  What were the barriers & facilitators?