Quality of Research
Review Date: November 2011
Documents Reviewed
The documents below were reviewed for Quality of Research. The research point of
contact can provide information regarding the studies reviewed and the availability
of additional materials, including those from more recent studies that may have been conducted.
Study 1Salloum, A., & Overstreet, S. (2008). Evaluation of individual and group grief and trauma interventions for children post disaster. Journal of Clinical Child and Adolescent Psychology, 37(3), 495-507.  Study 2Salloum, A., & Overstreet, S. (2012). Grief and trauma intervention for children after disaster: Exploring coping skills versus trauma narration. Behaviour Research and Therapy, 50(3), 169-179. (NOTE: At the time of the NREPP review, the manuscript of this article had been submitted for publication but not yet accepted.)
Supplementary Materials Baggerly, J., & Salloum, A. (2010). Deaths connected to natural disasters. In N. Boyd Webb (Ed.), Helping bereaved children: A handbook for practitioners (3rd ed., pp. 240-260). New York, NY: Guilford Press.
Salloum, A. (2008). Group therapy for children after homicide and violence: A pilot study. Research on Social Work Practice, 18(3), 198-211.
Salloum, A., Garside, L. W., Irwin, C. L., Anderson, A. D., & Francois, A. H. (2009). Grief and trauma group therapy for children after Hurricane Katrina. Social Work With Groups, 32, 64-79.
Outcomes
| Outcome 1: Posttraumatic stress symptoms |
|
Description of Measures
|
Posttraumatic stress symptoms were assessed by parents using the 22-item UCLA Posttraumatic Stress Disorder Index for DSM-IV (UCLA-PTSD-Index). Using a scale from 0 (none) to 4 (most of the time), respondents indicate the frequency of the child's symptoms, such as inability to concentrate; angry outbursts and physical fights; intrusive, distressing thoughts; guilt; diminished interest in activities; attitudes toward the future; difficulty sleeping; avoidance of trauma reminders; and distressing feelings. The instrument was administered in one study at pretest, posttest, and 3-week follow-up and in another study at pretest, posttest, 3-month follow-up, and 12-month follow-up.
|
|
Key Findings
|
In one study, children in New Orleans who reported moderate to severe levels of posttraumatic stress 4 months after Hurricane Katrina were randomly assigned to receive the intervention in either a group or individual format. Both treatment groups had a decrease in posttraumatic stress symptoms over time (p < .001). Specifically, both groups had a decrease in posttraumatic stress symptoms from pre- to posttest (p = .001) and from pretest to 3-week follow-up (p = .001). There were no significant between-group differences in posttraumatic stress symptoms.
A second study, conducted in New Orleans 3 years after Hurricane Katrina, involved children who were exposed to hurricane-related stressors and often other potentially traumatic events (e.g., community violence, death of someone close) and who had a moderate level of posttraumatic stress symptoms. The children were randomly assigned to one of two groups: one receiving the group format of the standard intervention using cognitive behavioral skill-based methods plus trauma narrative processing and one receiving the group format of the intervention using only cognitive behavioral skill-based methods. Both treatment groups had a decrease in posttraumatic stress symptoms over time (p < .001). Specifically, both groups had a decrease from pre- to posttest (p < .001), pretest to 3-month follow-up (p < .001), and pretest to 12-month follow-up (p < .001). There were no significant between-group differences in posttraumatic stress symptoms.
|
|
Studies Measuring Outcome
|
Study 1, Study 2
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
3.1
(0.0-4.0 scale)
|
| Outcome 2: Depression symptoms |
|
Description of Measures
|
Depression symptoms were assessed by parents using the 33-item Mood and Feelings Questionnaire--Child Version (MFQ-C), which assesses how a child felt or acted during the past 2 weeks. This instrument includes statements assessing suicidal ideation (e.g., "I thought my family would be better off without me" and "I thought about killing myself") and other symptoms of depression (e.g., "I felt miserable or unhappy" and "I didn't enjoy anything at all"). For each symptom, the response options are "true" (scored 2), "sometimes true" (scored 1), and "not true" (scored 0). The instrument was administered in one study at pretest, posttest, and 3-week follow-up and in another study at pretest, posttest, 3-month follow-up, and 12-month follow-up.
|
|
Key Findings
|
In one study, children in New Orleans who reported moderate to severe levels of posttraumatic stress 4 months after Hurricane Katrina were randomly assigned to receive the intervention in either a group or individual format. Both treatment groups had a decrease in depression symptoms over time (p < .001). Specifically, both groups had a decrease in depression symptoms from pre- to posttest (p = .001) and from pretest to 3-week follow-up (p = .001). There were no significant between-group differences in depression symptoms.
A second study, conducted in New Orleans 3 years after Hurricane Katrina, involved children who were exposed to hurricane-related stressors and often other potentially traumatic events (e.g., community violence, death of someone close) and who had a moderate level of posttraumatic stress symptoms. The children were randomly assigned to one of two groups: one receiving the group format of the standard intervention using cognitive behavioral skill-based methods plus trauma narrative processing and one receiving the group format of the intervention using only cognitive behavioral skill-based methods. Both treatment groups had a decrease in depression symptoms over time (p < .001). Specifically, both groups had a decrease from pre- to posttest (p < .001), pretest to 3-month follow-up (p < .001), and pretest to 12-month follow-up (p < .001). There were no significant between-group differences in depression symptoms.
|
|
Studies Measuring Outcome
|
Study 1, Study 2
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
3.1
(0.0-4.0 scale)
|
| Outcome 3: Internalizing and externalizing behaviors |
|
Description of Measures
|
The Child Behavior Check List (CBCL) for children ages 6 to 18 was used to assess parent-reported internalizing behaviors (i.e., anxious, depressive, overcontrolled) and externalizing behaviors (i.e., aggressive, hyperactive, noncompliant, undercontrolled). Using a 3-point rating scale from 0 (not true) to 2 (very true or often true), parents indicated the extent to which each item described their child's behavior within the past 6 months. The instrument was administered at pretest, posttest, 3-month follow-up, and 12-month follow-up.
|
|
Key Findings
|
A study conducted in New Orleans 3 years after Hurricane Katrina involved children who were exposed to hurricane-related stressors and often other potentially traumatic events (e.g., community violence, death of someone close) and who had a moderate level of posttraumatic stress symptoms. The children were randomly assigned to one of two groups: one receiving the group format of the standard intervention using cognitive behavioral skill-based methods plus trauma narrative processing and one receiving the group format of the intervention using only cognitive behavioral skill-based methods. Both treatment groups had a decrease in internalizing symptoms over time (p = .015) but no change in externalizing symptoms.
In additional analyses conducted using an intent-to-treat approach, both treatment groups had a decrease in internalizing behaviors over time (p < .05). In addition, there was a significant between-group difference over time on externalizing behaviors (p = .026). The group receiving the standard intervention using cognitive behavioral skill-based methods plus trauma narrative processing had a greater decrease in externalizing behaviors from pretest to 12-month follow-up (p = .044) than the group receiving the intervention using only cognitive behavioral skill-based methods.
|
|
Studies Measuring Outcome
|
Study 2
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
3.0
(0.0-4.0 scale)
|
Study Populations
The following populations were identified in the studies reviewed for Quality of
Research.
|
Study
|
Age
|
Gender
|
Race/Ethnicity
|
|
Study 1
|
6-12 (Childhood)
|
62% Male 38% Female
|
91.1% Black or African American 3.6% American Indian or Alaska Native 3.6% White 1.8% Hispanic or Latino
|
|
Study 2
|
6-12 (Childhood)
|
56% Male 44% Female
|
100% Black or African American
|
Quality of Research Ratings by Criteria (0.0-4.0 scale)
External reviewers independently evaluate the Quality of Research for an intervention's
reported results using six criteria:
For more information about these criteria and the meaning of the ratings, see Quality of Research.
|
Outcome
|
Reliability
of Measures
|
Validity
of Measures
|
Fidelity
|
Missing
Data/Attrition
|
Confounding
Variables
|
Data
Analysis
|
Overall
Rating
|
|
1: Posttraumatic stress symptoms
|
4.0
|
4.0
|
3.1
|
3.0
|
2.1
|
2.5
|
3.1
|
|
2: Depression symptoms
|
4.0
|
4.0
|
3.1
|
3.0
|
2.0
|
2.5
|
3.1
|
|
3: Internalizing and externalizing behaviors
|
4.0
|
4.0
|
3.3
|
2.3
|
2.0
|
2.5
|
3.0
|
Study Strengths For all outcome measures, reliability and validity were well documented and at acceptable levels. Clinicians completed an adherence checklist, documenting whether each planned topic was addressed, and the checklists indicated there was high adherence. The attendance rate of sessions was high. Supervision meetings were held at least weekly. Both studies employed random assignment to condition and use of multiple longitudinal data collection points. Evaluators and children were blind to treatment condition at pretest, and evaluators continued to be blind to condition through posttest and follow-up assessments. Data analyses were appropriate.
Study Weaknesses Information was not provided on the reliability and validity of the fidelity instruments. The clinicians' self-reported adherence was not corroborated by an independent observer, and sessions were not audiotaped or videotaped for review. Neither study included a no-treatment control group, raising concerns that results could have been due to nontreatment factors. In both studies, a small sample size limited data analyses.
|
|