Quality of Research
Review Date: September 2008
Documents Reviewed
The documents below were reviewed for Quality of Research. The research point of
contact can provide information regarding the studies reviewed and the availability
of additional materials, including those from more recent studies that may have been conducted.
Study 1Botvin, G. J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a White middle-class population. Journal of the American Medical Association, 273(14), 1106-1112.  Study 2Botvin, G. J., Griffin, K. W., Diaz, T., & Ifill-Williams, M. (2001). Drug abuse prevention among minority adolescents: Posttest and one-year follow-up of a school-based preventive intervention. Prevention Science, 2(1), 1-13. 
Botvin, G. J., Griffin, K. W., Diaz, T., & Ifill-Williams, M. (2001). Preventing binge drinking during early adolescence: One- and two-year follow-up of a school-based preventive intervention. Psychology of Addictive Behaviors, 15(4), 360-365. 
Griffin, K. W., Botvin, G. J., Nichols, T. R., & Doyle, M. M. (2003). Effectiveness of a universal drug abuse prevention approach for youth at high risk for substance use initiation. Preventive Medicine, 36(1), 1-7.  Study 3Spoth, R. L., Randall, G. K., Trudeau, L., Shin, C., & Redmond, C. (2008). Substance use outcomes 5 1/2 years past baseline for partnership-based, family-school preventive interventions. Drug and Alcohol Dependence, 96(1-2), 57-68. 
Trudeau, L., Spoth, R., Lillehoj, C., Redmond, C., & Wickrama, K. A. S. (2003). Effects of a preventive intervention on adolescent substance use initiation, expectancies, and refusal intentions. Prevention Science, 4(2), 109-122.  Study 4Botvin, G. J., Griffin, K. W., & Nichols, T. R. (2006). Preventing youth violence and delinquency through a universal school-based prevention approach. Prevention Science, 7(4), 403-408. 
Supplementary Materials Botvin, G. J., & Griffin, K. W. (2004). Life Skills Training: Empirical findings and future directions. Journal of Primary Prevention, 25(2), 211-232.
Epstein, J. A., Botvin, G. J., Diaz, T., Baker, E., & Botvin, E. M. (1997). Reliability of social and personal competence measures for adolescents. Psychological Reports, 81(2), 449-450.
LifeSkills Training: Quality of Research Overview and Summary
Macaulay, A. P., Griffin, K. W., & Botvin, G. J. (2002). Initial internal reliability and descriptive statistics for a brief assessment tool for the Life Skills Training drug-abuse prevention program. Psychological Reports, 91(2), 459-462. 
Spoth, R. L., Clair, S., Shin, C., & Redmond, C. (2006). Long-term effects of universal preventive interventions on methamphetamine use among adolescents. Archives of Pediatrics and Adolescent Medicine, 160(9), 876-882. 
Outcomes
| Outcome 1: Substance use (alcohol, tobacco, inhalants, marijuana, and polydrug) |
|
Description of Measures
|
Substance use (alcohol, cigarettes, inhalants, and marijuana) was assessed using self-report items from the LifeSkills Training questionnaire. Students were asked about the frequency and amount of substance use. Lifetime smoking, drinking, and marijuana use were assessed with items that asked if the respondent had ever used the substances (yes or no). Frequency of smoking, drinking, and marijuana use was assessed on a scale with responses ranging from "never" to "more than once a day." The amount of cigarette smoking was assessed on a scale with responses ranging from "never" to "more than a pack a day," and the amount of alcohol use was assessed on a scale with responses ranging from "don't drink" to "more than 6 drinks" per occasion. Frequency of getting drunk was assessed on a scale with responses ranging from "don't drink" to "more than once a day."
In addition, a substance use initiation scale/index was constructed by combining three dichotomous items regarding the use of tobacco, alcohol, and marijuana. Students were asked if they had ever "smoked a cigarette," "had a drink of alcohol," or "smoked marijuana." Responses were coded 0 for no and 1 for yes and summed. For each wave of data, responses were corrected for consistency, so that if an individual answered "yes" at any point in time, the subsequent response to the same question was also coded "yes."
|
|
Key Findings
|
In one study, junior high schools were assigned to one of three conditions: LST with annual provider training workshops and ongoing consultation, LST with videotaped training and no consultation, or a usual care control group. Follow-up data were collected 6 years after the intervention. This study found a significant decrease in cigarette smoking, alcohol use (drunkenness), and polydrug use (concurrent tobacco, alcohol, and marijuana use) at follow-up for the two groups of students who received LST (all p values < .05). The strongest intervention effects were observed among students exposed to at least 60% of the LST program (operationally defined as the "fidelity sample"). At follow-up, the LST fidelity sample had significantly lower rates than controls on nearly every measure of tobacco, alcohol, marijuana, and polydrug use (all p values < .05).
In another study, middle school students receiving LST were compared with a control group of students who received a program that was normally in place in New York City schools. Results at posttest and 1-year follow-up indicated that students who received LST reported less smoking, less alcohol use, less inhalant use, and less polydrug use relative to those in the control group (p values ranging from < .001 to < .05). The LST group had a 50% smaller proportion of binge drinkers relative to the control group at both the 1- and 2-year follow-up assessments (p < .05 and p < .01, respectively). In addition, among a subsample of youth at high risk for substance use initiation (participants with poor grades and friends who engage in substance use), those who received LST were found to engage in less smoking (p < .01), less drinking (p < .01), less inhalant use (p < .05), and less polydrug use (p < .01) compared with similarly matched controls who did not receive the intervention.
In a third study, 7th-grade students who received LST had a significantly slower rate of increase in substance initiation (tobacco, alcohol, and marijuana) from pretest to posttest and 1-year follow-up compared with students from a minimal contact control condition (p < .01). Five and a half years past baseline (i.e., when the participants were in 12th grade), LST participants reported significantly lower scores on the overall substance use initiation index (p < .01) as well as less cigarette use initiation (p < .05) and less marijuana use initiation (p < .05) relative to controls. When growth over time was examined in the higher risk subsample, the LST group had slower increases in the rates of frequency of marijuana use (p < .01) and monthly and advanced polydrug use (all p values < .01) compared with the control group.
|
|
Studies Measuring Outcome
|
Study 1, Study 2, Study 3
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
3.9
(0.0-4.0 scale)
|
| Outcome 2: Normative beliefs about substance use and substance use refusal skills |
|
Description of Measures
|
Normative beliefs about substance use and substance use refusal skills were assessed using self-report items from the LifeSkills Training Questionnaire. For normative beliefs, students were asked about the perceived prevalence of drug use among peers and adults, with separate items for specific substances (cigarettes, beer/wine, marijuana, cocaine or other "hard" drugs, and inhalants). Responses were on a 5-point scale ranging from 1 (none) to 5 (all or almost all).
For refusal skills, 10 items from the questionnaire were used. Five items adapted from the Gambrill-Richey Assertion Inventory assessed refusal intentions; students were asked how likely they would be to say no if someone asked them to try a specific substance (tobacco, alcohol, marijuana, inhalants, and cocaine/other drugs). Another five items assessed students' anticipated likelihood of using various refusal strategies (e.g., "tell them not now," "change the subject," "make up an excuse and leave"). For all 10 items, responses were on a 5-point Likert scale ranging from 1 (definitely would) to 5 (definitely would not).
|
|
Key Findings
|
In one study, middle school students receiving LST were compared with a control group of students receiving a program that was normally in place in New York City schools. At the 3-month posttest, LST participants reported lower normative expectations than control students for peer smoking and drinking (both p < .05) and for adult smoking (p < .05), drinking (p < .05), cocaine/hard drug use (p < .01), and inhalant use (p < .05). Similarly, at the 1-year follow-up, LST participants reported lower normative expectations than control students for peer smoking (p < .001) and drinking (p < .01) and for adult smoking (p < .01) and drinking (p < .05). LST participants also scored higher than control students on drug refusal skills at 1-year follow-up (p < .05). Significant effects on normative expectations for peer drinking were seen at 2-year follow-up, with LST participants reporting lower normative expectations than controls (p < .05).
Another study found that the rate of decrease in drug refusal skills was significantly slower from pretest to posttest and 1-year follow-up for 7th-grade students who received LST program compared with students from a minimal contact control condition (p < .01).
|
|
Studies Measuring Outcome
|
Study 2, Study 3
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
3.9
(0.0-4.0 scale)
|
| Outcome 3: Violence and delinquency |
|
Description of Measures
|
Violent and delinquent behaviors were assessed using 20 self-report items from the LifeSkills Training Questionnaire. Items related to verbal and physical aggression were adapted from Elliott, Huizinga, and Menard. Verbal aggression was measured using 7 items asking students the number of times in the past month they committed acts such as name-calling, yelling, cursing, or telling someone off. Mild physical aggression was measured using 3 items asking students the number of times in the past month they had pushed or shoved, tripped, or hit someone. Items related to fighting and delinquent behaviors were adapted from Hawkins and associates. Fighting was measured using 4 items asking students the number of times in the past year they engaged in behaviors such as picking a fight with someone or hitting someone to hurt the person seriously. Delinquency was measured using 6 items asking students the number of times in the past year they committed acts such as destroying others' property, throwing objects at people or cars, or shoplifting.
|
|
Key Findings
|
Results of a study among middle school students demonstrated significant reductions in violence and delinquency at 3-month follow-up for LST participants relative to the control group of students who received a standard heath education curriculum (all p values < .05). Stronger effects were found for students who received at least half of the LST program. These effects included decreased verbal aggression (p < .01), physical aggression (p < .01), fighting (p < .001), and delinquency (p < .05).
|
|
Studies Measuring Outcome
|
Study 4
|
|
Study Designs
|
Experimental
|
|
Quality of Research Rating
|
4.0
(0.0-4.0 scale)
|
Study Populations
The following populations were identified in the studies reviewed for Quality of
Research.
|
Study
|
Age
|
Gender
|
Race/Ethnicity
|
|
Study 1
|
13-17 (Adolescent)
|
52% Male 48% Female
|
91% White 2% Asian 2% Black or African American 2% Hispanic or Latino 2% Race/ethnicity unspecified 1% American Indian or Alaska Native
|
|
Study 2
|
13-17 (Adolescent)
|
53% Female 47% Male
|
61% Black or African American 22% Hispanic or Latino 6% Asian 6% White 5% Race/ethnicity unspecified
|
|
Study 3
|
13-17 (Adolescent)
|
52% Male 48% Female
|
97% White 3% Race/ethnicity unspecified
|
|
Study 4
|
13-17 (Adolescent)
|
51% Male 49% Female
|
39% Black or African American 33% Hispanic or Latino 10% Race/ethnicity unspecified 10% White 6% Asian 2% American Indian or Alaska Native
|
Quality of Research Ratings by Criteria (0.0-4.0 scale)
External reviewers independently evaluate the Quality of Research for an intervention's
reported results using six criteria:
For more information about these criteria and the meaning of the ratings, see Quality of Research.
|
Outcome
|
Reliability
of Measures
|
Validity
of Measures
|
Fidelity
|
Missing
Data/Attrition
|
Confounding
Variables
|
Data
Analysis
|
Overall
Rating
|
|
1: Substance use (alcohol, tobacco, inhalants, marijuana, and polydrug)
|
4.0
|
4.0
|
3.8
|
3.9
|
4.0
|
4.0
|
3.9
|
|
2: Normative beliefs about substance use and substance use refusal skills
|
4.0
|
4.0
|
3.7
|
3.9
|
4.0
|
4.0
|
3.9
|
|
3: Violence and delinquency
|
4.0
|
4.0
|
3.8
|
4.0
|
4.0
|
4.0
|
4.0
|
Study Strengths The outcome measures have excellent reliability and validity indicators and are supported by independent research. The investigators considered and controlled for confounding variables through the use of block randomization design and standardized data collections and by establishing baseline equivalence between groups. Sophisticated techniques were used to statistically account for attrition and missing data. Significant efforts were made to measure intervention fidelity, and adherence rates were high in some studies. The data analyses were appropriate for the study designs and types of data collected and support the inferences made about causal relationships.
Study Weaknesses Attrition and adherence rates to fidelity were a minor concern in some studies.
|
|
Readiness for Dissemination
Review Date: September 2008
Materials Reviewed
The materials below were reviewed for Readiness for Dissemination. The implementation
point of contact can provide information regarding implementation of the intervention
and the availability of additional, updated, or new materials.
Botvin, G. J. (1999). LifeSkills Training level one: Grades 3/4 student guide. White Plains, NY: Princeton Health Press.
Botvin, G. J. (1999). LifeSkills Training level two: Grades 4/5 student guide. White Plains, NY: Princeton Health Press.
Botvin, G. J. (1999). LifeSkills Training level two: Grades 4/5 teacher's manual. White Plains, NY: Princeton Health Press.
Botvin, G. J. (1999). LifeSkills Training level three: Grades 5/6 teacher's manual. White Plains, NY: Princeton Health Press.
Botvin, G. J. (1999). LifeSkills Training level three: Grades 5/6 student guide. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2000). LifeSkills Training teacher's manual 2. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2002). LifeSkills trainer's manual for TOT participants. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training level one: Grades 3/4 teacher's manual. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training student guide 1. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training student guide 2. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training student guide 3. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training teacher's manual 1. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). LifeSkills Training teacher's manual 3. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2004). Middle school 101: Skills for success [CD-ROM]. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2006). LifeSkills Training high school student guide. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2006). LifeSkills Training high school teacher's manual. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2006). LifeSkills Training parent program leader's guide. White Plains, NY: Princeton Health Press.
Botvin, G. J. (2008). LifeSkills: Stress management techniques [CD]. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2005). LifeSkills Training overview [CD-ROM]. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2007). LifeSkills Training fidelity checklists. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2007). LifeSkills Training outcome instruments. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2008). LifeSkills: Smoking and biofeedback [DVD]. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2008). LifeSkills Training: Elementary and middle school training materials. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2008). LifeSkills Training: High school training materials. White Plains, NY: Princeton Health Press.
National Health Promotion Associates. (2008). LifeSkills Training: Training of trainers materials. White Plains, NY: Author.
Program Web site, http://www.lifeskillstraining.com
Research articles for the training-of-trainers/technical assistance model
Readiness for Dissemination Ratings by Criteria (0.0-4.0 scale)
External reviewers independently evaluate the intervention's Readiness for Dissemination
using three criteria:
- Availability of implementation materials
- Availability of training and support resources
- Availability of quality assurance procedures
For more information about these criteria and the meaning of the ratings, see Readiness for Dissemination.
Implementation
Materials
|
Training and Support
Resources
|
Quality Assurance
Procedures
|
Overall
Rating
|
|
4.0
|
4.0
|
4.0
|
4.0
|
Dissemination Strengths Implementation materials are clear, concise, practical, and effectively targeted to multiple age groups. Initial core training, booster training, and train-the-trainer workshops are provided to support implementation. Training can be delivered on site or at open workshops across the country. Customized technical assistance is available. A comprehensive trainer certification process and an array of brief, easy-to-use outcome and fidelity tools are provided to support quality assurance.
Dissemination Weaknesses No weaknesses were identified by reviewers.
|
|
Costs
The cost information below was provided by the developer. Although this cost information
may have been updated by the developer since the time of review, it may not reflect
the current costs or availability of items (including newly developed or discontinued
items). The implementation point of contact can provide current information and
discuss implementation requirements.
|
Item Description
|
Cost
|
Required by Developer
|
|
Grade level curriculum set
|
$175-$275 depending on grade level
|
Yes
|
|
Additional student guides
|
$40-$60 for 10 depending on grade level
|
No
|
|
Elementary Program CD-ROM (available for some grade levels)
|
$45.95 each
|
No
|
|
Smoking and biofeedback DVD
|
$20 each
|
Yes (for middle school program only)
|
|
Stress management techniques audio CD
|
$10 each
|
Yes (for middle school program only)
|
|
1-day, on-site workshop
|
$200 per participant for up to 20 participants, plus travel expenses
|
No
|
|
2-day, on-site workshop
|
$250 per participant for up to 20 participants, plus travel expenses
|
No
|
|
Off-site and online trainings
|
$235 per participant
|
No
|
|
1-day, on-site consultation
|
$1,000 for up to 20 participants, plus travel expenses
|
No
|
|
Half-day, on-site consultation
|
$500 for up to 20 participants, plus travel expenses
|
No
|
|
Phone and online consultation
|
$75 per hour
|
No
|
|
Email consultation
|
Free
|
No
|
|
Pre- and posttest instruments
|
Free
|
No
|
|
Fidelity checklists
|
Free
|
No
|
Additional Information Additional resources can be accessed for free at http://www.lifeskillstraining.com. Resources include the LST Planning Workbook, grant writing support, and curriculum samples.
|
Replications
Selected citations are presented below. An asterisk indicates that the document
was reviewed for Quality of Research.
Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: Results of a three-year study. Journal of Consulting and Clinical Psychology, 58, 437-446. Botvin, G. J., Baker, E., Filazzola, A., & Botvin, E. M. (1990). A cognitive-behavioral approach to substance abuse prevention: One-year follow-up. Addictive Behaviors, 15(1), 47-63.  Botvin, G. J., Dusenbury, L., Baker, E., James-Ortiz, S., Botvin, E. M., & Kerner, J. (1992). Smoking prevention among urban minority youth: Assessing effects on outcome and mediating variables. Health Psychology, 11(5), 290-299.  Botvin, G. J., Epstein, J. A., Baker, E., Diaz, T., & Ifill-Williams, M. (1997). School-based drug abuse prevention with inner-city minority youth. Journal of Child and Adolescent Substance Abuse, 6(1), 5-20. Botvin, G. J., Griffin, K. W., Diaz, T., Scheier, L. M., Williams, C., & Epstein, J. A. (2000). Preventing illicit drug use in adolescents: Long-term follow-up data from a randomized control trial of a school population. Addictive Behaviors, 25(5), 769-774.  Botvin, G. J., Griffin, K. W., Paul, E., & Macaulay, A. P. (2003). Preventing tobacco and alcohol use among elementary school students through Life Skills Training. Journal of Child and Adolescent Substance Abuse, 12, 1-17. Fraguela, J. A., Martin, A. L., & Trinanes, E. R. (2003). Drug abuse prevention in the school: Four-year follow-up of a programme. Psychology in Spain, 7, 29-38. Griffin, K. W., Botvin, G. J., & Nichols, T. R. (2004). Long-term follow-up effects of a school-based drug abuse prevention program on adolescent risky driving. Prevention Science, 5(3), 207-212.  Griffin, K. W., Botvin, G. J., & Nichols, T. R. (2006). Effects of a school-based drug abuse prevention program for adolescents on HIV risk behavior in young adulthood. Prevention Science, 7(1), 103-112.  Spoth, R., Clair, S., Shin, C., & Redmond, C. (2006). Long-term effects of universal preventive interventions on methamphetamine use among adolescents. Archives of Pediatrics and Adolescent Medicine, 160(9), 876–882. 
|
|
|