Outcomes and Process Evaluation
This is a critical of aspect of the effectiveness of the VHYTC Healing and Recovery program. Evaluation allows for a more comprehensive and objective understanding of the extent to which services are effective. Outcome evaluation addresses the question, “To what extent does the Healing and Recovery progress show effectiveness and for whom? At VHYTC, we will evaluate the following outcomes…
Domain
|
Outcome
|
Measures
|
Reduced problem
symptoms |
- Abstinence from alcohol and drug use
- Reduced alcohol and drug use
- Reduced alcohol and drug symptoms
|
- Number of days using illicit drugs during past 90 days
- Number of days drinking (at least one drink vs. binge drinking) during the past 90 days
- Perceived risk for alcohol and drug effects
- Alcohol and drug symptoms
- Percent of days use with and without environmental constraints
- Confidence for change
- Readiness for change
|
Education |
- Increased involvement
in school
|
- Increased attendance
- Increased academic performance (grades)
|
Legal problems |
- Decreased or no
criminal behaviour
|
- Number of police contacts without arrests
- Number of arrests
- Number of tickets
- Time spent in juvenile detention
|
Family |
- Increased family functioning
- Decreased family conflict
- Increased quality time spent with family
- Increased parent family management practices
|
- Parental monitoring, use of discipline, and expectations for teen behavior
- Closeness and attachment between parent(s) and teen
- Number of weekly family dinners
|
Social/Peer Group |
- Decreased association with alcohol and drug involved peers
- Decreased alcohol and drug use in the peer group setting
- Increased Recovery social supports
|
- Percentage of time spent with alcohol and drug using peers
- Percentage of friends who are not alcohol and drug involved
- Percentage of time refusing offers to use alcohol and drug with peers
- Number of Recovery meetings attended
|
Retention |
- Increased retention
in treatment
|
- Number of Participants who complete treatment
- Healing and Recovery program evaluation
|
Access/Capacity |
- Number of Participants served by age, gender, race, and ethnicity
- Decrease wait list time
|
- Demographic information
- Number of days from initial phone screening to intake
|
Perception of Care |
- Satisfaction with services
- Satisfaction with employees
|
- Usefulness,
helpfulness, and relevance of services
|
The evaluation process will allow for a more comprehensive and objective understanding of the extent to which services are effective. It will also shed light on programs and practice areas that are not showing effectiveness.
In this way, evaluation challenges our program to demonstrate effectiveness while reflecting on ways to improve the design and delivery of services.
Work will continue on expanding the outcome measures to include other measureable domains.