Developing Youth Competencies: The Impact of Program Quality

Authors

  • Tegan M. Smischney University of Minnesota
  • Matthew A. Roberts University of Minnesota
  • Kate Gliske University of Minnesota
  • Lynne M. Borden University of Minnesota
  • Daniel F. Perkins Pennsylvania State University

DOI:

https://doi.org/10.5195/jyd.2018.587

Keywords:

program quality, positive youth development, youth competencies

Abstract

As youth programs have continued to evolve over the last 100 years, the field of program evaluation has advanced significantly in an effort to differentiate which youth program components are necessary to promote positive youth development (e.g., Eccles & Gootman, 2002; Lerner et al., 2013). The Children, Youth, and Families at Risk (CYFAR) initiative funds a variety of sustainable community projects (SCPs) that aim to support at-risk youth and families and help them become healthy, positive, and contributing members of society (U.S. Department of Agriculture, n.d.). To ensure these programs are meeting CYFAR’s goals, a required collection of common measures began in 2011 (University of Minnesota, 2017b). This study used CYFAR evaluation data to explore how specific program quality components (e.g. physical and psychological safety and relationship building) influence change in youth competencies. It was hypothesized that higher program quality ratings would be significantly associated with higher pretest to posttest change in youth competencies. Results indicated differential associations between the qualities of youth programs, particularly positive social norms and skill building, and changes in youth competencies. Implications for positive youth development programs are discussed.

References

Agans, J. P., Champine, R. B., DeSouza, L. M., Mueller, M. K., Johnson, S. K., & Lerner, R. M. (2014). Activity involvement as an ecological asset: Profiles of participation and youth outcomes. Journal of Youth and Adolescence, 43(6), 919-932. doi:10.1007/s10964-014-0091-1

Anderson-Butcher, D., & Cash, S. J. (2010). Participation in boys and girls clubs, vulnerability, and problem behaviors. Children and Youth Services Review, 32(5), 672-678. doi:10.1016/J.CHILDYOUTH.2010.01.002

Anderson-Butcher, D., Newsome, S. W., & Ferrari, T. M. (2003). Participation in boys and girls clubs and relationships to youth outcomes. Journal of Community Psychology, 31(1), 39-55. doi:10.1002/jcop.10036

Arnold, M. E., & Cater, M. (2011). From then to now: Emerging directions for youth program evaluation. Journal of Youth Development, 6(3), 82-94. doi:10.5195/jyd.2011.176

Borden, L. M., & Perkins, D. F. (2003). Youth program quality instrument [Measurement instrument]. Unpublished instrument.

Borden, L. M., Wiggs, C. B., Schaller, A., & Schlomer, G. L. (2012). Engaging youth in evaluation: Using clickers for data collection. Journal of Youth Development, 7(1), 147-151. doi:10.5195/JYD.2012.159

Cater, M., Arnold, M., Bouillion Diaz, L., Heck, K., Mead, J., Spears, B., . . . LeMenestrel, S. (2010a). Scale: Critical thinking [Measurement instrument]. Washington, D.C.

Cater, M., Arnold, M., Bouillion Diaz, L., Heck, K., Mead, J., Spears, B., . . . LeMenestrel, S. (2010b). Scale: Decision making [Measurement instrument]. Washington, D.C.

Cheng, H. C. H., Siu, A. M. H., & Leung, M. C. M. (2006). Prosocial involvement as a positive youth development construct: Conceptual bases and implications for curriculum development. International Journal of Adolescent Medical Health, 18(3), 393-400. doi:10.1515/IJAMH.2006.18.3.393

Dawes, N. P., & Larson, R. (2011). How youth get engaged: Grounded-theory research on motivational development in organized youth programs. Developmental Psychology, 47(1), 259-269. doi:10.1037/a0020729

Deutsch, N. L., Blyth, D. A., Kelley, J., Tolan, P. H., & Lerner, R. M. (2017). Let’s talk after-school: The promises and challenges of positive youth development for after-school research, policy, and practice. In N. Deutsch (Ed.), After-school programs to promote positive youth development (pp. 45-68). Cham, Switzerland: Springer.

DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: A meta analytic review. American Journal of Community Psychology, 30(2), 157-197. doi:10.1023/A:1014628810714

Durlak, J. A., Mahoney, J. L., Bohnert, A. M., & Parente, M. E. (2010). Developing and improving after-school programs to enhance youth’s personal growth and adjustment: A special issue of AJCP. American Journal of Community Psychology, 45(3-4), 285-293. doi:10.1007/s10464-010-9298-9

Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology, 45(3-4), 294-309. doi:10.1007/s10464-010-9300-6

Eccles, J. S., & Gootman, J. A. (2002). Features of positive developmental settings. In Community programs to promote youth development (pp. 86–118). Washington, DC: National Academy Press.

Jelicic, H., Bobek, D. L., Phelps, E., Lerner, R. M., & Lerner, J. V. (2007). Using positive youth development to predict contribution and risk behaviors in early adolescence: Findings from the first two waves of the 4-H Study of positive youth development. International Journal of Behavioral Development, 31(3), 263-273. doi:10.1177/0165025407076439

Kataoka, S., & Vandell, D. L. (2013). Quality of afterschool activities and relative change in adolescent functioning over two years. Applied Developmental Science, 17(3), 123-134. doi:10.1080/10888691.2013.804375

Kremer, K. P., Maynard, B. R., Polanin, J. R., Vaughn, M. G., & Sarteschi, C. M. (2015). Effects of after-school programs with at-risk youth on attendance and externalizing behaviors: A systematic review and meta-analysis. Journal of Youth and Adolescence, 44(3), 616-636. doi:10.1007/s10964-014-0226-4

Leos-Urbel, J. (2013). What works after school? The relationship between after-school program quality, program attendance, and academic outcomes. Youth & Society, 47(5), 684-706. doi:10.1177/0044118X13513478

Lerner, R. M. (2004). Liberty: Thriving and civic engagement among America’s youth. Thousand Oaks, CA: Sage.

Lerner, R. M. (2008a). Personal values [Measurement instrument]. Retrieved from https://cyfar.org/sites/default/files/PsychometricsFiles/Personal Values %28middle school%29.pdf

Lerner, R. M. (2008b). Social conscience [Measurement instrument]. Retrieved from https://cyfar.org/sites/default/files/PsychometricsFiles/Social Conscience %28middle school%29_1_0.pdf

Lerner, R. M., Lerner, J. V., Almerigi, J. B., Theokas, C., Phelps, E., Gestsdottir, S., … von Eye, A. (2005). Positive youth development, participation in community youth development programs, and community contributions of fifth-grade adolescents: Findings from the first wave of the 4-H study of positive youth development. Journal of Early Adolescence, 25(1), 17-71. doi:10.1177/0272431604272461

Lerner, J. V., Bowers, E., Minor, K., Boyd, M. J., Kiely Mueller, M., Schmid, K. L., … Lerner, R. M. (2013). Positive youth development: Processes, philosophies, and programs. In R. M. Lerner, M. A. Easterbrooks, J. Mistry, & I. B. Weiner (Eds.), Handbook of psychology: Developmental psychology (2nd ed., Vol. 6, pp. 365–392). Hoboken, NJ: John Wiley & Sons, Inc.

Meschke, L. L., Peter, C. R., & Bartholomae, S. (2012). Developmentally appropriate practice to promote healthy adolescent development: Integrating research and practice. Child & Youth Care Forum, 41(1), 89-108. doi: 0.1007/s10566-011-9153-7

Mincemoyer, C., & Perkins, D. F. (2001). Making decisions in everyday life [Measurement instrument]. Retrieved from http://www.humanserviceresearch.com/youthlifeskillsevaluation/

Perkins, D. F., & Borden, L. M. (2003). Key elements of community youth development programs. In F. A. Villarruel, D. F. Perkins, L. M. Borden, & J. G. Keith (Eds.), Community youth development: Practice, policy, and research (pp. 327-340). Thousand Oaks, CA: Sage.

Perkins, D. F., Borden, L. M., Keith, J. G., Hoppe-Rooney, T., & Villarruel, F. A. (2003). Community youth development: A partnership for creating a positive world. In F. A. Villarruel, D. F. Perkins, L. M. Borden, & J. G. Keith (Eds.), Community youth development: Practice, policy, and research (pp. 1-23). Thousand Oaks, CA: Sage.

Rhodes, J. E. (2004). The critical ingredient: caring youth-staff relationships in after-school settings. New Directions for Youth Development, (101), 145-161. doi:10.1002/yd.75

Roth, J. L., & Brooks-Gunn, J. (2016). Evaluating youth development programs: Progress and promise. Applied Developmental Science, 20(3), 188-202. doi: 10.1080/10888691.2015.1113879

Smith, E. P., Witherspoon, D. P., & Wayne Osgood, D. (2017). Positive youth development among diverse racial–ethnic children: Quality afterschool contexts as developmental assets. Child Development, 88(4), 1063-1078. doi:10.1111/cdev.12870

Taheri, S. a., & Welsh, B. C. (2016). After-school programs for delinquency prevention: A systematic review and meta-analysis. Youth Violence and Juvenile Justice, 14(3), 272-290. doi:10.1177/1541204014567542

U.S. Department of Agriculture. (n.d.). Children, Youth and Families at Risk (CYFAR) | National Institute of Food and Agriculture. Retrieved June 30, 2017, from https://nifa.usda.gov/program/children-youth-and-families-risk-cyfar

U.S. Department of Agriculture, University of Minnesota, & Penn State. (2016). 2016 CYFAR Annual Report. Retrieved from https://nifa.usda.gov/sites/default/files/resource/2016 -YFAR Annual Report-.pdf

University of Minnesota. (2017a). CYFAR approved common measures. Retrieved November 17, 2017, from https://cyfar.org/ilm_common_measures

University of Minnesota. (2017b). Frequently asked questions | CYFAR. Retrieved December 6, 2017, from https://cyfar.org/faqs

Walker, J. A., Gambone, M. A., & Walker, K. C. (2011). Reflections on a century of youth development research and practice. Journal of Youth Development, 6(3), 7-19. doi:10.5195/jyd.2011.172

Yohalem, N., & Wilson-Ahlstrom, A. (2010). Inside the black box: Assessing and improving quality in youth programs. American Journal of Community Psychology, 45(3), 350-357. doi:10.1007/s10464-010-9311-3

Zarrett, N., & Bell, B. A. (2014). The effects of out-of-school time on changes in youth risk of obesity across the adolescent years. Journal of Adolescence, 37(1), 85-96. doi:10.1016/j.adolescence.2013.11.001

Downloads

Published

2018-12-14

Issue

Vol. 13 No. 4 (2018)

Section

Feature Articles

License

Authors who publish with this journal agree to the following terms:

  1. The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
  2. Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
  3. The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 International License or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
    1. Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
    with the understanding that the above condition can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
  4. The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
  5. Authors are permitted and encouraged to post online a prepublication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
  6. Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
  7. The Author represents and warrants that:
    1. the Work is the Author’s original work;
    2. the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
    3. the Work is not pending review or under consideration by another publisher;
    4. the Work has not previously been published;
    5. the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
    6. the Work contains no libel, invasion of privacy, or other unlawful matter.
  8. The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.

Revised 7/16/2018. Revision Description: Removed outdated link.