Research

Active Kids: evaluation protocol for a universal voucher program to increase children’s participation in organised physical activity and sport

Lindsey J Reece, Bridget Foley, William Bellew, Katherine Owen, David Cushway, Nivi Srinivasan, Phil Hamdorf, Adrian Bauman

Published 9 June 2021. https://doi.org/10.17061/phrp30122006
Citation: Reece LJ, Foley B, Bellew W, Owen K, Cushway D, Srinivasan N, Hamdorf P, Bauman A. Active Kids: evaluation protocol for a universal voucher program to increase children’s participation in organised physical activity and sport. Public Health Res Pract. 2021;31(2):e30122006. First published 2 June 2020.

  • Citation

  • PDF

About the author/s

Lindsey J Reece | SPRINTER Group, Prevention Research Collaboration, Charles Perkins Centre and School of Public Health, Faculty of Medicine and Health, University of Sydney, NSW, Australia

Bridget Foley | SPRINTER Group, Prevention Research Collaboration, Charles Perkins Centre and School of Public Health, Faculty of Medicine and Health, University of Sydney, NSW, Australia

William Bellew | SPRINTER Group, Prevention Research Collaboration, Charles Perkins Centre and School of Public Health, Faculty of Medicine and Health, University of Sydney, NSW, Australia

Katherine Owen | SPRINTER Group, Prevention Research Collaboration, Charles Perkins Centre and School of Public Health, Faculty of Medicine and Health, University of Sydney, NSW, Australia

David Cushway | Office of Sport, NSW Government, Sydney, Australia

Nivi Srinivasan | Office of Sport, NSW Government, Sydney, Australia

Phil Hamdorf | Office of Sport, NSW Government, Sydney, Australia

Adrian Bauman | SPRINTER Group, Prevention Research Collaboration, Charles Perkins Centre and School of Public Health, Faculty of Medicine and Health, University of Sydney, NSW, Australia

Corresponding author

Lindsey J Reece | Lindsey.Reece@sydney.edu.au

Competing interests

The SPRINTER research partnership is a funded partnership between the University of Sydney and the Office of Sport NSW Government.

Author contributions

LR led the design of this evaluation protocol, facilitated the research team and led the writing of this manuscript. AB and WB provided senior research, epidemiology and evaluation expertise to support the complex pragmatic evaluation design. KO led the analytical plan and BF conducted research into the validated measures used, with both supporting the drafting of the manuscript. PH, as the executive director at the NSW Government Office of Sport at the time the Active Kids program started, provided senior support for the SPRINTER partnership to evaluate the Active Kids program. Together with DC, PH shared operational details of the program required for the evaluation design and contributed this detail in the manuscript. NS helped with methodological design. All authors contributed to the drafting and editing of this manuscript.

Abstract

Background: Regular participation in physical activity during childhood and adolescence is important for good health. There is strong evidence of the physical and psychosocial benefits associated with recreational physical activity in these age groups, specifically in the context of organised sport. Most children in New South Wales (NSW), Australia, do not meet the recommended guidelines for physical activity, with financial cost commonly cited as a barrier to the initiation and maintenance of sport. The Active Kids program is a major policy initiative introduced in 2018 that aimed to overcome this barrier by implementing a statewide sport voucher scheme, allowing all NSW school-enrolled children (1.2 million) initial access to a $100 annual contribution towards organised sport and physical activity, with concurrent evaluation over the initial 4-year phase of the program.

Study type: This paper presents the protocol for evaluation of the Active Kids program, including an assessment of program impact on children’s organised sport participation and recreational physical activity level, and analysis of the correlates of participation at individual, state and national levels.

Methods: A quasi-experimental and mixed-method evaluation will be used to examine the patterns of organised sport and recreational physical activity behaviour and the correlates associated with sports participation, voucher uptake and program reach. Sociodemographic information will be collected for each child who registers for a voucher. The effects of this program on children’s health-enhancing physical activity, engagement with the sport sector, self-efficacy and social influences on participation will be monitored through a cohort study. Acceptability, engagement and experience of the voucher program will be assessed from both user and provider perspectives. Additionally, effects of the program on families’ annual sport-related expenditure will be assessed.

Results and conclusion: It is anticipated that the implementation of the NSW Government’s Active Kids program will increase participation in recreational physical activity among NSW children. The results of this evaluation will contribute to the evidence base and policy directions for sport voucher programs in Australia and internationally.

Full text

Key points

  • Active Kids, the first universal sports voucher program of its kind in Australia, is an innovative approach to promoting participation in recreational physical activity and organised sport among all children in New South Wales (NSW), Australia. Evaluation of the program presents a unique opportunity to learn about the sport and physical activity participation behaviours of children in NSW
  • Evaluation of the program will also contribute to the evidence base on how to effectively design and implement complex yet pragmatic evaluations, underpinned by evidence yet appropriate for policy makers and practitioners

Background

Regular participation in physical activity during childhood and adolescence is important for good health.1 To acquire health and wellbeing benefits, it is recommended that children participate in at least 60 minutes of at least moderate-intensity physical activity every day.2 Data from 2015 indicate that 81% of adolescents worldwide and 88% of Australian adolescents residing in New South Wales (NSW) do not meet these recommendations.2,3 Children can accumulate the requisite minutes for health in a variety of physical activity domains including active transport, recreational activities and organised sport.4 There is evidence that children’s participation in organised sport has greater psychological, social, health and cognitive benefits compared with their participation in other forms of recreational physical activity.1,5,6 Participation during childhood is also predictive of a lasting commitment to engage in sport and physical activity.7,8,9 Although Australia ranks reasonably well for children’s participation in organised sport compared with other countries10, children’s total physical activity levels are significantly lower, indicating sports participation alone does not currently generate enough minutes of health-enhancing physical activity to meet guideline recommendations. It is therefore important to understand the contribution that sport participation can make to a child’s overall physical activity profile.

A recent systematic review found a positive association between sport participation and recreational physical activity, with sport participants more likely to achieve the recommended level of moderate intensity physical activity than non-participants.11 More than half of the reviewed studies included adolescents, with the school and education sector the most frequently cited intervention setting.11 Research indicates a sport participation peak in children aged 10–1412, decreasing significantly during adolescence.13 Kjønniksen et al also found that children enrolled in a sports club during adolescence (13–16 years old) were more likely to be physically active than older children, and that engagement in multiple sports was favourably associated with an active lifestyle in adulthood.14 Adolescents involved with sport clubs report higher life satisfaction than those not involved15 and clubs provide opportunities for social interactions.16 Notwithstanding the benefits associated with sport participation and recreational physical activity, a longitudinal cross-sectional population survey of school children aged 5–16 years in NSW found that only one in five (19%) were meeting daily physical activity recommendations.3 Among those, subgroups that were less likely to meet the recommendations include girls (15% met recommendations), children from urban areas (18%) and those from Middle Eastern (13%) and Asian cultural backgrounds (9%).3

Designing effective strategies to increase recreational physical activity and sport among children is challenging due to the myriad factors influencing children’s and adolescents’ behaviour at personal, social, community and environmental levels.17 Cost, lack of parental support and a lack of local and adequate facilities are frequently cited as key barriers for children to engage in sport.18 In response, policies have been trialled that deploy financial incentives to promote children’s participation in sport and physical activity, with mixed effects. In 2007, the Canadian Government implemented a children fitness tax credit (CFTC) providing non-refundable CAD$500 (AUD$556) for eligible physical activity. Although uptake was high, with more than half of all parents claiming a voucher, the tax credit appeared to benefit the wealthier families in Canada. In contrast, a sport voucher program, ACTIVE, targeting disadvantaged communities in Wales, UK, positively influenced attitudes towards physical activity and enabled children from disadvantaged backgrounds to access broader opportunities to participate in sport and physical activity.19-21

The Active Kids program

On 31 January 2018, the NSW State Government launched the Active Kids program framework; a universal voucher program to provide annual support to parents and primary caregivers to subsidise the cost of children’s participation in sport and physical activity, over the 4-year period to December 2021. The primary objective of Active Kids is to increase participation of school-enrolled children in sport and physical activity in NSW. The program aims to reduce the barrier of sport registration cost or membership fees for after-school and weekend structured sport or physical activity, by up to AUD$100 per year per child. To promote access to organised sport and physical activity all year round, from 1 July 2019, every school-enrolled child has had access to a second voucher. The two $100 vouchers both expire at the end of each calendar year. To register for an Active Kids voucher, adults/caregivers must register online through the NSW Government online platform each year.

Eligible activities must be provided as part of an organised program of at least 8 weeks’ duration and involve moderate or vigorous levels of physical activity; these activities include recognised sports, swimming lessons, structured fitness programs, outdoor recreation programs and approved active recreation (e.g. dance).

Evaluation of the program will assess policy implementation and reach across NSW. The effects of the universal Active Kids voucher program on increasing participation in recreational physical activity and organised sport outside school will be monitored among NSW school-enrolled children. The evaluation also aims to improve understanding of the patterns of organised sport and recreational physical activity behaviour, along with assessing the correlates associated with sports participation, voucher uptake and population reach of the program. This evaluation will inform refinement and targeted components of the Active Kids program, in line with the NSW Office of Sport commitment to evidence-based delivery of the program. Secondary evaluation aims include: assessing the impact of Active Kids on social wellbeing, self-efficacy, participant’s body mass index and knowledge of the benefits of physical activity; and experiences of being engaged with the Active Kids program from the individual and delivery organisation perspectives.

Methods

Study design

A quasi-experimental and mixed-method pragmatic evaluation will evaluate the implementation and effectiveness of the Active Kids program. To achieve this, several discrete populations will be included in the evaluation, namely: all children who are registered for the program (process evaluation); all children and their parents/caregivers for whom consent to follow-up in an evaluation cohort is given (impact/outcome evaluation). An additional component will include all sports service providers registering for the program. The Active Kids program started on 31 January 2018 and will end in December 2021. This study received ethics approval from the Human Research Ethics Committee at the University of Sydney (project number: 2017/947) and is registered with Australian New Zealand Clinical Trials Registry (ACTRN12618000897268).

Process evaluation

Evaluation of population reach, voucher uptake and implementation will be performed through the collection of mandatory registration data for each participant. Mandatory data fields include participant demographic characteristics, as well as information on intended voucher use, participation data on structured sport and recreational physical activity and achievement of physical activity guidelines.

Semistructured qualitative interviews with a representative sample will be conducted to assess the experience of the accredited Active Kids’ providers being involved in the program, along with the barriers and facilitators associated with Active Kids and their perceived impact of Active Kids on their organisation. A representative sample will be assessed by geographic location, sport and active recreation providers, as well as the number of vouchers claimed within the organisation.

Impact/outcome evaluation

A nested, large subset cohort will be recruited within this evaluation to determine whether there are changes in children’s physical activity and sport participation, and health and wellbeing, after registering for an Active Kids voucher. This cohort of children will be recruited during registration for the program. Participants must register for all of their Active Kids vouchers each year online. Longitudinal data will be collected at voucher redemption, and then 8 weeks and 18 weeks after voucher redemption. This longitudinal sample will enable us to tell which children increased their activity, which children within this sample were already active or inactive, and which children come from marginalised, geographical areas with low socio-economic status. As this sample is reasonably representative of the whole Active Kids sample from which it will be drawn, the results will enable the impact of the program to be assessed. A key consideration inherent within this evaluation is the purchasing behaviour of the adult primary caregivers. Data collected from the cohort will capture expenditure on sport-related memberships in the 12-month period before data collection, which will enable assessment of any changes in adult spending before, during and after the implementation of Active Kids. We can also assess expenditure of adults by geographical location, socio-economic status, activity status, sex, age and gender.

Participant recruitment

To be eligible for an Active Kids voucher, children must be aged between 4.5 and 18 years, be enrolled in school and reside in NSW. Participants for this study will be recruited on a rolling basis during the program registration process through a bespoke online government portal. All children who are eligible for an Active Kids voucher will be eligible to participate in the evaluation, with parental/caregiver consent (Figure 1). For all children, the primary adult caregiver completes the registration process for the child.

Sample size

There were more than 1.2 million school-enrolled children who were eligible to claim a voucher on 31 January 2018. Everyone who registers for a voucher will be invited to take part in the evaluation, and they will be invited each year they register.

Data collection

The cohort study includes three email invitations to complete three online surveys, with additional reminder messages, sent close to when the Active Kids sport subsidy voucher is redeemed. All those who successfully claim their voucher are classified as ‘redeemers’. If the voucher is not used within 6 months after registration, one online invitation will be sent to this group classified as the ‘non-redeeming’ group. Figure 1 depicts the evaluation components however, in brief, all cohort participants who redeem their voucher with an eligible provider in an organised sport program will be contacted:

  • At point of redemption – pragmatically, redemption is considered to indicate the start of participation in the physical activity or sport, although this depends on providers’ organisational capacity to redeem vouchers during busy registration periods
  • 8 weeks after redemption – survey will align with the final week of participation in the voucher activity as this is the minimum threshold for a provider to be recognised as an accredited Active Kid’s provider
  • 18 weeks after redemption – follow-up surveys will assess whether physical activity is maintained after the registered activity has ended.

Figure 1. Process and outcome evaluation flow diagram (click to enlarge)

Active Kids process adn outcome evaluation flow diagram

Note:  Irrespective of survey completion, consenting participants will be invited to complete a survey at each time point, unless consent is withdrawn
a     Mandatory registration data to provide information on population reach, voucher uptake and implementation
b     Qualitative interviews to explore participants’ experience of engaging with the Active Kids program
c     Online surveys to provide information on sport-related participation, physical activity, voucher use, body mass index and global subjective wellbeing
d     Semistructured qualitative interviews to explore experience of providers being involved with the Active Kids program

Primary outcomes

Participation in organised sport and recreational physical activity

Self-report sport-related participation will be collected using select questions from the Ausplay Survey (2016), the Australian national sport sector population survey.22 These questions will provide detailed information on the frequency and duration of structured sport and physical activity sessions. This will be administered at the point of voucher registration for each child, once per year. This question is also included in the online survey sent to all cohort participants at three time points, each calendar year.

Physical activity

Physical activity is measured by self-report attainment of physical activity guidelines captured broadly using the single-item measure, which asks how many days in the past week the child was physically active for at least 60 minutes.23 This will be administered at the point of voucher registration for each child, once per year. This question is also included in the online survey sent to all cohort participants at three time points each calendar year.

Secondary outcomes

Voucher use

Motivation to engage with Active Kids will be captured along with a subjective assessment of the ease of locating places for the child to be physically active.24 Additional information will be captured on the frequency and duration of physical activities for which the voucher was used to assess the impact of the Active Kids voucher on organised sport and recreational physical activity participation. This will be assessed using validated questions which are also included within the population measurement tool; Ausplay, (2018). The economic contribution of the voucher on total annual expenditure on sport-related costs will also be assessed.

Body mass index

All voucher registrants (parents/caregivers) will be asked to voluntarily report the child’s weight and height at the point of voucher registration, which will be repeated each year. Body mass index will be calculated as weight divided by height squared (i.e., kg/m2), and categorised as below healthy weight, healthy weight, overweight or obese using the International Obesity Taskforce definitions.25

Global subjective wellbeing

Children’s global subjective wellbeing, specifically self-efficacy and enjoyment of physical activity, will be assessed using self-reported measures adapted from Motl et al.26 Social influences on children’s physical activity will also be captured.27 All measures will be assessed in cohort participants at voucher redemption, 8 weeks and 18 weeks post voucher redemption, repeated each year of registration.

Analysis

To assess if the children registered in the Active Kids program are representative of the NSW population, process evaluation data and participant outcomes from all Active Kids’ registrants will be compared with existing population health surveys, specifically comparing participants in terms of population groups and demography, weight status (NSW Population Health Survey/ABS National Health Survey); organised participation (AusPlay) and physical activity (NSW Population Health Survey/Schools Physical Activity and Nutrition Survey). All research outcomes will be stratified by registrant demographics (age, sex and weight status, recreational physical activity, organised sport status and socio-economic status) to explore their potential effect of children’s uptake of the program in NSW. Statistical multivariate modelling will explore the relationship between exposure to the voucher and changes in physical activity minutes and sessions of organised sport activity with subgroups and for the whole population adjusting for potential demographic factors.

Conclusion

Active Kids is an innovative approach to promoting participation in recreational physical activity and organised sport among all NSW children and is the first universal voucher program of its kind in Australia. This large-scale prevention policy initiative is a unique opportunity to engage with the sport and recreation sector. The population scale of the program will allow detailed examination of the reach of the Active Kids scheme, and assess any inequalities in reach, uptake or impact of the program. The campaign targets children during a key developmental period and leverages a partnership between providers and parents to affect behaviour change. This evaluation will also further understanding of the mediating factors that influence children’s participation in recreational physical activity and organised sport.

Peer review and provenance

Externally peer reviewed, not commissioned.

Copyright:

Creative Commons License

© 2020 Reece et al. This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International Licence, which allows others to redistribute, adapt and share this work non-commercially provided they attribute the work and any adapted version of it is distributed under the same Creative Commons licence terms.

References

  • 1. Eime RM, Young JA, Harvey JT, Charity MJ, Payne WR. A systematic review of the psychological and social benefits of participation in sport for children and adolescents: informing development of a conceptual model of health through sport. Int J Behav Nutr Phys Act. 2013;10:98. CrossRef | PubMed
  • 2. Global action plan on physical activity 2018–2030: more active people for a healthier world. Geneva: World Health Organization; 2018 [cited 2020 May 19]. Available from: apps.who.int/iris/bitstream/handle/10665/272722/9789241514187-eng.pdf?ua=1
  • 3. Hardy LL, Mihrshahi S, Drayton BA, Bauman A. NSW schools physical activity and nutrition survey (SPANS) 2015: full report. Sydney: NSW Department of Health; 2016 [cited 2020 May 19]. Available from: www.health.nsw.gov.au/heal/Publications/spans-2015-full-report.PDF
  • 4. Eime RM, Sawyer N, Harvey JT, Casey MM, Westerbeek H, Payne WR. Integrating public health and sport management: sport participation trends 2001–2010. Sport Manag Rev. 2015;18(2):207–17. CrossRef
  • 5. Watson A, Timperio A, Brown H, Best K, Hesketh KD. Effect of classroom-based physical activity interventions on academic and physical activity outcomes: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):114. CrossRef | PubMed
  • 6. Sævarsson ES, Svansdottir E, Sveinsson T, Asgeirsdottir TL, Arngrimsson SA, Johannsson E. Organized leisure-time sport participation and academic achievement in preadolescents. Scand J Public Health. 2017;45(8):861–8. CrossRef | PubMed
  • 7. Telama R, Yang X, Viikari J, Välimäki I, Wanne O, Raitakari O. Physical activity from childhood to adulthood: a 21-year tracking study. Am J Prev Med. 2005;28(3):267–73. CrossRef | PubMed
  • 8. Mandic S, Bengoechea E, Stevens E, Leon de la Barra S, Skidmore P. Getting kids active by participating in sport and doing it more often: focusing on what matters. Int J Behav Nutr Phys Act. 2012;9(1):86. CrossRef | PubMed
  • 9. Papaioannou A, Bebetsos E, Theodorakis Y, Christodoulidis T, Kouli O. Causal relationships of sport and exercise involvement with goal orientations, perceived competence and intrinsic motivation in physical education: a longitudinal study. J Sports Sci. 2006;24(4):367–82. CrossRef | PubMed
  • 10. Schranz N, Olds T, Evans J, Gomersall S, Hardy L, Hesketh K, et al. Muscular fitness: it’s time for a jump start. The 2018 active healthy kids Australia report card on physical activity for children and young people. Adelaide, SA: Active Healthy Kids Australia; 2018 [cited 2020 May 19]. Available from: dx.doi.org/10.25954/5b862301479a1
  • 11. Lee JE, Pope Z, Gao Z. The role of youth sports in promoting children’s physical activity and preventing pediatric obesity: a systematic review. Behav Med. 2018;44(1):62–76. CrossRef | PubMed
  • 12. Eime RM, Harvey JT, Charity MJ, Casey MM, Westerbeek H, Payne WR. Age profiles of sport participants. BMC Sports Sci Med Rehabil. 2016;8(1):6. CrossRef | PubMed
  • 13. Howie EK, Straker LM. Rates of attrition, non-compliance and missingness in randomized controlled trials of child physical activity interventions using accelerometers: a brief methodological review. J Sci Med Sport. 2016;19(10):830–6. CrossRef | PubMed
  • 14. Kjønniksen L, Anderssen N, Wold B. Organized youth sport as a predictor of physical activity in adulthood. Scand J Med Sci Sports. 2009;19(5):646–54. CrossRef | PubMed
  • 15. Zambon A, Morgan A, Vereecken C, Colombini S, Boyce W, Mazur J, et al. The contribution of club participation to adolescent health: evidence from six countries. J Epidemiol Community Health. 2010;64(1):89–95. CrossRef | PubMed
  • 16. Casey MM, Eime RM, Payne WR, Harvey JT. Using a socioecological approach to examine participation in sport and physical activity among rural adolescent girls. Qual Health Res. 2009;19(7):881–93. CrossRef | PubMed
  • 17. Dobbins M, Husson H, Decorby K, LaRocca RL. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2013;(2):CD007651. CrossRef | PubMed
  • 18. Charlton R, Gravenor MB, Rees A, Knox G, Hill R, Rahman MA, et al. Factors associated with low fitness in adolescents – a mixed methods study. BMC Public Health. 2014;14(1):764. CrossRef | PubMed
  • 19. Christian D, Todd C, Hill R, Rance J, Mackintosh K, Stratton G, et al. Active children through incentive vouchers – evaluation (ACTIVE): a mixed-method feasibility study. BMC Public Health. 2016;16(1):890. CrossRef | PubMed
  • 20. Bellew B, Young S. Voucher schemes to promote increased participation in sport and active recreation: rapid evidence review for the NSW Office of Sport. Sydney: SPRINTER Group, University of Sydney; 2017.
  • 21. James ML, Christian D, Scott SC, Todd CE, Stratton G, Demmler J, et al. Active children through individual vouchers evaluation: a mixed-method RCT. Am J Prev Med. 2020;58(2):232–43. CrossRef | PubMed
  • 22. Australian Sports Commission. AusPlay participation data for the sport sector: summary of key national findings October 2015 to September 2016 data. Australian Government: Canberra, Australia; 2016 [cited 2020 May 19]. Available from: www.clearinghouseforsport.gov.au/__data/assets/pdf_file/0007/762136/34648_AusPlay_summary_report_accessible2.pdf
  • 23. Prochaska JJ, Sallis JF, Long B. A physical activity screening measure for use with adolescents in primary care. Arch Pediatr Adolesc Med. 2001;155(5):554. CrossRef | PubMed
  • 24. Sørensen K, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, et al. Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q). BMC Public Health. 2013;13(1):948. CrossRef | PubMed
  • 25. Cole TJ, Lobstein T. Extended international (IOTF) body mass index cut-offs for thinness, overweight and obesity. Pediatr Obes. 2012;7(4):284–94. CrossRef | PubMed
  • 26. Motl RW, Dishman RK, Trost SG, Saunders RP, Dowda M, Felton G, et al. Factorial validity and invariance of questionnaires measuring social-cognitive determinants of physical activity among adolescent girls. Prev Med. 2000;31(5):584–94. CrossRef | PubMed
  • 27. Hume C, Ball K, Salmon J. Development and reliability of a self-report questionnaire to examine children's perceptions of the physical activity environment at home and in the neighbourhood. Int J Behav Nutr Phys Act. 2006;3(1):16. CrossRef | PubMed