scieee AI-readable full text Open interactive document viewer

What Can You Achieve in Eight Years? : A Case Study on Participation, Effectiveness, and Overall Impact of a Comprehensive Workplace Health Promotion Program

Äikäs, Antti Hermanni,Absetz, Pilvikki,Hirvensalo, Mirja Hannele,Pronk, Nicolaas P.

Full text

This is a self-archived version of an original article. This version may differ from the original in pagination and typographic details. Author(s): Title: Year: Version: Copyright: Rights: Rights url: Please cite the original version: CC BY 4.0 https://creativecommons.org/licenses/by/4.0/ What Can You Achieve in Eight Years? : A Case Study on Participation, Effectiveness, and Overall Impact of a Comprehensive Workplace Health Promotion Program 2019 The Author(s) Published version Äikäs, Antti Hermanni; Absetz, Pilvikki; Hirvensalo, Mirja Hannele; Pronk, Nicolaas P. Äikäs, A. H., Absetz, P., Hirvensalo, M. H., & Pronk, N. P. (2019). What Can You Achieve in Eight Years? : A Case Study on Participation, Effectiveness, and Overall Impact of a Comprehensive Workplace Health Promotion Program. Journal of Occupational and Environmental Medicine, 61(12), 964-977. https://doi.org/10.1097/JOM.0000000000001699 2019 What Can You Achieve in 8 Years? A Case Study on Participation, Effectiveness, and Overall Impact of a Comprehensive Workplace Health Promotion Program Antti Hermanni A ¨ika ¨s, MSc, Pilvikki Absetz, PhD, Mirja Hannele Hirvensalo, PhD, and Nicolaas P. Pronk, PhD Objective: The aim of this study was to investigate participation and effectiveness of a multiyear comprehensive workplace health promotion (WHP) program. Methods: Participation and effectiveness data came from employer and vendor systems. Health data came from health risk assessments (HRA) and biometric screenings. Participation and effectiveness were analyzed using descriptive analyses, ttests, and Mann–Whitney Utests where appropriate. Overall impact was assessed using the PIPE Impact Metric. Results: Eighty-six percent of employees completed the HRA and 80% the biometrical screenings. Annual participation rate was 24%, and total reach was 58%. The portion of successful participants was 23% in 2010 to 2013 and 18% in 2014 to 2017. PIPE Impact scores were 18% for 2010 to 2013 and 14% for the 2014 to 2017 study periods. Conclusion: Despite modest annual participation rates, overall 8-year reach was considered reasonable. Conservatively, we consider the overall program impact to be moderate. Keywords: effectiveness, implementation, participation, program design, program evaluation, workplace health promotion Abest practice worksite health promotion (WHP) program is a synthesis of an evidence-based design process, a cost-efficient implementation with ongoing evaluation, an engagement of an organization and its management and employees, and a successful process or support toward behavioral change, which in all leads to better health and productivity outcomes at an individual and company level. 1–6 Participation is a crucial element for a successful program to gain eligible health effects. 6–8 Therefore, WHP programs should seek high participation levels. Descriptively, in a North American survey almost all US (89%) and Canadian (87%) employers (n¼335) state employee health and productivity as core components of their organizational health strategy, yet participation rates can be low in disease management or smoking cessation programs, often falling below 20%. 9 The participation rates reported in systematic reviews vary a great deal. In a review of 24 studies, Bull et al found a wide range of participation rates between 8% and 97%, with a median of 61%. 10 More recently, Robroek et al documented participation rates between 10% and 64% and a lower median of 33% in programs aimed at physical activity and/or nutrition. 8 Even if single long-term programs have documented participation rates of over 70%, 11,12 participation levels in WHP interventions tend to remain below 50%. 8–10 The large variation among single studies may be explained by different employer sizes, mixed service contents, and varied duration and incentive usage, but also by the definition of participation. 8,13 Some studies define the employees’ intention to attend a program as participation, whereas others interpret an entry into a program as participation, and yet others define it only as long-term adherence. 8,13 It has been suggested that participation rates of completing a health risk assessment (HRA) should be investigated separately from attendance into the program’s services. 8 A mean participation rate of 57% (44.2% to 75%) for baseline HRA was calculated in a review of 37 studies. 14 In North America, average participation in biometric screenings was reported to be 45% with incentives and 25% without incentives. 9 One of the highest HRA rates have been achieved in the Johnson & Johnson multiyear program, where 76% of the eligible employees completed a health assessment both at baseline in 2002 and at follow-up in 2007. 12 This high participation rate and well-engaged population was largely a result of a significant financial incentive. 12 Research shows that incentives can push HRA participation from a 20% to 40% level to a level of 70% to 90%. 15,16 The authors of the North American survey suggested that incentives are clearly effective in boosting a relatively simple action or task, such as completing an HRA, but financial incentives might not be enough to drive people to participate in programs that aim for long-lasting health behavior change. 9 Initial participation rates lose their value, if dropout rates are high. 17 Success in WHP efforts demands adherence that generates a sufficient number of participants with improved health. 6,18,19 In an HRA review, Soler et al noted that the median retention rate for HRAs was 79%, meaning that every fifth employee dropped out before the follow-up assessment. 15 In a review of 32 studies by Marshall et al, most of the physical activity interventions achieved retention rates from 51% to 63%. 17 Long-term participation analyses are very rare, but one incentive-based WHP program revealed that participation rates lowered from 43% to 37% during 7 years, and 30% of the employees enrolled in the program continuously. 20 From the Faculty of Sport and Health Sciences, University of Jyva ¨skyla ¨, Mikkeli, Finland (Mr A ¨ika ¨s); University of Eastern Finland, Institute of Public Health and Clinical Nutrition, Head of Research and Development, Provention Ltd., Finland (Dr Absetz); Faculty of Sport and Health Sciences, University of Jyva ¨skyla ¨, Mikkeli, Finland (Dr Hirvensalo); HealthPartners Institute and Chief Science Officer, HealthPartners, Minneapolis, Minnesota (Dr Pronk). Funding: Metsa ¨miesten sa ¨a ¨tio ¨, Finland, supported financially the manuscript writing process. Urheiluopistosa ¨a ¨tio ¨, Finland, supported financially the data collection and analysis. Conflicts of interest: AA ¨is an employee of 4event Ltd, which designed and implemented the study’s worksite health promotion program. PA has kept two single team workshops for 4event Ltd during 2013 to 2015; the participants (10 to 20 persons) were employee of Stora Enso Metsa ¨. Other authors: None declared. Consultant Jouni Lahti, PhD, Adjunct Professor in the University of Helsinki: None declared. Supplemental digital contents are available for this article. Direct URL citation appears in the printed text and is provided in the HTML and PDF versions of this article on the journal’s Web site (www.joem.org). Clinical significance: High participation rates (80%) can be achieved in health risk assessments also without incentives. Eight-year worksite health promotion program (WHP) achieved reasonable total reach and moderate health impact, despite modest annual participation. Study’s findings agree with earlier literature, suggesting that comprehensive WHP programs can promote lifestyle changes and health improvements. Address correspondence to: Antti Hermanni A ¨ika ¨s, MSc, Faculty of Sport and Health Sciences, University of Jyva ¨skyla ¨, Hauskankatu 1b, 50100 Mikkeli, Finland ([email protected]). Copyright ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. DOI: 10.1097/JOM.0000000000001699 964 JOEM Volume 61, Number 12, December 2019 ORIGINAL ARTICLE Another 7 year’s investigation reported a total reach of 48%, but not dropout rates. 21 A few simple reasons for the 20% to 40% dropout rate may be directly related to the workplace context. First, staff is not stationary, employees change jobs, business units and workplaces or they retire. 6,9 Across all employee groups, turnover rates can range from 2% to 46%. 22 According to a recent study, the annual average turnover rate was 22% in the United States and 20% in Canada. 23 The more the workforce switches, the more likely the decrease is in long-term adherence. 4 Second, health screenings are usually offered to all employees, but ‘‘the need’’ for actual health promotion services reflects a smaller proportion of the staff. 18,24 In a health risk reduction study, 13% of the participants were in a high risk group, 31% in a moderate risk group, and 56% in a low risk group. 18 Considering this context, expecting to reach a high participation rate only from the employees who are at a moderate or high risk group may be overly optimistic. Previously, some employee characteristics have been identified as being associated with participation, such as being familiar with health behavior and its benefits, concern for one’s health, having a positive attitude toward the program, being ready to make changes, and giving high priority to the expected outcomes. 24,25 Furthermore, women tend to participate more often than men, nonsmokers more often than smokers, white-collar workers more often than blue-collar workers, employees with day jobs more often than shift workers, and employees with secure jobs more often than part-time or temporary workers. 8,11,25 It is not unexpected that employees with weaker intentions participate less. 8 Unfortunately, employees with more severe health risks, such as an abnormal body mass index (BMI), are the least likely ones to participate. 12,14,26,27 Programs that consist of several components have a moderate level of services, and programs where participation is possible during working hours are expected to have higher participation rates than those which have a minimal number of services, and where the events take place outside work. 8,28 To summarize the literature findings on participation, the participation rates can exceed 50% for HRAs, but tend to decrease or stay below 50% during intervention and long-term monitoring. 8,14,20,21 Positive intentions and beliefs, as well as support received from peers, managements, and the environment, function as facilitators, whereas the factors related to time, health, and the job tend to function as barriers. 8,24,25,27–29 Although important, participation alone is not sufficient to produce population impact, but needs to be complemented with effective program strategies. 29 Changes in behavior and improvement in health on an individual level are necessary drivers for a program to be overall successful and effective. 5,30 Several reviews have evaluated effectiveness of WHP programs from different types of perspectives. Soler (2010) evaluated programs including HRA, feedback, and a short-term (<1 year) intervention component (eg, health education, enhanced access to physical activity) and showed meaningful positive effect on a wide range of outcomes including decrease in tobacco use, alcohol use, seatbelt nonuse, dietary fat intake, blood pressure, cholesterol, health risk estimates, worker absenteeism, and health care service use, but not on fruit and vegetables intake, body composition, and cardiorespiratory fitness. 14 Two systematic reviews evaluating physical activity interventions at workplace revealed modest effects at best on physical activity behavior, 31,32 as well as on fitness, lipids, work attendance, and job stress. 32 In a systematic review, comprehensive WHP programs with duration ranging from few months up to 7 years, Osilla et al observed mixed results regarding the programs’ impact on health-related behavior, substance use, physiological markers, and costs. 33 They also found that the evidence on absenteeism, incentive usage, and mental health was insufficient. 33 In a systematic review of RCTs, where maximum duration was 2 years, the overall effect of the programs was perceived to be small but positive across work-related outcome measures such as perceived health, absence due to sickness, productivity at work, and workability. 34 Notably, effects were larger among younger populations and in interventions with weekly contacts, and smaller in studies which met the criteria of high-quality RCTs. 34 To summarize earlier literature, WHP programs can generate improvement in health behavior and in health parameters, reduce absenteeism, and thereby produce positive financial return for the employer, 14,32,34,35 but clearly not all WHP efforts have been successful. 30,31,33 Furthermore, very little is known about the long-term effectiveness of WHP programs, although a 7-year study reported savings from diminished health care costs and absenteeism, 20 a voluntary incentive-based program noted improvements in risk factors during 7 years of follow-up 21 and a 6-year program yielded positive changes in health risks and ROI. 12 Multiyear participation and effectiveness analyses are rarely reported in the literature. 12,20,21 Therefore, the purpose of this study was to analyze participation levels of a comprehensive WHP program that lasted for 8 years (hereafter referred to as ENSO). The annual participants of the ENSO program were reported from the whole study population period and separate analyses were completed for three different health status groups (poor, moderate, good). In addition, cumulative 8-year participation analyses were done to represent the total reach of ENSO. Earlier, ENSO was analyzed from a design and implementation perspective using the 4-S and Best Practice Dimensions developed by Pronk, 2,36 and the content and implementation of the program’s first 4 years were described in more detail. 37 In this study, we present a detailed description of the latter half of the ENSO program. The current study also pivots the evaluation perspective to observe ‘‘the generated returns of the program.’’ To report ENSO’s effectiveness, an analysis of successful participants and a comparison of characteristics of successful and unsuccessful participants were completed between the years 2010 to 2017, and separately for 2010 to 2013 and 2014 to 2017. In addition, the overall program impact was quantified using the PIPE Impact Metric Model based on target population penetration, implementation, participation, and effectiveness data. 36,37 METHODS Study Design This case study focuses on a multiyear implementation of a WHP in a single company, with a retrospective quasi-experimental study design without a control group at three different measurement points in 2010 to 2011, 2013 to 2014, and 2016 to 2017. In the area of health promotion, experimental and quasi-experimental designs are suitable for questions on the effectiveness outcome. 38 The participation and effectiveness analyses according to the PIPE Impact Metric Model by Pronk were carried out to reflect the generated health returns of the multiyear WHP executed in a real-world setting. 36 This model has been described in various levels of detail in previous discussions related to research translation, 36,39 a systems approach and its dissemination and implementation in a real-world setting, 36,39–41 and it has been used in evaluating diabetes prevention interventions 42–44 and physical activity programs. 36,45 Intervention Stora Enso Metsa ¨,the employer, implemented a health promotion program (ENSO) in Finland as part of their global reThink transformation process starting in 2010 and lasting until 2017. The ENSO program can be classified as a comprehensive program, including all five elements that are based on the Healthy JOEM Volume 61, Number 12, December 2019 Eight-year Outcomes of Worksite Health Promotion ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. 965 People 2010 definition: health education, supportive environment, integration into organization’s structure, linkage to related programs, and worksite screening. 46 The employer is a wood supply company, and its main business is to buy, harvest, and transport wood for Stora Enso mills throughout Finland. At the time, the employer had altogether over 100 company business units nationwide. Employees of Stora Enso Metsa ¨were the participants of the program; subcontractors and family members were excluded. The ENSO program was a tailored version of a comprehensive WHP concept produced by the provider of the program, 4event Ltd. As a theoretical foundation, ENSO deployed the transtheoretical model (TTM) and a mixture of different behavioral change techniques, such as self-monitoring and motivational interviewing. 37,47,48 ENSO was executed in practice by the service provider’s head coach and approximately 30 wellness coaches and professionals. The wellness professionals had at least a Master’s degree and the coaches at minimum an undergraduate educational degree in either nutrition, physical education, health sciences, or coaching. The program management was shared mostly between human resources executives and the provider. A mutual pension company and occupational health care units were informed about the program, but they were not involved in the design or implementation processes until the very last year. The main goal of the program was to improve the health and well-being of every employee. Altogether 27 different services took place from 2010 until 2013. The main aim of these services was to support low-effort, pleasant lifestyle changes and to create a positive health conception rather than a negative one. It is noteworthy that the emphasis of the services shifted in 2014. More services and tools were established to maintain and improve the workplace climate and stress management, as well as to strengthen mental resources from 2014 until 2017, whereas less targeted services related to nutrition, physical activity, and lifestyle were offered than during the first half. During these last 4 years, 49 different services were implemented. During its entire 8-year-long period, ENSO consisted of altogether 76 different services, three assessments of health risks, and seven annual WHP events, and it contained several communications materials such as the Vitality Book (2011) and six Service Books (2012 to 2017). A flowchart of the program during the years 2014 to 2017 is presented in Figure 1, and a more detailed information about the years 2009 to 2013 has been published earlier. 37 ENSO had six main components during its 8-year period. First, assessments of health risk with feedback were made available for all employees at three different time points, 2010 to 2011, 2013 to 2014, and 2016 to 2017. The assessment consisted of biometrical measurements and a HRA questionnaire. Biometrical screening was executed using a mobile Polar Body Age clinic, which was transferred into different locations to meet the employees. 49,50 As a second main component, based on the results of the HRA and biometrical screening, participants were offered targeted services of the 4event WHP concept. Support for lifestyle change was categorized into three different subgroups of health and fitness status: poor,moderate, and good. The participants were classified into the groups according to their Body Age measurement results. The result of the measurement is expressed as plus or minus years to be added to or reduced from the person’s actual age. The result of the poor health status group was þ6 years or higher, the moderate health status group between þ1 and þ5 years, and the good health status 0 year or less than person’s own age. Furthermore, if an HRA participant was identified with a risk behavior or health risk (such as poor health status, physical inactivity, overweight, stress, functional insomnia, or fatigue), a coach invited the respondent to participate in suitable targeted service. Notably, the strongest life change support was offered to the population of poor health status with limited coaching places. Employees with moderate health status were encouraged to participate in group sessions with moderate support, and employees with a good health status were offered group services with minimal lifestyle change support. The invitation outreach protocol included phone calls, text messages, group or individual emails depending on the size of the group, and reachability and data protection necessities of a service. Robust incentives were not used to promote participation into HRAs or other services. However, employees were free to attend some of the services during paid working hours. The third main component of ENSO was that it had services that were offered to all employees. These included annual WHP events, open webinars, and hiking trips in Europe. In addition, the provider started local group coaching sessions in 16 locations in 2017. As a fourth component, to ensure local awareness to the program within a widely dispersed organization, a playmaker network was established in 2011. Playmakers were nonmanagement employees volunteering to be trained by the provider to assist in the implementation and communications processes of ENSO. A playmaker was asked to promote well-being in their own local area. Every year they had their own list of tasks such as to enhance participation, promote workplace climate, or organize local loweffort sport events. A single playmaker was responsible for 15 to 30 employees, so to cover the entire staff, there were annually 23 to 28 playmakers in total. With the help of the employer, the provider introduced several communication solutions, including home mailings, posters, a website, an intranet, service flyers, targeted phone calls, emails, Skype meetings, and electronic registration processes. This can be seen as the fifth main component of ENSO. It represented a communication strategy based on multichannel information to make the program as available and visible as possible to the employee audience. Ongoing program management was ENSO’s sixth component. This was a shared responsibility between the HR executives and representatives of the provider. Based on user experience, feedback, assessments of health risks, and the process evaluation reports, the provider planned the program’s annual solutions and its continuum, and the HR executives made the final decisions. After reaching an agreement, the provider implemented the program. As stated in the design evaluation of ENSO, the process was lacking a plan for long-term sustainability, 37 and both parties were willing to optimize efficiency related to administrative work. As a result, to support the program management, the provider nominated a ‘‘head coach’’ to maintain the process, and deployed a customer relationship management system (CRM) to help with the management. In 2017, the service provider, the occupational health care provider, the mutual pension company, and the HR established a collaborative steering group which showed positive impact toward stronger cooperation at the end of the program. Participants The ENSO program and the assessments of health risk were made available for the whole staff of Stora Enso Metsa ¨. Subcontractors were not involved. In the over 100 offices, most of the employees were executives, local forest officers, organization officials, and lumberjacks, whereas the staff in the working stations connected into Stora Enso’s eight paper mills consisted of terminal workers. Statutory labor negotiations took place twice during the intervention. First, a new organization was established in 2013 to 2014 and as a result the totalnumber of employees declined. After 2014, the local forest officers in Western Finland and the lumberjacks were no longer part of theorganization. The second negotiation in 2017 did not have a major influence on the study population. Hence, the total number of employees decreased from 2010 to 2017 as follows: 651, 634, 630, 625, 530, 526, 523, and 523. Employees, who did not take part in HRAs or biometrical screenings (10% at baseline, 20% at the first follow-up, and 13% at the second follow-up), still retained access to the services during the whole program period of 2010 to 2017. A ¨ika¨s et al JOEM Volume 61, Number 12, December 2019 966 ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. FIGURE 1. A flow chart of the program during 2014 to 2017. T ¼Targeted service for specific population based on location or content of the service; A ¼Service was available for all employees (see reference 37 for flow chart for the years 2009 to 2013). JOEM Volume 61, Number 12, December 2019 Eight-year Outcomes of Worksite Health Promotion ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. 967 Data Collection There are a variety of ways to define participation, such as estimating intentions to use services or applications, enrolling into HRAs and into single services, completing coaching programs, and participating in self-care activities. 6,24 In this study, participation was defined as actual attendance at the activities that were implemented. The intention to participate or cases where an employee registered to a service but never took part were excluded. Information on participation wascollected either from e-registration lists or from scanned lists of the participants’ names. The data about contacts (face-to-face vs e-contacts; group vs individual; total) were gathered by combining the data of actual attendance and the ordered number of contacts based on the provider’s annual service books and orientation materials for the coaches. Each attendance to a service accumulated the contact data, which was used also in the effectiveness analysis. Dropout rates from single services could not be used in this study, due to the fact that the majority of the services were executed face-to-face (f2f), and a separate list for those participants who left the service earlier than expected was not established by the employer or the service provider. In addition, registration to webinars and Skype meetings, as well as to the playmakers’ local events, was more difficult to define, and this information was lost during the data collection. Therefore, the final participation data in our analysis were conducted along a priori defined parameters. The final element of the PIPE Impact Metric Model is effectiveness. According to Pronk (2003), effectiveness refers to the rate of successful participants. 36 Effectiveness should be considered in the context of a program conducted in a real-world setting, and the criteria for success should be defined as part of the design phase: what is planned to be achieved? 36 Furthermore, criteria for success should be closely related to the design phase and to the program’s ability to generate expected outcomes. Aziz et al, for example, associated the effectiveness of diabetes prevention programs with three main criteria: weight loss, diabetes risk reduction absolute, and relative. 42 According to earlier findings of the ENSO program, 37,51 the primary targets of the program were to support lifestyle changes, improve health metrics, and over time improve the health status of the people in poor or moderate health status groups. Based on these factors, participants were considered to be successful if they met two clear criteria. First being that the person answered YES to the question ‘‘Have you made a lifestyle change during the program?’’, and chose at least one from a list of nine lifestyle change options. The options were (1) I’m eating better quality fatty acids. (2) I eat more vegetables, salads, berries and fruits. (3) Nowadays, I enjoy a decent breakfast and lunch. (4) I have decreased the amount of high-caloric drinks and delicacies. (5) I have increased endurance training such as skiing, swimming, Nordic walking, cycling. (6) I have increased muscular fitness training such as gym, water aerobics, circuit training. (7) I have increased my everyday exercise. (8) I have decreased the use of alcohol. (9) I have cut down on smoking. Second, the person’s biometric health parameters had to be improved based on the Body Age biometric screening. The answers to the question about life change were collected with an HRA questionnaire 52 at the same time with the Body Age biometrical screenings. In 2016 to 2017, employees who were not able to attend biometrical screenings filled the HRA questionnaire via a web-based survey tool. The questionnaire was a combination of questions from an annual national survey Health Behaviour and Health among the Finnish Adult Population (physical activity, habits), 53 Polar Body Age test protocol (testing safety), the stages of change transtheoretical model, 47 the employer’s own questions (background information), and the provider’s own questions (vitality, weight management, musculoskeletal disorders). 52 The questionnaire also assessed absences due to musculoskeletal disorders, but not information concerning to health care costs or occupational health care usage. 52 The data on health improvement was based on the Body Age measurement. The Body Age method is a technology-aided testing system, primarily targeted for use in fitness and health-related environments to motivate individuals to be physically active and to improve their overall well-being 49,50 and it was chosen by the provider to renew employer’s physical health testing pattern. 51 It contained five physiological factors and four performance factors. 49,50 The five physiological factors were body mass index, body fat percentage, systolic blood pressure, diastolic blood pressure, and VO 2 max. The four performance factors were number of crunches in 60 seconds, a leg endurance test, a bicep curl, and a sit-and-reach test. As a summation of each of these performance tests, the BodyAge system calculated the Body Age value, where poor health parameters increased the body age and good or excellent values decreased it. An example of two different Body Age values for same-aged males, is given in Figure 2. The method had been tested in a RTC study and more detailed descriptions of the measurement protocol and the Body Age calculation had been published earlier. 49,54 The Body Age value was calculated if a participant had at least four out of five physiological factors measured. 49 In this study, the health improvement was categorized as positive, if an employee succeeded to improve the overall evaluation of their Body Age. For example, if a participant had a result of þ5 years in the baseline measurement and 2 years in the follow-up, the health improvement was counted as positive. If the Body Age stayed the same or got higher, it was considered as negative. Most of the participation and effectiveness data were gathered as part of the service provision by the provider. To reduce potential bias in the data collection, the data resources, the participation lists, and the participation data collection were double-checked by an external WHP professional (PhD, Adjunct Professor at the University of Helsinki). Data Analysis Data on participation and effectiveness were analyzed from the whole program continuum 2010 to 2017. Descriptive statistics including frequencies, means, standard deviations, and percentages were used in reporting the characteristics of the study population and trends in participation. Participation percentages were calculated by dividing the number of actual attendants by the annual amount of employees. Additional participation analyses were conducted to represent the flow and accumulation of participation in the three different health status groups during the whole program. In these analyses, only those employees who took part in both the annual WHP event and the targeted services during the same year (hereafter referred to as BOTH group) were included. Effectiveness analysis included those employees who completed two HRAs andbiometrical screenings either between 2010 and 2017, 2010 and 2013 or between 2014 and 2017. To analyze the effectiveness rate among employees, a comparison of characteristics of successful and unsuccessful participants was conducted. The dichotomous variables were presented in percentages: life change (yes/no), health status (poor, moderate, good), gender, and personnel group, whereas continuous variables were presented in means and standard deviations. Statistical comparisons between age, Body Age change, and participation information were carried out by using the t test and the Mann–Whitney Utest, as appropriate. A difference between the variables was considered statistically significant at a standard P0.05. All analyses were carried out using the IBM SPSS Statistics version 24.0 for Windows. Finally, to complete the impact analysis, the total calculation of the PIPE Impact Metric score was calculated separately for the years 2010 to 2013 and 2014 to 2017 as follows: penetration implementation participation effectiveness. 36 To estimate the penetration rate, both the provider and the employer gave their own independent evaluations about the amount of employees reached with invitations and communication materials, and the final penetration rate was an A ¨ika¨s et al JOEM Volume 61, Number 12, December 2019 968 ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. average of these two evaluations. The implementation coefficient represents the rate of implemented actions compared with the rate of planned actions. 36 The data for this factor were calculated similarly to A ¨ika ¨s et al by comparing the provider’s annual budgets with the executed actions marked in the provider’s CRM database. 37 A coefficient for the participation was calculated by dividing the number of participants with the proportion of the target population that was reached with invitations (penetration). 36 In this study, the participationvalue forthe PIPEImpact Metric’s analysis was a sum of BOTH participants. More specifically, the value for the years 2010 to 2013 represents the accumulative sum of participants who had participated in at least once into WHP event and targeted service either in 2011, 2012, or 2013. The participation rate for theyears 2010 to 2017 and 2014 to 2017 was calculated the same way. In calculating the effectiveness coefficient, the number of individuals who met the two success criteria of the programwereused as thenumerator and the participation value was the denominator. 36 Ethical Issues The employer and all the employees provided an informed consent for the program evaluation study. The protocol of the study with an informed consent form was included in the HRA remapping questionnaire both in 2013 to 2014 and in 2016 to 2017 and given to each employee. Participation in the study, as well as giving authorization to use earlier HRA and biometrical screening results and participation history, was voluntary. The data and the material related to the participation and effectiveness components of ENSO were retained carefully by the researcher. The study was conducted according to the ethical principles of the University of Jyva ¨skyla ¨and the research guidelines provided by the National Advisory Board on Research Ethics in Finland. 55 RESULTS Participation in Assessments of Health Risk and Population Characteristics The descriptive statistics of the representative sample of those who participated in the HRA and biometrical screenings during the program are shown in Table 1. Participation in the baseline HRA questionnaire was 90%, 80% for the first follow-up, and 87% for the second follow-up (average 86%). The corresponding values for biometrical screenings were 90%, 80%, and 69% (average 80%). Both average participation rates were high. Most of the biometrical screening attendants were categorized into good health status group, 40% at the baseline, 47% at the first follow-up, and 51% at the second. The rates for moderate health status group at these assessment times were 29%, 29%, and 25%, respectively, and 31%, 24%, and 24% for poor health status, respectively. From a human resource perspective, all personnel groups were represented in the HRAs, although the number of lumberjacks decreased in 2013 and none of them was a part of the company after 2014 due to structural changes in the organization. Most of the HRA participants were male and local forest officers. Participation Of the total amount annual employees, 51% to 70% took part in annual WHP events in 2010 to 2017 and 16% to 70% in targeted services in 2011 to 2017 (see Table 2). The average percentage for attending the annual WHP events during the intervention was 63% and for targeted services 36%. The lowest attendance in targeted services was reported in 2011 (16%) and the highest in 2017 (70%). Most of the participants were male, 82% in the WHP events and 77% in the targeted services. In this research, the both participation (BOTH) rate reflects the combined analysis of the WHP event and the targeted services. The annual amount of employees in the BOTH group varied between 14% and 42%, resulting as an average of 24%. Sex differences of the BOTH group followed the same pattern as in the earlier separated analysis, even though female employees tend to participate more often, if results (74% males and 26% females) are compared with the baseline sex distribution at the baseline (83%, 17%; see Table 1). When studying the BOTH participation of the three different health status groups, the main finding indicated that every health status group was involved in the program each year. In the poor FIGURE 2. An example of two different Body Age values for the same age group and sex. JOEM Volume 61, Number 12, December 2019 Eight-year Outcomes of Worksite Health Promotion ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. 969 health status group, 21 to 79 employees (28% to 56% of the total BOTH group) took part annually. Values for the moderate health status population were 12 to 74 employees (14% to 33%) and for the good health status group 25 to 81 employees (28% to 47%). An average participation rate for the 7 years was 32% for the poor, 26% for the moderate, and 38% for the good health status group. The number of participants in the poor health status group decreased to 20 to 35 people after the first 2 years, and rose up again in 2017. BOTH rates were lower after the HRA in 2011, in 2013 to 2014, and also in 2016. The highest participation rates occurred in 2012 and 2017, when the program reached at least 38% of the employees. In the personnel group analysis, most of the BOTH group’s attendants (55%) worked as local forest officers all over the country. Participation rates of executives (13%) and organization officials (22%) were proportional to total staff. Terminal workers (6%) and lumberjacks (3%), on the contrary, were not reached successfully. The cumulative participation rate of the BOTH group within the whole study period is presented in Figure 3. Overall, the participation flow steadily increased across all health status groups. However, the number of people in the poor and moderate health status groups increased slightly less than in the good health status group, and after 2013 those with the best health condition were the largest participant group. Taken together, 491 employees were ranked into the BOTH participation group at least once between the years 2010 and 2017. This result indicates that the ENSO program reached 58.1% (491/845) of those employees, who worked at least for 1 year in the organization. At the same time, the annual employee turnover rate varied between 3.6% and 17.0% with a mean of 7.8% per year (data available upon request). The highest accretions occurred during the same years as the highest participation jumps occurred: 2012, 2015, and 2017. A minority of the BOTH participants (n¼24) did not complete a HRA. To summarize the participation results, the ENSO program achieved moderate gains in attendance every year after the launch of the program. Approximately one in four (24%) employees took part in the program annually, and with the help of long-term implementation, the program managed to reach 58% of the total workforce at least once during the 8 years. Most of the participants were males which represented the study population. There were no major attendance differences among the three different health status groups. The only personnel groups which were not deeply involved in the program were terminal workers and lumberjacks. TABLE 1. Participants in Assessments of Health Risks, Population Characteristics, and Descriptive Results at Three Different Time Points 2010–2011 2013–2014 2016–2017 Year N(%) N(%) N(%) HRA participants 586 (90%) 422 (80%) 457  (87%) HRA declined 65 (10%) 108 (20%) 66 (13%) Sex Male 489 (83) 348 (82) 363 (79) Female 97 (17) 74 (18) 94 (21) Personnel group Executives 85 (14) 98 (23) 118 (26) Local forest officers 275 (47) 207 (49) 224 (49) Organization officials 110 (19) 59 (14) 62 (13) Terminal workers 71 (12) 42 (10) 53 (12) Lumberjacks 34 (6) 16 (4) 0 NA 11 (2) 0 0 N¼586 N¼422 N¼363  Participants in Biometrical Screenings Mean (SD) Mean (SD) Mean (SD) Age 43.8 (11.0) 45.0 (10.7) 44.8 (11.1) BMI 26.9 (4.0) 26.6 (4.0) 26.8 (4.1) Systolic BP, mm Hg 137 (16.6) 135 (15.5) 134 (16.3) Diastolic BP, mm Hg 79 (10.1) 80 (9.7) 78 (9.6) Body fat percentage 26.3 (6.7) 26.3 (6.5) 26.8 (6.4) Bicep curl, kg 40.6 (10.3) 41.0 (10.5) 41.2 (10.8) Sit and reach test, cm 32.2 (9.6) 36.4 (10.9) 36.6 (11.7) Crunches in 60 s 36.8 (13.1) 32.0 (14.6) 33.0 (16.0) Leg endurance, s 107 (53.1) 129 (60.7) 132 (64.2) VO 2 max, mL/kg/min 37.9 (8.3) 38.1 (8.2) 38.4 (8.3) Fitness class 1–7 4.2 (1.3) 4.3 (1.3) 4.4 (1.3) Health Status in HRA y N(%) N(%) N(%) Good 235 (40) 201 (47) 184 (51) Moderate 168 (29) 121 (29) 91 (25) Poor 183 (31) 100 (24) 88 (24)  457 employees answered the HRA questionnaire and 363 of them completed also the biometrical screenings. y Health status based on the Body Age (BA) calculations. If the BAwas at most 0 years, a participant was categorized into the good health status group. The BA value between þ1 and þ5 years resulted moderate health status and the BA value at least þ6 years was counted as poor health status. A ¨ika¨s et al JOEM Volume 61, Number 12, December 2019 970 ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. Effectiveness Table 3 provides a comparison of successful and unsuccessful participants from 2010 to 2017, 2010 to 2013, and 2014 to 2017. To be included in the effectiveness analysis, a participant had to have two HRAs and biometrical screenings completed from the 2010 to 2017, 2010 to 2013, or 2014 to 2017 time periods. The inclusion gathered 253 people into the whole continuum, 359 people into the first time period, and 255 into the last. Notably, 215 participants completed all three HRAs and biometrical screenings, meaning that a large part of the participants were included in all periods’ analysis (more detailed data is presented in Appendix 1, http://links. lww.com/JOM/A599). Of included participants, 134 persons in 2010 to 2017, 143 persons in 2010 to 2013, and 96 persons in 2014 to 2017 met the criteria of success (lifestyle change and improvement in health) during the intervention. The successful rates for participants were 52% (134/253) and 40% (143/359) and 38% (96/ 255) for the same three periods, respectively. Altogether 67% of the HRA participants (281/422) reported that they had made a lifestyle change during the first half ofthe intervention. Duringthe second half, the proportion was 55% (198/363) and 87% (220/253) for those who completed both the baseline HRA and the last follow-up HRA. There were no demographic (age, sex) differences between the successful and the unsuccessful groups. When comparing health status (good, moderate, poor) in the successful group, the differences of successful participants were quite similar during all periods, 34%, 36%, and 25% of the successful participants came from the poor health status group. Corresponding results for the moderate health status group were 24%, 29%, and 37.5%. For the good health group, the rates were 42%, 35%, and 37.5%, respectively. Noticeably, most of the unsuccessful participants came from the good health status group: 51% in 2010 to 2017 and 2010 to 2013 and 59% in 2014 to 2017. In the personnel group analysis, local forest officers composed the majority group behind successfulness, followed by organization officials and executives. Terminal workers and lumberjacks showed the lowest success rates in all investigations periods. There were notable differences in participation and contacts between the groups of successful and unsuccessful participants. Participation in annual WHP events did contribute to effectiveness only during the whole program period (P¼0.040), but not during the halves of the program in our analysis (P¼0.108, P¼0.147). At the early years of the intervention, participation in targeted services tended to be higher in the successful group (P¼0.030), but the difference was not significant during 2010 to 2017 or 2014 to 2017. The BOTH participation was slightly higher in the successful group between 2010 to 2017 and 2014 to 2017 than in the unsuccessful group (P¼0.020, P¼0.034). When comparing the contacts between the groups, primary findings were that the successful group received more face-to-face meetings and group contacts in all three study periods (P<0.010). Correspondingly, the total amount of contacts was somewhat higher in the successful group than in the unsuccessful group (P¼0.034, P¼0.014, P¼0.044). Interestingly, the groups did not differ in e-contacts or individual contacts. Pipe Impact Metric Score PIPE Impact Metric score was calculated as a product of both design and execution elements of the WHP program. The calculation formula along with the coefficients of each of the four elements and the resulting PIPE Impact Metric score for the Enso program for TABLE 2. Participation Rates in WHP Events, Targeted Services, and Separated BOTH Participation Analysis During 2010 to 2017 Year 2010 2011 2012 2013 2014 2015 2016 2017 Mean% Total personnel N 651 634 630 625 530 526 523 523 N(%) N(%) N(%) N(%) N(%) N(%) N(%) N(%) 63% Partic. in WHP event 431 (66%) 423 (67%) 428 (68%) 437 (70%) 289 (55%) 367 (70%) 269 (51%) 312 (60%) Sex Male 361 (84) 351 (83) 360 (84) 363 (83) 225 (78) 307 (84) 223 (83) 243 (78) 82 Female 70 (16) 72 (17) 68 (16) 74 (17) 64 (22) 60 (16) 46 (17) 69 (22) 18 Partic. in targeted services 104 (16) 268 (43) 130 (21) 132 (25) 223 (42) 189 (36) 365 (70) 36% Sex Male 79 (76) 216 (81) 96 (74) 91 (69) 173 (78) 150 (79) 294 (80) 77 Female 25 (24) 52 (19) 34 (26) 41 (31) 50 (22) 39 (21) 71 (20) 23 BOTH participation (WHP event and TS) 88 (14%) 240 (38%) 95 (15%) 90 (17%) 148 (28%) 76 (15%) 222 (42%) 24% Sex Male 68 (77) 195 (81) 67 (71) 58 (64) 114 (77) 54 (71) 175 (79) 74 Female 20 (23) 45 (19) 28 (29) 32 (36) 34 (23) 22 (29) 47 (21) 26 Health status  Good 25 (28) 81 (34) 39 (41) 42 (47) 64 (43) 28 (37) 86 (39) 38 Moderate 12 (14) 74 (31) 21 (22) 20 (22) 44 (30) 25 (33) 64 (29) 26 Poor 49 (56) 79 (33) 27 (28) 26 (29) 35 (24) 21 (28) 65 (29) 32 NA 2 (2) 6 (3) 8 (9) 2 (2) 5 (3) 2 (2) 7 (3) 4 Personnel group Executives 9 (10) 33 (14) 9 (10) 19 (21) 24 (16) 5 (7) 28 (13) 13 Local forest officers 57 (65) 122 (51) 47 (49) 52 (58) 61 (41) 48 (63) 126 (57) 55 Organization officials 19 (22) 48 (20) 20 (21) 19 (21) 26 (18) 22 (29) 49 (22) 22 Terminal workers 1 (1) 20 (8) 1 (1) 0 (0) 37 (25) 1 (1) 16 (7) 6 Lumberjacks 2 (2) 13 (5) 15 (16) NA NA NA NA 3 NA 0 (0) 4 (2) 3 (3) 0 (0) 0 (0) 0 (0) 3 (1) 1  The health categorization was based on the participant’s first HRA. For example, if an employee participated in the services in 2011, but had her/his first HRA in 2013 and the second in 2017, this analysis used the health status from 2013 assessment. JOEM Volume 61, Number 12, December 2019 Eight-year Outcomes of Worksite Health Promotion ß2019 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American College of Occupational and Environmental Medicine. 971