scieee AI-readable full text Open interactive document viewer

Comparison of Sustainable Environmental, Social, and Corporate Governance Value Added Models for Investors Decision Making

Pavláková Dočekalová, Marie; Kocmanová, Alena

Abstract

The Sustainable Value-Added Model is a new approach in value-oriented strategic management that focuses on maximizing the value created by non-financial sustainability indicators. The objective of this paper is to refine the calculation of sustainable added value by incorporating environmental, social, and corporate governance sustainability indicators, assigning weights to the indicators and, by alternative methods, assigning target values to the indicators. Ten alternative models of Sustainable Environmental, Social, and Corporate Governance Value Added were created. The models encompass 11 environmental, social, and corporate governance indicators of sustainability and 2 economic indicators (Earnings before Interest, Taxes, Depreciation and Amortization and Value Added). Indicator values are related to the target values that represent the opportunity costs. The quality of the models was assessed by statistical methods, i.e. the ROC curve, Gini index, and Kolmogorov-Smirnov statistic. The results of these statistics show sufficient quality of all the models proposed. The most accurate model is that with the economic indicator Value Added and target values based on the values of the company with the best economic results.

Full text

sustainability Article Comparison of Sustainable Environmental, Social, and Corporate Governance Value Added Models for Investors Decision Making Marie PavlákováDoˇcekalová* and Alena Kocmanová Department of Economics, Faculty of Business and Management, Brno University of Technology, Kolejní4, Brno 61200, Czech Republic; [email protected].cz *Correspondence: [email protected].cz; Tel.: +420-541-142-638 Received: 11 January 2018; Accepted: 27 February 2018; Published: 28 February 2018 Abstract: The Sustainable Value-Added Model is a new approach in value-oriented strategic management that focuses on maximizing the value that is created by non-financial sustainability indicators. The objective of this paper is to refine the calculation of sustainable added value by incorporating environmental, social, and corporate governance sustainability indicators, assigning weights to the indicators and, by alternative methods, assigning target values to the indicators. Ten alternative models of Sustainable Environmental, Social, and Corporate Governance Value Added were created. The models encompass 11 environmental, social, and corporate governance indicators of sustainability, and two economic indicators (Earnings before Interest, Taxes, Depreciation and Amortization, and Value Added). Indicator values are related to the target values that represent the opportunity costs. The quality of the models was assessed by statistical methods, i.e., the Receiver Operating Characteristic curve, Gini index, and Kolmogorov-Smirnov statistic. The results of these statistics show sufficient quality of all the models proposed. The most accurate model is that with the economic indicator Value Added and target values that are based on the values of the company with the best economic results. Keywords: corporate sustainability; sustainable value added; ESG indicators; non-financial indicators; benchmarking; Data Envelopment Analysis 1. Introduction Various stakeholders are having an increasing influence and it is becoming obvious that the traditional attitude towards evaluating the economic performance of a company and its reporting are no longer sufficient [ 1 , 2 ]. Companies adopt measures and implement tools that are aimed at ensuring sustainability and long-term prospects. In the context of corporate sustainability it is necessary to create appropriate models to measure corporate sustainability that take into account the impact of the business on the community and stakeholders. Many authors deal with the issue of sustainability at the corporate level and its relationship to corporate performance [ 3 – 5 ]. In corporate practice, there is not yet a consistent approach to the application of tools for measuring and assessing sustainability. Use of these tools varies in business practice, which in turn, makes it difficult to make comparisons [ 6 ]. Composite indices are a relatively new approach to measuring and evaluating sustainability [ 7 – 11 ]. Despite their indisputable advantages, their development is accompanied by many difficulties. The basic problem is primarily the dimensionality of the very subject of the solutions that are impacting the environmental, social, economic, and corporate governance perspective of sustainability and their interactions. Currently, in the international context, there is a growing emphasis on determining whether a company is able to increase its value and provide an appropriate return on investment for creditors. The basic general aim of most businesses is to maximise and increase market value in the long term. Sustainability 2018,10, 649; doi:10.3390/su10030649 www.mdpi.com/journal/sustainability Sustainability 2018,10, 649 2 of 13 Authors [ 12 , 13 ] investigated going public drivers in Poland and Czech Republic and conclude that a considerably larger number of financial managers are motivated by the establishment of the firm’s market value. In practice, the most commonly used method of measuring and assessing the financial and economic performance of a company is fundamental or technical analysis, which assesses the company from the economic point of view based on an analysis of financial statements and on the basis of Economic Value Added, but investors are aware that they need financial and non-financial indicators to decide on their investments. This is why contemporary economic theoreticians, mainly under pressure from investors and other stakeholder groups, prefer the idea based on the presumption that the economic problems of our time have to be solved by integrating environmental, social, and economic performance in corporate decision-making. This article aims to modify the original concept of calculating Sustainable Value Added (SVA) and to determine other possible approaches to the Sustainable Environmental, Social, and Corporate Governance Value Added (SESG VA ) model design, and thus give accuracy to the calculation of sustainable value added for businesses in the manufacturing industry, and, at the same time, to evaluate the quality of the proposed SESGVA models. 2. Theoretical Approach to Sustainable Value From an economic point of view, value can be viewed through the prism of utilized resources, which represents a holistic approach to value creation and is based on the interaction of resources. Porter and Kramer [ 14 ] came up with a concept of value as something beneficial for both the company and the society. They point out that the internal economic costs approach needs to be extended to include social costs and benefits that contribute to a long-term sustainability. The current concepts of sustainable value (SV) take into account the efficiency and effectiveness of environmental and social dimensions of sustainability. Eco-efficiency and socio-efficiency express the use of natural and social resources in relation to its economic activity. Improved efficiency leads to an increase in corporate sustainability [ 15 ]. Eco-efficiency describes the degree to which the company makes use of the environmental resources in reverse proportion to its economic output (e.g., EUR/tonnes of CO 2 ). Social-efficiency can be calculated as the ratio of the added value to the social impact of the company (e.g., EUR/work injury). SV allows for establishing the value of environmental and social resources in monetary terms. Investors are very interested in knowing how much businesses contributed to the achievement of environmental, social and economic objectives, and SV provides such information. The concept of Sustainable Value Added (SVA) was first published in 2002 by German authors Frank Figge and Tobias Hahn [ 16 ]. Since the introduction of SVA several studies have been conducted on the macroeconomic and microeconomic levels [11,15–19]. The SVA created by the company can be calculated according to Equation (1) [11]: SV =1 n n ∑ i=1y xi −y∗ x∗ ixi, (1) where: n—number of forms of capital considered; y—value added (output) of the company; y*—value added (output) of the benchmark; x i —amount of capital iused by the company; x i *—amount of capital iused of benchmark; y*/x i *—opportunity cost. In the SVA model the considered x i resources are: CO 2 emissions [t] CH 4 emissions [t] SO 2 emissions [t], NO x emissions [t], CO emissions [t], PM 10 [t], and Work accidents [number]. Even the authors themselves recognize that this model of SV measurement is imperfect and does not say whether the company is sustainable; it only indicates that it uses its resources in a more sustainable way than the benchmark. The SV model has its opponents [ 20 – 22 ] who criticize it for using an arbitrary benchmark to determine the eco-efficiency of a firm and for being based on a simple average of added values. Sustainability 2018,10, 649 3 of 13 3. Materials and Methods The initial modified SESG VA model [ 23 ] was based on the strengths of the SVA model [ 11 ] and was extended namely to include the weights of indicators, maximizing social and corporate governance indicators, and the ways of establishing targets (benchmarks) using the methods of Data Envelopment Analysis (DEA). The methodology of research for determining SESGVA models is broken into four steps: (1) Selection and reduction of ESG indicators through factor analysis. (2) Assigning weights to a reduced set of ESG indicators. (3) Setting a benchmark values. (4) Evaluation of SESGVA models quality on selected Czech manufacturing companies. 3.1. Selection and Reduction of ESG Indicators Important components of the SVA model, as per Equation (1), are indicators that are in fact negative (unwanted) outputs of company production that are to be minimised. This can be considered as a weakness of the SVA model which does not contain indicators that positively define the sustainability of the company and, at the same time, it does not contain indicators in the field of corporate governance, i.e., it omits the fourth pillar of corporate sustainability [ 7 ]. For this reason, the maximisation of corporate governance and social indicators were included in the SESGVA model. The details of the indicators selection methodology were presented in the work [ 7 , 23 ]. 25 absolute I ESGi performance indicators were identified which were subsequently reduced using one-dimensional and multi-dimensional statistical methods (exploratory factor analysis and confirmatory factor analysis) to 12 I ESGi performance indicators. Table 1shows a total of 11 I ESGi performance indicators because the Number of terminated employees and Total number of employees indicators are merged into the ISoc 2 —Employee turnover indicator. Before EFA and PCA scales of I ESGi were modified so that higher values mean better results. 3.2. Assigning Weights to ESG Indicators The reason for the modification of the SVA model [ 11 ] was one of its weaknesses that assumes that all of the indicators participate equally in the value added. It is the easiest way to deal with the allocation of weights and to assign the same weight to all indicators. Assigning equal weights assumes that each indicator contributes equally to creating value, but in the corporate reality, this is often not the case. A rather more exact approach is recommended to determine the exact weights, namely objective methods, expert approach or subjective methods. Since the model of sustainable value is significantly influenced by the choice of used environmental, social, and corporate governance performance indicators (I ESGi ) and their assigned weights, this specific approach may lead to an attempt to influence purely statistical approaches. Some authors [ 24 ] recommended the expert approach since, in their view, weights that are assigned solely on the basis of exact approach do not necessarily reflect the actual relationships between indicators. In order to determine the w i weights the authors initially applied the assignment of weights on the basis of the exact approach using factor scores from the Principal Component Analysis method [23]. In order to determine the weights in this article they applied the expert approach that appears to be more appropriate given the smaller number of indicators because it does not lower the resolution capacity of the respondent. This is why they used the views of experts in the manufacturing industry companies. The weights of I ESGi indicators express in numeric values their importance for the sustainability of the company. The higher the importance of the indicator for sustainability, the higher is the value of its weight. Questionnaires were sent to a group of 40 experts in selected manufacturing companies and they were asked to assign weights to individual I ESGi indicators in the areas of environmental, social, and corporate governance. Experts expressed their opinions on the basis of 1–10 rating scale. Sustainability 2018,10, 649 4 of 13 The rating method was used to estimate the weights of indicators. The experts assigned the b i value to the i-th I ESGi indicator on the < 0; 10 > scale. The higher the importance of the I ESGi for the decision-maker, the higher is the rating. The weight of the i-th indicator is calculated according to the formula Equation (2): wi=bi ∑k i=1bi,(2) The sum of binumbers in the denominator is the sum of knatural numbers. The wiweights are standardised in Equation (3): ∑k i=1wNi =1, for i=1, 2, ..., k.(3) 3.3. Setting Benchmark Values Benchmarking is a fundamental element in the SESG VA model. In the SVA model, the authors Figge and Hahn [ 15 ], use the same general target values for all businesses that are derived from the results of the national economy. In the article [ 23 ], the target values of the SESG VA model were determined using the Data Envelopment Analysis (DEA) through the Slack Based Measure additive model [ 25 ]. The main advantage of this model is that it prevents a situation where the unit reaches an effective score of 1 but is not efficient because one of its additive variables is not zero. The advantage of using DEA for establishing the target values is the fact that the target values are set specifically for each company. The disadvantage of this approach is that the results are defined in relation to other companies included in the surveyed sample and as such the method is sensitive to the type of companies that are included in the sample. Another disadvantage limiting the practical application of this approach is that it is necessary to obtain data from a large number of companies which is difficult in a situation where companies do not publish data or publish it in various formats making an inter-company comparison difficult. Given the limitations of the DEA method for determining benchmarks, other approaches will be applied. The IESGi performance indicators are benchmarked against: I. values of a so-called fictitious company; II. industry average; III. values of a company with the best economic results; and, IV. values of a company with average economic results. Assessing businesses in terms of their distance from the fictitious (ideal) company is an approach applied in the multi-criteria analysis of variants. The so-called fictitious company is mostly a hypothetical company that achieves the best possible values in all criteria. For the application of this approach in the context of sustainability, see for example [26]. When comparing the values with the industry average the target values are set at the level of average values of a group of companies, separately for each indicator. This creates an analogy to the fictitious company but with the average values of all I ESGi . Another approach is to identify a particular company that achieves average values of the selected economic indicator and to compare the I ESGi performance indicators with values of the identified reference company. The company that shows the best economic results should be set as a leader representing the best practice. In case of this benchmarking approach it is important to make sure that we do not identify a company that achieves high economic results at the expense of sustainability. 3.4. Evaluating the Quality of the Sustainable Environmental, Social and Corporate Governance Value Added Model There are numerous methods for evaluating the quality of models with binary response variable, for example the Receiver Operating Characteristic curve, Gini index, the Kolmogorov-Smirnov statistic and others. Sustainability 2018,10, 649 5 of 13 Receiver Operating Characteristic curve (ROC) is used in psychology, sociology, economics, as well as in medicine [ 27 ] and the environmental area [ 28 ]. The ROC curve is a graphical representation of the specificity S p and sensitivity S e . The ROC curve is formed by a set of all possible pairs (Se,1 −Sp) for various svalues [ 29 , 30 ]. When comparing several models we will choose the one for which the highest positioned ROC curve reaches 1. To compare ROC curves the area under the ROC curve known as AUC is successfully used. The higher the AUC, the better the SESG VA models differentiate between companies that create sustainable value and those that fail to do so. Since AUC is a part of a unit square its value will always be between 0 and 1. We know from the result of a random predictor that AUC will never be less than 0.5, and therefore AUC will achieve a value in the interval (0.5; 1.0). The area under curve is determined by the relationship demonstrated in Equation (4): AUC =r1 0ROC(p)dp,(4) The accuracy of the test, i.e., the size of AUC, is determined by the following rating: 0.9–1.0 excellent; 0.8–0.9 very good; 0.7–0.8 good, 0.6–0.7 sufficient; 0.5–0.6 insufficient [30,31]. The Gini test (GI) is often preferred in the evaluation of model quality. The relationship between AUC and GI is described in the Equation (5) [30]: GI =2AUC −1, (5) GI assumes values in the interval (0; 1). If it is zero, then it is a quite random ranking of cases, on the contrary, if it equals one, it is the ideal model which ranks good and bad cases perfectly. The closer the GI is to one, the better is the quality of the model. Kolmogorov-Smirnov statistic (KS) is yet another tool for model quality evaluation. The KS test seeks the maximum vertical distance between two distribution functions. The KS test is defined in the relationship shown in the Equation (6): KS =max s(F(s|B)−F(s|G)),(6) The KS statistic is the length of line that maximizes the distance between distribution functions F(s|B) and F(s|G). When displaying densities, this maximum separation would occur at the point where the densities cross because the extreme cases occur at the point where the derivative function is zero. Therefore f(s ∗ |B)– f(s ∗ |G)= 0 on the maximizing score s ∗ . Generally speaking, the distance between distribution functions will be shorter or equal to KS statistic and thus KS is the upper limit of the distance separating the conditional distributions [ 32 ]. In our case, in the SESG VA models, the conditional distribution functions F(s|G) will be used for companies that create sustainable value and F(s|B) will be used for those that do not create sustainable value. The disadvantage of GI, and also of AUC and KS statistic, is their abstractness. For example, the GI of a model has a value of 0.5; this information on its own does not have a great informative value. All that we can say based on this information is that this model has a higher quality than the model for which GI = 0.3. Based on the GI we are not able (unlike in sensitivity and specificity) to quantify the added value of the model. In order to verify the SESG VA model we obtained data on 219 EU manufacturing companies for the year 2014 from their annual reports and voluntary reporting; see Appendix A. Companies that reported remote values and companies that clearly could not create sustainable value, i.e., companies with negative economic value added, were removed from the sample for the sake of data quality. The number of companies in the sample was reduced to 66 and on these we evaluated the SESGVA model; see Appendix B. Sustainability 2018,10, 649 6 of 13 4. Results and Discussion With respect to the benchmarking methods used in the modified SESG VA model, it is appropriate to express the I ESGi indicators in relative terms. The I ESGi indicators are relative to the annual value added and the indicator I Soc2 —Employee turnover is designed on the basis of the Number of terminated employees and Total number of employees. IESGi are listed in Table 1. Table 1. IESGi performance indicators used in the SESGVA model. IESGi—Input Indicators Unit Expertly Defined Weights wNij IEni—Environmental indicators IEn1—Non-investment expenditures for the protection of the environment [’000 CZK] 0.093 IEn2—Total annual consumption of water [m3]0.076 IEn3—Total annual production of waste [t] 0.099 IEn4—Total annual production of hazardous waste [t] 0.104 ISoci—Social indicators ISoc1—Total amount of money for charitable work in support of local communities [’000 CZK] 0.067 ISoc2—Employee turnover [number] 0.089 ISoc3—Education and training expenditures [’000 CZK] 0.084 ICgi—CG indicators ICg1—Information about financial results [yes = 0.98; no = 0.02] 0.101 ICg2—Collective agreement [yes = 0.53; no = 0.47] 0.093 I Cg3 —Reports from environmental and social areas [yes = 0.60; no = 0.40] 0.096 ICg4—Code of ethics [yes = 0.70; no = 0.30] 0.098 Earnings before Interest, Taxes, Depreciation and Amortization (EBITDA), or Value Added are used as economic (output) indicators in the SESG VA model. EBITDA is the most robust indictor of profit and it is useful thanks to the possibility of comparing various companies in various sectors. The value added is in line with the EMAS recommendations concerning the design of key indicators. IEcoi are listed in Table 2. Table 2. IEcoi economic output indicators in the SESGVA model. IEcoi—Economic indicators Unit IEco1—Earnings before Interest, Taxes, Depreciation and Amortization [’000 CZK] IEco2—Value Added [’000 CZK] The modified SESG VA model presented in this paper is based on the model that was published by Kocmanováet al. (2016). The SESGVA calculation is as follows: SESGVA =EnVA +SocVA +CgVA,(7) EnVA =∑R r=1wNiIEcoi IEni −I∗ Ecoi I∗ Eni IEni,(8) SocVA =∑R r=1wNiIEcoi ISoci −I∗ Ecoi I∗ Soci ISoci,(9) CgVA =∑R r=1wNiIEcoi ICgi −I∗ Ecoi I∗ Cgi ICgi,(10) on condition : f(x)=(x,x6=0 IEcoi,x=0, where x=IEcoi IESGi −I∗ Ecoi I∗ ESGi IESGi.(11) Sustainability 2018,10, 649 7 of 13 Then SESGVA =∑R r=1wNix.(12) where: En VA —Environmental Value of the company; Soc VA —Social Value of the company; Cg VA — Corporate Value of the company; R—Total amount of resources considered; w Ni —standardized weight of i-th indicator I ij ;I Ecoi —Economic output of the company; I Ecoi*— Economic output of benchmark; I Eni – Environmental resource of the company; I Eni* —Benchmark value of environemntal resource; I Soci —Benchmark value of social resource; I Soci* —Social output of benchmark; I Cgi —Corporate governance resource of company; ICgi*—Benchmark value of corporate governance indicator. In total, ten SESG VA models were created combining output economic indicators I Ecoi with various methods of determining target values: five models of EBITDA SESG VA_EBITDA and five models of Value Added SESGVA_ValueAdded. SESGVA models with EBITDA as an output economic indicator: •model SESGVA_EBITDA_I uses values of a fictitious (ideal) company as a benchmark; •model SESGVA_EBITDA_II uses industry average as a benchmark; • model SESG VA_EBITDA_III uses values of a company with the best economic results as a benchmark; •model SESGVA_EBITDA_IV uses values of a company with average economic results; and, •model SESGVA_EBITDA_V uses values DEA target values as a benchmark. SESGVA models with Value Added as an output economic indicator: •model SESGVA_ValueAdded_I uses values of a fictitious (ideal) company as a benchmark; •model SESGVA_ValueAdded_II uses industry average as a benchmark; • model SESG VA_ValueAdded_III uses values of a company with the best economic results as a benchmark; •model SESGVA_ValueAdded_IV uses values of a company with average economic results; and, •model SESGVA_ValueAdded_V uses values DEA target values as a benchmark. The summary of models and their designation are provided in Table 3. Table 3. Modification of the SESGVA model. SESGVA Model Benchmarking Method IEcoi—Economic Indicators EBITDA Value Added Fictitious (ideal) company SESGVA_EBITDA_I SESGVA_ValueAdded_I Industry average SESGVA_EBITDA_II SESGVA_ValueAdded_II Best economic results SESGVA_EBITDA_III SESGVA_ValueAdded_III Average economic results SESGVA_EBITDA_IV SESG VA_ValueAdded_IV DEA target values SESGVA_EBITDA_V SESGVA_ValueAdded_V It follows from the descriptive characteristics of individual models in Table 4that the biggest difference in the values of sustainable value is achieved when using benchmarking values of the ideal (fictitious) company (SESG VA_EBITDA_I and SESG VA_ValueAdded_I ), while the mean value is significantly lower in these models when compared to other models. The results of the Bonferroni post hoc analysis showed that the differences in comparison with other SESG VA models are statistically significant. The use of the ideal company for the sustainable value calculation is an extreme approach, since no company can achieve such target values and therefore the resulting sustainable value will always be negative. The variation margin is generally higher in the Value Added models than in EBITDA models, which is due to the nature of these economic indicators. Sustainability 2018,10, 649 8 of 13 Table 4. Descriptive characteristics of SESGVA models. SESGVA Models Descriptive Statistics [CZK] N Mean Std. Deviation Minimum Maximum SESGVA_EBITDA_I 66 −239,474,453,000 408,826,335,300 −1,813,765,457,000 −290,323,541 SESGVA_EBITDA_II 66 −37,774 516,338 −1,857,855 1,297,521 SESGVA_EBITDA_III 66 −52,486,346 112,186,950 −714,867,082 1,411,015 SESGVA_EBITDA_IV 66 −308,220 805,946 −2,399,334 1,325,365 SESGVA_EBITDA_V 66 −5 048,824 16,858,742 −99,445,057 1,411,015 SESGVA_ValueAdded_I 66 −521,809,651,500 890,823,681,800 −3,952,155,479,000 −632,234,851 SESGVA_ValueAdded_II 66 −79,821 1,126,239 −3,918,260 2,742,060 SESGVA_ValueAdded_III 66 −24,908,504 35,823,466 −158,605,092 2,325,851 SESGVA_ValueAdded_IV 66 −500,906 1,612,190 −4,492,450 2,721,710 SESGVA_ValueAdded_V 66 −6,091,975 30,983,209 −249,152,178 2,582,878 The generally most lenient approach to determining the target value is the definition of benchmarks on the level of industry average for each indicator separately (SESG VA_EBITDA_II and SESGVA_ValueAdded_II). The Spearman method is used for the calculation of the SESG VA models correlation; see Table 5. In fact, this method is more robust and more appropriate for application on real data. Table 5. Correlation matrix for SESGVA models. SESGVA Models (1) (2) (3) (4) (5) (6) (7) (8) (9) (1) SESGVA_EBITDA_I (2) SESGVA_EBITDA_II 0.929 (3) SESGVA_EBITDA_III 0.739 0.728 (4) SESGVA_EBITDA_IV 0.847 0.890 0.858 (5) SESGVA_EBITDA_V −0.014 0.022 0.253 0.197 (6) SESGVA_ValueAdded_I 1.000 0.929 0.739 0.847 −0.014 (7) SESGVA_ValueAdded_II 0.929 0.932 0.826 0.961 0.087 0.929 (8) SESGVA_ValueAdded_III 0.883 0.859 0.932 0.946 0.201 0.883 0.942 (9) SESGVA_ValueAdded_IV 0.856 0.869 0.874 0.986 0.165 0.856 0.969 0.959 (10) SESGVA_ValueAdded_V −0.014 0.006 0.279 0.212 0.831 −0.014 0.093 0.203 0.187 The resulting values of individual SESG VA models are highly correlated with each other, with the exception of models that use the target values defined by the DEA method (SESG VA_EBITDA_V and SESG VA_ValueAdded_V ), which significantly correlate only among themselves. It is clear that the DEA targets provide different results in comparison with other models. Repeated measures ANOVA was performed with a Greenhouse-Geisser correction testing the null hypothesis H0: SESG VA models have no significant effect on the sustainable value results. The results show there is a statistically significant difference between SESG VA models (F(1, 65) = 22.645, p= 0.000). Almost 26% of variability in values is explained by the applied model ( η2 = 0.258). Results of Bonferroni post hoc test showed that benchmarking models with ideal values (fictitious companies) (SESG VA_EBITDA_I and SESG VA_ValueAdded_I ) yield statistically significantly lower values compared to other SESG VA models. For SESG VA models using other benchmarking methods (e.g., industry average, values of a company with the best economic results, values of a company with average economic results, and DEA target values) the result is not significantly influenced by the choice of economic indicator, in comparison, there are no significant differences between these methods. Evaluation of SESGVA Models Quality A sample containing SESG VA models calculation data was subjected to statistical evaluation. The sample included 66 companies in the manufacturing industry. In this sample, 36 companies were identified as companies that are geared towards sustainability and 30 companies that are not. Sustainability 2018,10, 649 9 of 13 Companies were selected based on the calculation of the composite “corporate sustainability index” (I CS ) indicator for the measurement and evaluation of sustainability of the manufacturing industry [ 33 ]. Results of the calculation of SESG VA models sustainable value were used for the evaluation of the model quality. The ROC curves are the graphic representation of SESG VA_EBITDA_I , SESG VA_EBITDA_II , SESG VA_EBITDA_III , SESG VA_EBITDA_IV and SESG VA_EBITDA_V models (see Figure 1) and SESG VA_ValueAdded_I , SESG VA_ValueAdded_II , SESG VA_ValueAdded_III , SESG VA_ValueAdded_IV and SESG VA_ValueAdded_V models (see Figure 2), which express the relationship between S e sensitivity and 1-specificity S p . Thus the point of reference is a unit square whose vertical axis represents the S e sensitivity and the horizontal axis represents the value of 1-specificity S p . The ROC curve represents the combination of sensitivity and specificity values. Sustainability 2018, 10, x FOR PEER REVIEW 9 of 13 Figure 1. ROC curves of SESGVA_EBITDA models. Figure 2. ROC curves of SESGVA_ValueAdded models. SESGVA_EBITDA ROC curves models in Figure 1 show the sufficient quality of models. SESGVA_ValueAdded in Figure 2 show a very good quality of models. The values of AUC, Gini index and Kolmogorov-Smirnov statistic of individual SESGVA models indicate the accuracy of the models; see Table 6. Figure 1. ROC curves of SESGVA_EBITDA models. Sustainability 2018, 10, x FOR PEER REVIEW 9 of 13 Figure 1. ROC curves of SESGVA_EBITDA models. Figure 2. ROC curves of SESGVA_ValueAdded models. SESGVA_EBITDA ROC curves models in Figure 1 show the sufficient quality of models. SESGVA_ValueAdded in Figure 2 show a very good quality of models. The values of AUC, Gini index and Kolmogorov-Smirnov statistic of individual SESGVA models indicate the accuracy of the models; see Table 6. Figure 2. ROC curves of SESGVA_ValueAdded models.