Assisting Users in Decisions Using Fuzzy Ontologies: Application in the Wine Market
Abstract
FEDER funds by the Spanish Ministry of Economy and Competitiveness TIN2016-75850-R
Full text
mathematics Article Assisting Users in Decisions Using Fuzzy Ontologies: Application in the Wine Market Juan Antonio Morente-Molinera 1,* , Francisco Javier Cabrerizo 1, Sergio Alonso 1, Ignacio Javier Pérez 2and Enrique Herrera-Viedma 1 1Andalusian Research Institute in Data Science and Computational Intelligence, University of Granada, 18010 Granada, Spain; [email protected].es (F.J.G.); [email protected] (S.A.); [email protected].es (E.H.-V.) 2Department of Computer Sciences and Engineering, University of Cadiz, 11003 Cadiz, Spain; ignaciojavier[email protected] *Correspondence: jamor[email protected].es Received: 29 July 2020; Accepted: 26 September 2020; Published: 7 October 2020 Abstract: Nowadays, wine has become a very popular item to purchase. There are a lot of brands and a lot of different types of wines that have different prices and characteristics. Since there is a lot of options, it is easy for buyers to feel lost among the high number of possibilities. Therefore, there is a need for computational tools that help buyers to decide which is the wine that better fits their necessities. In this article, a decision support system built over a fuzzy ontology has been designed for helping people to select a wine. Two different possible architecture implementation designs are presented. Furthermore, imprecise information is used to design a comfortable way of providing information to the system. Users can use this comfortable communication system to express their preferences and provide their opinion about the selected products. Moreover, mechanisms to carry out a constant update of the fuzzy ontology are exposed. Keywords: decision support systems; fuzzy ontologies; computing with words 1. Introduction Wines are a popular item to purchase. Depending on the manufacture, they can have different characteristics. For instance, there are wines with different levels of alcohol, acidity, year, etc. Therefore, finding the perfect wine for a specific buyer is a quite difficult task. There is not a perfect wine for everybody since each person has different tastes and searches for a specific experience. The high number of brands and wines that are available on the market make it difficult for the buyers to select the wine that better fits their necessities. They cannot handle by themselves the high amount of information about all the features, prices and brands. Therefore, there is a need for designing decision support systems (DSS) [ 1 – 4 ] that allow them to choose the wine that better fulfils their needs. This process must be carried out in an organized and fair way. The system should ask the buyers for parameters about what they need and provide them with a short list of wines that fufil them. This way, buyers can decide which wine they should buy based on objective criteria. Thanks to this, they avoid being misled by the high amount of information. Furthermore, they do not rely on criteria that may make the wrong choice. In this paper, a novel DSS whose main purpose is to help buyers to choose a wine is designed. Users provide information to the system and they obtain several suggestions that they can use to select their most preferred wine. Fuzzy ontologies (FOs) are used to store all the information in the system. For the DSS to work properly, the set of elements stored on the FO must be constantly updated. For this purpose, two different updating information processes are described. For testing purposes, the method is applied over a real case example. Concretely, the Wine Fuzzy Ontology [ 5 ] Mathematics 2020,8, 1724; doi:10.3390/math8101724 www.mdpi.com/journal/mathematics
Mathematics 2020,8, 1724 2 of 18 that contains real information about 623 different wines is used. Linguistic modelling (LM) [ 6 – 8 ] is employed for storing wines features in the FO and for buyers to provide preferences. LM provides a fluid user-system commutation for the buyers. When an item is requested from the FO, users are usually not capable of providing accurate features values. Instead, they prefer to communicate and express themselves using imprecise words instead of numbers. For instance, if users are interested in a high alcohol wine, they probably would like one with around 15% alcohol. On the contrary, they would not like a wine that only has 5% alcohol. Our system takes into account this issue and allows users to specify every feature value in an non-accurate way avoiding the troublesome task of providing numerical values to the system. Moreover, the novel designed DSS implements a feedback process that allows users to benefit from the opinion of other users that have already tested the device. Furthermore, to implement the system, two different architecture schemes are proposed. In conclusion, a novel DSS system that allows users to choose a wine fairly and impartially is designed in this article. Our method relies only on the wines’ features and quality. Thanks to this, the system can be trusted. It is possible to adapt the designed system to solve other problems. That is, the FO can be adapted to deal with other data related to other decision making problems. For instance, it is possible to build a DSS that help buyers in renting a flat on a location. Thanks to this, the tenant can reduce the high number of possible houses into the ones that really fit their needs. Another possible application of the presented design would be, for instance, in deciding among different films. The organization of the paper is done in the following way. Section 2presents several concepts that the novel developed method uses. In Section 3, the DSS is exposed in detail. In Section 4, a brief use example is shown. In Section 5the method is discussed in detail. The paper ends with conclusions. 2. Preliminaries Some concepts needed to correctly comprehend the method are introduced here. Concretely, in Section 2.1, basis of LM are introduced. In Section 2.2, FOs are exposed. 2.1. Group Decision Making and Linguistic Modelling Linguistic modelling [ 6 , 7 , 9 , 10 ] has had a clear impact over Group Decision Making methods over the years. Its main purpose is to allow experts to communicate using words instead of numbers. This way, the communication gap between users and the computational system that manage the decision process is reduced. In our system, LM is used to design a framework that allows users to provide information to the FO reasoner in a comfortable way. Words and expression like Very high, Low, Very low or Medium are employed by them to send their preferences to the system. Since FOs can deal with imprecise information, they can effectively manage the data. Thanks to LM, users do not have to provide accurate numerical information. On the contrary, they can just indicate more or less the importance and the values that each characteristic of the alternative have for them. The relations of the FO also use LM for storing the information. LM uses linguistic variables that contain different terms. Each term represents a different grade of the variable. Formally, a linguistic variable can be defined as a quintuple hL , T(L) , U , S , Mi , where Lis the variable name, T(L) is a set that contains the labels that conform the linguistic variable, U is the universe of discourse, M(X) is a subset of U and S is a set of rules that associates the set X with M(X) . To express the meaning of a fuzzy set M(X) from U , it is possible to define a membership function such that: µM(X):U→[0,1](1) where µM(X)(z)is membership degree of z. It should be noticed that z∈U[11]. In Figure 1, a graphical representation of the linguistic variable Acidity is shown. This representation is the one used on the Wine FO.
Mathematics 2020,8, 1724 3 of 18 Figure 1. Representation of the linguistic variable Acidity. LM is an area that nowadays is still having a high impact in the recent literature [ 12 – 15 ]. Most of the articles describe application research that employs LM to represent imprecise information. DSS are also a prime example of this as can be stated in [ 16 – 20 ]. Furthermore, this field has had a clear impact over FOs [21–24]. In the Group Decision Making area, it is very important that the experts are provided with means that allow them to provide information in a comfortable way. That is why LM has been of great use on the area. Formally, a Group Decision Making method can be defined as follows: Let us define two sets, of experts and alternatives respectively, E={e1 , . . . , en} and X={x1, . . . , xm} . The main aim of a group decision making methods is to rank elements from Xusing the preferences values Pk,∀k∈[1, n], that has been provided by experts in E. A typical Group Decision Making method follows the next steps [2]: •Providing preferences : Experts carry out a thorough debate in which they discuss about the advantages and drawbacks of the alternatives. Afterwards, they provide their preferences to the system. •Calculating the collective preference value : All the preferences provided by the experts are aggregated into a single collective piece of information containing the overall opinion of all the experts. •Calculating consensus : Consensus is a helping feature that allows Group Decision Making processes to be fair and include all experts’ points of view on the decision process. The main idea of applying consensus is to promote that experts make their opinion closers in order to reach a final result as consensual as possible. Consensus measures analyze the experts’ preferences and indicate how similar two experts’s preferences are. This way, it is possible to know which experts have different opinions than the others. Furthermore, it is possible to measure the overall consensus reached. If the consensus is high enough, it is possible to calculate the final ranking of alternatives. On the contrary, experts should carry out more debate in order to bring their opinions closer. •Ranking alternatives : By using the collective preference piece of information, alternatives are ranked. The first alternative on the ranking is considered the most promising one. In Figure 2, a graphical representation of this process is shown.
Mathematics 2020,8, 1724 4 of 18 Figure 2. Group Decision Making general scheme. 2.2. Fuzzy Ontologies Ontologies [ 25 , 26 ] are a very interesting tool that allows the information to be represented in a conceptual way inside a computational system. Nevertheless, they require the information to be accurate and numerical. Consequently, they do not allow data to be represented using LM. For this reason, there is a need to update ontologies in a way that they can work using imprecise information. FOs [ 27 – 30 ] were designed to achieve this goal. A FO can be formally defined by using a quintuple OF={I , C , R , F , A} . I is the element that represents the set of individuals. C contains a set of concepts that are used to describe the individuals. R establishes the relationships between sets I and C . Furthermore, elements in I can be related. These relationships are crisp making them unable to employ LM on them. F represents fuzzy relationships among elements. In this case, a fuzzy set is employed to relate the different elements. Therefore, F values are typically used when establishing imprecise relationships among the FO elements. Finally, Arepresents the set of axioms. The described scheme is shown in Figure 3. All the elements of the quintuple that conform the FO are depicted. Figure 3. How elements in a FO interact. There exist some variations of FOs such as the known as Fuzzy Grassroots Ontologies (FGOs) [ 31 ]. They employ clustering in order to create groups of similar elements. The further an element is from the center of the cluster, the less similarity it has. Formally, a fuzzy grass ontology is a quintuple <X , C , T , N , A> where X indicates the set of normalized terms, C the set of fuzzy clusters, N the set
Mathematics 2020,8, 1724 5 of 18 of non-taxonomy relations among the clusters and A a set of axioms. Each cluster is built as a fuzzy set on the dataset X . Some Fuzzy Grassroots Ontology applications can be seen on [ 32 , 33 ]. In these articles, Fuzzy Grassroots Ontologies are used for extracting information about weblogs and for improving social semantic web search respectively. Before ending the subsection, some papers that are part of the recent research carried out in the FO area are shown. For example, Huitzil et al. [ 21 ] employ FOs and Kinect sensor data to recognize gait. In [ 34 ], authors use FOs to manage fuzzy roles in risk-based environments. In [ 35 ], a DSS that uses a fuzzy OWL 2 ontology is presented. In [ 36 ], description logics are used in order to define the multi-criteria group decision making problem. In [ 37 ], FOs are used to define the necessary semantic for controlling smart homes using the internet of Things. In [ 38 ], Sumathi et al. propose an ontology that stores information about an information processing technique for query recommendation applications. It can be concluded that FO is a quite recent field that is evolving and changing due to the research made on the area. In [ 39 ], authors present some algorithms for information retrieval and realization in fuzzy ontologies. In [ 23 ], authors review several constructions referring to type-2 fuzzy ontologies. That is, fuzzy ontologies that employ type-2 fuzzy sets in order to represent their elements. 3. A Novel Decision Support System for Assisting Users in the Selection of a Wine The novel designed DSS is thoroughly described in this section. Concretely, in Section 3.1, the wine FO is described in detail. In Section 3.2, the DSS procedure for generating recommendations is exposed. In Section 3.3, two possible architectures that can be used to carry out the DSS implementation are analysed. In Section 3.4, the users’ feedback process is exposed. Finally, in Section 3.5, two possible ways of carrying out the updating information task of the FO are exposed. 3.1. The Wines’ Fuzzy Ontology All the data that are used to support the users in their decision is stored in a FO. Thanks to it, it is possible to have an overview of the wine that are present in the market in a concrete time. To provide up to date information to buyers, it is necessary to constantly update the FO. In this paper, two different ways of carrying out this update process are presented. The first one is to let wine experts to do it without any computational intervention. This option is not a good one in cases like the tackled one where there is a high amount of information available. On the other hand, it is possible to design an automatic process that analyses certain Webpages to extract information about the new wines that keep appearing in the shops. This computational process would be in charge of deleting wines that are no longer available and include the new ones that appear on the market. The complete updating process is thoroughly described in Section 3.5. For testing purposes, a real case example has been chosen: the Wine FO. Wine FO contains 623 individuals related to six different concepts. The fuzzy ontology is built in a way that each individual of I represents one wine and each concept of C represents a wine characteristic. The set of concepts that appear in the FO have been obtained by studying which are the features that wine buyers care the most. Finally, F and R indicates how each wine on I is related to the features in C . The relations related information have been obtained from different famous webpages (alko.fi, winesfromspain.com, snooth.com). The used FO can be accessed and downloaded on the following webpage [5]. The elements that are part of the wine FO set Care described below: •Year : This feature indicates the wine year. Older wines have different tastes than recent ones. Therefore, it is important to take into account the wine year on the reasoning process. The associated labels for this concept include wines from 1999 in advance. A linguistic label set of four different labels, {NovelloYear,RegularYear,OldYear,ExclusiveYear}is used. •Acidity: It indicates the level of acidity of the wine. Acid wines have different properties than sweet ones. The concept is defined in the interval [ 0,10 ] . A linguistic label set of seven different
Mathematics 2020,8, 1724 6 of 18 labels, S7={s1 , . . . , s7} is used. A graphical representation of how the labels are distributed on the scale can be seen in Figure 1. •Alcohol: This feature indicates the level of alcohol that the wine has. The level of alcohol has a high impact on the wine final taste. Values related to this feature are located on the interval [ 0,20 ] . A linguistic label set of seven different labels, S7={s1 , . . . , s7} is used. The same distribution than the one used for acidity is employed. Concretely, values { 3.33,6.66,10,13.33,16.66 } are used for defining the support of the fuzzy sets used for representing the labels. •Price : Indicates how much the wine costs. This concept main purpose is to provide buyers with options whose price matches with the amount of money that the buyers want to spend. The range of the values of this concept are located on the interval [ 6.5,23 ] . In order to represent this concept, a linguistic label set of three different labels, S3={s1 , s2 , s3} is used. Fuzzy sets used for representing S3labels are shown in Figure 4. •Wine color : Indicates the color of the wine. This concept is related to the individuals by using a crisp relation instead of a fuzzy one. There are three different values for this option: red, white and rose. •Other users’ opinions : This fuzzy concept stores the overall experience that other users have had with the wine. This value is in constant update since it summarizes the values obtained on the feedback process. The range of values used in defining the linguistic labels is [ 0,10 ] , being 10 the maximum punctuation that can be given to a wine and 0 the worst one. More information about its representation and how the feedback process is performed can be seen on Section 3.4. Figure 4. Representation of the linguistic variable Price in the Wine FO. 3.2. Decision Support System Design This subsection describes how the designed DSS for choosing wines works. Let X={x1 , . . . , xn} be the overall set of alternatives and C={c1 , . . . , cm} the overall set of criteria. The main purpose of the process is to obtain a ranking set, R={r1 , . . . , ro} that includes the o best options among the set X . It should be noticed that o<n . In order to carry out this process, the following steps are followed: 1. Preferences providing step : Buyers provide their preferences according to the features that they want the selected wine to have. They can choose which features they want to provide information for and which labels they want to associate to them. Thanks to this, only the features that matter to the buyers are used on the search. Buyers express themselves using LM. They can choose labels from the linguistic label sets that conform the FO to provide information to the system. Let S={Sc1 , . . . , Scm} be the linguistic label sets used for describing the criteria specified in C . In case that a specific criterion is crisp instead of fuzzy, the possible values that the relation can
Mathematics 2020,8, 1724 7 of 18 have are listed. In the preference providing step, buyers provide the sets W , QC and QS to the system where: W={w1, . . . , wm1}(2) QC ={qc1, . . . , qcm1}(3) QS ={sqc1 i, . . . , sqcm1 j}(4) where m1 is the number of features selected by the buyers, QC is the set of features that have been selected and sqc1 i indicates the label whose index is i inside the linguistic label set Sqc1 . Finally, Wis the set of weights. 2. FO search : The preferences that the buyers have sent to the system are used for retrieving the individuals that better fulfil them. To carry out this task, the following steps are used: • Buyers determine the importance that each feature has to them by providing the set of weights W . If buyers do not want to provide this information or they feel unsure about it, it is possible to assign the same importance to all the features included on the query. Weights have an important role in the presented DSS. This is because they are the tools that buyers employ in order to determine the importance that should be given to each FO concept. In the Wine FO, the represented information is subjective and more related to tastes. Therefore, there not exist objective good solutions. Nevertheless, there can be other applications where this statement is not fulfilled. For instance, imagine a FO filled with information about smartphones and their characteristics. It is clear that everyone would want a smartphone with a high screen resolution, fast and cheap. In this case, the importance given to each concept will determine the set of smartphones that the buyers will receive. For instance, if the price has the highest weight on the query, cheap smartphones will be highlighted over the ones that have, for instance, a high screen resolution. Concretely, the query will end up returning cheap smartphones whose screen resolution is the highest possible one. This behavior is interesting in DSS environments that have a high number of alternatives. This is because the FO will focus on pareto-optimal smartphones, that is, the smartphones that, by fulfilling all the desired characteristics, have higher values for all the mentioned features. Smartphones that are worse in every sense to this pareto-optimal set, will be discarded. • The weighting values along with the preferences conform the user query. This query is taken by the FO reasoner to process it and generate a result. The query can be formally represented as: Q={w1·[qc1,sqc1 i], . . . , wk·[qck,sqck l], . . . , wm1·[qcm1,sqcm1 j]},k=1 . . . , m1. (5) • The FO reasoner uses an aggregation operator to calculate the similarity that each individual of the FO has with the query. Depending on the type of relation, the similarity of the individual according to one of the concepts included in the query is calculated as follows: – Crisp relation : Crisp relations are employed for binary relations, that is, the concept is fulfilled or not by the FO individual. If the query includes one of these concepts, the similarity is 1 if the individual fulfils the concept included on the query or 0 otherwise. – Fuzzy relation : In the case of fuzzy relations, the similarity is calculated as a number in the interval [ 0,1 ] . The similarity value of the FO individual is calculated using the membership function to the fuzzy set that represents the linguistic label specified for the concept included on the query.
Mathematics 2020,8, 1724 8 of 18 To calculate the similarity that alternative xh has to the query Q and the feature Cqk , the following expression can be used: SimC(xh,Cqk,Q) = µ{xh,sqck l}, (6) where µ{xh , sqck l} indicates the membership value that alternative xh has for the label sqck l and the concept qck . By using the weighted mean operator, it is possible to calculate the similarity value for xhand the query Qusing the following expression: Sim(xh,Q) = φ(wk,SimC(xh,Cqk,Q)),k=1, . . . , m1. (7) Once that the similarity value for each alternative is calculated, it is possible to select the o closer elements to the query. For this purpose, the following expression can be used: R=\ o rank(Sim(xh,Q)),h=1, . . . , n, (8) where rank is a function that sort all the results according to their similarity value. To takes the first oelements of the set. 3. Feedback advice : The users opinion system is called for the recommended wines. If one of the resulting wines have a low opinion value and a reasonable number of provided opinions, this issue is showed to the user as a warning. This way, users are alerted that the recommended wine did not fulfil other users expectations. 4. Providing opinion : After buying and testing the selected wine, the user is asked to carry out the feedback process. This process is exposed in more detail in Section 3.4. Its main purpose is to warn other users about problems with the selected choices. In Figure 5, this process is presented schematically. Figure 5. Designed DSS scheme. 3.3. Architecture Scheme Two possible architecture scheme options for implementing the process described in Section 3.2 were analysed: a client-server architecture and a distributed architecture. Both of them have their own advantages and drawbacks. Therefore, implementers should choose one or the other according to their needs. The client-server architecture design has the following advantages:
Mathematics 2020,8, 1724 9 of 18 • All the information is concentrated in a single point. This way, carrying out changes to the stored information is easy since only the server values have to be modified. In cases when the FO is in constant update, this is a really important point that should be taken into account. • All the calculations are carried out in the server. This way, users do not have to carry out any computations or install anything in their client devices. Easing the way that users interact and manage the designed system is critical if we want to encourage them to use it. Nevertheless, the use of a client-server architecture presents the following disadvantages: • Since all the information is concentrated in the same point, if the server fails or a connection error occurs between the server and the client devices, the system will stop working. Consequently, users will be unable to use the system until the error is fixed. • Since a single server holds all the computations, if a very high number of users access the system at the same time, the server may collapse. The main advantages of using a distributed architecture for carrying out the process are exposed below: • Distributed architectures are a good option when a high number of accesses are expected to the system. Due to the fact that the computational effort is divided among the different nodes, the system is rarely overcharged. • When there are several requests at the same time, the overall system response time is increased since several user petitions can be carried out at the same time. • One of the most important advantages of distributed architectures is the scalability that they provide. This way, it is easy to add and remove nodes from the computational network as needed. Furthermore, information from the FO becomes scalable since new information storing nodes can be added with new FO information in an easy way. • If the information is replicated in each information node, the system is more fault-tolerant. This is due to the fact that, if one of the network nodes fail, the system can rely on the other nodes to continue the operations as usual. The main drawbacks of using a distributed architecture are exposed below: • Maintaining a computational network is more expensive than maintaining a single server holding all the computations. If a very high number of users is not expected, to use a distributed architecture may not be worth it due to the expenses that it entails. • The overall computation of a single request is increased since time is lost during the network nodes communication. Therefore, using a distributed architecture can slow down the overall request resolving time when a low number of requests are being resolved by the system. • When the stored information is replicated in different nodes, making changes to the information is costly since all the nodes that stores the data must be modified. On the other hand, if the whole information is distributed in different nodes, this problem is solved but the overall network becomes less fault-tolerant. This is due to the fact that, for every request, all the information must be accessed. Therefore, if one of the information storing nodes fails, all the user client requests cannot be resolved. 3.4. Feedback Process In order to increase the reliability of the designed DSS, an user feedback process has been added to the system. Its main purpose is to aid users who are unsure about what wine they should choose. Thanks to this module, they can get benefit from the experience that other users that own their chosen wines had. The idea consists of allowing the users to provide an opinion about the wine after buying and trying it. The feedback process follows the next steps:
Mathematics 2020,8, 1724 16 of 18 of China(#71725001 and #71910107002). Finally, we would like to thank the “Juan de la Cierva Incorporación“ grant from the Spanish Ministry of Economy and Competitiveness. Conflicts of Interest: The authors declare no conflict of interest. References 1. Batmaz, Z.; Yurekli, A.; Bilge, A.; Kaleli, C. A review on deep learning for recommender systems: Challenges and remedies. Artif. Intell. Rev. 2019,52, 1–37. [CrossRef] 2. Cabrerizo, F.J.; Morente-Molinera, J.A.; Pedrycz, W.; Taghavi, A.; Herrera-Viedma, E. Granulating linguistic information in decision making under consensus and consistency. Expert Syst. Appl. 2018 ,99, 83–92. [CrossRef] 3. Jorro-Aragoneses, J.L.; Recio-García, J.A.; Díaz-Agudo, B.; Jimenez-Díaz, G. RecoLibry-core: A component-based framework for building recommender systems. Knowl.-Based Syst. 2019 ,182, 104854. [CrossRef] 4. Zuheros, C.; Li, C.C.; Cabrerizo, F.J.; Dong, Y.; Herrera-Viedma, E.; Herrera, F. Computing with words: Revisiting the qualitative scale. Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 2018,26, 127–143. [CrossRef] 5. The Fuzzy Wine Ontology. Available online: http://users.abo.fi/rowikstr/FuzzyWineOntology/ (accessed on 28 September 2020). 6. Li, C.C.; Dong, Y.; Herrera, F.; Herrera-Viedma, E.; Martínez, L. Personalized individual semantics in computing with words for supporting linguistic group decision making. An application on consensus reaching. Inf. Fusion 2017,33, 29–40. [CrossRef] 7. Zadeh, L.A. Computing with Words in Information/Intelligent Systems 1: Foundations; Physica: Berlin/ Heidelberg, Germany, 2013; Volume 33. 8. Zadeh, L.A. The concept of a linguistic variable and its application to approximate reasoning. Inf. Sci. 1975 , 8, 199–249 . [CrossRef] 9. Qiyas, M.; Abdullah, S.; Ashraf, S.; Abdullah, L. Linguistic Picture Fuzzy Dombi Aggregation Operators and Their Application in Multiple Attribute Group Decision Making Problem. Mathematics 2019 ,7, 764. [CrossRef] 10. Zhang, S.; Gao, H.; Wei, G.; Wei, Y.; Wei, C. Evaluation based on distance from average solution method for multiple criteria group decision making under picture 2-tuple linguistic environment. Mathematics 2019 , 7, 243. [CrossRef] 11. Zadeh, L.A. Fuzzy Sets. Inf. Control 1965,8, 338–353. [CrossRef] 12. Bhatia, S.; Richie, R.; Zou, W. Distributed semantic representations for modeling human judgment. Curr. Opin. Behav. Sci. 2019,29, 31–36. [CrossRef] 13. He, T.; Wei, G.; Lu, J.; Wei, C.; Lin, R. Pythagorean 2-Tuple Linguistic VIKOR Method for Evaluating Human Factors in Construction Project Management. Mathematics 2019,7, 1149. [CrossRef] 14. Li, C.; Yi, J.; Wang, H.; Zhang, G.; Li, J. Interval data driven construction of shadowed sets with application to linguistic word modelling. Inf. Sci. 2020,507, 503–521. [CrossRef] 15. Ponti, E.M.; Ohoran, H.; Berzak, Y.; Vuli´c, I.; Reichart, R.; Poibeau, T.; Shutova, E.; Korhonen, A. Modeling language variation and universals: A survey on typological linguistics for natural language processing. Comput. Linguist. 2019,45, 559–601. [CrossRef] 16. Alonso, S.; Pérez, I.J.; Cabrerizo, F.J.; Herrera-Viedma, E. A linguistic consensus model for Web 2.0 communities. Appl. Soft Comput. 2013,13, 149–157. [CrossRef] 17. Cabrerizo, F.J.; Al-Hmouz, R.; Morfeq, A.; Martínez, M.Á.; Pedrycz, W.; Herrera-Viedma, E. Estimating incomplete information in group decision making: A framework of granular computing. Appl. Soft Comput. 2020,86, 105930. [CrossRef] 18. Cabrerizo, F.J.; Ureña, R.; Pedrycz, W.; Herrera-Viedma, E. Building consensus in group decision making with an allocation of information granularity. Fuzzy Sets Syst. 2014,255, 115–127. [CrossRef] 19. Porcel, C.; Ching-Lopez, A.; Bernabé-Moreno, J.; Tejeda-Lorente, A.; Herrera-Viedma, E. Fuzzy Linguistic Recommender Systems for the Selective Diffusion of Information in Digital Libraries. JIPS J. Inf. Process. Syst. 2017,13, 653–667. [CrossRef]
Mathematics 2020,8, 1724 17 of 18 20. Porcel, C.; Herce-Zelaya, J.; Bernabé-Moreno, J.; Tejeda-Lorente, Á.; Herrera-Viedma, E. Trust Based Fuzzy Linguistic Recommender Systems as Reinforcement for Personalized Education in the Field of Oral Surgery and Implantology. Int. J. Comput. Commun. Control 2020,15. [CrossRef] 21. Huitzil, I.; Alegre, F.; Bobillo, F. GimmeHop: A recommender system for mobile devices using ontology reasoners and fuzzy logic. Fuzzy Sets Syst. 2019. [CrossRef] 22. Morente-Molinera, J.A.; Cabrerizo, F.J.; Mezei, J.; Carlsson, C.; Herrera-Viedma, E. A dynamic group decision making process for high number of alternatives using hesitant Fuzzy Ontologies and sentiment analysis. Knowl.-Based Syst. 2020,195, 105657. [CrossRef] 23. Qasim, I.; Alam, M.; Khan, S.; Khan, A.W.; Malik, K.M.; Saleem, M.; Bukhari, S.A.C. A comprehensive review of type-2 fuzzy ontology. Artif. Intell. Rev. 2020,53, 1187–1206. [CrossRef] 24. Sweidan, S.; El-Bakry, H.; Sabbeh, S.F. Construction of Liver Fibrosis Diagnosis Ontology From Fuzzy Extended ER Modeling: Construction of FibrOnto From an EER Model. Int. J. Decis. Support Syst. Technol. (IJDSST) 2020,12, 46–69. [CrossRef] 25. Giaretta, P. Philosophy and the Ontologies of Knowledge Representation in AI. In Ontology Makes Sense; IOS Press: Amsterdam, The Netherlands, 2019; pp. 24–36. 26. Norris, E.; Finnerty, A.N.; Hastings, J.; Stokes, G.; Michie, S. A scoping review of ontologies related to human behaviour change. Nat. Hum. Behav. 2019,3, 164–172. [CrossRef] [PubMed] 27. Bobillo, F.; Straccia, U. The fuzzy ontology reasoner fuzzyDL. Knowl.-Based Syst. 2016 ,95, 12–34. [CrossRef] 28. Carlsson, C.; Brunelli, M.; Mezei, J. Decision making with a fuzzy ontology. Soft Comput. 2012 ,16, 1143–1152. [CrossRef] 29. Carlsson, C.; Mezei, J.; Brunelli, M. Fuzzy Ontology Used for Knowledge Mobilization. Int. J. Intell. Syst. 2013,28, 52–71. [CrossRef] 30. Morente-Molinera, J.A.; Kou, G.; Pang, C.; Cabrerizo, F.J.; Herrera-Viedma, E. An automatic procedure to create fuzzy ontologies from users’ opinions using sentiment analysis procedures and multi-granular fuzzy linguistic modelling methods Inf. Sci. 2020,476, 222–238. [CrossRef] 31. Portmann, E. The FORA Framework: A Fuzzy Grassroots Ontology for Online Reputation Management; Springer Science & Business Media: Berkeley, CA, USA, 2012. 32. Portmann, E.; Meier, A. TA fuzzy grassroots ontology for improving weblog extraction. J. Digit. Inf. Manag. 2010,8, 276–284. 33. Portmann, E. A fuzzy grassroots ontology for improving social semantic web search. In Proceedings of the 6th International Summer School on Aggregation Operators, Benevento, Italy, 11–15 July 2011. 34. Subramanian, C.M.; Cherukuri, A.K. Fuzzy Role Based Access Control Design using Fuzzy Ontology. Int. J. Inf. Technol. Proj. Manag. (IJITPM) 2019,10, 118–136. [CrossRef] 35. Di Noia, T.; Mongiello, M.; Nocera, F.; Straccia, U. A fuzzy ontology-based approach for tool-supported decision making in architectural design. Knowl. Inf. Syst. 2019,58, 83–112. [CrossRef] 36. Straccia, U. Multi criteria decision making in fuzzy description logics: A first step. In International Conference on Knowledge-Based and Intelligent Information and Engineering Systems; Springer: Berlin/Heidelberg, Germany, 2009; pp. 78–86. 37. Lesani, M.; Naderan, M.; Alavi, S.E. Fuzzy Ontology with ANFIS Neural Network for Semantic Sensor Networks in Smart Homes based on Internet of Things. Int. J. Web Res. 2019,2, 26–38. 38. Sumathi, G.; Akilandeswari, J. Improved fuzzy weighted-iterative association rule based ontology postprocessing in data mining for query recommendation applications. Comput. Intell. 2020 ,36, 773–782. [CrossRef] 39. Huitzil, I., Bernad, J., Bobillo, F. GimmeHop: Algorithms for Instance Retrieval and Realization in Fuzzy Ontologies. Mathematics 2020,8, 154. [CrossRef] 40. Fu, C.; Chang, W.; Xue, M.; Yang, S. Multiple criteria group decision making with belief distributions and distributed preference relations. Eur. J. Oper. Res. 2019,273, 623–633. [CrossRef] 41. Luo, S.Z.; Zhang, H.Y.; Wang, J.Q.; Li, L. Group decision-making approach for evaluating the sustainability of constructed wetlands with probabilistic linguistic preference relations. J. Oper. Res. Soc. 2019 ,70, 2039–2055. [CrossRef] 42. Tang, M.; Zhou, X.; Liao, H.; Xu, J.; Fujita, H.; Herrera, F. Ordinal consensus measure with objective threshold for heterogeneous large-scale group decision making. Knowl.-Based Syst. 2019,180, 62–74. [CrossRef]
Mathematics 2020,8, 1724 18 of 18 43. Wu, Z.; Xu, J. A consensus model for large-scale group decision making with hesitant fuzzy information and changeable clusters. Inf. Fusion 2018,41, 217–231. [CrossRef] 44. Xiao, J.; Wang, X.; Zhang, H. Managing personalized individual semantics and consensus in linguistic distribution large-scale group decision making. Inf. Fusion 2020,53, 20–34. [CrossRef] 45. Gou, X.; Xu, Z.; Liao, H.; Herrera, F. Consensus Model Handling Minority Opinions and Noncooperative Behaviors in Large-Scale Group Decision-Making Under Double Hierarchy Linguistic Preference Relations. IEEE Trans. Cybern. 2020, in press. [CrossRef] 46. Liu, X.; Xu, Y.; Montes, R.; Ding, R.X.; Herrera, F. Alternative ranking-based clustering and reliability index-based consensus reaching process for hesitant fuzzy large scale group decision making. IEEE Trans. Fuzzy Syst. 2018,27, 159–171. [CrossRef] 47. Morente-Molinera, J.A.; Ríos-Aguilar, S.; González-Crespo, R.; Herrera-Viedma, E. Dealing with group decision-making environments that have a high amount of alternatives using card-sorting techniques. Expert Syst. Appl. 2019,127, 187–198. [CrossRef] 48. Wu, T.; Liu, X.; Qin, J. A linguistic solution for double large-scale group decision-making in E-commerce. Comput. Ind. Eng. 2018,116, 97–112. [CrossRef] 49. Du, Z.J.; Luo, H.Y.; Lin, X.D.; Yu, S.M. A trust-similarity analysis-based clustering method for large-scale group decision-making under a social network. Inf. Fusion 2020. [CrossRef] 50. Liu, B.; Zhou, Q.; Ding, R.X.; Palomares, I.; Herrera, F. Large-scale group decision making model based on social network analysis: Trust relationship-based conflict detection and elimination. Eur. J. Oper. Res. 2019 , 275, 737–754. [CrossRef] 51. Tian, Z.P.; Nie, R.X.; Wang, J.Q. Social network analysis-based consensus-supporting framework for large-scale group decision-making with incomplete interval type-2 fuzzy information. Inf. Sci. 2019 , 502, 446–471. [CrossRef] 52. Ren, R.; Tang, M.; Liao, H. Managing Minority opinions in micro-grid planning by a social network analysis-based large scale group decision making method with hesitant fuzzy linguistic information. Knowl.-Based Syst. 2020,189, 105060. [CrossRef] 53. Hudec, M.; Mesiar, R. The axiomatization of asymmetric disjunction and conjunction. Inf. Fusion 2020 , 53, 165–173. [CrossRef] 54. Dujmovic, J. Soft Computing Evaluation Logic: The LSP Decision Method and Its Applications; John Wiley & Sons: Hoboken, NJ, USA, 2018. c 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).