Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction

Machine Learning is concerned in constructing models which can learn and make predictions based on data. Rule extraction from real world data that are usually tainted with noise, ambiguity, and uncertainty, automatically requires feature selection. Neuro-Fuzzy system (NFS) which is known with its pr...

Full description

Saved in:
Bibliographic Details
Main Author: Al-Himyari, Bayadir Abbas
Format: Thesis
Language:eng
eng
Published: 2017
Subjects:
Online Access:https://etd.uum.edu.my/6809/1/s93024_01.pdf
https://etd.uum.edu.my/6809/2/s93024_02.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-uum-etd.6809
record_format uketd_dc
institution Universiti Utara Malaysia
collection UUM ETD
language eng
eng
advisor Yasin, Azman
Horizon, Gitano
topic QA76.76 Fuzzy System.
spellingShingle QA76.76 Fuzzy System.
Al-Himyari, Bayadir Abbas
Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
description Machine Learning is concerned in constructing models which can learn and make predictions based on data. Rule extraction from real world data that are usually tainted with noise, ambiguity, and uncertainty, automatically requires feature selection. Neuro-Fuzzy system (NFS) which is known with its prediction performance has the difficulty in determining the proper number of rules and the number of membership functions for each rule. An enhanced hybrid Genetic Algorithm based Fuzzy Bayesian classifier (GA-FBC) was proposed to help the NFS in the rule extraction. Feature selection was performed in the rule level overcoming the problems of the FBC which depends on the frequency of the features leading to ignore the patterns of small classes. As dealing with a real world problem such as the Air/Fuel Ratio (AFR) prediction, a multi-objective problem is adopted. The GA-FBC uses mutual information entropy, which considers the relevance between feature attributes and class attributes. A fitness function is proposed to deal with multi-objective problem without weight using a new composition method. The model was compared to other learning algorithms for NFS such as Fuzzy c-means (FCM) and grid partition algorithm. Predictive accuracy and the complexity of the Fuzzy Rule Base System (FRBS) including number of rules and number of terms in each rule were taken as terms of evaluation. It was also compared to the original GA-FBC depending on the frequency not on Mutual Information (MI). Experimental results using Air/Fuel Ratio (AFR) data sets show that the new model participates in decreasing the average number of attributes in the rule and sometimes in increasing the average performance compared to other models. This work facilitates in achieving a self-generating FRBS from real data. The GA-FBC can be used as a new direction in machine learning research. This research contributes in controlling automobile emissions in helping the reduction of one of the most causes of pollution to produce greener environment.
format Thesis
qualification_name other
qualification_level Doctorate
author Al-Himyari, Bayadir Abbas
author_facet Al-Himyari, Bayadir Abbas
author_sort Al-Himyari, Bayadir Abbas
title Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
title_short Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
title_full Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
title_fullStr Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
title_full_unstemmed Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
title_sort self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction
granting_institution Universiti Utara Malaysia
granting_department Awang Had Salleh Graduate School of Arts & Sciences
publishDate 2017
url https://etd.uum.edu.my/6809/1/s93024_01.pdf
https://etd.uum.edu.my/6809/2/s93024_02.pdf
_version_ 1747828117930508288
spelling my-uum-etd.68092021-05-02T00:51:34Z Self learning neuro-fuzzy modeling using hybrid genetic probabilistic approach for engine air/fuel ratio prediction 2017 Al-Himyari, Bayadir Abbas Yasin, Azman Horizon, Gitano Awang Had Salleh Graduate School of Arts & Sciences Awang Had Salleh Graduate School of Arts and Sciences QA76.76 Fuzzy System. Machine Learning is concerned in constructing models which can learn and make predictions based on data. Rule extraction from real world data that are usually tainted with noise, ambiguity, and uncertainty, automatically requires feature selection. Neuro-Fuzzy system (NFS) which is known with its prediction performance has the difficulty in determining the proper number of rules and the number of membership functions for each rule. An enhanced hybrid Genetic Algorithm based Fuzzy Bayesian classifier (GA-FBC) was proposed to help the NFS in the rule extraction. Feature selection was performed in the rule level overcoming the problems of the FBC which depends on the frequency of the features leading to ignore the patterns of small classes. As dealing with a real world problem such as the Air/Fuel Ratio (AFR) prediction, a multi-objective problem is adopted. The GA-FBC uses mutual information entropy, which considers the relevance between feature attributes and class attributes. A fitness function is proposed to deal with multi-objective problem without weight using a new composition method. The model was compared to other learning algorithms for NFS such as Fuzzy c-means (FCM) and grid partition algorithm. Predictive accuracy and the complexity of the Fuzzy Rule Base System (FRBS) including number of rules and number of terms in each rule were taken as terms of evaluation. It was also compared to the original GA-FBC depending on the frequency not on Mutual Information (MI). Experimental results using Air/Fuel Ratio (AFR) data sets show that the new model participates in decreasing the average number of attributes in the rule and sometimes in increasing the average performance compared to other models. This work facilitates in achieving a self-generating FRBS from real data. The GA-FBC can be used as a new direction in machine learning research. This research contributes in controlling automobile emissions in helping the reduction of one of the most causes of pollution to produce greener environment. 2017 Thesis https://etd.uum.edu.my/6809/ https://etd.uum.edu.my/6809/1/s93024_01.pdf text eng public https://etd.uum.edu.my/6809/2/s93024_02.pdf text eng public other doctoral Universiti Utara Malaysia Abadeh, M. S., Habibi, J., & Lucas, C. (2007). Intrusion detection using a fuzzy genetics-based learning algorithm. Journal of Network and Computer Applications, 30(1), 414-428. Abraham, A. (2004). Intelligent systems: Architectures and perspectives. arXiv preprint cs/0405009. Abraham, A. (2005). Adaptation of fuzzy inference system using neural learning Fuzzy systems engineering (pp. 53-83): Springer. Alcala-Fdez, J., Alcala, R., & Herrera, F. (2011). A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning. Fuzzy Systems, IEEE Transactions on, 19(5), 857-872. Alcalá‐Fdez, J., Herrera, F., Márquez, F., & Peregrín, A. (2007). Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems. International Journal of Intelligent Systems, 22(9), 1035-1064. Alcalá, R., Gacto, M. J., & Herrera, F. (2011). A fast and scalable multiobjective genetic fuzzy system for linguistic fuzzy modeling in high-dimensional regression problems. Fuzzy Systems, IEEE Transactions on, 19(4), 666-681. Alsmadi, M. K. S., Omar, K. B., & Noah, S. A. (2009). Back propagation algorithm: the best algorithm among the multi-layer perceptron algorithm. International Journal of Computer Science and Network Security, 9(4), 378-383. Amakali, S. (2008). Development of models for short-term load forecasting using artificial neural networks. Antonelli, M., Ducange, P., & Marcelloni, F. (2012). Multi-objective evolutionary rule and condition selection for designing fuzzy rule-based classifiers. Paper presented at the Fuzzy Systems (FUZZ-IEEE), 2012 IEEE International Conference on. Bailey, A. (2001). Class-dependent features and multicategory classification. Citeseer. Barghi, F., & Safavi, A. (2012). An intelligent control policy for fuel injection control of CNG engines. Iranian Journal of Science and Technology. Transactions of Electrical Engineering, 36(E1), 83. Battiti, R. (1994). Using mutual information for selecting features in supervised neural net learning. Neural Networks, IEEE Transactions on, 5(4), 537-550. Bezdek, J. C. (1981). Pattern recognition with fuzzy objective function algorithms: Kluwer Academic Publishers. Bose, N., & Kumar, N. S. (2007). Prediction of engine emissions through Fuzzy logic Modeling. Paper presented at the Conference on Computational Intelligence and Multimedia Applications, 2007. International Conference on. Boyd, S., Kim, S.-J., Vandenberghe, L., & Hassibi, A. (2007). A tutorial on geometric programming. Optimization and engineering, 8(1), 67-127. Brown, G., Pocock, A., Zhao, M.-J., & Luján, M. (2012). Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. The Journal of Machine Learning Research, 13(1), 27-66. Cao, H., Du, D., Peng, Y., & Yin, Y. (2006). Air-Fuel-Ratio optimal control of a gas heating furnace based on fuzzy neural networks Advances in Neural Networks-ISNN 2006 (pp. 876-884): Springer. Carvalho, D. R., & Freitas, A. A. (2002). A genetic-algorithm for discovering smalldisjunct rules in data mining. Applied soft computing, 2(2), 75-88. Casillas, J., Cordón, O., Del Jesus, M. J., & Herrera, F. (2001). Genetic feature selection in a fuzzy rule-based classification system learning process for highdimensional problems. Information Sciences, 136(1), 135-157. Casillas, J., Cordón, O., Del Jesus, M. J., & Herrera, F. (2005). Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. Fuzzy Systems, IEEE Transactions on, 13(1), 13-29. Chakraborty, D., & Pal, N. R. (2004). A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification. Neural Networks, IEEE Transactions on, 15(1), 110-123. Chen, Y.-C., Pal, N. R., & Chung, I. (2012). An integrated mechanism for feature selection and fuzzy rule extraction for classification. Fuzzy Systems, IEEE Transactions on, 20(4), 683-698. Chiu, S. L. (1994). Fuzzy model identification based on cluster estimation. Journal of Intelligent and Fuzzy Systems, 2(3), 267-278. Coello, C. A. C. (2005). An introduction to evolutionary algorithms and their applications Advanced Distributed Systems (pp. 425-442): Springer. Cordón, O., Herrera, E., Gomide, E., Hoffman, E., & Magdalena, L. (2004). Ten years of genetic fuzzy systems: current framework and new trends. Paper presented at the IFSA World Congress and 20th NAFIPS International Conference, 2001. Joint 9th. Cordón, O., Herrera, F., Hoffmann, F., & Magdalena, L. (2001). Genetic fuzzy systems: World Scientific Publishing Company Singapore. Cover, T. M., & Thomas, J. A. (2012). Elements of information theory: John Wiley & Sons. Dailey, D. J., Harn, P., & Lin, P.-J. (1996). ITS data fusion: Washington State Department of Transportation. Dehuri, S., Patnaik, S., Ghosh, A., & Mall, R. (2008). Application of elitist multiobjective genetic algorithm for classification rule generation. Applied soft computing, 8(1), 477-487. Dunn, J. C. (1973). A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. Durrant-Whyte, H., & Henderson, T. C. (2008). Multisensor data fusion Springer Handbook of Robotics (pp. 585-610): Springer. Ebrahimi, B., Tafreshi, R., Masudi, H., Franchek, M., Mohammadpour, J., & Grigoriadis, K. (2012). A parameter-varying filtered PID strategy for air–fuel ratio control of spark ignition engines. Control Engineering Practice, 20(8), 805-815. Emmanouilidis, C., Hunter, A., & MacIntyre, J. (2000). A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator. Paper presented at the Evolutionary Computation, 2000. Proceedings of the 2000 Congress on. Fazzolari, M., Alcala, R., Nojima, Y., Ishibuchi, H., & Herrera, F. (2013). A review of the application of multiobjective evolutionary fuzzy systems: Current status and further directions. IEEE Transactions on fuzzy systems, 21(1), 45-65. Fernández, A., López, V., del Jesus, M. J., & Herrera, F. (2015). Revisiting Evolutionary Fuzzy Systems: Taxonomy, applications, new trends and challenges. Knowledge-Based Systems. Flach, P. (2012). Machine learning: the art and science of algorithms that make sense of data: Cambridge University Press. Fogel, D. B., & Fogel, L. J. (1996). An introduction to evolutionary programming. Paper presented at the Artificial Evolution. Gacto, M. J., Alcalá, R., & Herrera, F. (2010). Integration of an index to preserve the semantic interpretability in the multiobjective evolutionary rule selection and tuning of linguistic fuzzy systems. Fuzzy Systems, IEEE Transactions on, 18(3), 515-531. Gacto, M. J., Alcalá, R., & Herrera, F. (2011). Interpretability of linguistic fuzzy rulebased systems: An overview of interpretability measures. Information Sciences, 181(20), 4340-4360. Garcia, A. M. (2013). Feed-Forward Air-Fuel Ratio Control during Transient Operation of an Alternative Fueled Engine. The Ohio State University. Ghaffari, A., Shamekhi, A. H., Saki, A., & Kamrani, E. (2008). Adaptive fuzzy control for air-fuel ratio of automobile spark ignition engine. World Academy of Science, Engineering and Technology, 48, 284-292. Gliwa, B., & Byrski, A. (2011). Hybrid neuro-fuzzy classifier based on NEFCLASS model. Computer Science, 115-135. Gonzalez, A., & Perez, R. (2001). Selection of relevant features in a fuzzy genetic learning algorithm. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 31(3), 417-425. Gonzblez, A., & Pérez, R. (1999). SLAVE: A genetic learning system based on an iterative approach. Fuzzy Systems, IEEE Transactions on, 7(2), 176-191. Gopalakrishnan, K., Ceylan, H., & Attoh-Okine, N. O. (2009). Intelligent and soft computing in infrastructure systems engineering: recent advances (Vol. 259): Springer Science & Business Media. Gopalakrishnan, V., Lustgarten, J. L., Visweswaran, S., & Cooper, G. F. (2010). Bayesian rule learning for biomedical data mining. Bioinformatics, 26(5), 668-675. Gorrostieta, E., & Pedraza, C. (2006). Neuro fuzzy modeling of control systems. Paper presented at the Electronics, Communications and Computers, 2006. CONIELECOMP 2006. 16th International Conference on. Grosan, C., & Abraham, A. (2011). Intelligent Systems: Springer. Guyon, I. (2006). Feature extraction: foundations and applications (Vol. 207): Springer Science & Business Media. Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. The Journal of Machine Learning Research, 3, 1157-1182. Hastie, T., Tibshirani, R., Friedman, J., Hastie, T., Friedman, J., & Tibshirani, R. (2009). The elements of statistical learning (Vol. 2): Springer. Herrera, F. (2008). Genetic fuzzy systems: taxonomy, current research trends and prospects. Evolutionary Intelligence, 1(1), 27-46. Holland, J. H. (1975). Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence: U Michigan Press. Hong, T.-P., Wang, H.-S., Lin, W.-Y., & Lee, W.-Y. (2002). Evolution of appropriate crossover and mutation operators in a genetic process. Applied Intelligence, 16(1), 7-17. Hu, B.-G. (2014). What are the differences between Bayesian classifiers and mutual information classifiers? Neural Networks and Learning Systems, IEEE Transactions on, 25(2), 249-264. Hu, B.-G. (2015). Information Theory and Its Relation to Machine Learning. Paper presented at the Proceedings of the 2015 Chinese Intelligent Automation Conference. Huysmans, J., Baesens, B., & Vanthienen, J. (2006). Using rule extraction to improve the comprehensibility of predictive models. Available at SSRN 961358. Huysmans, J., Dejaeger, K., Mues, C., Vanthienen, J., & Baesens, B. (2011). An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models. Decision Support Systems, 51(1), 141-154. Ichihashi, H., Shirai, T., Nagasaka, K., & Miyoshi, T. (1996). Neuro-fuzzy ID3: a method of inducing fuzzy decision trees with linear programming for maximizing entropy and an algebraic method for incremental learning. Fuzzy Sets and Systems, 81(1), 157-167. Ishibuchi, H., Nakashima, T., & Morisawa, T. (1997). Simple fuzzy rule-based classification systems perform well on commonly used real-world data sets. Paper presented at the Fuzzy Information Processing Society, 1997. NAFIPS'97., 1997 Annual Meeting of the North American. Ishibuchi, H., Nakashima, T., & Morisawa, T. (1999). Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets and Systems, 103(2), 223-238. Ishibuchi, H., Nakashima, T., & Murata, T. (2001). Three-objective genetics-based machine learning for linguistic rule extraction. Information Sciences, 136(1), 109-133. Ishibuchi, H., & Nojima, Y. (2007). Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning. International Journal of Approximate Reasoning, 44(1), 4-31. Ishibuchi, H., & Yamamoto, T. (2004). Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets and Systems, 141(1), 59-88. Ishibuchi, H., Yamamoto, T., & Nakashima, T. (2005). Hybridization of fuzzy GBML approaches for pattern classification problems. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 35(2), 359-365. Ishida, C. Y., Pozo, A., Goldbarg, E., & Goldbarg, M. (2009). Multiobjective optimization and rule learning: Subselection algorithm or meta-heuristic algorithm? Innovative applications in data mining (pp. 47-70): Springer. Jin, Y. (2000). Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement. Fuzzy Systems, IEEE Transactions on, 8(2), 212-221. Jin, Y. (2012). Advanced fuzzy systems design and applications (Vol. 112): Physica. Juang, C.-F., Lin, J.-Y., & Lin, C.-T. (2000). Genetic reinforcement learning through symbiotic evolution for fuzzy controller design. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 30(2), 290-302. Karegowda, A. G., Jayaram, M., & Manjunath, A. (2010). Feature subset selection problem using wrapper approach in supervised learning. International journal of Computer applications, 1(7), 13-17. Khaleghi, B., Khamis, A., Karray, F. O., & Razavi, S. N. (2013). Multisensor data fusion: A review of the state-of-the-art. Information Fusion, 14(1), 28-44. Kira, K., & Rendell, L. A. (1992). A practical approach to feature selection. Paper presented at the Proceedings of the ninth international workshop on Machine learning. Knowles, J. D., & Corne, D. W. (2000). M-PAES: A memetic algorithm for multiobjective optimization. Paper presented at the Evolutionary Computation, 2000. Proceedings of the 2000 Congress on. Koch, W. (2010). On Bayesian tracking and data fusion: a tutorial introduction with examples. Aerospace and Electronic Systems Magazine, IEEE, 25(7), 29-52. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. Paper presented at the Ijcai. Kumar, V., & Minz, S. (2014). Feature Selection. SmartCR, 4(3), 211-229. Lakhmi, J., & Lim, C. (2010). Handbook on Decision Making: Techniques and Applications. Intelligent Systems Reference Library, 4, 548. Lee, H.-M., Chen, C.-M., Chen, J.-M., & Jou, Y.-L. (2001). An efficient fuzzy classifier with feature selection based on fuzzy entropy. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 31(3), 426-432. Lee, S. H., Howlett, R., & Walters, S. (2004). Engine fuel injection control using fuzzy logic. Intelligent Sistems & Signal Processing Laboratories. Liu, Z.-q., & Zhou, Y.-c. (2010). A fuzzy neural network and application to air-fuel ratio control under Gasoline Engine Transient Condition. Paper presented at the Intelligent System Design and Engineering Application (ISDEA), 2010 International Conference on. Lughofer, E., & Kindermann, S. (2010). SparseFIS: data-driven learning of fuzzy systems with sparsity constraints. Fuzzy Systems, IEEE Transactions on, 18(2), 396-411. Lv, H., Zhu, B., & Tang, Y. (2007). Fuzzy Classifier with Probabilistic IF-THEN Rules Foundations of Fuzzy Logic and Soft Computing (pp. 666-676): Springer. Ma, B. (2001). Parametric and nonparametric approaches for multisensor data fusion. The University of Michigan. Mahajan, S. R. (2013). Air Pollution from IC Engines & It‘s Control. Carbon, 1(50), 500. Mandal, S., & Pal, M. K. K. S. K. (2011). Pattern Recognition and Machine Intelligence. Mansoori, E. G., Zolghadri, M. J., & Katebi, S. D. (2007). A weighting function for improving fuzzy classification systems performance. Fuzzy Sets and Systems, 158(5), 583-591. Mansoori, E. G., Zolghadri, M. J., & Katebi, S. D. (2008). SGERD: A steady-state genetic algorithm for extracting fuzzy classification rules from data. Fuzzy Systems, IEEE Transactions on, 16(4), 1061-1071. Michalewicz, Z. (2013). Genetic algorithms+ data structures= evolution programs: Springer Science & Business Media. Mitchell, H. (2007). Introduction Multi-Sensor Data Fusion (pp. 3-13): Springer. Mitra, S., & Hayashi, Y. (2000). Neuro-fuzzy rule generation: survey in soft computing framework. Neural Networks, IEEE Transactions on, 11(3), 748-768. Mumford, C. L. (2009). Computational intelligence: collaboration, fusion and emergence (Vol. 1): Springer Science & Business Media. Nauck, D., & Kruse, R. (1997). A neuro-fuzzy method to learn fuzzy classification rules from data. Fuzzy Sets and Systems, 89(3), 277-288. Nauck, D., & Nurnberger, A. (2005). The evolution of neuro-fuzzy systems. Paper presented at the Fuzzy Information Processing Society, 2005. NAFIPS 2005. Annual Meeting of the North American. Navot, A. (2006). On the role of feature selection in machine learning. Hebrew University. Negnevitsky, M. (2005). Artificial intelligence: a guide to intelligent systems: Pearson Education. Noda, E., Freitas, A., & Lopes, H. S. (1999). Discovering interesting prediction rules with a genetic algorithm. Paper presented at the Evolutionary Computation, 1999. CEC 99. Proceedings of the 1999 Congress on. Noda, E., Freitas, A. A., & Yamakami, A. (2003). A Distributed-Population GA for Discovering Interesting Prediction Rules Advances in Soft Computing (pp. 287-296): Springer. Nozaki, K., Ishibuchi, H., & Tanaka, H. (1996). Adaptive fuzzy rule-based classification systems. Fuzzy Systems, IEEE Transactions on, 4(3), 238-250. Oh, I.-S., Lee, J.-S., & Moon, B.-R. (2004). Hybrid genetic algorithms for feature selection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(11), 1424-1437. Pal, N. R., & Saha, S. (2008). Simultaneous structure identification and fuzzy rule generation for Takagi–Sugeno models. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 38(6), 1626-1638. Peña-Reyes, C. A. (2004). Coevolutionary fuzzy modeling (Vol. 3204): Springer Science & Business Media. Picek, S., & Golub, M. (2010). Comparison of a crossover operator in binary-coded genetic algorithms. WSEAS transactions on computers, 9, 1064-1073. Pomares, H., Rojas, I., Ortega, J., Gonzalez, J., & Prieto, A. (2000). A systematic approach to a self-generating fuzzy rule-table for function approximation. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 30(3), 431-447. Qin, Y., Langari, R., & Gu, L. (2015). A new modeling algorithm based on ANFIS and GMDH. Journal of Intelligent & Fuzzy Systems, 1-9. Quinlan, J. (2014). MDL and categorical theories (continued). Paper presented at the Proceedings of the Twelfth International Conference on Machine Learning. Raitamäki, J. (2003). An approach to linguistic pattern recognition using fuzzy systems: Jyväskylän yliopisto. Ravi, V., & Zimmermann, H.-J. (2000). Fuzzy rule based classification with FeatureSelector and modified threshold accepting. European Journal of Operational Research, 123(1), 16-28. Rawat, K., & Burse, K. ( 2013). A Soft Computing Genetic-Neuro fuzzy Approach for Data Mining and Its Application to Medical Diagnosis. International Journal of Engineering and Advanced Technology, 3(1). Reid, D. J. (2000). Feasibility and Genetic Algorithms: The Behaviour of Crossover and Mutation: DTIC Document. Rezaee, M. R., Goedhart, B., Lelieveldt, B. P., & Reiber, J. H. (1999). Fuzzy feature selection. Pattern Recognition, 32(12), 2011-2019. Richter, T., Oliveira, A. F., & da Silva, I. N. (2010). Virtual oxygen sensor implementation using artificial neural networks Technological Developments in Education and Automation (pp. 219-224): Springer. Rigatos, G. G. (2011). Modelling and Control for Intelligent Industrial Systems: Springer. Riza, L. S., Bergmeir, C. N., Herrera, F., & Benítez Sánchez, J. M. (2015). frbs: fuzzy rule-based systems for classification and regression in R. Ross, T. J. (2013). Fuzzy logic with engineering applications (Vol. 761): Wiley. Rudas, I. J., & Kaynak, M. O. (1998). Entropy-based operations on fuzzy sets. Fuzzy Systems, IEEE Transactions on, 6(1), 33-40. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1988). Learning representations by back-propagating errors. Cognitive modeling, 5. Sadoghi Yazdi, H., & Vahedian Mazloum, A. (2009). Fuzzy Bayesian classification of LR Fuzzy numbers. International Journal of Engineering and Technology, 1. Sánchez, L., Suárez, M. R., Villar, J. R., & Couso, I. (2008). Mutual informationbased feature selection and partition design in fuzzy rule-based classifiers from vague data. International Journal of Approximate Reasoning, 49(3), 607-622. Sarkar, B. K., Sana, S. S., & Chaudhuri, K. (2012). A genetic algorithm-based rule extraction system. Applied soft computing, 12(1), 238-254. Saxena, V., & Pratap, A. (2012). Genetic Algorithm Based Bayesian Classification Algorithm for Object Oriented Data. IRACST-International Journal of Computer Science and Information Technology & Security (IJCSITS), 2(6), 1177-1182. Setnes, M., & Roubos, H. (2000). GA-fuzzy modeling and classification: complexity and performance. Fuzzy Systems, IEEE Transactions on, 8(5), 509-522. Silipo, R., & Berthold, M. R. (2000). Input features' impact on fuzzy decision processes. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 30(6), 821-834. Sivanandam, S., & Deepa, S. (2007). Introduction to genetic algorithms: Springer Science & Business Media. Tang, Y., & Sun, S. (2004). A mixture model of classical fuzzy classifiers Advances in Web-Age Information Management (pp. 616-621): Springer. Triantaphyllou, E., & Felici, G. (2006). Data mining and knowledge discovery approaches based on rule induction techniques (Vol. 6): Springer Science & Business Media. Ukil, A. (2007). Intelligent systems and signal processing in power engineering: Springer Science & Business Media. Vancoillie, F. (2003). Design and application of artificial neural networks for digital image classification of tropical savanna vegetation. Ghent University. Wang, L.-X., & Mendel, J. M. (1992). Generating fuzzy rules by learning from examples. Systems, Man and Cybernetics, IEEE Transactions on, 22(6), 1414-1427. Wang, L., & Fu, X. (2006). Data mining with computational intelligence: Springer Science & Business Media. Wang, Y., Chang, H., Wang, Z., & Li, X. (2003). Input selection and rule generation in Adaptive Neuro-Fuzzy Inference System for protein structure prediction Intelligent Data Engineering and Automated Learning (pp. 514-521): Springer. Wargo, J., Wargo, L. E., & Alderman, N. (2006). The harmful effects of vehicle exhaust: A case for policy change: Environment & Human Health. Wong, P. K., Wong, H. C., Vong, C. M., & Wong, K. I. (2016). Online wavelet leastsquares support vector machine fuzzy predictive control for engine lambda regulation. International Journal of Engine Research, 1468087415623909. Wu, H.-C. (2004). Fuzzy reliability estimation using Bayesian approach. Computers & Industrial Engineering, 46(3), 467-493. Xu, J., & Zhou, X. (2011). Fuzzy-like multiple objective decision making (Vol. 263): Springer. Zarandi, M. H. F., Mohammadhasan, N., & Bastani, S. (2012). A fuzzy rule-based expert system for evaluating intellectual capital. Advances in Fuzzy Systems, 2012, 7. Zhang, C. K., & Hu, H. (2005). An effective feature selection scheme via genetic algorithm using mutual information Fuzzy Systems and Knowledge Discovery (pp. 73-80): Springer. Zhang, X., & Hu, B.-G. (2014). A new strategy of cost-free learning in the class imbalance problem. Knowledge and Data Engineering, IEEE Transactions on, 26(12), 2872-2885. Zhao, H.-c., & Sun, Z.-s. (2012). A Heuristic Algorithm for Rule Extraction Based on Conditional Information Entropy. International Journal of Advancements in Computing Technology, 4(21). Zilouchian, A., & Jamshidi, M. (2000). Intelligent control systems using soft computing methodologies: CRC Press, Inc.