Autosoft Journal

Online Manuscript Access


Training ANFIS Using the Enhanced Bees Algorithm and Least Squares Estimation


Authors



Abstract

This paper presents the result of research in developing a novel training model for Adaptive Neuro-Fuzzy Inference Systems (ANFIS). ANFIS integrates the learning ability of Artificial Neural Networks with the Takagi-Sugeno Fuzzy Inference System to approximate nonlinear functions. Therefore, it is considered as a Universal Estimator. The original algorithm used in ANFIS training process has a hybrid model that uses Steepest Decent Derivative; therefore, it inherits low convergence rate and local minima during training. In this study, a training algorithm is proposed that combines Bees Algorithm (BA) and Least Square Estimation (LSE) (BA-LSE). The local and global exploration of BA as integrates with the best-fit solution of the LSE improves current shortcomings of ANFIS training process. The proposed training algorithm is examined under three different scenarios of function approximation, time series prediction, and classification experiments in order to verify the promising improvements in the training process of ANFIS. The experimental results validate high generalization capabilities of the BA-LSE training algorithm in comparison to the original hybrid training model of ANFIS. The new training model also enhances local minima avoidance and has high convergence rate.


Keywords


Pages

Total Pages: 8
Pages: 227-234

DOI
10.1080/10798587.2016.1196880


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways


Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Published

Volume: 23
Issue: 2
Year: 2016

Cite this document


References

Mira, José, and Alberto Prieto, eds. "Connectionist Models of Neurons, Learning Processes, and Artificial Intelligence." Lecture Notes in Computer Science (2001): n. pag. Crossref. Web. https://doi.org/10.1007/3-540-45720-8

Bache, K. & Lichman, M. (2013). UCI machine learning repository: University of California, School of Information and Computer Science. Retrieved from http://archive.ics.uci.edu/ml, 2013.

Bilgehan, Mahmut. "Comparison of ANFIS and NN models—With a Study in Critical Buckling Load Estimation." Applied Soft Computing 11.4 (2011): 3779-3791. Crossref. Web. https://doi.org/10.1016/j.asoc.2011.02.011

Blum, Christian, and Daniel Merkle, eds. "Swarm Intelligence." Natural Computing Series (2008): n. pag. Crossref. Web. https://doi.org/10.1007/978-3-540-74089-6

Carrano, Eduardo G. et al. "A Genetic Algorithm for Multiobjective Training of ANFIS Fuzzy Networks." 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) (2008): n. pag. Crossref. Web. https://doi.org/10.1109/CEC.2008.4631239

Catalao, J. P. S., and V. M. F. Mendes. "Influence of Environmental Constraints on Profit-Based Short-Term Thermal Scheduling." IEEE Transactions on Sustainable Energy 2.2 (2011): 131-138. Crossref. Web. https://doi.org/10.1109/TSTE.2010.2101088

Cheng, Ching-Hsue, Liang-Ying Wei, and You-Shyang Chen. "Fusion ANFIS Models Based on Multi-Stock Volatility Causality for TAIEX Forecasting." Neurocomputing 72.16-18 (2009): 3462-3468. Crossref. Web. https://doi.org/10.1016/j.neucom.2008.09.027

Ding, Feng. "Combined State and Least Squares Parameter Estimation Algorithms for Dynamic Systems." Applied Mathematical Modelling 38.1 (2014): 403-412. Crossref. Web. https://doi.org/10.1016/j.apm.2013.06.007

Duch, W. "Uncertainty of Data, Fuzzy Membership Functions, and Multilayer Perceptrons." IEEE Transactions on Neural Networks 16.1 (2005): 10-23. Crossref. Web. https://doi.org/10.1109/TNN.2004.836200

Gite A.V. International Journal of Engineering Research and Technology

Jang, J.-S.R. "ANFIS: Adaptive-Network-Based Fuzzy Inference System." IEEE Transactions on Systems, Man, and Cybernetics 23.3 (1993): 665-685. Crossref. Web. https://doi.org/10.1109/21.256541

Khoshgoftaar, Taghi M, Jason Van Hulse, and Amri Napolitano. "Supervised Neural Network Modeling: An Empirical Investigation Into Learning From Imbalanced Data With Labeling Errors." IEEE Transactions on Neural Networks 21.5 (2010): 813-830. Crossref. Web. https://doi.org/10.1109/TNN.2010.2042730

Puyin Liu. "Mamdani Fuzzy System: Universal Approximator to a Class of Random Processes." IEEE Transactions on Fuzzy Systems 10.6 (2002): 756-766. Crossref. Web. https://doi.org/10.1109/TFUZZ.2002.805890

Ma X. Future Communication Technology (2 Volume Set)

Marzi, H. "Modular Neural Network Architecture for Precise Condition Monitoring." IEEE Transactions on Instrumentation and Measurement 57.4 (2008): 805-812. Crossref. Web. https://doi.org/10.1109/TIM.2007.909411

Moayer, Sorousha, and Parisa A. Bahri. "Hybrid Intelligent Scenario Generator for Business Strategic Planning by Using ANFIS." Expert Systems with Applications 36.4 (2009): 7729-7737. Crossref. Web. https://doi.org/10.1016/j.eswa.2008.09.046

Nocedal J. Conjugate gradient methods

Pham, D T, and Haj A Darwish. "Using the Bees Algorithm with Kalman Filtering to Train an Artificial Neural Network for Pattern Classification." Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering 224.7 (2010): 885-892. Crossref. Web. https://doi.org/10.1243/09596518JSCE1004

Pham, Duc Truong, Marco Castellani, and Hoai An Le Thi. "Nature-Inspired Intelligent Optimisation Using the Bees Algorithm." Lecture Notes in Computer Science (2014): 38-69. Crossref. Web. https://doi.org/10.1007/978-3-642-54455-2_2

Rajasekaran S. Neural networks, Fuzzy logic and Genetic algorithms

Ruz, Gonzalo A., and Eric Goles. "Learning Gene Regulatory Networks Using the Bees Algorithm." Neural Computing and Applications 22.1 (2011): 63-70. Crossref. Web. https://doi.org/10.1007/s00521-011-0750-z

Salahshoor, Karim, Mojtaba Kordestani, and Majid S. Khoshro. "Fault Detection and Diagnosis of an Industrial Steam Turbine Using Fusion of SVM (support Vector Machine) and ANFIS (adaptive Neuro-Fuzzy Inference System) Classifiers." Energy 35.12 (2010): 5472-5482. Crossref. Web. https://doi.org/10.1016/j.energy.2010.06.001

Sayadi F. European Journal of Scientific Research

Simon, Dan. "Training Fuzzy Systems with the Extended Kalman Filter." Fuzzy Sets and Systems 132.2 (2002): 189-199. Crossref. Web. https://doi.org/10.1016/S0165-0114(01)00241-X

Trabelsi A. International Journal of Computational Cognition

Vairappan, Catherine et al. "Batch Type Local Search-Based Adaptive Neuro-Fuzzy Inference System (ANFIS) with Self-Feedbacks for Time-Series Prediction." Neurocomputing 72.7-9 (2009): 1870-1877. Crossref. Web. https://doi.org/10.1016/j.neucom.2008.05.010

Warne K. Systems, Man and Cybernetics

International Journal of Climatology 32.13 (2012): n. pag. Crossref. Web. https://doi.org/10.1002/joc.v32.13

Yegnanarayana B. Artificial Neural Networks

Yuce, Baris et al. "Honey Bees Inspired Optimization Method: The Bees Algorithm." Insects 4.4 (2013): 646-662. Crossref. Web. https://doi.org/10.3390/insects4040646

JOURNAL INFORMATION


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present




CONTACT INFORMATION


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048
EMAIL: tsiepress@gmail.com
WEB: http://www.wacong.org/tsi/