Autosoft Journal

Online Manuscript Access

Training ANFIS Using the Enhanced Bees Algorithm and Least Squares Estimation



This paper presents the result of research in developing a novel training model for Adaptive Neuro-Fuzzy Inference Systems (ANFIS). ANFIS integrates the learning ability of Artificial Neural Networks with the Takagi-Sugeno Fuzzy Inference System to approximate nonlinear functions. Therefore, it is considered as a Universal Estimator. The original algorithm used in ANFIS training process has a hybrid model that uses Steepest Decent Derivative; therefore, it inherits low convergence rate and local minima during training. In this study, a training algorithm is proposed that combines Bees Algorithm (BA) and Least Square Estimation (LSE) (BA-LSE). The local and global exploration of BA as integrates with the best-fit solution of the LSE improves current shortcomings of ANFIS training process. The proposed training algorithm is examined under three different scenarios of function approximation, time series prediction, and classification experiments in order to verify the promising improvements in the training process of ANFIS. The experimental results validate high generalization capabilities of the BA-LSE training algorithm in comparison to the original hybrid training model of ANFIS. The new training model also enhances local minima avoidance and has high convergence rate.



Total Pages: 8
Pages: 227-234


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways

Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Volume: 23
Issue: 2
Year: 2016

Cite this document


Mira, José, and Alberto Prieto, eds. "Connectionist Models of Neurons, Learning Processes, and Artificial Intelligence." Lecture Notes in Computer Science (2001): n. pag. Crossref. Web.

Bache, K. & Lichman, M. (2013). UCI machine learning repository: University of California, School of Information and Computer Science. Retrieved from, 2013.

Bilgehan, Mahmut. "Comparison of ANFIS and NN models—With a Study in Critical Buckling Load Estimation." Applied Soft Computing 11.4 (2011): 3779-3791. Crossref. Web.

Blum, Christian, and Daniel Merkle, eds. "Swarm Intelligence." Natural Computing Series (2008): n. pag. Crossref. Web.

Carrano, Eduardo G. et al. "A Genetic Algorithm for Multiobjective Training of ANFIS Fuzzy Networks." 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) (2008): n. pag. Crossref. Web.

Catalao, J. P. S., and V. M. F. Mendes. "Influence of Environmental Constraints on Profit-Based Short-Term Thermal Scheduling." IEEE Transactions on Sustainable Energy 2.2 (2011): 131-138. Crossref. Web.

Cheng, Ching-Hsue, Liang-Ying Wei, and You-Shyang Chen. "Fusion ANFIS Models Based on Multi-Stock Volatility Causality for TAIEX Forecasting." Neurocomputing 72.16-18 (2009): 3462-3468. Crossref. Web.

Ding, Feng. "Combined State and Least Squares Parameter Estimation Algorithms for Dynamic Systems." Applied Mathematical Modelling 38.1 (2014): 403-412. Crossref. Web.

Duch, W. "Uncertainty of Data, Fuzzy Membership Functions, and Multilayer Perceptrons." IEEE Transactions on Neural Networks 16.1 (2005): 10-23. Crossref. Web.

Gite A.V. International Journal of Engineering Research and Technology

Jang, J.-S.R. "ANFIS: Adaptive-Network-Based Fuzzy Inference System." IEEE Transactions on Systems, Man, and Cybernetics 23.3 (1993): 665-685. Crossref. Web.

Khoshgoftaar, Taghi M, Jason Van Hulse, and Amri Napolitano. "Supervised Neural Network Modeling: An Empirical Investigation Into Learning From Imbalanced Data With Labeling Errors." IEEE Transactions on Neural Networks 21.5 (2010): 813-830. Crossref. Web.

Puyin Liu. "Mamdani Fuzzy System: Universal Approximator to a Class of Random Processes." IEEE Transactions on Fuzzy Systems 10.6 (2002): 756-766. Crossref. Web.

Ma X. Future Communication Technology (2 Volume Set)

Marzi, H. "Modular Neural Network Architecture for Precise Condition Monitoring." IEEE Transactions on Instrumentation and Measurement 57.4 (2008): 805-812. Crossref. Web.

Moayer, Sorousha, and Parisa A. Bahri. "Hybrid Intelligent Scenario Generator for Business Strategic Planning by Using ANFIS." Expert Systems with Applications 36.4 (2009): 7729-7737. Crossref. Web.

Nocedal J. Conjugate gradient methods

Pham, D T, and Haj A Darwish. "Using the Bees Algorithm with Kalman Filtering to Train an Artificial Neural Network for Pattern Classification." Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering 224.7 (2010): 885-892. Crossref. Web.

Pham, Duc Truong, Marco Castellani, and Hoai An Le Thi. "Nature-Inspired Intelligent Optimisation Using the Bees Algorithm." Lecture Notes in Computer Science (2014): 38-69. Crossref. Web.

Rajasekaran S. Neural networks, Fuzzy logic and Genetic algorithms

Ruz, Gonzalo A., and Eric Goles. "Learning Gene Regulatory Networks Using the Bees Algorithm." Neural Computing and Applications 22.1 (2011): 63-70. Crossref. Web.

Salahshoor, Karim, Mojtaba Kordestani, and Majid S. Khoshro. "Fault Detection and Diagnosis of an Industrial Steam Turbine Using Fusion of SVM (support Vector Machine) and ANFIS (adaptive Neuro-Fuzzy Inference System) Classifiers." Energy 35.12 (2010): 5472-5482. Crossref. Web.

Sayadi F. European Journal of Scientific Research

Simon, Dan. "Training Fuzzy Systems with the Extended Kalman Filter." Fuzzy Sets and Systems 132.2 (2002): 189-199. Crossref. Web.

Trabelsi A. International Journal of Computational Cognition

Vairappan, Catherine et al. "Batch Type Local Search-Based Adaptive Neuro-Fuzzy Inference System (ANFIS) with Self-Feedbacks for Time-Series Prediction." Neurocomputing 72.7-9 (2009): 1870-1877. Crossref. Web.

Warne K. Systems, Man and Cybernetics

International Journal of Climatology 32.13 (2012): n. pag. Crossref. Web.

Yegnanarayana B. Artificial Neural Networks

Yuce, Baris et al. "Honey Bees Inspired Optimization Method: The Bees Algorithm." Insects 4.4 (2013): 646-662. Crossref. Web.


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048