Autosoft Journal

Online Manuscript Access

Endoscopy Video Summarization based on Multi-Modal Descriptors and Possibilistic Unsupervised Learning and Feature Subset Weighting



The spread of capsule endoscopy systems has proved to be inherently constrained by the tedious diagnosis process when the physician has to review thousands of endoscopy video frames in order to detect pathology symptoms. In this paper, we propose a novel endoscopy video summarization approach based on possibilistic clustering and feature weighting algorithm. The algorithm generates possibilistic membership that represents the degree of typicality of the video frames, and that is used to identify and discard noise frames. The robustness to irrelevant features is achieved by learning optimal relevance weight for each feature subset within each cluster. We extend the proposed algorithm to find the optimal number of clusters in an unsupervised and efficient way by exploiting some properties of the possibilistic membership function. The system demonstrated promising performance in extensive testing on real-world datasets associated with the difficult problem of endoscopy video summarization. The endoscopy video collection was acquired on four patients at different geographic locations. It includes more than 90k video frames.



Total Pages: 22
Pages: 381-402


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways

Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Volume: 20
Issue: 3
Year: 2014

Cite this document


Manjunath, B. S. & Sikora, T. (2002). Introduction to MPEG-7: Multimedia content description interface. New York: John Wiley.

Li, Baopu, Max Q.-H. Meng, and Qian Zhao. "Wireless Capsule Endoscopy Video Summary." 2010 IEEE International Conference on Robotics and Biomimetics (2010): n. pag. Crossref. Web.

Bezdek, James C. "Pattern Recognition with Fuzzy Objective Function Algorithms." (1981): n. pag. Crossref. Web.

Coimbra, M.T., and J.P.S. Cunha. "MPEG-7 Visual Descriptors—Contributions for Automated Feature Extraction in Capsule Endoscopy." IEEE Transactions on Circuits and Systems for Video Technology 16.5 (2006): 628-637. Crossref. Web.

Iakovidis, D. K. et al. "Unsupervised Summarisation of Capsule Endoscopy Video." 2008 4th International IEEE Conference Intelligent Systems (2008): n. pag. Crossref. Web.

Zeitoun, Jean-David. "Portal Hypertensive Duodenal Polyp: A Case Report." World Journal of Gastroenterology 13.9 (2007): 1451. Crossref. Web.

Mackiewicz, Micha. "Capsule Endoscopy - State of the Technology and Computer Vision Tools After the First Decade." New Techniques in Gastrointestinal Endoscopy (2011): n. pag. Crossref. Web.

MacQueen, J. B. (1967). Some Methods for classification and analysis of multivariate observations. Proceedings of 5th berkeley symposium on mathematical statistics and probability (pp. 281–297). Berkeley, CA: University of California Press.

Riccioni, Maria Elena. "Colon Capsule Endoscopy: Advantages, Limitations and Expectations. Which Novelties?" World Journal of Gastrointestinal Endoscopy 4.4 (2012): 99. Crossref. Web.

Okun, Oleg, and Helen Priisalu. "Unsupervised Data Reduction." Signal Processing 87.9 (2007): 2260-2267. Crossref. Web.

Nakamura, Tetsuya, and Akira Terano. "Capsule Endoscopy: Past, Present, and Future." Journal of Gastroenterology 43.2 (2008): 93-99. Crossref. Web.

Gerber, Jeremy, Ari Bergwerk, and David Fleischer. "A Capsule Endoscopy Guide for the Practicing Clinician: Technology and Troubleshooting." Gastrointestinal Endoscopy 66.6 (2007): 1188-1195. Crossref. Web.

Miaou S.-G. Journal of Medical and Biological Engineering

Mewes, P. W. et al. "Semantic and Topological Classification of Images in Magnetically Guided Capsule Endoscopy." Ed. Bram van Ginneken and Carol L. Novak. Medical Imaging 2012: Computer-Aided Diagnosis (2012): n. pag. Crossref. Web.

Kodogiannis V. S. World Academy of Science, Engineering and Technology

Almuallim, H. & Dietterich, T. G. (1991). Learning with many irrelevant features. Ninth national conference on artificial intelligence (pp. 547–552)

Rendell, L. A. & Kira, K. (1992). A practical approach to feature selection. International conference on machine learning (pp. 249–256)

Wettschereck, Dietrich, David W. Aha, and Takao Mohri. Artificial Intelligence Review 11.1/5 (1997): 273-314. Crossref. Web.

Frigui, Hichem, and Olfa Nasraoui. "Unsupervised Learning of Prototypes and Attribute Weights." Pattern Recognition 37.3 (2004): 567-581. Crossref. Web.

Datta, R., Joshi, D., Li, J. & Wang, J. Z. (2006). Image retrieval: Ideas, inuences, and trends of the new age. Penn State University Technical Report CSE.

Chen, C., Gagaudakis, G. & Rosin, P. (2000). Similarity-based image browsing. Proceedings of the 16th IFIP world computer congress. International conference on intelligent information processing.

Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. & Stahel, W. A. (1986). Robust statistics: The approach based on inuence functions. New York: John Wiley & Sons.

Dave, R.N., and R. Krishnapuram. "Robust Clustering Methods: a Unified View." IEEE Transactions on Fuzzy Systems 5.2 (1997): 270-293. Crossref. Web.

Bezdek, J.C., and N.R. Pal. "Some New Indexes of Cluster Validity." IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 28.3 (1998): 301-315. Crossref. Web.

Krishnapuram, Raghu, and Chih-Pin Freg. "Fitting an Unknown Number of Lines and Planes to Image Data through Compatible Cluster Merging." Pattern Recognition 25.4 (1992): 385-400. Crossref. Web.

Krishnapuram, R., H. Frigui, and O. Nasraoui. "Fuzzy and Possibilistic Shell Clustering Algorithms and Their Application to Boundary Detection and Surface Approximation. I." IEEE Transactions on Fuzzy Systems 3.1 (1995): 29-43. Crossref. Web.

McLachlan, Geoffrey, and David Peel. "Finite Mixture Models." Wiley Series in Probability and Statistics (2000): n. pag. Crossref. Web.

Krishnapuram, R., O. Nasraoui, and H. Frigui. "The Fuzzy c Spherical Shells Algorithm: A New Approach." IEEE Transactions on Neural Networks 3.5 (1992): 663-671. Crossref. Web.

Ismail, M. Maher Ben, and Hichem Frigui. "Possibilistic Clustering Based on Robust Modeling of Finite Generalized Dirichlet Mixture." 2010 20th International Conference on Pattern Recognition (2010): n. pag. Crossref. Web.

Bashar, M.K. et al. "Automatic Detection of Informative Frames from Wireless Capsule Endoscopy Images." Medical Image Analysis 14.3 (2010): 449-470. Crossref. Web.

Suykens, J.A.K., and J. Vandewalle. Neural Processing Letters 9.3 (1999): 293-300. Crossref. Web.

Zhao, Q. & Meng, M. Q.H. (2010). An abnormality based WCE video segmentation strategy. IEEE international conference on automation and logistics – ICAL.

Everitt, B. (1993). Cluster analysis. New York: Halsted Press.

Jain, A. K., M. N. Murty, and P. J. Flynn. "Data Clustering: a Review." ACM Computing Surveys 31.3 (1999): 264-323. Crossref. Web.

Raju, G., Thomas, B., Tobgay, S. & Shanta Kumar, T. (2008). Fuzzy clustering methods in data mining: A comparative case analysis. International conference on advanced computer theory and engineering (pp. 489–493)

Hathaway, Richard J., John W. Davenport, and James C. Bezdek. "Relational Duals of the c-Means Clustering Algorithms." Pattern Recognition 22.2 (1989): 205-212. Crossref. Web.

Bezdek, James C. et al. "Detection and Characterization of Cluster Substructure I. Linear Structure: Fuzzy c-Lines." SIAM Journal on Applied Mathematics 40.2 (1981): 339-357. Crossref. Web.

Krishnapuram, R., and J.M. Keller. "A Possibilistic Approach to Clustering." IEEE Transactions on Fuzzy Systems 1.2 (1993): 98-110. Crossref. Web.

Frigui H. Proceedings of the First International Conference Neural, Parallel and Scientific Computations

"10.1162/153244303322753616." CrossRef Listing of Deleted DOIs 1 (2000): n. pag. Crossref. Web.

Kira, K. & Rendell, L. A. (1992). The feature selection problem: Traditional methods and a new algorithm. Tenth National Conference on Artificial Intelligence (pp. 129–134)

Frigui, Hichem. "Simultaneous Clustering and Feature Discrimination with Applications." Advances in Fuzzy Clustering and its Applications 285-312. Crossref. Web.

Frigui, H. & Nasraoui, O. (2005). Simultaneous clustering and attribute discrimination. Proceedings IEEE Conference on Fuzzy Systems (pp. 158–163)

Frigui, Hichem, Cheul Hwang, and Frank Chung-Hoon Rhee. "Clustering and Aggregation of Relational Data with Applications to Image Database Categorization." Pattern Recognition 40.11 (2007): 3053-3068. Crossref. Web.

Yang, Miin-Shen, and Kuo-Lung Wu. "Unsupervised Possibilistic Clustering." Pattern Recognition 39.1 (2006): 5-21. Crossref. Web.


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)

SJR: "The two years line is equivalent to journal impact factor ™ (Thomson Reuters) metric."

Journal: 1995-Present


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048