Autosoft Journal

Online Manuscript Access


Endoscopy Video Summarization based on Multi-Modal Descriptors and Possibilistic Unsupervised Learning and Feature Subset Weighting


Authors



Abstract

The spread of capsule endoscopy systems has proved to be inherently constrained by the tedious diagnosis process when the physician has to review thousands of endoscopy video frames in order to detect pathology symptoms. In this paper, we propose a novel endoscopy video summarization approach based on possibilistic clustering and feature weighting algorithm. The algorithm generates possibilistic membership that represents the degree of typicality of the video frames, and that is used to identify and discard noise frames. The robustness to irrelevant features is achieved by learning optimal relevance weight for each feature subset within each cluster. We extend the proposed algorithm to find the optimal number of clusters in an unsupervised and efficient way by exploiting some properties of the possibilistic membership function. The system demonstrated promising performance in extensive testing on real-world datasets associated with the difficult problem of endoscopy video summarization. The endoscopy video collection was acquired on four patients at different geographic locations. It includes more than 90k video frames.


Keywords


Pages

Total Pages: 22
Pages: 381-402

DOI
10.1080/10798587.2014.890320


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways


Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Published

Volume: 20
Issue: 3
Year: 2014

Cite this document


References

Manjunath, B. S. & Sikora, T. (2002). Introduction to MPEG-7: Multimedia content description interface. New York: John Wiley.

Li, Baopu, Max Q.-H. Meng, and Qian Zhao. "Wireless Capsule Endoscopy Video Summary." 2010 IEEE International Conference on Robotics and Biomimetics (2010): n. pag. Crossref. Web. https://doi.org/10.1109/ROBIO.2010.5723369

Bezdek, James C. "Pattern Recognition with Fuzzy Objective Function Algorithms." (1981): n. pag. Crossref. Web. https://doi.org/10.1007/978-1-4757-0450-1

Coimbra, M.T., and J.P.S. Cunha. "MPEG-7 Visual Descriptors—Contributions for Automated Feature Extraction in Capsule Endoscopy." IEEE Transactions on Circuits and Systems for Video Technology 16.5 (2006): 628-637. Crossref. Web. https://doi.org/10.1109/TCSVT.2006.873158

Iakovidis, D. K. et al. "Unsupervised Summarisation of Capsule Endoscopy Video." 2008 4th International IEEE Conference Intelligent Systems (2008): n. pag. Crossref. Web. https://doi.org/10.1109/IS.2008.4670414

http://www.givenimaging.com/en-us/Innovative-Solutions/Capsule-Endoscopy/Software/Pages/default.aspx.

http://medical.olympusamerica.com/procedure/capsule-endoscopy.

Zeitoun, Jean-David. "Portal Hypertensive Duodenal Polyp: A Case Report." World Journal of Gastroenterology 13.9 (2007): 1451. Crossref. Web. https://doi.org/10.3748/wjg.v13.i9.1451

Mackiewicz, Micha. "Capsule Endoscopy - State of the Technology and Computer Vision Tools After the First Decade." New Techniques in Gastrointestinal Endoscopy (2011): n. pag. Crossref. Web. https://doi.org/10.5772/23145

MacQueen, J. B. (1967). Some Methods for classification and analysis of multivariate observations. Proceedings of 5th berkeley symposium on mathematical statistics and probability (pp. 281–297). Berkeley, CA: University of California Press.

Riccioni, Maria Elena. "Colon Capsule Endoscopy: Advantages, Limitations and Expectations. Which Novelties?" World Journal of Gastrointestinal Endoscopy 4.4 (2012): 99. Crossref. Web. https://doi.org/10.4253/wjge.v4.i4.99

Okun, Oleg, and Helen Priisalu. "Unsupervised Data Reduction." Signal Processing 87.9 (2007): 2260-2267. Crossref. Web. https://doi.org/10.1016/j.sigpro.2007.02.006

Nakamura, Tetsuya, and Akira Terano. "Capsule Endoscopy: Past, Present, and Future." Journal of Gastroenterology 43.2 (2008): 93-99. Crossref. Web. https://doi.org/10.1007/s00535-007-2153-6

Gerber, Jeremy, Ari Bergwerk, and David Fleischer. "A Capsule Endoscopy Guide for the Practicing Clinician: Technology and Troubleshooting." Gastrointestinal Endoscopy 66.6 (2007): 1188-1195. Crossref. Web. https://doi.org/10.1016/j.gie.2007.06.003

Miaou S.-G. Journal of Medical and Biological Engineering

Mewes, P. W. et al. "Semantic and Topological Classification of Images in Magnetically Guided Capsule Endoscopy." Ed. Bram van Ginneken and Carol L. Novak. Medical Imaging 2012: Computer-Aided Diagnosis (2012): n. pag. Crossref. Web. https://doi.org/10.1117/12.912280

Kodogiannis V. S. World Academy of Science, Engineering and Technology

Almuallim, H. & Dietterich, T. G. (1991). Learning with many irrelevant features. Ninth national conference on artificial intelligence (pp. 547–552)

Rendell, L. A. & Kira, K. (1992). A practical approach to feature selection. International conference on machine learning (pp. 249–256)

Wettschereck, Dietrich, David W. Aha, and Takao Mohri. Artificial Intelligence Review 11.1/5 (1997): 273-314. Crossref. Web. https://doi.org/10.1023/A:1006593614256

Frigui, Hichem, and Olfa Nasraoui. "Unsupervised Learning of Prototypes and Attribute Weights." Pattern Recognition 37.3 (2004): 567-581. Crossref. Web. https://doi.org/10.1016/j.patcog.2003.08.002

Datta, R., Joshi, D., Li, J. & Wang, J. Z. (2006). Image retrieval: Ideas, inuences, and trends of the new age. Penn State University Technical Report CSE.

Chen, C., Gagaudakis, G. & Rosin, P. (2000). Similarity-based image browsing. Proceedings of the 16th IFIP world computer congress. International conference on intelligent information processing.

Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. & Stahel, W. A. (1986). Robust statistics: The approach based on inuence functions. New York: John Wiley & Sons.

Dave, R.N., and R. Krishnapuram. "Robust Clustering Methods: a Unified View." IEEE Transactions on Fuzzy Systems 5.2 (1997): 270-293. Crossref. Web. https://doi.org/10.1109/91.580801

Bezdek, J.C., and N.R. Pal. "Some New Indexes of Cluster Validity." IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 28.3 (1998): 301-315. Crossref. Web. https://doi.org/10.1109/3477.678624

Krishnapuram, Raghu, and Chih-Pin Freg. "Fitting an Unknown Number of Lines and Planes to Image Data through Compatible Cluster Merging." Pattern Recognition 25.4 (1992): 385-400. Crossref. Web. https://doi.org/10.1016/0031-3203(92)90087-Y

Krishnapuram, R., H. Frigui, and O. Nasraoui. "Fuzzy and Possibilistic Shell Clustering Algorithms and Their Application to Boundary Detection and Surface Approximation. I." IEEE Transactions on Fuzzy Systems 3.1 (1995): 29-43. Crossref. Web. https://doi.org/10.1109/91.366564

McLachlan, Geoffrey, and David Peel. "Finite Mixture Models." Wiley Series in Probability and Statistics (2000): n. pag. Crossref. Web. https://doi.org/10.1002/0471721182

Krishnapuram, R., O. Nasraoui, and H. Frigui. "The Fuzzy c Spherical Shells Algorithm: A New Approach." IEEE Transactions on Neural Networks 3.5 (1992): 663-671. Crossref. Web. https://doi.org/10.1109/72.159056

Ismail, M. Maher Ben, and Hichem Frigui. "Possibilistic Clustering Based on Robust Modeling of Finite Generalized Dirichlet Mixture." 2010 20th International Conference on Pattern Recognition (2010): n. pag. Crossref. Web. https://doi.org/10.1109/ICPR.2010.145

Bashar, M.K. et al. "Automatic Detection of Informative Frames from Wireless Capsule Endoscopy Images." Medical Image Analysis 14.3 (2010): 449-470. Crossref. Web. https://doi.org/10.1016/j.media.2009.12.001

Suykens, J.A.K., and J. Vandewalle. Neural Processing Letters 9.3 (1999): 293-300. Crossref. Web. https://doi.org/doi:10.1023/A:1018628609742

Zhao, Q. & Meng, M. Q.H. (2010). An abnormality based WCE video segmentation strategy. IEEE international conference on automation and logistics – ICAL.

Everitt, B. (1993). Cluster analysis. New York: Halsted Press.

Jain, A. K., M. N. Murty, and P. J. Flynn. "Data Clustering: a Review." ACM Computing Surveys 31.3 (1999): 264-323. Crossref. Web. https://doi.org/10.1145/331499.331504

Raju, G., Thomas, B., Tobgay, S. & Shanta Kumar, T. (2008). Fuzzy clustering methods in data mining: A comparative case analysis. International conference on advanced computer theory and engineering (pp. 489–493)

Hathaway, Richard J., John W. Davenport, and James C. Bezdek. "Relational Duals of the c-Means Clustering Algorithms." Pattern Recognition 22.2 (1989): 205-212. Crossref. Web. https://doi.org/10.1016/0031-3203(89)90066-6

Bezdek, James C. et al. "Detection and Characterization of Cluster Substructure I. Linear Structure: Fuzzy c-Lines." SIAM Journal on Applied Mathematics 40.2 (1981): 339-357. Crossref. Web. https://doi.org/10.1137/0140029

Krishnapuram, R., and J.M. Keller. "A Possibilistic Approach to Clustering." IEEE Transactions on Fuzzy Systems 1.2 (1993): 98-110. Crossref. Web. https://doi.org/10.1109/91.227387

Frigui H. Proceedings of the First International Conference Neural, Parallel and Scientific Computations

"10.1162/153244303322753616." CrossRef Listing of Deleted DOIs 1 (2000): n. pag. Crossref. Web. https://doi.org/10.1162/153244303322753616

Kira, K. & Rendell, L. A. (1992). The feature selection problem: Traditional methods and a new algorithm. Tenth National Conference on Artificial Intelligence (pp. 129–134)

Frigui, Hichem. "Simultaneous Clustering and Feature Discrimination with Applications." Advances in Fuzzy Clustering and its Applications 285-312. Crossref. Web. https://doi.org/10.1002/9780470061190.ch14

Frigui, H. & Nasraoui, O. (2005). Simultaneous clustering and attribute discrimination. Proceedings IEEE Conference on Fuzzy Systems (pp. 158–163)

Frigui, Hichem, Cheul Hwang, and Frank Chung-Hoon Rhee. "Clustering and Aggregation of Relational Data with Applications to Image Database Categorization." Pattern Recognition 40.11 (2007): 3053-3068. Crossref. Web. https://doi.org/10.1016/j.patcog.2007.02.019

Yang, Miin-Shen, and Kuo-Lung Wu. "Unsupervised Possibilistic Clustering." Pattern Recognition 39.1 (2006): 5-21. Crossref. Web. https://doi.org/10.1016/j.patcog.2005.07.005

JOURNAL INFORMATION


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)

TWO YEAR CITATIONS PER DOCUMENT (SJR DATA): 0.993 (2018)
SJR: "The two years line is equivalent to journal impact factor ™ (Thomson Reuters) metric."





Journal: 1995-Present


CONTACT INFORMATION


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048
EMAIL: tsiepress@gmail.com
WEB: http://www.wacong.org/tsi/