Autosoft Journal

Online Manuscript Access

Portrait Vision Fusion for Augmented Reality


Li-Hong Juang ()*

School of Electrical Engineering and Automation, Xiamen University of Technology, No.600, Ligong Road, Jimei, 360124, P.R.China

Ming-Ni Wu

Department of Information Management, National Taichung University of Technology, Taichung, Taiwan

Feng-Mao Tsou

Department of Information Management, National Taichung University of Technology, Taichung, Taiwan



Video communication is a common way to communicate via interactive technology, especially using webcams for remote interaction and for each participant to see each other’s characteristics from the screen display. In this paper, the main goal is to augment some dynamic interactive virtual environments. Towards this goal , a method using superimposing a segmented human portrait on a panoramic background is proposed, then the limb interactive element is added into these videos involved with a dynamic portrait segmentation method meanwhile using a Kinect (+openCV) device to extract a portrait for amendment, finally acquires a full portrait of information. Because the face is the most important identification region in a portrait, a head skeleton tracking method is also used to strengthen the remedy for its head segmentation, further uses the edge transparent processing to synthesize them into the video. The approach leds the users can verbally and physically communicate through these video interactive much more vibrantly.



Total Pages: 8
Pages: 739-745


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways

Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Volume: 24
Issue: 4
Year: 2018

Cite this document


Alexiadis, Dimitrios S., Dimitrios Zarpalas, and Petros Daras. "Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras." IEEE Transactions on Multimedia 15.2 (2013): 339-358. Crossref. Web.

Cai, Xingyang et al. "Effective Active Skeleton Representation for Low Latency Human Action Recognition." IEEE Transactions on Multimedia 18.2 (2016): 141-154. Crossref. Web.

Chen, Yen-Hsu et al. "A Vision-Based Augmented-Reality System For Multiuser Collaborative Environments." IEEE Transactions on Multimedia 10.4 (2008): 585-595. Crossref. Web.

Chen, Po-Yin et al. "Lower Limb Power Rehabilitation (LLPR) Using Interactive Video Game for Improvement of Balance Function in Older People." Archives of Gerontology and Geriatrics 55.3 (2012): 677-682. Crossref. Web.

Gonzalez-Jorge, H. et al. "Metrological Evaluation of Microsoft Kinect and Asus Xtion Sensors." Measurement 46.6 (2013): 1800-1806. Crossref. Web.

Jun-Wei Hsieh et al. "Segmentation of Human Body Parts Using Deformable Triangulation." IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 40.3 (2010): 596-610. Crossref. Web.

Paragios, Nikos et al., eds. "Variational, Geometric, and Level Set Methods in Computer Vision." Lecture Notes in Computer Science (2005): n. pag. Crossref. Web.

Julià, Carme et al. "Shape-Based Image Segmentation through Photometric Stereo." Computer Vision and Image Understanding 115.1 (2011): 91-104. Crossref. Web.

KHONGKRAPHAN, Kittiya, and Pakorn KAEWTRAKULPONG. "A Novel Reconstruction and Tracking of 3D-Articulated Human Body from 2D Point Correspondences of a Monocular Image Sequence." IEICE Transactions on Information and Systems E94-D.5 (2011): 1090-1098. Crossref. Web.

Lee, Chi-Yu, Jin-Jang Leou, and Han-Hui Hsiao. "Saliency-Directed Color Image Segmentation Using Modified Particle Swarm Optimization." Signal Processing 92.1 (2012): 1-18. Crossref. Web.

Liu, Zhi et al. "Automatic Segmentation of Focused Objects from Images with Low Depth of Field." Pattern Recognition Letters 31.7 (2010): 572-581. Crossref. Web.

Luo, Wang et al. "Global Salient Information Maximization for Saliency Detection." Signal Processing: Image Communication 27.3 (2012): 238-248. Crossref. Web.

Marchand, Eric, Hideaki Uchiyama, and Fabien Spindler. "Pose Estimation for Augmented Reality: A Hands-On Survey." IEEE Transactions on Visualization and Computer Graphics 22.12 (2016): 2633-2651. Crossref. Web.

Menk, C., and R. Koch. "Truthful Color Reproduction in Spatial Augmented Reality Applications." IEEE Transactions on Visualization and Computer Graphics 19.2 (2013): 236-248. Crossref. Web.

Dal Mutto, Carlo, Pietro Zanuttigh, and Guido M. Cortelazzo. "Fusion of Geometry and Color Information for Scene Segmentation." IEEE Journal of Selected Topics in Signal Processing 6.5 (2012): 505-521. Crossref. Web.

Ratnaweera, A., S.K. Halgamuge, and H.C. Watson. "Self-Organizing Hierarchical Particle Swarm Optimizer With Time-Varying Acceleration Coefficients." IEEE Transactions on Evolutionary Computation 8.3 (2004): 240-255. Crossref. Web.

Sheng, Yu, Theodore C. Yapo, and Barbara Cutler. "Global Illumination Compensation for Spatially Augmented Reality." Computer Graphics Forum 29.2 (2010): 387-396. Crossref. Web.

Vincent, L., and P. Soille. "Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations." IEEE Transactions on Pattern Analysis and Machine Intelligence 13.6 (1991): 583-598. Crossref. Web.

Yuan, Miaolong et al. "A Mixed Reality Virtual Clothes Try-On System." IEEE Transactions on Multimedia 15.8 (2013): 1958-1968. Crossref. Web.


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048