Autosoft Journal

Online Manuscript Access


Portrait Vision Fusion for Augmented Reality


Authors

Li-Hong Juang ()*

School of Electrical Engineering and Automation, Xiamen University of Technology, No.600, Ligong Road, Jimei, 360124, P.R.China

 
Ming-Ni Wu

Department of Information Management, National Taichung University of Technology, Taichung, Taiwan

 
Feng-Mao Tsou

Department of Information Management, National Taichung University of Technology, Taichung, Taiwan

 


Abstract

Video communication is a common way to communicate via interactive technology, especially using webcams for remote interaction and for each participant to see each other’s characteristics from the screen display. In this paper, the main goal is to augment some dynamic interactive virtual environments. Towards this goal , a method using superimposing a segmented human portrait on a panoramic background is proposed, then the limb interactive element is added into these videos involved with a dynamic portrait segmentation method meanwhile using a Kinect (+openCV) device to extract a portrait for amendment, finally acquires a full portrait of information. Because the face is the most important identification region in a portrait, a head skeleton tracking method is also used to strengthen the remedy for its head segmentation, further uses the edge transparent processing to synthesize them into the video. The approach leds the users can verbally and physically communicate through these video interactive much more vibrantly.


Keywords


Pages

Total Pages: 8

DOI
10.1080/10798587.2017.1327549


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways


Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Published

Online Article

Cite this document


References

Alexiadis, Dimitrios S., Dimitrios Zarpalas, and Petros Daras. "Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras." IEEE Transactions on Multimedia 15.2 (2013): 339-358. Crossref. Web. https://doi.org/10.1109/TMM.2012.2229264

Cai, Xingyang et al. "Effective Active Skeleton Representation for Low Latency Human Action Recognition." IEEE Transactions on Multimedia 18.2 (2016): 141-154. Crossref. Web. https://doi.org/10.1109/TMM.2015.2505089

Chen, Yen-Hsu et al. "A Vision-Based Augmented-Reality System For Multiuser Collaborative Environments." IEEE Transactions on Multimedia 10.4 (2008): 585-595. Crossref. Web. https://doi.org/10.1109/TMM.2008.921741

Chen, Po-Yin et al. "Lower Limb Power Rehabilitation (LLPR) Using Interactive Video Game for Improvement of Balance Function in Older People." Archives of Gerontology and Geriatrics 55.3 (2012): 677-682. Crossref. Web. https://doi.org/10.1016/j.archger.2012.05.012

Gonzalez-Jorge, H. et al. "Metrological Evaluation of Microsoft Kinect and Asus Xtion Sensors." Measurement 46.6 (2013): 1800-1806. Crossref. Web. https://doi.org/10.1016/j.measurement.2013.01.011

Jun-Wei Hsieh et al. "Segmentation of Human Body Parts Using Deformable Triangulation." IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 40.3 (2010): 596-610. Crossref. Web. https://doi.org/10.1109/TSMCA.2010.2040272

Paragios, Nikos et al., eds. "Variational, Geometric, and Level Set Methods in Computer Vision." Lecture Notes in Computer Science (2005): n. pag. Crossref. Web. https://doi.org/10.1007/11567646

Julià, Carme et al. "Shape-Based Image Segmentation through Photometric Stereo." Computer Vision and Image Understanding 115.1 (2011): 91-104. Crossref. Web. https://doi.org/10.1016/j.cviu.2010.09.009

KHONGKRAPHAN, Kittiya, and Pakorn KAEWTRAKULPONG. "A Novel Reconstruction and Tracking of 3D-Articulated Human Body from 2D Point Correspondences of a Monocular Image Sequence." IEICE Transactions on Information and Systems E94-D.5 (2011): 1090-1098. Crossref. Web. https://doi.org/10.1587/transinf.E94.D.1090

Lee, Chi-Yu, Jin-Jang Leou, and Han-Hui Hsiao. "Saliency-Directed Color Image Segmentation Using Modified Particle Swarm Optimization." Signal Processing 92.1 (2012): 1-18. Crossref. Web. https://doi.org/10.1016/j.sigpro.2011.04.026

Liu, Zhi et al. "Automatic Segmentation of Focused Objects from Images with Low Depth of Field." Pattern Recognition Letters 31.7 (2010): 572-581. Crossref. Web. https://doi.org/10.1016/j.patrec.2009.11.016

Luo, Wang et al. "Global Salient Information Maximization for Saliency Detection." Signal Processing: Image Communication 27.3 (2012): 238-248. Crossref. Web. https://doi.org/10.1016/j.image.2011.10.004

Marchand, Eric, Hideaki Uchiyama, and Fabien Spindler. "Pose Estimation for Augmented Reality: A Hands-On Survey." IEEE Transactions on Visualization and Computer Graphics 22.12 (2016): 2633-2651. Crossref. Web. https://doi.org/10.1109/TVCG.2015.2513408

Menk, C., and R. Koch. "Truthful Color Reproduction in Spatial Augmented Reality Applications." IEEE Transactions on Visualization and Computer Graphics 19.2 (2013): 236-248. Crossref. Web. https://doi.org/10.1109/TVCG.2012.146

Dal Mutto, Carlo, Pietro Zanuttigh, and Guido M. Cortelazzo. "Fusion of Geometry and Color Information for Scene Segmentation." IEEE Journal of Selected Topics in Signal Processing 6.5 (2012): 505-521. Crossref. Web. https://doi.org/10.1109/JSTSP.2012.2194474

Ratnaweera, A., S.K. Halgamuge, and H.C. Watson. "Self-Organizing Hierarchical Particle Swarm Optimizer With Time-Varying Acceleration Coefficients." IEEE Transactions on Evolutionary Computation 8.3 (2004): 240-255. Crossref. Web. https://doi.org/10.1109/TEVC.2004.826071

Sheng, Yu, Theodore C. Yapo, and Barbara Cutler. "Global Illumination Compensation for Spatially Augmented Reality." Computer Graphics Forum 29.2 (2010): 387-396. Crossref. Web. https://doi.org/10.1111/j.1467-8659.2009.01608.x

Vincent, L., and P. Soille. "Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations." IEEE Transactions on Pattern Analysis and Machine Intelligence 13.6 (1991): 583-598. Crossref. Web. https://doi.org/10.1109/34.87344

Yuan, Miaolong et al. "A Mixed Reality Virtual Clothes Try-On System." IEEE Transactions on Multimedia 15.8 (2013): 1958-1968. Crossref. Web. https://doi.org/10.1109/TMM.2013.2280560

JOURNAL INFORMATION


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present




CONTACT INFORMATION


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048
EMAIL: tsiepress@gmail.com
WEB: http://www.wacong.org/tsi/