›› 2011, Vol. 26 ›› Issue (6): 1011-1016.doi: 10.1007/s11390-011-1197-5

Special Issue: Artificial Intelligence and Pattern Recognition

• Computer Graphics and Visualization • Previous Articles     Next Articles

Free Appearance-Editing with Improved Poisson Image Cloning

Xiao-Hui Bie1,3 (别晓辉), Hao-Da Huang2 (黄浩达), and Wen-Cheng Wang1 (王文成), Member, CCF   

  1. 1. State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing 100190, China;
    2. Microsoft Research Asia, Beijing 100190, China;
    3. Graduate University of Chinese Academy of Sciences, Beijing 100190, China
  • Received:2010-12-29 Revised:2011-09-05 Online:2011-11-05 Published:2011-11-05
  • About author:Xiao-Bui Bie received his B.S. degree in engineering mechanics from Huazhong University of Science and Technology. He is currently a Ph.D. student at the Institute of Software, Chinese Academy of Sciences. His main research interests are computer vision and interactive image/video editing.
    Hao-Da Huang received his Master's degree from the Institute of Software, Chinese Academy of Sciences in 2007. He is currently an associate researcher of Microsoft Research Asia. His research inte-rests include facial performance cap-ture, hand deformation, image analy-sis and editing.
    Wen-Cheng Wang received his Ph.D. degree from the Institute of Software, Chinese Academy of Sci-ences in 1998, where he is currently a professor of the State Key Lab-oratory of Computer Science. His research interests include computer graphics, visualization, virtual reali-ty and expressive rendering and edit-ing.
  • Supported by:

    This work was partly supported by the National Natural Science Foundation of China under Grant Nos. 60773026, 60873182, 60833007.

In this paper, we present a new edit tool for the user to conveniently preserve or freely edit the object appearance during seamless image composition. We observe that though Poisson image editing is effective for seamless image composition. Its color bleeding (the color of the target image is propagated into the source image) is not always desired in applications, and it provides no way to allow the user to edit the appearance of the source image. To make it more flexible and practical, we introduce new energy terms to control the appearance change, and integrate them into the Poisson image editing framework. The new energy function could still be realized using efficient sparse linear solvers, and the user can interactively refine the constraints. With the new tool, the user can enjoy not only seamless image composition, but also the flexibility to preserve or manipulate the appearance of the source image at the same time. This provides more potential for creating new images. Experimental results demonstrate the effectiveness of our new edit tool, with similar time cost to the original Poisson image editing.

[1] Pérez P, Gangnet M, Blake A. Poisson image editing. ACMTrans. Graph, 2003, 22(3): 313-318.

[2] Jia J, Sun J, Tang C K, Shum H Y. Drag-and-drop pasting.ACM Trans. Graph, 2006, 25(3): 631-637.

[3] Sun J, Jia J, Tang C K, Shum H Y. Poisson matting. ACMTrans. Graph, 2004, 23(3): 315-321.

[4] Levin A, Rva-acha A, Lischinski D. Spectral matting. IEEETransactions on Pattern Analysis and Machine Intelligence,2008, 30(10): 1699-1712.

[5] Mcguire M, Matusik W, Pfister H, Hughes J F, Durand F.Defocus video matting. ACM Trans. Graph, 2005, 24(3):567-576.

[6] Boykov Y, Jolly M. Interactive graph cuts for optimal boun-dary and region segmentation of objects in N-D images.In Proc. ICCV 2001, Vancouver, Canada, July 7-14, 2001,pp.105-112.

[7] Agarwala A, Dontcheva M, Agrawala M, Drucker S, ColburnA, Curless B, Salesin D, Cohen M. Interactive digital pho-tomontage. ACM Trans. Graph, 2004, 23(3): 294-302.

[8] Sunkavalli K, Johson M K, Matusik W, Pfister H. Multi-scaleimage harmonization. ACM Trans. Graph, 2010, 29(4).

[9] Kazhdan M, Hoppe H. Streaming multigrid for gradient-domain operations on large images. ACM Trans. Graph,2008, 27(3).

[10] Agarwala A. Efficient gradient-domain compositing usingquadtrees. ACM Trans. Graph, 2007, 27(3).

[11] Farbman Z, Hoffer G, Lipman Y, Cohen-Or D, Lichinski D.Coordinates for instant image cloning. ACM Trans. Graph,2009, 28(3).

[12] Jeschke S, Cline D, Wonka P. A GPU laplacian solver for dif-fusion curves and poisson image editing. ACM Trans. Graph,2009, 28(5).

[13] Levin A, Lischinski D, Weiss Y. Colorization using optimiza-tion. ACM Trans. Graph, 2004, 23(3): 689-694.

[14] Lischinshi D, Farbman Z, Uyttendaele M, Szeliski R. Inte-ractive local adjustment of tonal values. ACM Trans. Graph,2006, 25(3): 646-653.

[15] Pellacini F, Lawrence J. Appwand: Editing measured ma-terials using appearance-driven optimization. ACM Trans.Graph. 2007, 26(3).

[16] An X, Pellacini F. Appprop: All-pairs appearance-space editpropagation. ACM Trans. Graph, 2008, 27(3).

[17] Farbman Z, Fattal R, Lischinski D. Diffusion maps for edge-aware image editing. ACM Trans. Graph, 2010, 29(6).
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Liu Mingye; Hong Enyu;. Some Covering Problems and Their Solutions in Automatic Logic Synthesis Systems[J]. , 1986, 1(2): 83 -92 .
[2] Chen Shihua;. On the Structure of (Weak) Inverses of an (Weakly) Invertible Finite Automaton[J]. , 1986, 1(3): 92 -100 .
[3] Gao Qingshi; Zhang Xiang; Yang Shufan; Chen Shuqing;. Vector Computer 757[J]. , 1986, 1(3): 1 -14 .
[4] Chen Zhaoxiong; Gao Qingshi;. A Substitution Based Model for the Implementation of PROLOG——The Design and Implementation of LPROLOG[J]. , 1986, 1(4): 17 -26 .
[5] Huang Heyan;. A Parallel Implementation Model of HPARLOG[J]. , 1986, 1(4): 27 -38 .
[6] Min Yinghua; Han Zhide;. A Built-in Test Pattern Generator[J]. , 1986, 1(4): 62 -74 .
[7] Tang Tonggao; Zhao Zhaokeng;. Stack Method in Program Semantics[J]. , 1987, 2(1): 51 -63 .
[8] Min Yinghua;. Easy Test Generation PLAs[J]. , 1987, 2(1): 72 -80 .
[9] Zhu Hong;. Some Mathematical Properties of the Functional Programming Language FP[J]. , 1987, 2(3): 202 -216 .
[10] Li Minghui;. CAD System of Microprogrammed Digital Systems[J]. , 1987, 2(3): 226 -235 .

ISSN 1000-9000(Print)

         1860-4749(Online)
CN 11-2296/TP

Home
Editorial Board
Author Guidelines
Subscription
Journal of Computer Science and Technology
Institute of Computing Technology, Chinese Academy of Sciences
P.O. Box 2704, Beijing 100190 P.R. China
Tel.:86-10-62610746
E-mail: jcst@ict.ac.cn
 
  Copyright ©2015 JCST, All Rights Reserved