Making better use of edges for sketch generation

Xingyuan Zhang; Yaping Huang; Qi Zou; Qingji Guan; Junbo Liu

doi:10.1117/1.JEI.27.6.063006

19 November 2018 Making better use of edges for sketch generation

Xingyuan Zhang, Yaping Huang, Qi Zou, Qingji Guan, Junbo Liu

Author Affiliations +

Funded by: National Natural Science Foundation of China (NSFC), National Nature Science Foundation of China, Fundamental Research Funds for the Central Universities

Journal of Electronic Imaging, Vol. 27, Issue 6, 063006 (November 2018). https://doi.org/10.1117/1.JEI.27.6.063006

Abstract

Sketching has become fashionable with the increasing availability of touch-screens on portable devices. It is typically used for rendering the visual world, automatic sketch style recognition and abstraction, sketch-based image retrieval (SBIR), and sketch-based perceptual grouping. How to automatically generate a sketch from a real image remains an open question. We propose a convolutional neural network-based model, named SG-Net, to generate sketches from natural images. SG-Net is trained to learn the relationship between images and sketches and thus makes full use of edge information to generate a rough sketch. Then, mathematical morphology is further utilized as a postprocess to eliminate the redundant artifacts in the generated sketches. In addition, in order to increase the diversity of generated sketches, we introduce thin plate splines to generate more sketches with different styles. We evaluate the proposed method of sketch generation both quantitatively and qualitatively on the challenging dataset. Our approach achieves superior performance to the established methods. Moreover, we conduct extensive experiments on the SBIR task. The experimental results on the Flickr15k dataset demonstrate that our proposed method leverages the retrieval performance compared with the state-of-the-art methods.

Citation Download Citation

Xingyuan Zhang, Yaping Huang, Qi Zou, Qingji Guan, and Junbo Liu "Making better use of edges for sketch generation," Journal of Electronic Imaging 27(6), 063006 (19 November 2018). https://doi.org/10.1117/1.JEI.27.6.063006

Received: 17 May 2018; Accepted: 26 October 2018; Published: 19 November 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE