Technical Papers
Two-stage Sketch Colorization
Event Type
Technical Papers
Registration Categories
TimeFriday, 7 December 201811:52am - 12:18pm
DescriptionSketch colorization, or line art colorization, is a research field with considerable market demands. Different from photo colorization which adds colors to textured grayscale input, sketch colorization is more challenging: we have to generate proper color, texture, and gradient from abstract sketch lines. In this paper, we propose a semi-automatic learning-based framework to colorize sketch images with proper texture and gradient. Our framework consists of two stages. In the first stage, our interactive system guesses color regions and splash many different colors on the sketch image to obtain a color draft. In the second stage, the interactive system detects the mistakes of the draft, and then correct the wrong color to achieve a refined painting. The two-stage design resolves artifacts like water-color blurring, color distortion, and dull textures, comparing to existing methods.

We build an interactive software based on our model where users can iteratively edit and refine the colorization. Then we evaluated our framework through a multi-dimensional user study, which proves that our method outperforms the state-of-art techniques and industrial applications in several aspects in terms of visual quality, precision on user controls, user experience and so on.