• Stars
    star
    17,966
  • Rank 1,483 (Top 0.03 %)
  • Language
    JavaScript
  • License
    Apache License 2.0
  • Created over 7 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

sketch + style = paints 🎨 (TOG2018/SIGGRAPH2018ASIA)

News

See also the Preview of Style2Paints V5.

Note that below are previous versions of style2paints. If you come from an introduction of V5 and are interested in V5, you do not need to download the V4 or V4.5. Note that V5 is still in preview and we have not released it yet.

Download Style2Paints V4.5

You can directly download the software (windows x64) at:

Again, this is style2paints V4.5, NOT style2paints V5!

Google Drive:

https://drive.google.com/open?id=1gmg2wwNIp4qMzxqP12SbcmVAHsLt1iRE

Baidu Drive (百度网盘):

https://pan.baidu.com/s/15xCm1jRVeHipHkiB3n1vzA

You do NOT need to install any complex things like CUDA and python. You can directly download it and then double click it, as if you were playing a normal video game.

Never hesitate to let me know if you have any suggestions or ideas. You may directly send emails to my private address [[email protected]] or [[email protected]].

Welcome to style2paints V4!

logo

Style2paints V4 is an AI driven lineart colorization tool.

Different from previous end-to-end image-to-image translation methods, style2paints V4 is the first system to colorize a lineart in real-life human workflow, and the outputs are layered.

Inputs:

● Linearts
● (with or without) Human hints
● (with or without) Color style reference images
● (with or without) Light location and color

Outputs:

● Automatic color flattening without lines (solid/flat/inherent/固有色/底色 color layer)
● Automatic color flattening with black lines
● Automatic colorization without lines
● Automatic colorization with black lines
● Automatic colorization with colored lines
● Automatic rendering (separated layer)
● Automatic rendered colorization

Style2paints V4 gives you results of the current highest quality. You are able to get separated layers from our system. These layers can be directly used in your painting workflow. Different from all previous AI driven colorization tools, our results are not single 'JPG/PNG' images, and in fact, our results are 'PSD' layers.

User Instruction: https://style2paints.github.io/

And we also have an official Twitter account.

Help human in their standard coloring workflow!

Most human artists are familiar with this workflow:

sketching -> color filling/flattening -> gradients/details adding -> shading

And the corresponding layers are:

lineart layers + flat color layers + gradient layers + shading layers

Style2paints V4 is designed for this standard coloring workflow! In style2paints V4, you can automatically get separated results from each step!

Examples

logo

Here we present some results in this ABCD format. Users only need to upload their sketch, select a style, and put a light source.

When the result is achieved immediately without any human color correction, we regard this result as fully automatic result. When the result needs some color correction, human can easily put some color hints on the canvas to guide the AI coloring process. In this case, we regard these results as semi-automatic results. If a result is semi-automatic, but the quantity of human color hint points is smaller than 10, we regard these results as almost automatic result. In this section, about half of the presented results are fully automatic result, and the others are all almost automatic result. Do notice that all the below results can be achieved with less than 15 clicks!

logo

logo

Real-life results

logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo

Know more about us!

User Instruction: https://style2paints.github.io/

And we also have an official Twitter account.

Acknowledgement

Thanks a lot to TaiZan. This project could not be achieved without his great help.

Lisence

All codes are released in Apache-2.0 License.

We preserve all rights on all pretrained deep learning models and binary releases.

Your colorized images are yours, and we do not add any extra lisences to colorized results. Use your colorized images in any commercial or non-commercial cases.

中文社区

我们有一个除了技术什么东西都聊的以技术交流为主的群。如果你一次加群失败,可以多次尝试: 816096787。

Previous Publications

Style2paints V1:

ACPR 2017:

@Article{ACPR2017ZLM,
  author  = {LvMin Zhang, Yi Ji and ChunPing Liu},
  title   = {Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN},
  conference = {Asian Conference on Pattern Recognition (ACPR)},
  year    = {2017},
}

paper

Style2paints V2:

No Publications.

Style2paints V3:

TOG 2018:

@Article{ACMTOGTSC2018,
  author  = {LvMin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji and ChunPing Liu},
  title   = {Two-stage Sketch Colorization},
  journal = {ACM Transactions on Graphics},
  year    = {2018},
  volume  = {37},
  number  = {6},
  month   = nov,
  doi     = {https://doi.org/10.1145/3272127.3275090},
}

paper

Style2paints V4:

No Publications.

Style2paints V5 (Project SEPA, not released yet):

CVPR2021

@InProceedings{Filling2021zhang,
  author={Lvmin Zhang and Chengze Li and Edgar Simo-Serra and Yi Ji and Tien-Tsin Wong and Chunping Liu}, 
  booktitle={IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, 
  title={User-Guided Line Art Flat Filling with Split Filling Mechanism}, 
  year={2021}, 
}

More Repositories

1

Fooocus

Focus on prompting and generating
Python
40,542
star
2

ControlNet

Let us control diffusion models!
Python
29,314
star
3

Omost

Your image is almost there!
Python
7,046
star
4

stable-diffusion-webui-forge

Python
5,639
star
5

ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
Python
4,635
star
6

IC-Light

More relighting!
Python
4,561
star
7

sd-forge-layerdiffuse

[WIP] Layer Diffusion for WebUI (via Forge)
Python
3,720
star
8

Paints-UNDO

Understand Human Behavior to Align True Needs
Python
3,119
star
9

LayerDiffuse

Transparent Image Layer Diffusion using Latent Transparency
1,943
star
10

PaintingLight

Generating Digital Painting Lighting Effects via RGB-space Geometry (SIGGRAPH2020/TOG2020)
Python
720
star
11

MangaCraft

This project has been abandoned.
708
star
12

sketchKeras

an u-net with some algorithm to take sketch from paints
Python
453
star
13

DanbooRegion

DanbooRegion: An Illustration Region Dataset (ECCV 2020)
Python
384
star
14

YGOProUnity_V2

A sample version of ygopro in Unity
C#
314
star
15

AdverseCleaner

Remove adversarial noise from images
Python
297
star
16

LayerDiffuse_DiffusersCLI

LayerDiffuse in pure diffusers without any GUI
Python
280
star
17

AppearanceEraser

Erasing Appearance Preservation in Optimization-based Smoothing (ECCV 2020)
C++
182
star
18

ToonDecompose

A project to decompose the components in cartoon animations.
Python
116
star
19

SingleFileDB

A single file implementation of key-value database for Python 3.
Python
50
star
20

MangaFilter

"Generating Manga from Illustrations via Mimicking Manga Creation Workflow" in CVPR 2021
HTML
44
star
21

Style2PaintsResearch

Style2Paints Research Website
HTML
27
star
22

SplitFilling

"User-Guided Line Art Flat Filling with Split Filling Mechanism" in CVPR 2021
HTML
26
star
23

huggingface_guess

A simple tool to guess an HuggingFace repo URL from a state dict.
Python
23
star
24

lllyasviel.github.io

lllyasviel.github.io
15
star
25

lllyasviel

lllyasviel
8
star
26

GitPageToonDecompose

GitHub Page of ToonDecompose
HTML
5
star
27

forge-legacy-extensions

some archived legacy forge extensions
Python
5
star
28

misc_files

Misc files.
3
star
29

misc

Misc files.
2
star
30

Discussion

2
star
31

pages

some github pages
JavaScript
2
star
32

google_blockly_prototypes

1
star