StyleGAN2 Webtoon / Anime Style Toonify
Korea Webtoon or Japanese Anime Character
Stylegan2 base high Quality 1024x1024 / 512x512 Generate and Transfer
Korean language
Stylegan2 ๋ฅผ ์ด์ฉํด ๊ณ ํ์ง ๋ฐ์ฌ์คํ ๋ฐ Webtoon / anime ์คํ์ผ ์บ๋ฆญํฐ ์์ฑ ๋ฐ ๋ณํ์ ์๋ํด ๋ณด์๊ณ ๋ช๋ฒ์ ์ํ์ฐฉ์ค ๋์ ์๋์ ๊ฐ์ด ๋ง๋ค ์ ์์์ต๋๋ค.
์ฌ๋ ์ผ๊ตด ์ฌ์ง Pretrained Model ์์ webtoon / anime ์ด๋ฏธ์ง 4๋ฐฑ์ฅ์ ๋๋ก Transfer Learning ๊ณผ Network blending ์ ์ด์ฉํ์์ต๋๋ค.
๊ธฐ์กด์ ๋์จ ๊ฒ๋ค์ ์์ ์นดํฐ ๋์ฆ๋์ ์ด๊ฑฐ๋ ๋ฐ์ฌ์คํ์ ์ด์ง ์๊ฑฐ๋ ๋์์ ์ธ ์์ ์ผ๋ฆญํฐ๊ฐ ์ ๋์ค์ง ์์์ ์ฌ์คํ๊ฐ์ผ๋ฉด์ ๋์์ ์์๊ณ ๋ฉ์ง webtoon / anime ์บ๋ฆญํฐ๊ฐ ๋์ค๋๋ฐ ๋ชฉ์ ์ ๋์์ต๋๋ค.
์๋ก์ด ๋์์ ์ด๊ณ ์์ ๊ณ ํ์ง ์บ๋ฆญํฐ ์์ฑ๋ ์ ํ์ง๋ง ์ฌ๋ ์ผ๊ตด ์ฌ์ง์ project ํ ๋์จ latent vectors ๋ฅผ ์ด์ฉํด ์ด๋ฅผ ์๋ก์ด ํ๋ จ๋ ๋ชจ๋ธ๋ก generate ํ์ฌ photo face to toon/anime face ๋ก ๋ณํํ์์ต๋๋ค.
์์ง ๋ฏธ์ํ ์ ๋ ์์ง๋ง ๋จ์ ์์ฑ, ๋ณํ๋ง์ด ์๋๊ณ latent vectors ๋ฅผ ์ด์ฉํ์ฌ ์ผ๊ตด ์์ง์ด๊ธฐ, ์๊ธฐ, ํ๋ด๊ธฐ ๋ฑ ํ์ ๋ฑ๋ ๋ณ๊ฒฝ ์์ฑ ๊ฐ๋ฅํ์์ต๋๋ค.
์ดํ์๋ ๋ฐ๋๋ก webtoon / anime ์บ๋ฆญํฐ ์ด๋ฏธ์ง๋ฅผ ์ฌ์ค์ photo๋ก ๋ณ๊ฒฝํ๋ ๊ฒ๊ณผ ์ผ๊ตด๋ฟ๋ง ์๋๋ผ ์ ์ฒด ๋ชธ์ ์์ฑ, webtoon / anime ์ ์ฒด ํ๋ฉด์ ์์ฑํด ๋ณด๋ ๊ฒ์ ํด ๋ณด๋ ค ํฉ๋๋ค. ์๊ฐ์ด ๋๋๋๋ก...
๋ ๋์๊ฐ์๋ DALL-E, CLIP ๋ฅผ ์ด์ฉํ๊ฑฐ๋ ์ด๋ฐ ๋ฐฉ์์ ์ด์ฉํด ๊ธ์ ํตํด toon/anime ๋ฅผ ์์ฑํ๋ ๊ฒ์ ์งํํด๋ณด๊ณ ์ถ์ต๋๋ค.
์นํฐ/์ ๋๋ฉ์ด์
์ ์ข์ํ๋ ๊ทธ๋ฆผ ์์จ๋ ์์ด๋
AI๋ฅผ ์ด์ฉํด์ ์ํ๋ ์บ๋ฆญํฐ๋ toon/anime ์ ๋ง๋ค๊ณ ์ด๋ฅผ ์์ง์ด๊ณ ๋ง์ด๋ ๊ธ์ ํตํด์ ๋ง๋ค์ ์์ง ์์๊น. ๋ง๋ก AI ์๊ฒ ์ง์ํด์ ๋ง๋ค์ด๊ฐ๋ tonn/anime ์ ์์ํด ๋ด
๋๋ค.
English Language
I tried creating and converting high-definition reflections and Webtoon/anime style characters using Stylegan2, and after several trials and errors, I was able to create it as follows.
Transfer learning and network blending were used with about 400 webtoon / anime images with the human face photo Pretrained Model.
The existing ones are Western Cartoon Disney, not reflective, or Asian pretty characters aren't well out, so the purpose is to come up with Asian pretty and cool webtoon/anime character.
I am good at creating new Asian and pretty high-quality characters, but I used latent vectors that came out after projecting a human face photo and generated it as a new trained model and converted it to photo face to toon/anime face.
Although there are still some inexperienced things, it was possible to change expressions such as facial movements, laughs, and anger using latent vectors as well as simple creation and transformation.
Afterwards, I will try to change the webtoon / anime character image to a realistic photo, create not only the face but also the entire body, and create the webtoon / anime full screen. As time comes...
Furthermore, I would like to proceed with creating toon/anime through text writing using DALL-E, CLIP, or using this method.
I like webtoon/animation, but I donโt have any drawing skills.
Wouldn't it be possible to create a character or toon/anime you want using AI, move it, and create it through words or writings? I imagine a toon/anime created by instructing AI in words.
Compare to Others
Generate toon images
Transfer Korea Star Photos to toon Images
Edit Face 1(Latent direction move)
Edit Face 2(Latent direction move)
Requirements
See StyleGAN2 Requirements
Usage
- align image
Copy real face photos in "data_test" directory. It will save face croped and aligned images.
python align_images.py data_test data_img_aligned
- project image
It will generate *.npy files and projected_image files in "data_project_gen" directory.
Make "pretrained_networks" directory.
Download pretrain network "https://drive.google.com/u/0/uc?id=1-04v78_pI59M0IvhcKxsm3YhK2-plnbj&export=download" and save in "pretrained_networks" directory.
Try to change --num-steps 500 or 700 or 1300, 1500, 2000 ...
python project_images.py data_img_aligned data_project_gen --num-steps=1000 --network-pkl="pretrained_networks/generator_star-stylegan2-config-f.pkl" --tmp-dir="./tmp"
- toonify
It will generate toonified image files in "data_project_gen" directory and It will add "_toon" to filename.
Semi-realistic Toon Download pretrain network "https://drive.google.com/file/d/1mmMqjS_8P23KthbsUxQRjTfiFQDa6met/view?usp=sharing" and save in "pretrained_networks" directory. Drawing Toon Download pretrain network "https://drive.google.com/file/d/1Xh2lQDcQXrYX7Zug4_95q8_9SR6lVwct/view?usp=sharing" and save in "pretrained_networks" directory.
- if you need, ask for download permission. These are for personal use only and cannot be used externally without permission.
Semi-realistic Toon
python toonify_lnw.py --image_dir=data_project_gen --filename=_toon1.jpg --blendednet="pretrained_networks/wonwizard-bl-anistar-s30r64.pkl"
Drawing Toon
python toonify_lnw.py --image_dir=data_project_gen --filename=_toon2.jpg --blendednet="pretrained_networks/wonwizard-bl-anistar-s120r128.pkl"
Based on nvidia StyleGAN2.
๊ฐ์ธ์ ์ผ๋ก๋ง ์ฌ์ฉ๊ฐ๋ฅํ๋ฉฐ ํ๊ฐ์์ด ๋์ธ์ ์ผ๋ก ์ฌ์ฉํ ์ ์์.
These are for personal use only and cannot be used externally without my permission.