Awesome AI image synthesis

A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools. Many of these tools come with "batteries included" and won't include colabs or python code you have to run. (for colabs see this list)

Contents

• 🤖 Text-to-image Models
  • 💰 Commercial
  • ☁️ Free hosted
  • 💻 Free local - Run on your GPU
• ✍️ Prompt engineering
  • 🎨 Tools for prompt engineer
  • 📚 Artist studies
  • 🔗 Browser extensions
  • 🎩 Tips and tricks
  • 🎭 Inspiration tools
• ✨ Post processing tools
  • 💰 Resolution upscale - hosted
  • 🆓 Resolution upscale - free
  • 🙃 Fix faces
  • ✋ Fix hands
  • 👸 Beutify
  • 👩‍🌾 Outcrop
  • 👩‍🎨 Inpaint
• 👨‍👨‍👧‍👦 Communities
  • 👾 Discord
  • 👽 Reddit
• 👩‍🏫 Theory & Learning
  • 📖 Tutorials
  • 🐦 Twitter Threads
  • 🎥 Videos
  • ✉️ Substack newsletters
  • 🫡 Notable twitter follows
• [🚨 Upcoming exciting projects](#upcoming-exciting-projects]

Text-to-image Models you can run

Models, commercial and open source, that you can either try for free and pay for credits or can run in the cloud.

Commercial

• DreamStudio - #StableDiffusion in the cloud
• Midjourney - Discord bot with amazing visuals
• Dalle2 - The one that started it all, great with multi characters
• NightCafe - Nightcafe studio is an AI Art Generator (incrorporates stableDiffusion)
• ArtBreeder Collage - A collaging tool to generate art using visual aides.
• Photoroom - Photoroom has a new feature for backgrounds (featured on product hunt)

Free hosted tools

• Craiyon - Formerly dalleMini - open source tool that outputs great compositions but lower quality
• StableDiffusion on HuggingFace - Run the #StableDiffusion right in huggingface UI
• StableDiffusion on Replicate - Run #StableDiffusionon on replicate.com
• Google Colab - Google free GPU machines in the cloud running models of all sorts.

Free local

*Advanced Batteries not included, this section is for advanced folks who can use the command line, install python packages, run code etc'

• StableDiffusion + Web GUI - This repo has a step by step way to install and run #stableDiffusion using local GPU + a gradio based web UI. Has a nice UI, upscalers built-in, img2img and inpainting, and a LOT more! (see thread with features

• StableDiffusion with Diffusers - A simple-ish way to run stable diffusion locally using hugging face diffusers library

img2img - Generate images from a combination of prompt + init image

img2img refers to the practice of feeding a model an init image AND a prompt.

• stable-img-to-img - Hosted version of img2img tool from stable diffusion. Provide an image + a prompt
• Diffuse-The-Rest - A simple Hugging Face img2img tool that allows for image upload and/or simplistic drawing with a prompt

Prompt engineering

The emerging field of the Prompt Engineering is just beginning, and yet there are tools released for us every day. Follow this repo for the best tools as they become "Awesome"

Tools for prompt engineers

• Lexica - A Stable Diffusion prompts search engine
• Libraire - Another Stable Diffusion prompts search engine, with over 10M images and prompts
• Krea.ai - A prompt builder with a nice UI, searchable prompts.
• PromptMania prompt builder - A prompt builder that supports MJ, SD and Dalle, with visual examples and a lot of modifiers
• Promptbase Marketplace - Buy and sell your promtps for 💰
• GPT-2 prompt generator - A GPT2 model trained to autocomplete MJ prompts

Artist/Modifier studies

• Stable diffusion artist study - A huge list of artist (no living) with examples by (@sureailabs, @proximasan, @EErratica, and @KyrickYoung)
• Stable Diffusion Portrait Prompt Study - A great resource for seeing how different prompts change the style and effects of portrait images.
• Stable Diffusion Artist Style Comparison - A great resource shwoing off artists' styles using the same prompt.
• StableDiffusion modifier study - A great study of modifiers that can enhance your prompts significantly
• Google doc with 3800+ artists and styles - Great collaborative effort 3800+ artists and styles + tips for prompting. Continuesly updated. (without generated images)

Browser extensions

• Dalle prompt helper - a chrome extension to inject prompts into the Dalle interface by @altryne

Tips and tricks

• CLIP interrogator - Convert uploaded images into prompts by @pharampsychotic
• img2prompt - Hosted version of CLIP interrogator on Replicate. Upload image, get prompt ideas.

Inspiration tools

• same.energy - A visual exploration search engine.
• CLIP retrieval - Allows you to browse the major datasets the img-2-text models were trained on.

Post processing tools

Resolution upscale - subscription

• Gigapixel upscaler Great upscaler app + web. One time payment
• https://letsenhance.io/ - LetEnhance is a credit based enhancement system

Resolution upscale - free

• WebUI repo has upscalers built in!
• real-esrgan - A hosted version of real-ERSGan with optional face correction
• Cupscale - Windows app that upscales with ERSGan on your GPU
• chaiNNer - A flowchart/node-based image processing GUI for Windows, MacOS, and Linux

Fix faces

Fix hands

Beutify

• TBD

Outcrop

• TBD

Inpaint

• TBD

Communities

Discord

• Stable Diffusion discord - A great community with folks who help each other
• MidJourney - A huge community of image synthesis folks, prompt help, inspiration channels, etc

Reddit

• r/StableDiffusion - A rapidly growing Subreddit for Stable Diffusion related content - Community Run
• r/MidJourney - The official subreddit for MidJourney related Content

Theory & Learning

Tutorials

• How to get images that don't suck - A Beginner/Intermediate Guide to Getting Cool Images from Stable Diffusion, by u/pxan on Reddit
• Steps for getting better images - A good guide published on the r/StableDiffusion subreddit detailing good prompt crafting.
• A-Traveler-s-Guide-to-the-Latent-Space - In depth guide for prompt engineering.
• Dalle2 prompt book - A great, visual intro to prompt creation by @guyp - Dalle focused

YouTube Video Resources

• bycloud - A channel focused on AI related content, with a lot of content foscusing on AI-Generated artwork.
  • Is Stable Diffusion Actually Better Than DALL-E 2? - A video from bycloud comparing Stable Diffusion to DALL-E 2.
  • The Current State of AI Generated Art Another video from bycloud showing the history and current world of AI Generated art (Released just before Stable Diffusion was truly a thing, talks about it generally with Latent Diffusion though).
• MattVidPro AI - A channel mostly focused on AI related content, including MidJourney, DALL-E 2, and Stable Diffusion. -Text to Image AI Backlash - Should AI be regulated? - A video by MattVidPro AI covering backlash to the release of Stable Diffusion and addressing the arguments about if AI should be regulated by law. Includes part of an interview with Emad Mostaque, the creator of Stability.
• Scott Detweiler - A great channel featuring videos covering MidJourney and Stable Diffusion content

Twitter Threads

• Dalle vs MJ vs StableDiffusion - A great thread comparing the 3 main models by @fabianstelzer
• Stable Diffusion explained - A easy to udnerstand stable diffusion explanation thread by @ai__pub

Notable Twitter Accounts

• Ai, AiArt, Generative - A twitter list of 70+ #aiArt community members, a stream of conciuosness for the field
• @ClaireSilver12 - Great content, tips and tricks, up to date knowledge about ai synthesis
• @TomLikesRobots - Deep insight into this new tech, with updates
• @diffusionBot - A stableDiffusion bot that generates a prompt right in twitter replies when you mention it.
• Whats AI - Louis Bouchard - Accessible AI concepts, paper reviews, youtube videos

Upcoming exciting projects

🚨 These are some of amazing things folks are working on, and is worth keeping in mind, maybe register to their waiting list or give them a follow

• Alpaca - Photoshop plugin - Exciting photoshop implementation! DEMO
• Stable Diffusion for Krita - Soon to be releasing plugin to allow Stable Diffusion features within the Krita art program
• Ando - figma plugin - Figma plugin! DEMO
• Stablender - a blender plugin - a WIP blender plugin with SD

If you find this list valuable

Contribute

Contributions more than welcome! In fact it's why I wrote this list, to get contributions and have folks subscribe to changes to get notified about new and exciting stuff coming to this world of AI art

Read the contribution guidelines first.

Acknowledgements and shoutouts

@pharampsychotic - For the insane tools list on their website, the support in DMs, and the spaces with a lot of patience and answers ❤️