Stable Diffusion - Trending Images
Pepe
Stable Diffusion
Help. DeepFloyd IF has learned to write
Stable Diffusion
Way to get around the anatomy
Stable Diffusion
Lofi Girl
Stable Diffusion
Not good enough to draw a picture for you, but good enough for concepts
Stable Diffusion
Besties
Stable Diffusion
Goth
Stable Diffusion
Pink Nurse
Stable Diffusion
just miku
Stable Diffusion
What's this called?
Stable Diffusion
Kamen Rider suit based after Rathalos
Stable Diffusion
How Stable Diffusion Works
![How Stable Diffusion Works * Stable Diffusion is a Denoising Algorithm, which means that it tries to remove 'noise' from images. * The algorithm is calibrated by showing it partial images covered in artificial noise, and seeing how well it guesses what the noise-to-remove is. * The algorithm never saves the training images. The file size stays the same whether it trains on 1 image or 1 million images. • The calibrations are given a tiny nudge depending on how wrong each guess is, not enough to make a difference from any one image. Eventually a general solution to image denoising emerges. * Words are mapped to unique weights which are added to the denoising algoirthm, and thus the calibration needs to work in balance of the impact of words. e.g. 'photo' or 'cartoon' would weight some denoising choices differently. Step 1 Name Step 5 'city': [0.0037, 0.0141, 0.0066, 0.0024, -0.0440, 'building': [0.0051, 0.0122, -0.0262, 0.0161, -0.0058, Common calibration nudge size: 0.000005 Step 10 The algorithm doesn't use full resolution images. A highly compressed internal format is used, where 512x512x3 (for RGB color) becomes 64x64x4. The encoder/ decoder model downscales & upscales at each end of the denoiser. txt2img generates initial random 'noise.' Whereas img2img and training blend an input image with random noise by a given strength factor. The denoiser is a 'U-Net' model, which shrinks the image to even smaller resolutions, to consider details of different scales, then considers the fine details as it enlarges the image again. Within the U- Net, 'cross-attention' layers are used to associate different parts of the image with different words in the prompt. sd_v1-4.ckpt 4,165,411 KB sd_v1-5.ckpt 4,165,411 KB The input text is encoded using a third model, the CLIP Text Encoder. New faces and art styles which the model never trained on can still be drawn by finding the weights for an imaginary word which would sit somewhere between other words, using textual inversion and running the model in reverse from example output images. Eventually the denoiser gets so good that it can resolve an entirely new image from just noise, by running it several times in a row to keep improving the image. H CLIP Text Encoder Size -0.0111, 64x64 32x 32 "City, street, buildings, photo" -0.0125, 0.0086,....] -0.0008, 0.0072, 0.0058, ...] Step 20 512x512 TH Encoder Denoiser "U-Net" Decoder G 512x512 32x 32 64x64](https://i.kym-cdn.com/photos/images/masonry/002/494/747/535.png)
![How Stable Diffusion Works * Stable Diffusion is a Denoising Algorithm, which means that it tries to remove 'noise' from images. * The algorithm is calibrated by showing it partial images covered in artificial noise, and seeing how well it guesses what the noise-to-remove is. * The algorithm never saves the training images. The file size stays the same whether it trains on 1 image or 1 million images. • The calibrations are given a tiny nudge depending on how wrong each guess is, not enough to make a difference from any one image. Eventually a general solution to image denoising emerges. * Words are mapped to unique weights which are added to the denoising algoirthm, and thus the calibration needs to work in balance of the impact of words. e.g. 'photo' or 'cartoon' would weight some denoising choices differently. Step 1 Name Step 5 'city': [0.0037, 0.0141, 0.0066, 0.0024, -0.0440, 'building': [0.0051, 0.0122, -0.0262, 0.0161, -0.0058, Common calibration nudge size: 0.000005 Step 10 The algorithm doesn't use full resolution images. A highly compressed internal format is used, where 512x512x3 (for RGB color) becomes 64x64x4. The encoder/ decoder model downscales & upscales at each end of the denoiser. txt2img generates initial random 'noise.' Whereas img2img and training blend an input image with random noise by a given strength factor. The denoiser is a 'U-Net' model, which shrinks the image to even smaller resolutions, to consider details of different scales, then considers the fine details as it enlarges the image again. Within the U- Net, 'cross-attention' layers are used to associate different parts of the image with different words in the prompt. sd_v1-4.ckpt 4,165,411 KB sd_v1-5.ckpt 4,165,411 KB The input text is encoded using a third model, the CLIP Text Encoder. New faces and art styles which the model never trained on can still be drawn by finding the weights for an imaginary word which would sit somewhere between other words, using textual inversion and running the model in reverse from example output images. Eventually the denoiser gets so good that it can resolve an entirely new image from just noise, by running it several times in a row to keep improving the image. H CLIP Text Encoder Size -0.0111, 64x64 32x 32 "City, street, buildings, photo" -0.0125, 0.0086,....] -0.0008, 0.0072, 0.0058, ...] Step 20 512x512 TH Encoder Denoiser "U-Net" Decoder G 512x512 32x 32 64x64](https://i.kym-cdn.com/photos/images/original/002/494/747/535.png)
Stable Diffusion
Character with Mary Sue traits
Stable Diffusion
AI Soyjak doesn't like AI art
Stable Diffusion
Plant
Stable Diffusion
boobra
Stable Diffusion
booba
Stable Diffusion
Take me out to where?
Stable Diffusion
Guidance scale increase
Stable Diffusion
The Sopranos on Disney+
Stable Diffusion
