cosk commited on
Commit
b564934
1 Parent(s): 37caab3

Update README.md

Browse files

---
license: creativeml-openrail-m
language:
- en
pipeline_tag: text-to-image
tags:
- stable-diffusion
- art
- cutesexyrobutts
- style
- dreambooth
datasets:
- Cosk/cutesexyrobutts
library_name: diffusers
widget:
- text: portrait of a beautiful girl
- text: beautiful girl, playboy bunny, dark skin, black hair, blunt bangs, ponytail
---

# 'Sketchstyle' (cutesexyrobutts style)
Base model: https://huggingface.co/Linaqruf/anything-v3.0.</br>
Used 'fast-DreamBooth' on Google Colab and 768x768 images for all versions.

## NEW: Merges
*Merging sketchstyle models with other models will help to improve anatomy and other elements while also trying to keep the intended style as much as possible.</br>
I will upload from time to time new merges, if any of those improves on the previous ones. </br>
A 'weak' model means there is more weight to cutesexyrobutts style and a 'strong' model means there is a little more focus on the other model/models.</br>
Weak models might mantain a little more of the style but could have some anatomy problems, while strong models keep better anatomy though the style might become a little affected. Low CFG Scale (5-9) and using the "sketchstyle" token in the prompts might help with keeping the style on strong models.</br>*

**List of merges:**
- Pastelmix 0.2 + sketchstyle_v4-42k 0.8 weak (weighted sum, fp16)
- Pastelmix 0.4 + sketchstyle_v4-42k 0.6 strong (weighted sum, fp16)

**Versions:**
- V1: Trained with around 1300 images (from danbooru), automatically cropped.
- V2: Trained with 400 handpicked and handcropped images.
- V3: Trained with the same images as V2, but with 'style training' enabled.
- V4: Trained with 407 images, including 'captions' for each image.

**Recommended to use:**
- V4-42k (pretty good style and decent anatomy, might be the best)
- V3-40k (decent style and anatomy)
- V4-10k (best anatomy, meh style)
- V4-100k (good style, bad anatomy/hard to use, useful with img2img)

**Usage recommendations:**
- For V4, don't use CFG Scale over 11-12, as it will generate an overcooked image. Try between 6 to 9 at first. 9 seems to be the best if you're using the 'sketchstyle' in the prompt, if not, lower
- Generating specific characters might be hard, result in bad anatomy or not even work at all. If you want an specific character, the best is to use img2img with an image generated with another model
- Going over a certain resolution will generate incoherent results, so try staying close to 768x768 (examples: 640x896, 768x960, 640x1024, 832x640, and similar). Maybe Hires fix could help.
- Make sure to add nsfw/nipples/huge or large breasts in the negative prompts if you don't want any of those.
- Skin tone tends to be 'tan', use dark skin/tan on the negative prompts if its the case, and/or pale skin in the prompts.
- Using img2img to change the style of another image generally gives the best results, examples below.

Pay attention to this number. Normally going below 75 generates bad results, specially with models with high steps like V4-100k. Best with 100+
![Screenshot_1.png](https://s3.amazonaws.com/moonup/production/uploads/1671505643175-633520c031a2be3938c9f8f5.png)

Token: 'sketchstyle' (if used, anatomy may get affected, but it can be useful for models with low steps to get a better style)<br />

**Limitations and known errors:**
- Not very good anatomy
- Sometimes it generates artifacts, specially on the eyes and lips
- Tends to generate skimpy clothes, open clothes, cutouts, and similar
- Might generate unclear outlines
Try using inpainting and/or img2img to fix these.


# Comparison between different versions and models

As you can see, robutts tends to give less coherent results and might need more prompting/steps to get good results (tried on other things aswell with similar results)
![comparison.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671502776323-633520c031a2be3938c9f8f5.jpeg)

V2 with 10k steps or lower tends to give better anatomy results, and over that the style appears more apparent, so 10k is the 'sweet spot'.
![comparison2.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671504780023-633520c031a2be3938c9f8f5.jpeg)

Around 40 steps seems to be the best, but you should use 20 steps and, if you get an image you like, you increase the step count to 40 or 50.
![comparison3.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671509387599-633520c031a2be3938c9f8f5.jpeg)

Comparison between not completing that negative prompt and increasing the strength too much.
![comparison4.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671568686470-633520c031a2be3938c9f8f5.jpeg)

Comparison (using V3-5k) of token strength.
![comparison5.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671571773116-633520c031a2be3938c9f8f5.jpeg)

Another comparison of token strength using V3-15k.
![comparison6.jpg](https://s3.amazonaws.com/moonup/production/uploads/1671734192353-633520c031a2be3938c9f8f5.jpeg)

Comparison, from 1 to 30 steps, between NovelAI - Sketchstyle V3-27500 (img2img with NovelAI image) - Sketchstyle V3-27500. Using Euler sampler.
![comparison.gif](https://s3.amazonaws.com/moonup/production/uploads/1672115659361-633520c031a2be3938c9f8f5.gif)

# Examples:
![05144-1365838486-(masterpiece,best quality,ultra-detailed),((((face close-up)))),((profile)),((lips,pink_eyes)),((pink_hair,hair_slicked_back,hai.png](https://s3.amazonaws.com/moonup/production/uploads/1671513540474-633520c031a2be3938c9f8f5.png)
```bibtex
Prompt: (masterpiece,best quality,ultra-detailed),((((face close-up)))),((profile)),((lips,pink_eyes)),((pink_hair,hair_slicked_back,hair_strand)),(serious),portrait,frown,arms_up,adjusting_hair,eyelashes,parted_lips,(sportswear,crop_top),toned,collarbone,ponytail,1girl,solo,highres<br />
Negative prompt: (deformed,disfigured),(sitting,fat,thick,thick_thighs,nsfw),open_clothes,open_shirt,(jewelry,earrings,hair_ornament),((sagging_breasts,huge_breasts,shiny,shiny_hair,shiny_skin,realistic,3D,3D game)),((extra_limbs,extra_arms)),(loli,shota),(giant nipples),long body,(lowres),(((poorly drawn fingers, poorly drawn hands))),((anatomic nonsense)),(extra fingers),(fused fingers),(((one hand with more than 5 fingers))),(((one hand with less than 5 fingers))),(bad eyes),(separated eyes),(long neck),((bad proportions)),long body,((poorly drawn eyes)),((poorly drawn)),((bad drawing)),blurry,((mutation)),((bad anatomy)),(multiple arms),((bad face)),((bad eyes)),bad tail,((more than 2 ears)),((poorly drawn face)), (extra limb), ((deformed hands)), (poorly drawn feet), (mutated hands and fingers), extra legs, extra ears, extra hands, bad feet, bad anatomy, bad hands, text, error, missing fingers, bad hands, extra digit, fewer digits, worst quality, low quality, normal quality, jpeg artifacts,signature, watermark, username, artist name, bad face, bad mouth, animal hands, censored, blurry lines, wacky outlines, unclear outlines, doubled,monochrome, greyscale,face maskissing fingers, bad hands, extra digit, fewer digits, worst quality, low quality, normal quality, jpeg artifacts,signature, watermark, username, artist name, bad face, bad mouth, animal hands, censored, blurry lines, wacky outlines, unclear outlines, doubled,monochrome, greyscale,face mask<br />
Steps: 70, Sampler: Euler, CFG scale: 12, Seed: 1365838486, Size: 768x768, Model: Sketchstyle V3-5k
```

_Eyes fixed with inpainting_:
![00609-996011741-(masterpiece,best quality,ultra-detailed),((((face close-up)))),((profile)),((lips,pink_eyes)),((pink_hair,hair_slicked_back,hai.png](https://s3.amazonaws.com/moonup/production/uploads/1671515050937-633520c031a2be3938c9f8f5.png)
```bibtex
Prompt: (masterpiece,best quality,ultra-detailed),((((face close-up)))),((profile)),((lips,pink_eyes)),((pink_hair,hair_slicked_back,hair_strand)),(serious),portrait,frown,arms_up,adjusting_hair,eyelashes,parted_lips,(sportswear,crop_top),toned,collarbone,ponytail,1girl,solo,highres<br />
Negative prompt: (deformed,disfigured),(sitting,fat,thick,thick_thighs,nsfw),open_clothes,open_shirt,(jewelry,earrings,hair_ornament),((sagging_breasts,huge_breasts,shiny,shiny_hair,shiny_skin,realistic,3D,3D game)),((extra_limbs,extra_arms)),(loli,shota),(giant nipples),long body,(lowres),(((poorly drawn fingers, poorly drawn hands))),((anatomic nonsense)),(extra fingers),(fused fingers),(((one hand with more than 5 fingers))),(((one hand with less than 5 fingers))),(bad eyes),(separated eyes),(long neck),((bad proportions)),long body,((poorly drawn eyes)),((poorly drawn)),((bad drawing)),blurry,((mutation)),((bad anatomy)),(multiple arms),((bad face)),((bad eyes)),bad tail,((more than 2 ears)),((poorly drawn face)), (extra limb), ((deformed hands)), (poorly drawn feet), (mutated hands and fingers), extra legs, extra ears, extra hands, bad feet, bad anatomy, bad hands, text, error, missing fingers, bad hands, extra digit, fewer digits, worst quality, low quality, normal quality, jpeg artifacts,signature, watermark, username, artist name, bad face, bad mouth, animal hands, censored, blurry lines, wacky outlines, unclear outlines, doubled,monochrome, greyscale,face maskissing fingers, bad hands, extra digit, fewer digits, worst quality, low quality, normal quality, jpeg artifacts,signature, watermark, username, artist name, bad face, bad mouth, animal hands, censored, blurry lines, wacky outlines, unclear outlines, doubled,monochrome, greyscale,face mask<br />
Steps: 34, Sampler: Euler, CFG scale: 12, Seed: 996011741, Size: 768x768, Denoising strength: 0.6, Mask blur: 8, Model: Sketchstyle V2-10k
```

![05152-4172541433-sketchstyle,(masterpiece, best quality,beautiful lighting,stunning,ultra-detailed),(portrait,upper_body,parted_lips),1girl, (nip.png](https://s3.amazonaws.com/moonup/production/uploads/1671517158965-633520c031a2be3938c9f8f5.png)
```bibtex
Prompt: sketchstyle,(masterpiece, best quality,beautiful lighting,stunning,ultra-detailed),(portrait,upper_body,parted_lips),1girl, (nipples), (fox ears,animal_ear_fluff), (bare_shoulders,eyelashes,lips,orange eyes,blush),orange_hair,((onsen,indoors)),(toned),medium_breasts,navel,cleavage,looking at viewer,collarbone,hair bun, solo, highres,(nsfw)<br />
Negative prompt: (dark-skin,dark_nipp

Files changed (1) hide show
  1. README.md +7 -6
README.md CHANGED
@@ -22,13 +22,14 @@ Base model: https://huggingface.co/Linaqruf/anything-v3.0.</br>
22
  Used 'fast-DreamBooth' on Google Colab and 768x768 images for all versions.
23
 
24
  ## NEW: Merges
25
- So, playing around with stuff i thought that merging with other models would improve the anatomy of mine, and so i did.</br>
26
  I will upload from time to time new merges, if any of those improves on the previous ones. </br>
27
- 'Weak' means there is more weight to cutesexyrobutts style and 'strong' means there is a little more focus on the other model/models.</br>
28
- Weak models might mantain a little more of the style, and strong models keep better anatomy though the style might become a little affected. Less CFG Scale and using "sketchstyle" in the prompts might help with keeping the style on strong models.</br>
29
- List of merges:
30
- - Pastelmix 0.2 + cutesexyrobutts 0.8 weak (weighted sum, fp16)
31
- - Pastelmix 0.4 + cutesexyrobutts 0.6 strong (weighted sum, fp16)
 
32
 
33
  **Versions:**
34
  - V1: Trained with around 1300 images (from danbooru), automatically cropped.
 
22
  Used 'fast-DreamBooth' on Google Colab and 768x768 images for all versions.
23
 
24
  ## NEW: Merges
25
+ *Merging sketchstyle models with other models will help to improve anatomy and other elements while also trying to keep the intended style as much as possible.</br>
26
  I will upload from time to time new merges, if any of those improves on the previous ones. </br>
27
+ A 'weak' model means there is more weight to cutesexyrobutts style and a 'strong' model means there is a little more focus on the other model/models.</br>
28
+ Weak models might mantain a little more of the style but could have some anatomy problems, while strong models keep better anatomy though the style might become a little affected. Low CFG Scale (5-9) and using the "sketchstyle" token in the prompts might help with keeping the style on strong models.</br>*
29
+
30
+ **List of merges:**
31
+ - Pastelmix 0.2 + sketchstyle_v4-42k 0.8 weak (weighted sum, fp16)
32
+ - Pastelmix 0.4 + sketchstyle_v4-42k 0.6 strong (weighted sum, fp16)
33
 
34
  **Versions:**
35
  - V1: Trained with around 1300 images (from danbooru), automatically cropped.