Ai-tensa commited on
Commit
659e9b5
β€’
1 Parent(s): f1cc668

model upload

Browse files
Files changed (31) hide show
  1. README.md +62 -10
  2. ReWaifu/1K/ReWaifu_1K_e1.safetensors +3 -0
  3. ReWaifu/1K/ReWaifu_1K_e2.safetensors +3 -0
  4. ReWaifu/1K/ReWaifu_1K_e3.safetensors +3 -0
  5. ReWaifu/1K/ReWaifu_1K_e4.safetensors +3 -0
  6. ReWaifu/1K/ReWaifu_1K_e5.safetensors +3 -0
  7. ReWaifu/512p/ReWaifu_512p_e12.safetensors +3 -0
  8. ReWaifu/512p/ReWaifu_512p_e3.safetensors +3 -0
  9. ReWaifu/512p/ReWaifu_512p_e6.safetensors +3 -0
  10. ReWaifu/512p/ReWaifu_512p_e9.safetensors +3 -0
  11. ReWaifu/768p/ReWaifu_768p_e1.safetensors +3 -0
  12. ReWaifu/768p/ReWaifu_768p_e2.safetensors +3 -0
  13. ReWaifu/768p/ReWaifu_768p_e3.safetensors +3 -0
  14. ReWaifu/768p/ReWaifu_768p_e4.safetensors +3 -0
  15. ReWaifu/768p/ReWaifu_768p_e5.safetensors +3 -0
  16. {1K β†’ Rellust/1K}/Rellust_1K_e1.safetensors +0 -0
  17. {1K β†’ Rellust/1K}/Rellust_1K_e2.safetensors +0 -0
  18. {1K β†’ Rellust/1K}/Rellust_1K_e3.safetensors +0 -0
  19. {512p β†’ Rellust/512p}/Rellust_512p_e10.safetensors +0 -0
  20. {512p β†’ Rellust/512p}/Rellust_512p_e15.safetensors +0 -0
  21. {512p β†’ Rellust/512p}/Rellust_512p_e5.safetensors +0 -0
  22. {768p β†’ Rellust/768p}/Rellust_768p_e1.safetensors +0 -0
  23. {768p β†’ Rellust/768p}/Rellust_768p_e2.safetensors +0 -0
  24. {768p β†’ Rellust/768p}/Rellust_768p_e3.safetensors +0 -0
  25. {768p β†’ Rellust/768p}/Rellust_768p_e4.safetensors +0 -0
  26. {768p β†’ Rellust/768p}/Rellust_768p_e5.safetensors +0 -0
  27. images/00608-2310821.png +3 -0
  28. images/00616-2887952460.png +3 -0
  29. images/00620-4266538265.png +3 -0
  30. images/grid-0102-1783332202.png +3 -0
  31. images/grid-0103-1783332202.png +3 -0
README.md CHANGED
@@ -15,18 +15,29 @@ ReFT is a series of fine-tuned models from SD 1.5 for producing illustration sty
15
 
16
  ## Model Description
17
 
18
- | Model Name | Pretrained Model | Typical Resolusion |
19
- | ----------------- | ---------------- | ------------------ |
20
- | ReFT Rellust 512p | SD1.5 | 512x512 |
21
- | ReFT Rellust 768p | Rellust_512p_e10 | 768x768 |
22
- | ReFT Rellust 1K | Rellust_768p_e3 | 1024x1024 |
 
 
 
23
 
24
  **CLIP Skip 1 is recommended for all models!!**
25
 
26
- ## ReFT Rellust
27
 
28
- Each model is fine-tuned from SD1.5 with ~16k nijijourneyv5 tagged images of various authors published on the Internet with a learning rate of 4e-6 using Aspect Ratio Bucketing based on either 512p, 768p, or 1K resolution.
29
- Image captions are made by BLIP and WD1.4-tagger.
 
 
 
 
 
 
 
 
30
  The batch size is 16 for 512p only and 8 for the rest.
31
  Fine tuning is also performed at fp16, using mutires noise.
32
 
@@ -42,7 +53,48 @@ The models do not require underscores for tags in the prompts.
42
 
43
  CLIP Skip 1 is recommended.
44
 
45
- ### Examples (ReFT Rellust 1K)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
46
 
47
  ![](images/00056-4203630207.png)
48
  ```
@@ -77,4 +129,4 @@ The CreativeML OpenRAIL License specifies:
77
 
78
  ## Acknowledgements
79
 
80
- These Models build on the excellent work: SD1.5, developed by [CompVis](https://ommer-lab.com/) and [RUNWAY](https://runwayml.com)
 
15
 
16
  ## Model Description
17
 
18
+ | Model Name | Base Model | Typical Resolusion | lr |
19
+ | ----------------- | ---------------- | ------------------ | ---- |
20
+ | ReFT ReWaifu 512p | SD1.5 | 512x512 | 4e-6 |
21
+ | ReFT ReWaifu 768p | ReWaifu_512p_e12 | 768x768 | 4e-6 |
22
+ | ReFT ReWaifu 1K | ReWaifu_768p_e5 | 1024x1024 | 2e-6 |
23
+ | ReFT Rellust 512p | SD1.5 | 512x512 | 4e-6 |
24
+ | ReFT Rellust 768p | Rellust_512p_e10 | 768x768 | 4e-6 |
25
+ | ReFT Rellust 1K | Rellust_768p_e3 | 1024x1024 | 4e-6 |
26
 
27
  **CLIP Skip 1 is recommended for all models!!**
28
 
29
+ ### ReFT ReWaifu
30
 
31
+ Each model is fine-tuned from SD1.5 with AI-Illustration tagged images of various authors published on the web and [NijiJourney-Prompt-Pairs]([/NijiJourney-Prompt-Pairs](https://huggingface.co/datasets/Korakoe/NijiJourney-Prompt-Pairs)) using Aspect Ratio Bucketing based on either 512p, 768p, or 1K resolution.
32
+ For 512p, a 370k image data set was used, and for 768p and 1K a subset of 20k images selected by [ImageReward](https://huggingface.co/THUDM/ImageReward) score with BLIP was used.
33
+ Image captions are made by BLIP and WD1.4-tagger.
34
+ The batch size is 16 for 512p only and 8 for the rest.
35
+ Fine tuning is also performed at fp16, using mutires noise.
36
+
37
+ ### ReFT Rellust
38
+
39
+ Each model is fine-tuned from SD1.5 with ~16k nijijourneyv5 tagged images of various authors published on the web with a learning rate of 4e-6 using Aspect Ratio Bucketing based on either 512p, 768p, or 1K resolution.
40
+ Image captions are made by BLIP and WD1.4-tagger.
41
  The batch size is 16 for 512p only and 8 for the rest.
42
  Fine tuning is also performed at fp16, using mutires noise.
43
 
 
53
 
54
  CLIP Skip 1 is recommended.
55
 
56
+ ### Examples
57
+
58
+ #### ReFT ReWafu 1K
59
+
60
+ ![](images/00608-2310821.png)
61
+ ```
62
+ wide shot, solo, 1girl, full body, black hair, twintails, red eyes, white blouse, Peter Pan collar, dress, pinafore dress, strawberry print skirt, waist bow, frilled dress, pink skirt, long sleeves, puffy long sleeves, food print, pink footwear, strap shoes, closed mouth, fruit, white background, strawberry, pastel
63
+ Negative prompt: bad anatomy, text, frame, blurry, realistic
64
+ Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 2310821, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, Version: v1.5.1
65
+ ```
66
+
67
+ ![](images/00620-4266538265.png)
68
+ ```
69
+ solo, 1girl, cowboy shot, magical girl, white hair, medium hair, hair ornament, blue eyes, black dress, frilled dress, short sleeves, puffy sleeves, holding staff of ruby, starry sky, milky way
70
+ Negative prompt: bad anatomy, text, frame, blurry, realistic, skirt hold
71
+ Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 4266538265, Size: 960x1152, Model hash: 7716dbfa7b, Model: SDAXa3c, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
72
+ ```
73
+
74
+ ![](images/00616-2887952460.png)
75
+ ```
76
+ wide shot, grapes, muscat, white background, simple background, full body, solo, 1girl, small head, light-brown hair, medium hair, wavy hair, brown eyes, simple dress, casual, slim, shoes, water colors, pastel colors, light coloring
77
+ Negative prompt: worst quality, low quality, lowres, blurry, text, frame, light particle, water, vivid color, black, messy hair, frills
78
+ Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 2887952460, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Variation seed: 1970649291, Variation seed strength: 0.1, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, Version: v1.5.1
79
+ ```
80
+
81
+ - 2d <-> 3d: Use "realistic" tag.
82
+ - 2d
83
+ ![](images/grid-0102-1783332202.png)
84
+ ```
85
+ solo, 1girl, from side, anime girl is holding a maple leaf, red hair, own hands together , medium hair, wavy hair, yellow eyes, white sweater, long sleeves, skirt, mini skirt, plaid skirt, strap shoes, out doors, maple hair ornament, scenery, depth of field, tree, maple, look into hands
86
+ Negative prompt: bad anatomy, text, frame, blurry, school uniform, realistic, long neck
87
+ Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 1783332202, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
88
+ ```
89
+ - 3d
90
+ ![](images/grid-0103-1783332202.png)
91
+ ```
92
+ solo, 1girl, from side, anime girl is holding a maple leaf, red hair, own hands together , medium hair, wavy hair, yellow eyes, white sweater, long sleeves, skirt, mini skirt, plaid skirt, strap shoes, out doors, maple hair ornament, scenery, depth of field, tree, maple, look into hands, realistic
93
+ Negative prompt: bad anatomy, text, frame, blurry, school uniform
94
+ Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 1783332202, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
95
+ ```
96
+
97
+ #### ReFT Rellust 1K
98
 
99
  ![](images/00056-4203630207.png)
100
  ```
 
129
 
130
  ## Acknowledgements
131
 
132
+ These Models build on the excellent works: SD1.5, developed by [CompVis](https://ommer-lab.com/) and [RUNWAY](https://runwayml.com), and [ImageReward](https://huggingface.co/THUDM/ImageReward) (Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong).
ReWaifu/1K/ReWaifu_1K_e1.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6702c6e8dfdad4ea6ae677c345f8b343a5297e1010b4cd81fdc40c99cd7574f1
3
+ size 3851717247
ReWaifu/1K/ReWaifu_1K_e2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d0848af5ab6a04495d5bf665da9f04f7aa4a103c194d91bcd3501ec4c307fda
3
+ size 3851717247
ReWaifu/1K/ReWaifu_1K_e3.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:367b3de632107caa951ba00812d7b26182d03dd90ac58522810795ac72cf9bde
3
+ size 3851717247
ReWaifu/1K/ReWaifu_1K_e4.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebdbee2ef8e645720b78a32984449475be7124a0071114f5fcc262fed0abe3df
3
+ size 3851717247
ReWaifu/1K/ReWaifu_1K_e5.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7716dbfa7b829e7a50ef0d29c179e4c3723538af9939c094c59857dcbe6b4977
3
+ size 3851717247
ReWaifu/512p/ReWaifu_512p_e12.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4972390e4afe6ea53a0f920d3cec0ee26d049dd695270bc6247fdb2299b4f0f
3
+ size 3851717247
ReWaifu/512p/ReWaifu_512p_e3.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e46514533f06168a550fd7323ccf98aeb5f5803818c17513c4393df6aa6d43b
3
+ size 3851717247
ReWaifu/512p/ReWaifu_512p_e6.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be194a0885143a94704e5669cf293e3f8a7de2c8fae88ddfc99aa3922ca89f9e
3
+ size 3851717247
ReWaifu/512p/ReWaifu_512p_e9.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:706f33b36233d0e2f2d4e637b5b667d02cc3a63ae222598cce06b2c1cb37140e
3
+ size 3851717247
ReWaifu/768p/ReWaifu_768p_e1.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:457c852013eac2492b64eb0023d7110c2b6bcb35082b706501c0438398a398de
3
+ size 3851717247
ReWaifu/768p/ReWaifu_768p_e2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e98cf7af19cba4e581b46b536c90060e0acabaa3e179a7b1e3181808eeee468c
3
+ size 3851717247
ReWaifu/768p/ReWaifu_768p_e3.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5d9936c547da526807c4ccca724e26a3c18cea81d91e8a0d9c90bd58b863d19
3
+ size 3851717247
ReWaifu/768p/ReWaifu_768p_e4.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bc3c84e78d8a6a4efb184641cd22603ede276350dd679eec0c3c4a93be1bcfb
3
+ size 3851717247
ReWaifu/768p/ReWaifu_768p_e5.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f57ff402999c74019ec804a9672bb921403a0658d367271b9a19e81f4c8ef2c0
3
+ size 3851717247
{1K β†’ Rellust/1K}/Rellust_1K_e1.safetensors RENAMED
File without changes
{1K β†’ Rellust/1K}/Rellust_1K_e2.safetensors RENAMED
File without changes
{1K β†’ Rellust/1K}/Rellust_1K_e3.safetensors RENAMED
File without changes
{512p β†’ Rellust/512p}/Rellust_512p_e10.safetensors RENAMED
File without changes
{512p β†’ Rellust/512p}/Rellust_512p_e15.safetensors RENAMED
File without changes
{512p β†’ Rellust/512p}/Rellust_512p_e5.safetensors RENAMED
File without changes
{768p β†’ Rellust/768p}/Rellust_768p_e1.safetensors RENAMED
File without changes
{768p β†’ Rellust/768p}/Rellust_768p_e2.safetensors RENAMED
File without changes
{768p β†’ Rellust/768p}/Rellust_768p_e3.safetensors RENAMED
File without changes
{768p β†’ Rellust/768p}/Rellust_768p_e4.safetensors RENAMED
File without changes
{768p β†’ Rellust/768p}/Rellust_768p_e5.safetensors RENAMED
File without changes
images/00608-2310821.png ADDED

Git LFS Details

  • SHA256: 14dc0ede5a69c337fd6334080f2e35fe26101548f582435baf8cff0ed86cb967
  • Pointer size: 132 Bytes
  • Size of remote file: 3.17 MB
images/00616-2887952460.png ADDED

Git LFS Details

  • SHA256: 20621cf1904ca26831e93ef943d8a1ddc150621796fb50239a0d2cb1b77ea150
  • Pointer size: 132 Bytes
  • Size of remote file: 3.85 MB
images/00620-4266538265.png ADDED

Git LFS Details

  • SHA256: 8009ebb3f37302b2f74367657e5caa1ceaebfda3ab1d51a335e91b027f85fddf
  • Pointer size: 132 Bytes
  • Size of remote file: 3.94 MB
images/grid-0102-1783332202.png ADDED

Git LFS Details

  • SHA256: 2a5fd604ba6a1f10f398ec9f58bb74d739c75400741e8db42f5dfb40f8b9b04c
  • Pointer size: 133 Bytes
  • Size of remote file: 13.7 MB
images/grid-0103-1783332202.png ADDED

Git LFS Details

  • SHA256: 70fcc05fb7933730ace80ec3766d6c7bd7a5b1126e41a488ce656cf928166366
  • Pointer size: 133 Bytes
  • Size of remote file: 13.7 MB