model upload
Browse files- README.md +62 -10
- ReWaifu/1K/ReWaifu_1K_e1.safetensors +3 -0
- ReWaifu/1K/ReWaifu_1K_e2.safetensors +3 -0
- ReWaifu/1K/ReWaifu_1K_e3.safetensors +3 -0
- ReWaifu/1K/ReWaifu_1K_e4.safetensors +3 -0
- ReWaifu/1K/ReWaifu_1K_e5.safetensors +3 -0
- ReWaifu/512p/ReWaifu_512p_e12.safetensors +3 -0
- ReWaifu/512p/ReWaifu_512p_e3.safetensors +3 -0
- ReWaifu/512p/ReWaifu_512p_e6.safetensors +3 -0
- ReWaifu/512p/ReWaifu_512p_e9.safetensors +3 -0
- ReWaifu/768p/ReWaifu_768p_e1.safetensors +3 -0
- ReWaifu/768p/ReWaifu_768p_e2.safetensors +3 -0
- ReWaifu/768p/ReWaifu_768p_e3.safetensors +3 -0
- ReWaifu/768p/ReWaifu_768p_e4.safetensors +3 -0
- ReWaifu/768p/ReWaifu_768p_e5.safetensors +3 -0
- {1K β Rellust/1K}/Rellust_1K_e1.safetensors +0 -0
- {1K β Rellust/1K}/Rellust_1K_e2.safetensors +0 -0
- {1K β Rellust/1K}/Rellust_1K_e3.safetensors +0 -0
- {512p β Rellust/512p}/Rellust_512p_e10.safetensors +0 -0
- {512p β Rellust/512p}/Rellust_512p_e15.safetensors +0 -0
- {512p β Rellust/512p}/Rellust_512p_e5.safetensors +0 -0
- {768p β Rellust/768p}/Rellust_768p_e1.safetensors +0 -0
- {768p β Rellust/768p}/Rellust_768p_e2.safetensors +0 -0
- {768p β Rellust/768p}/Rellust_768p_e3.safetensors +0 -0
- {768p β Rellust/768p}/Rellust_768p_e4.safetensors +0 -0
- {768p β Rellust/768p}/Rellust_768p_e5.safetensors +0 -0
- images/00608-2310821.png +3 -0
- images/00616-2887952460.png +3 -0
- images/00620-4266538265.png +3 -0
- images/grid-0102-1783332202.png +3 -0
- images/grid-0103-1783332202.png +3 -0
README.md
CHANGED
@@ -15,18 +15,29 @@ ReFT is a series of fine-tuned models from SD 1.5 for producing illustration sty
|
|
15 |
|
16 |
## Model Description
|
17 |
|
18 |
-
| Model Name |
|
19 |
-
| ----------------- | ---------------- | ------------------ |
|
20 |
-
| ReFT
|
21 |
-
| ReFT
|
22 |
-
| ReFT
|
|
|
|
|
|
|
23 |
|
24 |
**CLIP Skip 1 is recommended for all models!!**
|
25 |
|
26 |
-
|
27 |
|
28 |
-
Each model is fine-tuned from SD1.5 with
|
29 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
30 |
The batch size is 16 for 512p only and 8 for the rest.
|
31 |
Fine tuning is also performed at fp16, using mutires noise.
|
32 |
|
@@ -42,7 +53,48 @@ The models do not require underscores for tags in the prompts.
|
|
42 |
|
43 |
CLIP Skip 1 is recommended.
|
44 |
|
45 |
-
### Examples
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
46 |
|
47 |
![](images/00056-4203630207.png)
|
48 |
```
|
@@ -77,4 +129,4 @@ The CreativeML OpenRAIL License specifies:
|
|
77 |
|
78 |
## Acknowledgements
|
79 |
|
80 |
-
These Models build on the excellent
|
|
|
15 |
|
16 |
## Model Description
|
17 |
|
18 |
+
| Model Name | Base Model | Typical Resolusion | lr |
|
19 |
+
| ----------------- | ---------------- | ------------------ | ---- |
|
20 |
+
| ReFT ReWaifu 512p | SD1.5 | 512x512 | 4e-6 |
|
21 |
+
| ReFT ReWaifu 768p | ReWaifu_512p_e12 | 768x768 | 4e-6 |
|
22 |
+
| ReFT ReWaifu 1K | ReWaifu_768p_e5 | 1024x1024 | 2e-6 |
|
23 |
+
| ReFT Rellust 512p | SD1.5 | 512x512 | 4e-6 |
|
24 |
+
| ReFT Rellust 768p | Rellust_512p_e10 | 768x768 | 4e-6 |
|
25 |
+
| ReFT Rellust 1K | Rellust_768p_e3 | 1024x1024 | 4e-6 |
|
26 |
|
27 |
**CLIP Skip 1 is recommended for all models!!**
|
28 |
|
29 |
+
### ReFT ReWaifu
|
30 |
|
31 |
+
Each model is fine-tuned from SD1.5 with AI-Illustration tagged images of various authors published on the web and [NijiJourney-Prompt-Pairs]([/NijiJourney-Prompt-Pairs](https://huggingface.co/datasets/Korakoe/NijiJourney-Prompt-Pairs)) using Aspect Ratio Bucketing based on either 512p, 768p, or 1K resolution.
|
32 |
+
For 512p, a 370k image data set was used, and for 768p and 1K a subset of 20k images selected by [ImageReward](https://huggingface.co/THUDM/ImageReward) score with BLIP was used.
|
33 |
+
Image captions are made by BLIP and WD1.4-tagger.
|
34 |
+
The batch size is 16 for 512p only and 8 for the rest.
|
35 |
+
Fine tuning is also performed at fp16, using mutires noise.
|
36 |
+
|
37 |
+
### ReFT Rellust
|
38 |
+
|
39 |
+
Each model is fine-tuned from SD1.5 with ~16k nijijourneyv5 tagged images of various authors published on the web with a learning rate of 4e-6 using Aspect Ratio Bucketing based on either 512p, 768p, or 1K resolution.
|
40 |
+
Image captions are made by BLIP and WD1.4-tagger.
|
41 |
The batch size is 16 for 512p only and 8 for the rest.
|
42 |
Fine tuning is also performed at fp16, using mutires noise.
|
43 |
|
|
|
53 |
|
54 |
CLIP Skip 1 is recommended.
|
55 |
|
56 |
+
### Examples
|
57 |
+
|
58 |
+
#### ReFT ReWafu 1K
|
59 |
+
|
60 |
+
![](images/00608-2310821.png)
|
61 |
+
```
|
62 |
+
wide shot, solo, 1girl, full body, black hair, twintails, red eyes, white blouse, Peter Pan collar, dress, pinafore dress, strawberry print skirt, waist bow, frilled dress, pink skirt, long sleeves, puffy long sleeves, food print, pink footwear, strap shoes, closed mouth, fruit, white background, strawberry, pastel
|
63 |
+
Negative prompt: bad anatomy, text, frame, blurry, realistic
|
64 |
+
Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 2310821, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, Version: v1.5.1
|
65 |
+
```
|
66 |
+
|
67 |
+
![](images/00620-4266538265.png)
|
68 |
+
```
|
69 |
+
solo, 1girl, cowboy shot, magical girl, white hair, medium hair, hair ornament, blue eyes, black dress, frilled dress, short sleeves, puffy sleeves, holding staff of ruby, starry sky, milky way
|
70 |
+
Negative prompt: bad anatomy, text, frame, blurry, realistic, skirt hold
|
71 |
+
Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 4266538265, Size: 960x1152, Model hash: 7716dbfa7b, Model: SDAXa3c, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
|
72 |
+
```
|
73 |
+
|
74 |
+
![](images/00616-2887952460.png)
|
75 |
+
```
|
76 |
+
wide shot, grapes, muscat, white background, simple background, full body, solo, 1girl, small head, light-brown hair, medium hair, wavy hair, brown eyes, simple dress, casual, slim, shoes, water colors, pastel colors, light coloring
|
77 |
+
Negative prompt: worst quality, low quality, lowres, blurry, text, frame, light particle, water, vivid color, black, messy hair, frills
|
78 |
+
Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 2887952460, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Variation seed: 1970649291, Variation seed strength: 0.1, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, Version: v1.5.1
|
79 |
+
```
|
80 |
+
|
81 |
+
- 2d <-> 3d: Use "realistic" tag.
|
82 |
+
- 2d
|
83 |
+
![](images/grid-0102-1783332202.png)
|
84 |
+
```
|
85 |
+
solo, 1girl, from side, anime girl is holding a maple leaf, red hair, own hands together , medium hair, wavy hair, yellow eyes, white sweater, long sleeves, skirt, mini skirt, plaid skirt, strap shoes, out doors, maple hair ornament, scenery, depth of field, tree, maple, look into hands
|
86 |
+
Negative prompt: bad anatomy, text, frame, blurry, school uniform, realistic, long neck
|
87 |
+
Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 1783332202, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
|
88 |
+
```
|
89 |
+
- 3d
|
90 |
+
![](images/grid-0103-1783332202.png)
|
91 |
+
```
|
92 |
+
solo, 1girl, from side, anime girl is holding a maple leaf, red hair, own hands together , medium hair, wavy hair, yellow eyes, white sweater, long sleeves, skirt, mini skirt, plaid skirt, strap shoes, out doors, maple hair ornament, scenery, depth of field, tree, maple, look into hands, realistic
|
93 |
+
Negative prompt: bad anatomy, text, frame, blurry, school uniform
|
94 |
+
Steps: 30, Sampler: UniPC, CFG scale: 7, Seed: 1783332202, Size: 1024x1024, Model hash: 7716dbfa7b, Model: ReWaifu_1K_e5, Denoising strength: 0.6, FreeU Stages: "[{\"backbone_factor\": 1.2, \"skip_factor\": 0.9}, {\"backbone_factor\": 1.4, \"skip_factor\": 0.2}]", CFG Rescale phi: 0, Hires upscale: 1.5, Hires steps: 20, Hires upscaler: Latent, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: FWR_TEfixed2(539136a8cf23), AddNet Weight A 1: 0.5, AddNet Weight B 1: 0.5, Version: v1.5.1
|
95 |
+
```
|
96 |
+
|
97 |
+
#### ReFT Rellust 1K
|
98 |
|
99 |
![](images/00056-4203630207.png)
|
100 |
```
|
|
|
129 |
|
130 |
## Acknowledgements
|
131 |
|
132 |
+
These Models build on the excellent works: SD1.5, developed by [CompVis](https://ommer-lab.com/) and [RUNWAY](https://runwayml.com), and [ImageReward](https://huggingface.co/THUDM/ImageReward) (Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong).
|
ReWaifu/1K/ReWaifu_1K_e1.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6702c6e8dfdad4ea6ae677c345f8b343a5297e1010b4cd81fdc40c99cd7574f1
|
3 |
+
size 3851717247
|
ReWaifu/1K/ReWaifu_1K_e2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1d0848af5ab6a04495d5bf665da9f04f7aa4a103c194d91bcd3501ec4c307fda
|
3 |
+
size 3851717247
|
ReWaifu/1K/ReWaifu_1K_e3.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:367b3de632107caa951ba00812d7b26182d03dd90ac58522810795ac72cf9bde
|
3 |
+
size 3851717247
|
ReWaifu/1K/ReWaifu_1K_e4.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ebdbee2ef8e645720b78a32984449475be7124a0071114f5fcc262fed0abe3df
|
3 |
+
size 3851717247
|
ReWaifu/1K/ReWaifu_1K_e5.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7716dbfa7b829e7a50ef0d29c179e4c3723538af9939c094c59857dcbe6b4977
|
3 |
+
size 3851717247
|
ReWaifu/512p/ReWaifu_512p_e12.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a4972390e4afe6ea53a0f920d3cec0ee26d049dd695270bc6247fdb2299b4f0f
|
3 |
+
size 3851717247
|
ReWaifu/512p/ReWaifu_512p_e3.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5e46514533f06168a550fd7323ccf98aeb5f5803818c17513c4393df6aa6d43b
|
3 |
+
size 3851717247
|
ReWaifu/512p/ReWaifu_512p_e6.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:be194a0885143a94704e5669cf293e3f8a7de2c8fae88ddfc99aa3922ca89f9e
|
3 |
+
size 3851717247
|
ReWaifu/512p/ReWaifu_512p_e9.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:706f33b36233d0e2f2d4e637b5b667d02cc3a63ae222598cce06b2c1cb37140e
|
3 |
+
size 3851717247
|
ReWaifu/768p/ReWaifu_768p_e1.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:457c852013eac2492b64eb0023d7110c2b6bcb35082b706501c0438398a398de
|
3 |
+
size 3851717247
|
ReWaifu/768p/ReWaifu_768p_e2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e98cf7af19cba4e581b46b536c90060e0acabaa3e179a7b1e3181808eeee468c
|
3 |
+
size 3851717247
|
ReWaifu/768p/ReWaifu_768p_e3.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d5d9936c547da526807c4ccca724e26a3c18cea81d91e8a0d9c90bd58b863d19
|
3 |
+
size 3851717247
|
ReWaifu/768p/ReWaifu_768p_e4.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8bc3c84e78d8a6a4efb184641cd22603ede276350dd679eec0c3c4a93be1bcfb
|
3 |
+
size 3851717247
|
ReWaifu/768p/ReWaifu_768p_e5.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f57ff402999c74019ec804a9672bb921403a0658d367271b9a19e81f4c8ef2c0
|
3 |
+
size 3851717247
|
{1K β Rellust/1K}/Rellust_1K_e1.safetensors
RENAMED
File without changes
|
{1K β Rellust/1K}/Rellust_1K_e2.safetensors
RENAMED
File without changes
|
{1K β Rellust/1K}/Rellust_1K_e3.safetensors
RENAMED
File without changes
|
{512p β Rellust/512p}/Rellust_512p_e10.safetensors
RENAMED
File without changes
|
{512p β Rellust/512p}/Rellust_512p_e15.safetensors
RENAMED
File without changes
|
{512p β Rellust/512p}/Rellust_512p_e5.safetensors
RENAMED
File without changes
|
{768p β Rellust/768p}/Rellust_768p_e1.safetensors
RENAMED
File without changes
|
{768p β Rellust/768p}/Rellust_768p_e2.safetensors
RENAMED
File without changes
|
{768p β Rellust/768p}/Rellust_768p_e3.safetensors
RENAMED
File without changes
|
{768p β Rellust/768p}/Rellust_768p_e4.safetensors
RENAMED
File without changes
|
{768p β Rellust/768p}/Rellust_768p_e5.safetensors
RENAMED
File without changes
|
images/00608-2310821.png
ADDED
Git LFS Details
|
images/00616-2887952460.png
ADDED
Git LFS Details
|
images/00620-4266538265.png
ADDED
Git LFS Details
|
images/grid-0102-1783332202.png
ADDED
Git LFS Details
|
images/grid-0103-1783332202.png
ADDED
Git LFS Details
|