Initial commit - v1
Browse files- .gitattributes +1 -0
- MosaicArt_v1.ckpt +3 -0
- MosaicArt_v1_ema.ckpt +3 -0
- README.md +45 -0
- dataset_v1.zip +3 -0
- showcase.png +3 -0
.gitattributes
CHANGED
@@ -32,3 +32,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
32 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
33 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
34 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
32 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
33 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
34 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
35 |
+
showcase.png filter=lfs diff=lfs merge=lfs -text
|
MosaicArt_v1.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3210a8dadf36bde2d3c05ed4a9160db6464b1db77d45394cd0de402e833d621a
|
3 |
+
size 2132888287
|
MosaicArt_v1_ema.ckpt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e701cf9701472b2bac10a220ac62bf6c7d7ab64f54f694822dd008dfc17a5e30
|
3 |
+
size 12126929961
|
README.md
CHANGED
@@ -1,3 +1,48 @@
|
|
1 |
---
|
|
|
|
|
2 |
license: creativeml-openrail-m
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
license: creativeml-openrail-m
|
5 |
+
thumbnail: "https://huggingface.co/Guizmus/MosaicArt/resolve/main/showcase.jpg"
|
6 |
+
tags:
|
7 |
+
- stable-diffusion
|
8 |
+
- text-to-image
|
9 |
+
- image-to-image
|
10 |
+
inference: false
|
11 |
---
|
12 |
+
|
13 |
+
# Mosaic Art
|
14 |
+
<p>
|
15 |
+
<img src="https://huggingface.co/Guizmus/MosaicArt/resolve/main/showcase.jpg"/><br/>
|
16 |
+
This is a Dreamboothed Stable Diffusion model trained on pictures of mosaic art.<br/>
|
17 |
+
The total dataset is made of 46 pictures, and the training has been done on [runawayml 1.5](https://huggingface.co/runwayml/stable-diffusion-v1-5) and the [new VAE](https://huggingface.co/stabilityai/sd-vae-ft-mse). I used [EveryDream](https://github.com/victorchall/EveryDream-trainer) to do the training, using full caption on the pictures with almost no recurring word outside the main concept, so that no additionnal regularisation was needed. Out of e0 to e11 epochs, e8 was selected as the best application of style while not overtraining. Prior preservation was constated as good. A total of 9 epochs of 40 repeats with a learning rate of 1e-6.<br/>
|
18 |
+
The token "Mosaic Art" will bring in the new concept, trained as a style.<br/>
|
19 |
+
The recommended sampling is k_Euler_a or DPM++ 2M Karras on 20 steps, CFGS 7.5 .
|
20 |
+
|
21 |
+
</p>
|
22 |
+
|
23 |
+
[CKPT](https://huggingface.co/Guizmus/MosaicArt/resolve/main/MosaicArt_v1.ckpt)
|
24 |
+
|
25 |
+
[CKPT with ema weights](https://huggingface.co/Guizmus/MosaicArt/resolve/main/MosaicArt_v1_ema.ckpt)
|
26 |
+
|
27 |
+
[Dataset](https://huggingface.co/Guizmus/MosaicArt/resolve/main/dataset_v1.ckpt)
|
28 |
+
|
29 |
+
## 🧨 Diffusers
|
30 |
+
|
31 |
+
This model can be used just like any other Stable Diffusion model. For more information,
|
32 |
+
please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
|
33 |
+
|
34 |
+
You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
|
35 |
+
|
36 |
+
```python
|
37 |
+
from diffusers import StableDiffusionPipeline
|
38 |
+
import torch
|
39 |
+
|
40 |
+
model_id = "Guizmus/MosaicArt"
|
41 |
+
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
|
42 |
+
pipe = pipe.to("cuda")
|
43 |
+
|
44 |
+
prompt = "Mosaic Art dog on the moon"
|
45 |
+
image = pipe(prompt).images[0]
|
46 |
+
|
47 |
+
image.save("./MosaicArt.png")
|
48 |
+
```
|
dataset_v1.zip
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:63a2789266ee692f0de8027a18862a33592b66864c18d4f21bf6d1b19bdccd21
|
3 |
+
size 156412413
|
showcase.png
ADDED
Git LFS Details
|