merve HF staff commited on
Commit
016b38a
1 Parent(s): b491cdb

End of training

Browse files
README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/FLUX.1-dev
3
+ library_name: diffusers
4
+ license: other
5
+ tags:
6
+ - text-to-image
7
+ - diffusers-training
8
+ - diffusers
9
+ - lora
10
+ - flux
11
+ - flux-diffusers
12
+ - template:sd-lora
13
+ instance_prompt: lego set in style of TOK
14
+ widget: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+
21
+ # Flux DreamBooth LoRA - merve/trained-flux-lora-lego
22
+
23
+ <Gallery />
24
+
25
+ ## Model description
26
+
27
+ These are merve/trained-flux-lora-lego DreamBooth LoRA weights for black-forest-labs/FLUX.1-dev.
28
+
29
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux.md).
30
+
31
+ Was LoRA for the text encoder enabled? False.
32
+
33
+ ## Trigger words
34
+
35
+ You should use `lego set in style of TOK` to trigger the image generation.
36
+
37
+ ## Download model
38
+
39
+ [Download the *.safetensors LoRA](merve/trained-flux-lora-lego/tree/main) in the Files & versions tab.
40
+
41
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
42
+
43
+ ```py
44
+ from diffusers import AutoPipelineForText2Image
45
+ import torch
46
+ pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16).to('cuda')
47
+ pipeline.load_lora_weights('merve/trained-flux-lora-lego', weight_name='pytorch_lora_weights.safetensors')
48
+ image = pipeline('lego set in style of TOK').images[0]
49
+ ```
50
+
51
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
52
+
53
+ ## License
54
+
55
+ Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md).
56
+
57
+
58
+ ## Intended uses & limitations
59
+
60
+ #### How to use
61
+
62
+ ```python
63
+ # TODO: add an example code snippet for running this diffusion pipeline
64
+ ```
65
+
66
+ #### Limitations and bias
67
+
68
+ [TODO: provide examples of latent issues and potential remediations]
69
+
70
+ ## Training details
71
+
72
+ [TODO: describe the data used to train the model]
checkpoint-500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b90a17079e2b676b6b52df0e4e9ec90892af930e4abcf0d678e451b85b12ad76
3
+ size 37799362
checkpoint-500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:191a9f670933bfbf8bda33034d840daad55fb5b67c1685b9665450506729d7a5
3
+ size 9388696
checkpoint-500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6452f5afa301ae9478c5a77c145d3096fc698b547c8a820e9a55540321958872
3
+ size 14344
checkpoint-500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d64e43d780f79b2c41c77b3638f3da55c2a3273c6e72a559cfe6fb2b05479b63
3
+ size 1000
logs/dreambooth-flux-dev-lora/1723821967.2263458/events.out.tfevents.1723821967.838ef21aa2f0.22480.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccee0c9d223c22ca1adfb6db66a52398f7e2135f2e387fdae9eaff62c0ce0c82
3
+ size 3193
logs/dreambooth-flux-dev-lora/1723821967.2282603/hparams.yml ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: null
10
+ center_crop: false
11
+ checkpointing_steps: 500
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: merve/lego_sets_latest
18
+ gradient_accumulation_steps: 4
19
+ gradient_checkpointing: false
20
+ guidance_scale: 3.5
21
+ hub_model_id: null
22
+ hub_token: null
23
+ image_column: image
24
+ instance_data_dir: null
25
+ instance_prompt: lego set in style of TOK
26
+ learning_rate: 1.0
27
+ local_rank: -1
28
+ logging_dir: logs
29
+ logit_mean: 0.0
30
+ logit_std: 1.0
31
+ lr_num_cycles: 1
32
+ lr_power: 1.0
33
+ lr_scheduler: constant
34
+ lr_warmup_steps: 0
35
+ max_grad_norm: 1.0
36
+ max_sequence_length: 512
37
+ max_train_steps: 700
38
+ mixed_precision: bf16
39
+ mode_scale: 1.29
40
+ num_class_images: 100
41
+ num_train_epochs: 44
42
+ num_validation_images: 4
43
+ optimizer: prodigy
44
+ output_dir: /content/trained-flux-lora-lego
45
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
46
+ prior_generation_precision: null
47
+ prior_loss_weight: 1.0
48
+ prodigy_beta3: null
49
+ prodigy_decouple: true
50
+ prodigy_safeguard_warmup: true
51
+ prodigy_use_bias_correction: true
52
+ push_to_hub: true
53
+ random_flip: false
54
+ rank: 4
55
+ repeats: 1
56
+ report_to: tensorboard
57
+ resolution: 512
58
+ resume_from_checkpoint: null
59
+ revision: null
60
+ sample_batch_size: 4
61
+ scale_lr: false
62
+ seed: 0
63
+ text_encoder_lr: 5.0e-06
64
+ train_batch_size: 1
65
+ train_text_encoder: false
66
+ use_8bit_adam: false
67
+ validation_epochs: 50
68
+ validation_prompt: null
69
+ variant: null
70
+ weighting_scheme: none
71
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora/events.out.tfevents.1723821967.838ef21aa2f0.22480.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fa342cc7715d3d4691fe68da785e6e077efe73cf4813201e7047189a776856b
3
+ size 223466
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e89ee9d9610917c754fa24e0ed5d9453861a844cb4a8c4a86002f621cd70a52
3
+ size 9388696