alvarobartt HF Staff commited on
Commit
b20d658
·
verified ·
1 Parent(s): 27c6d55

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -28
README.md CHANGED
@@ -6,29 +6,61 @@ tags:
6
  - diffusers
7
  - fal
8
  base_model: black-forest-labs/FLUX.1-dev
9
- instance_prompt: Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]
 
 
 
10
  license: other
11
  license_name: flux-1-dev-non-commercial-license
12
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
13
  widget:
14
- - text: Ghibli style futuristic stormtrooper with glossy white armor and a sleek helmet, standing heroically on a lush alien planet, vibrant flowers blooming around, soft sunlight illuminating the scene, a gentle breeze rustling the leaves
15
- output:
16
- url: images/x4swNXc6IRKnh-D6DtihE_5f83bc549d1742ab90badc3d4b70d633.jpg
17
- - text: Ghibli style Shrek, a lovable green ogre with a big smile, sitting on a moss-covered rock while enjoying a plate of freshly picked vegetables, in a magical forest filled with whimsical creatures, dappled sunlight filtering through the trees, surrounded by curious fairies peeking out from behind leaves
18
- output:
19
- url: images/7rrcd6pMDfYpF-ogxgG4h_539c7546dae945efb68560befc655eb3.jpg
20
- - text: Ghibli style Albus Dumbledore, a wise old wizard with long silver hair and a flowing robe, standing in a lush garden filled with colorful magical plants, gently stroking a phoenix perched on his shoulder, soft morning light filtering through the trees, surrounded by whimsical creatures curiously observing him
21
- output:
22
- url: images/62SwmyLf8xHJ8uGRBL4Tm_2dad22f9fcd64b859b3c83735b270016.jpg
23
- - text: Ghibli style The Grinch, a mischievous green creature with a sly grin, peeking out from behind a snow-covered tree while plotting his antics, in a quaint snowy village decorated for the holidays, warm light glowing from cozy homes, with playful snowflakes dancing in the air
24
- output:
25
- url: images/U9CD7T-PUXSdQqhOvMnZl_e867ddc5c1e34398b01112999f44eafa.jpg
26
- - text: Ghibli style Santa Claus, a jolly old man with a fluffy white beard and a red coat, cheerfully preparing gifts in a cozy workshop filled with magical toys, warm golden light glowing from lanterns, surrounded by adorable elves and whimsical creatures helping him
27
- output:
28
- url: images/_h_RDKv-7-SSwXTn3RCYw_fc2d6d100b354ac1bf54b5e45c364dd5.jpg
29
- - text: Ghibli style Garfield, a lazy orange cat with a mischievous grin, lounging on a sunny windowsill while dreaming of lasagna, in a cozy home filled with plants and colorful decor, warm light streaming in, with a friendly mouse peeking out from behind a flower pot
30
- output:
31
- url: images/laOMFQjySoeOM9SUc-yDr_958497495bef4224b9f845ba01beb1ec.jpg
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ---
33
 
34
  # Studio Ghibli Characters - FLUX.1 Dev LoRA
@@ -37,18 +69,19 @@ widget:
37
 
38
  ## Model description
39
 
40
- WIP
 
41
 
42
- ## Trigger words
43
 
44
- You should use `Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]` to trigger the image generation.
45
 
46
- ## Download model
47
 
48
- Weights for this model are available in Safetensors format.
 
 
49
 
50
- [Download](/alvarobartt/ghibli-characters-flux-lora/tree/main) them in the Files & versions tab.
51
 
52
- ## Training at fal.ai
53
-
54
- Training was done using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training).
 
6
  - diffusers
7
  - fal
8
  base_model: black-forest-labs/FLUX.1-dev
9
+ instance_prompt: >-
10
+ Ghibli style [character description] with [distinctive features], [action or
11
+ pose], [environment or background], [lighting or atmosphere], [additional
12
+ details]
13
  license: other
14
  license_name: flux-1-dev-non-commercial-license
15
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
16
  widget:
17
+ - text: >-
18
+ Ghibli style futuristic stormtrooper with glossy white armor and a sleek
19
+ helmet, standing heroically on a lush alien planet, vibrant flowers blooming
20
+ around, soft sunlight illuminating the scene, a gentle breeze rustling the
21
+ leaves
22
+ output:
23
+ url: images/x4swNXc6IRKnh-D6DtihE_5f83bc549d1742ab90badc3d4b70d633.jpg
24
+ - text: >-
25
+ Ghibli style Shrek, a lovable green ogre with a big smile, sitting on a
26
+ moss-covered rock while enjoying a plate of freshly picked vegetables, in a
27
+ magical forest filled with whimsical creatures, dappled sunlight filtering
28
+ through the trees, surrounded by curious fairies peeking out from behind
29
+ leaves
30
+ output:
31
+ url: images/7rrcd6pMDfYpF-ogxgG4h_539c7546dae945efb68560befc655eb3.jpg
32
+ - text: >-
33
+ Ghibli style Albus Dumbledore, a wise old wizard with long silver hair and a
34
+ flowing robe, standing in a lush garden filled with colorful magical plants,
35
+ gently stroking a phoenix perched on his shoulder, soft morning light
36
+ filtering through the trees, surrounded by whimsical creatures curiously
37
+ observing him
38
+ output:
39
+ url: images/62SwmyLf8xHJ8uGRBL4Tm_2dad22f9fcd64b859b3c83735b270016.jpg
40
+ - text: >-
41
+ Ghibli style The Grinch, a mischievous green creature with a sly grin,
42
+ peeking out from behind a snow-covered tree while plotting his antics, in a
43
+ quaint snowy village decorated for the holidays, warm light glowing from
44
+ cozy homes, with playful snowflakes dancing in the air
45
+ output:
46
+ url: images/U9CD7T-PUXSdQqhOvMnZl_e867ddc5c1e34398b01112999f44eafa.jpg
47
+ - text: >-
48
+ Ghibli style Santa Claus, a jolly old man with a fluffy white beard and a
49
+ red coat, cheerfully preparing gifts in a cozy workshop filled with magical
50
+ toys, warm golden light glowing from lanterns, surrounded by adorable elves
51
+ and whimsical creatures helping him
52
+ output:
53
+ url: images/_h_RDKv-7-SSwXTn3RCYw_fc2d6d100b354ac1bf54b5e45c364dd5.jpg
54
+ - text: >-
55
+ Ghibli style Garfield, a lazy orange cat with a mischievous grin, lounging
56
+ on a sunny windowsill while dreaming of lasagna, in a cozy home filled with
57
+ plants and colorful decor, warm light streaming in, with a friendly mouse
58
+ peeking out from behind a flower pot
59
+ output:
60
+ url: images/laOMFQjySoeOM9SUc-yDr_958497495bef4224b9f845ba01beb1ec.jpg
61
+ datasets:
62
+ - alvarobartt/ghibli-characters
63
+ pipeline_tag: text-to-image
64
  ---
65
 
66
  # Studio Ghibli Characters - FLUX.1 Dev LoRA
 
69
 
70
  ## Model description
71
 
72
+ This repository contains the LoRA adapter for [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), fine-tuned using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training)
73
+ with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).
74
 
75
+ The captions were written down manually by a single annotator, and following the exact same promp template as explained below.
76
 
77
+ ## Prompt Template
78
 
79
+ You should use the following format:
80
 
81
+ ```
82
+ Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]` to trigger the image generation.
83
+ ```
84
 
85
+ ## Disclaimer
86
 
87
+ The FLUX.1-dev fine-tunes fall under the same license as FLUX.1-dev i.e. https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md; and the Studio Ghibli dataset is "licensed" with a custom non-commercial license based on the findings on their website.