Update README.md
Browse files
README.md
CHANGED
|
@@ -6,29 +6,61 @@ tags:
|
|
| 6 |
- diffusers
|
| 7 |
- fal
|
| 8 |
base_model: black-forest-labs/FLUX.1-dev
|
| 9 |
-
instance_prompt:
|
|
|
|
|
|
|
|
|
|
| 10 |
license: other
|
| 11 |
license_name: flux-1-dev-non-commercial-license
|
| 12 |
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
|
| 13 |
widget:
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
---
|
| 33 |
|
| 34 |
# Studio Ghibli Characters - FLUX.1 Dev LoRA
|
|
@@ -37,18 +69,19 @@ widget:
|
|
| 37 |
|
| 38 |
## Model description
|
| 39 |
|
| 40 |
-
|
|
|
|
| 41 |
|
| 42 |
-
|
| 43 |
|
| 44 |
-
|
| 45 |
|
| 46 |
-
|
| 47 |
|
| 48 |
-
|
|
|
|
|
|
|
| 49 |
|
| 50 |
-
|
| 51 |
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
Training was done using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training).
|
|
|
|
| 6 |
- diffusers
|
| 7 |
- fal
|
| 8 |
base_model: black-forest-labs/FLUX.1-dev
|
| 9 |
+
instance_prompt: >-
|
| 10 |
+
Ghibli style [character description] with [distinctive features], [action or
|
| 11 |
+
pose], [environment or background], [lighting or atmosphere], [additional
|
| 12 |
+
details]
|
| 13 |
license: other
|
| 14 |
license_name: flux-1-dev-non-commercial-license
|
| 15 |
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
|
| 16 |
widget:
|
| 17 |
+
- text: >-
|
| 18 |
+
Ghibli style futuristic stormtrooper with glossy white armor and a sleek
|
| 19 |
+
helmet, standing heroically on a lush alien planet, vibrant flowers blooming
|
| 20 |
+
around, soft sunlight illuminating the scene, a gentle breeze rustling the
|
| 21 |
+
leaves
|
| 22 |
+
output:
|
| 23 |
+
url: images/x4swNXc6IRKnh-D6DtihE_5f83bc549d1742ab90badc3d4b70d633.jpg
|
| 24 |
+
- text: >-
|
| 25 |
+
Ghibli style Shrek, a lovable green ogre with a big smile, sitting on a
|
| 26 |
+
moss-covered rock while enjoying a plate of freshly picked vegetables, in a
|
| 27 |
+
magical forest filled with whimsical creatures, dappled sunlight filtering
|
| 28 |
+
through the trees, surrounded by curious fairies peeking out from behind
|
| 29 |
+
leaves
|
| 30 |
+
output:
|
| 31 |
+
url: images/7rrcd6pMDfYpF-ogxgG4h_539c7546dae945efb68560befc655eb3.jpg
|
| 32 |
+
- text: >-
|
| 33 |
+
Ghibli style Albus Dumbledore, a wise old wizard with long silver hair and a
|
| 34 |
+
flowing robe, standing in a lush garden filled with colorful magical plants,
|
| 35 |
+
gently stroking a phoenix perched on his shoulder, soft morning light
|
| 36 |
+
filtering through the trees, surrounded by whimsical creatures curiously
|
| 37 |
+
observing him
|
| 38 |
+
output:
|
| 39 |
+
url: images/62SwmyLf8xHJ8uGRBL4Tm_2dad22f9fcd64b859b3c83735b270016.jpg
|
| 40 |
+
- text: >-
|
| 41 |
+
Ghibli style The Grinch, a mischievous green creature with a sly grin,
|
| 42 |
+
peeking out from behind a snow-covered tree while plotting his antics, in a
|
| 43 |
+
quaint snowy village decorated for the holidays, warm light glowing from
|
| 44 |
+
cozy homes, with playful snowflakes dancing in the air
|
| 45 |
+
output:
|
| 46 |
+
url: images/U9CD7T-PUXSdQqhOvMnZl_e867ddc5c1e34398b01112999f44eafa.jpg
|
| 47 |
+
- text: >-
|
| 48 |
+
Ghibli style Santa Claus, a jolly old man with a fluffy white beard and a
|
| 49 |
+
red coat, cheerfully preparing gifts in a cozy workshop filled with magical
|
| 50 |
+
toys, warm golden light glowing from lanterns, surrounded by adorable elves
|
| 51 |
+
and whimsical creatures helping him
|
| 52 |
+
output:
|
| 53 |
+
url: images/_h_RDKv-7-SSwXTn3RCYw_fc2d6d100b354ac1bf54b5e45c364dd5.jpg
|
| 54 |
+
- text: >-
|
| 55 |
+
Ghibli style Garfield, a lazy orange cat with a mischievous grin, lounging
|
| 56 |
+
on a sunny windowsill while dreaming of lasagna, in a cozy home filled with
|
| 57 |
+
plants and colorful decor, warm light streaming in, with a friendly mouse
|
| 58 |
+
peeking out from behind a flower pot
|
| 59 |
+
output:
|
| 60 |
+
url: images/laOMFQjySoeOM9SUc-yDr_958497495bef4224b9f845ba01beb1ec.jpg
|
| 61 |
+
datasets:
|
| 62 |
+
- alvarobartt/ghibli-characters
|
| 63 |
+
pipeline_tag: text-to-image
|
| 64 |
---
|
| 65 |
|
| 66 |
# Studio Ghibli Characters - FLUX.1 Dev LoRA
|
|
|
|
| 69 |
|
| 70 |
## Model description
|
| 71 |
|
| 72 |
+
This repository contains the LoRA adapter for [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), fine-tuned using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training)
|
| 73 |
+
with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).
|
| 74 |
|
| 75 |
+
The captions were written down manually by a single annotator, and following the exact same promp template as explained below.
|
| 76 |
|
| 77 |
+
## Prompt Template
|
| 78 |
|
| 79 |
+
You should use the following format:
|
| 80 |
|
| 81 |
+
```
|
| 82 |
+
Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]` to trigger the image generation.
|
| 83 |
+
```
|
| 84 |
|
| 85 |
+
## Disclaimer
|
| 86 |
|
| 87 |
+
The FLUX.1-dev fine-tunes fall under the same license as FLUX.1-dev i.e. https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md; and the Studio Ghibli dataset is "licensed" with a custom non-commercial license based on the findings on their website.
|
|
|
|
|
|