Self-Evaluation Unlocks Any-Step Text-to-Image Generation
Paper
•
2512.22374
•
Published
•
15
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Self-Evaluation Unlocks Any-Step Text-to-Image Generation
Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Models
Andyx
submitted
a
paper
to Daily Papers
6 days ago
jacklishufan
submitted
a
paper
to Daily Papers
20 days ago
multimodalart
posted
an
update
3 months ago
Post
8406
Want to iterate on a Hugging Face Space with an LLM?
Now you can easily convert any HF entire repo (Model, Dataset or Space) to a text file and feed it to a language model!
multimodalart/repo2txt
Now you can easily convert any HF entire repo (Model, Dataset or Space) to a text file and feed it to a language model!
multimodalart/repo2txt
multimodalart
posted
an
update
7 months ago
Post
17986
Self-Forcing - a real-time video distilled model from Wan 2.1 by
@adobe
is out, and they open sourced it 🐐
I've built a live real time demo on Spaces 📹💨
multimodalart/self-forcing
I've built a live real time demo on Spaces 📹💨
multimodalart/self-forcing
-
- 6 replies
jsingh
authored
2
papers
9 months ago
jsingh
authored
a
paper
about 1 year ago
jsingh
authored
2
papers
over 1 year ago
multimodalart
posted
an
update
over 1 year ago
Post
35565
New feature 🔥
Image models and LoRAs now have little previews 🤏
If you don't know where to start to find them, I invite you to browse cool LoRAs in the profile of some amazing fine-tuners: @artificialguybr , @alvdansen , @DoctorDiffusion , @e-n-v-y , @KappaNeuro @ostris
Image models and LoRAs now have little previews 🤏
If you don't know where to start to find them, I invite you to browse cool LoRAs in the profile of some amazing fine-tuners: @artificialguybr , @alvdansen , @DoctorDiffusion , @e-n-v-y , @KappaNeuro @ostris
- 3 replies
multimodalart
posted
an
update
over 1 year ago
Post
28597
The first open Stable Diffusion 3-like architecture model is JUST out 💣 - but it is not SD3! 🤔
It is Tencent-Hunyuan/HunyuanDiT by Tencent, a 1.5B parameter DiT (diffusion transformer) text-to-image model 🖼️✨, trained with multi-lingual CLIP + multi-lingual T5 text-encoders for english 🤝 chinese understanding
Try it out by yourself here ▶️ https://huggingface.co/spaces/multimodalart/HunyuanDiT
(a bit too slow as the model is chunky and the research code isn't super optimized for inference speed yet)
In the paper they claim to be SOTA open source based on human preference evaluation!
It is Tencent-Hunyuan/HunyuanDiT by Tencent, a 1.5B parameter DiT (diffusion transformer) text-to-image model 🖼️✨, trained with multi-lingual CLIP + multi-lingual T5 text-encoders for english 🤝 chinese understanding
Try it out by yourself here ▶️ https://huggingface.co/spaces/multimodalart/HunyuanDiT
(a bit too slow as the model is chunky and the research code isn't super optimized for inference speed yet)
In the paper they claim to be SOTA open source based on human preference evaluation!
multimodalart
posted
an
update
almost 2 years ago
Post
The Stable Diffusion 3 research paper broken down, including some overlooked details! 📝
Model
📏 2 base model variants mentioned: 2B and 8B sizes
📐 New architecture in all abstraction levels:
- 🔽 UNet; ⬆️ Multimodal Diffusion Transformer, bye cross attention 👋
- 🆕 Rectified flows for the diffusion process
- 🧩 Still a Latent Diffusion Model
📄 3 text-encoders: 2 CLIPs, one T5-XXL; plug-and-play: removing the larger one maintains competitiveness
🗃️ Dataset was deduplicated with SSCD which helped with memorization (no more details about the dataset tho)
Variants
🔁 A DPO fine-tuned model showed great improvement in prompt understanding and aesthetics
✏️ An Instruct Edit 2B model was trained, and learned how to do text-replacement
Results
✅ State of the art in automated evals for composition and prompt understanding
✅ Best win rate in human preference evaluation for prompt understanding, aesthetics and typography (missing some details on how many participants and the design of the experiment)
Paper: https://stabilityai-public-packages.s3.us-west-2.amazonaws.com/Stable+Diffusion+3+Paper.pdf
Model
📏 2 base model variants mentioned: 2B and 8B sizes
📐 New architecture in all abstraction levels:
- 🔽 UNet; ⬆️ Multimodal Diffusion Transformer, bye cross attention 👋
- 🆕 Rectified flows for the diffusion process
- 🧩 Still a Latent Diffusion Model
📄 3 text-encoders: 2 CLIPs, one T5-XXL; plug-and-play: removing the larger one maintains competitiveness
🗃️ Dataset was deduplicated with SSCD which helped with memorization (no more details about the dataset tho)
Variants
🔁 A DPO fine-tuned model showed great improvement in prompt understanding and aesthetics
✏️ An Instruct Edit 2B model was trained, and learned how to do text-replacement
Results
✅ State of the art in automated evals for composition and prompt understanding
✅ Best win rate in human preference evaluation for prompt understanding, aesthetics and typography (missing some details on how many participants and the design of the experiment)
Paper: https://stabilityai-public-packages.s3.us-west-2.amazonaws.com/Stable+Diffusion+3+Paper.pdf
- 3 replies
multimodalart
posted
an
update
almost 2 years ago
Post
⚔️ The TIGERLab's Text2Image arena is here! ⚔️
TIGER-Lab/GenAI-Arena
Like https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard for LLMs: you prompt, two images emerge, vote for the best one 🏆
With enough votes this will lead to an Elo-based leaderboard for text-to-image models, go vote! 🗳️
TIGER-Lab/GenAI-Arena
TIGER-Lab/GenAI-Arena
Like https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard for LLMs: you prompt, two images emerge, vote for the best one 🏆
With enough votes this will lead to an Elo-based leaderboard for text-to-image models, go vote! 🗳️
TIGER-Lab/GenAI-Arena
multimodalart
posted
an
update
almost 2 years ago
Post
It seems February started with a fully open source AI renaissance 🌟
Models released with fully open dataset, training code, weights ✅
LLM - allenai/olmo-suite-65aeaae8fe5b6b2122b46778 🧠
Embedding - nomic-ai/nomic-embed-text-v1 📚 (sota!)
And it's literally February 1st - can't wait to see what else the community will bring 👀
Models released with fully open dataset, training code, weights ✅
LLM - allenai/olmo-suite-65aeaae8fe5b6b2122b46778 🧠
Embedding - nomic-ai/nomic-embed-text-v1 📚 (sota!)
And it's literally February 1st - can't wait to see what else the community will bring 👀
multimodalart
authored
2
papers
about 2 years ago
multimodalart
authored
a
paper
over 2 years ago