Initial commit

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+*.th filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,87 @@
+---
+license: apache-2.0
+language:
+- en
+---
+arxiv.org/abs/2503.15667
+
+
+
+<p align="center">
+
+  <h2 align="center">[CVPR'25]DiffPortrait360: Consistent Portrait Diffusion for 360 View Synthesis</h2>
+  <p align="center">
+      <a href="https://freedomgu.github.io/">Yuming Gu</a><sup>1,2</sup>
+      ·
+      <a href="https://p0lyfish.github.io/portfolio/">Phong Tran</a><sup>2</sup>
+    ·  
+      <a href="https://paulyzheng.github.io/about/">Yujian Zheng</a><sup>2</sup>
+    ·  
+      <a href="https://hongyixu37.github.io/homepage/">Hongyi Xu</a><sup>3</sup>
+    ·  
+      <a href="https://lhyfst.github.io/">Heyuan Li</a><sup>4</sup>
+    ·  
+      <a href="https://www.linkedin.com/in/adilbek-karmanov?originalSubdomain=ae">Adilbek Karmanov</a><sup>2</sup>
+    ·  
+      <a href="https://hao-li.com">Hao Li</a><sup>2,5</sup>
+    <br>
+    <sup>1</sup>Unviersity of Southern California &nbsp;<sup>2</sup>MBZUAI &nbsp; <sup>3</sup>ByteDance Inc. &nbsp; 
+    <br>
+    <sup>4</sup>The Chinese University of Hong Kong, Shenzhen&nbsp; <sup>5</sup>Pinscreen Inc.
+    <br>
+    </br>
+        <a href="https://arxiv.org/abs/2503.15667">
+        <img src='https://img.shields.io/badge/arXiv-diffportrait360-green' alt='Paper PDF'>
+        </a>
+        <a href='https://freedomgu.github.io/DiffPortrait360/'>
+        <img src='https://img.shields.io/badge/Project_Page-diffportrait360-blue' alt='Project Page'></a>
+        <a href='https://huggingface.co/gym890/diffportrait360'>
+        <img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a>
+     </br>
+</p>
+
+
+
+
+## 📜 Requirements
+* An NVIDIA GPU with CUDA support is required. 
+  * We have tested on a single A6000 GPU.
+  * **Minimum**: The minimum GPU memory required is 30GB for generating a single NVS video (batch_size=1) of 32 frames each time.
+  * **Recommended**: We recommend using a GPU with 40GB of memory.
+* Operating system: Linux
+
+
+## 🧱 Download Pretrained Models
+
+```bash
+Diffportrait360
+|----...
+|----pretrained_weights
+  |----back_head-230000.th # back head generator
+  |----model_state-3400000.th # diffportrait360 main module
+  |----easy-khair-180-gpc0.8-trans10-025000.th
+|----...
+``` 
+
+## 🔗 BibTeX
+If you find [Diffportrait360](https://arxiv.org/abs/2503.15667) is useful for your research and applications, please cite Diffportrait360 using this BibTeX:
+
+```BibTeX
+@article{gu2025diffportrait360,
+  title={DiffPortrait360: Consistent Portrait Diffusion for 360 View Synthesis},
+  author={Gu, Yuming and Tran, Phong and Zheng, Yujian and Xu, Hongyi and Li, Heyuan and Karmanov, Adilbek and Li, Hao},
+  journal={arXiv preprint arXiv:2503.15667},
+  year={2025}
+}
+```
+
+
+## License
+
+Our code is distributed under the Apache-2.0 license.
+
+
+## Acknowledgements
+
+This work is supported by the Metaverse Center Grant from the MBZUAI Research Office. We appreciate the contributions from [Diffportrait3D](https://github.com/FreedomGu/DiffPortrait3D), [PanoHead](https://github.com/SizheAn/PanoHead), [SphereHead](https://lhyfst.github.io/spherehead/), [ControlNet](https://github.com/lllyasviel/ControlNet) for their open-sourced research. We thank [Egor Zakharov](https://egorzakharov.github.io/), [Zhenhui Lin](https://www.linkedin.com/in/zhenhui-lin-5b6510226/?originalSubdomain=ae), [Maksat Kengeskanov](https://www.linkedin.com/in/maksat-kengeskanov/%C2%A0/), and Yiming Chen for the early discussions, helpful suggestions, and feedback.
+

back_head-230000.th

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16d0975d56cfcd957350c097f858ee53d83ab479c207bd2f7de88c11b61bedfb
+size 9149118575