xlangai
/

OpenCUA-7B

Image-Text-to-Text

feature-extraction

Computer-Use-Agent

Model card Files Files and versions

Instructions to use xlangai/OpenCUA-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use xlangai/OpenCUA-7B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="xlangai/OpenCUA-7B", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("xlangai/OpenCUA-7B", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use xlangai/OpenCUA-7B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "xlangai/OpenCUA-7B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "xlangai/OpenCUA-7B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/xlangai/OpenCUA-7B

How to use xlangai/OpenCUA-7B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "xlangai/OpenCUA-7B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "xlangai/OpenCUA-7B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "xlangai/OpenCUA-7B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "xlangai/OpenCUA-7B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use xlangai/OpenCUA-7B with Docker Model Runner:
```
docker model run hf.co/xlangai/OpenCUA-7B
```

Commit History

Make model compatible with newer versions of Transformers (#8)

a2efb7d

hmellor HF Staff commited on Feb 1

Make model compatible with Transformers v5 (#9)

73675ac

hmellor HF Staff commited on Feb 1

Delete model.args.pt

1b13246
verified

xywang626 commited on Jan 24

Update README.md

31743a9
verified

xywang626 commited on Jan 19

Update README.md

6d6f65b
verified

xywang626 commited on Jan 19

add _support_sdpa property to support more transformers version (#7)

49c54f8
verified

LutherXD commited on Jan 15

replace the config.json with a correct version (#6)

20f7829
verified

LutherXD commited on Jan 15

Upload 3 files (#5)

83cc8be
verified

LutherXD commited on Jan 14

Update README.md

1ded921
verified

xywang626 commited on Jan 2

Update README.md

343b749
verified

xywang626 commited on Dec 31, 2025

Update README.md (#4)

41241c4
verified

lim4349 commited on Nov 13, 2025

Update README.md

9b52afa
verified

xywang626 commited on Oct 12, 2025

Update README.md

1312373
verified

xywang626 commited on Aug 18, 2025

Update README.md

97a6352
verified

xywang626 commited on Aug 14, 2025

Update README.md

ae48ec0
verified

xywang626 commited on Aug 14, 2025

Update pipeline tag to `image-text-to-text` and add `library_name: transformers` (#1)

38ca5ce
verified

nielsr HF Staff commited on Aug 14, 2025

Update README.md

43f747c
verified

xywang626 commited on Aug 13, 2025

Update README.md

05b6b08
verified

xywang626 commited on Aug 13, 2025

Update README.md

f1e417b
verified

xywang626 commited on Aug 12, 2025

Update README.md

1458465
verified

xywang626 commited on Aug 12, 2025

Update README.md

9a3484a
verified

xywang626 commited on Aug 12, 2025

Update README.md

b9899be
verified

xywang626 commited on Aug 12, 2025

Update README.md

88c2cf2
verified

xywang626 commited on Aug 11, 2025

Update README.md

c188f80
verified

xywang626 commited on Aug 7, 2025

Update README.md

d8f1e70
verified

xywang626 commited on Aug 7, 2025

Update README.md

a708ced
verified

xywang626 commited on Aug 5, 2025

Update README.md

4f60f83
verified

xywang626 commited on Aug 5, 2025

Update README.md

45c4f60
verified

xywang626 commited on Aug 5, 2025

Update README.md

06b247a
verified

xywang626 commited on Aug 5, 2025

Update README.md

021aae3
verified

xywang626 commited on Aug 5, 2025

Update README.md

36cfea4
verified

xywang626 commited on Aug 5, 2025

Update README.md

b111c49
verified

xywang626 commited on Jul 24, 2025

Update modeling_opencua.py

6be43a5
verified

xywang626 commited on Jul 24, 2025

Upload folder using huggingface_hub

d1844e8
verified

xywang626 commited on Jul 24, 2025

initial commit

1f20048
verified

xywang626 commited on Jul 24, 2025