Qwen3-4B-Instruct-2507-mahjong-alpha

Qwen3-4B-Instruct-2507-mahjong-alpha ๆ˜ฏไธ€ไธชๅŸบไบŽ unsloth/Qwen3-4B-Instruct-2507 ่ฟ›่กŒ QLoRA ๅพฎ่ฐƒ็š„็ซ‹็›ด้บปๅฐ†ๅž‚็›ดๆจกๅž‹๏ผŒ้ขๅ‘ๅ››้บปๅผƒ็‰Œๅปบ่ฎฎไปปๅŠกใ€‚

ๆจกๅž‹ๅฏๆ นๆฎ่พ“ๅ…ฅ็š„ๅœบๆฌกไฟกๆฏใ€ๆ‰‹็‰Œใ€ๅ‰ฏ้œฒใ€็‰Œๆฒณใ€็‰Œๆ•ˆไธŽ้˜ฒๅฎˆไฟกๆฏ๏ผŒ่พ“ๅ‡บๅฝ“ๅ‰ๆœ€ๅบ”ๆ‰“ๅ‡บ็š„ไธ€ๅผ ็‰Œใ€‚

ๅฝ“ๅ‰็‰ˆๆœฌไธป่ฆ้ขๅ‘ๅทฅๅ…ท้›†ๆˆๅœบๆ™ฏ๏ผŒๆŽจ็†่พ“ๅ‡บไธบๅ•ๅผ ็‰Œๆ–‡ๆœฌ๏ผŒไธๅŒ…ๅซ่งฃ้‡Šไฟกๆฏใ€‚

ๆจกๅž‹็‰น็‚น

  • ไปปๅŠก๏ผšๅ››้บป็ซ‹็›ด้บปๅฐ†ๅผƒ็‰Œๅปบ่ฎฎ
  • ๅŸบๅบงๆจกๅž‹๏ผšunsloth/Qwen3-4B-Instruct-2507
  • ๅพฎ่ฐƒๆ–นๅผ๏ผšQLoRA
  • ่ฎญ็ปƒๆก†ๆžถ๏ผšUnsloth
  • ๅ‘ๅธƒๆ ผๅผ๏ผšGGUF (F16)
  • ๆŽจ็†ๆ–นๅผ๏ผšllama.cpp
  • ็ปดๆŠค่€…๏ผšTTDXQ

้€‚็”จ่Œƒๅ›ด

ๆœฌๆจกๅž‹้ขๅ‘ๅ››้บปๅœบๆ™ฏ๏ผŒไธๅซ่ตคๅฎ็‰Œใ€‚ๅฝ“ๅ‰็‰ˆๆœฌไธ“ๆณจไบŽ"ๅผƒ็‰Œๅปบ่ฎฎ"่ฟ™ไธ€ๅ•ไธ€ไปปๅŠก๏ผŒไธๆไพ›ๅฎŒๆ•ดๅฏนๅฑ€่ง„ๅˆ’๏ผŒไนŸไธๆไพ›ๅฝน็งใ€ๆ‰“็‚นๆˆ–่ฏฆ็ป†ๆ”ป้˜ฒ่งฃ้‡Šใ€‚

ไฝฟ็”จ้™ๅˆถ

  • ไป…ๆ”ฏๆŒๅผƒ็‰Œๅปบ่ฎฎ
  • ไธๆ”ฏๆŒๅฎŒๆ•ดๅฏนๅฑ€่ง„ๅˆ’
  • ไธๆ”ฏๆŒๅฝน็งใ€ๆ‰“็‚นใ€่ฟ›ๆ”ป้˜ฒๅฎˆ่งฃ้‡Š
  • ไธไฟ่ฏ็ซž่ต›ๆˆ–ๅฎžๆˆ˜ๆ•ˆๆžœ
  • ไป…ไพ›็ ”็ฉถไธŽๅญฆไน ไฝฟ็”จ

็ฆๆญข็”จ้€”

็ฆๆญขๅฐ†ๆœฌๆจกๅž‹็”จไบŽ๏ผš

  • ไฝœๅผŠ
  • ๅค–ๆŒ‚
  • ไปฃๆ‰“
  • ็œŸ้’ฑ่ตŒๅš่พ…ๅŠฉ

ๆจกๅž‹่พ“ๅ…ฅ่พ“ๅ‡บ

่พ“ๅ…ฅๆ ผๅผ

ๆจกๅž‹่พ“ๅ…ฅไธบ็ป“ๆž„ๅŒ–่‡ช็„ถ่ฏญ่จ€ๅฑ€้ขๆ่ฟฐใ€‚็คบไพ‹๏ผš

[ๆƒ…ๆ™ฏๅˆ†ๆž]
- ็‰Œๅฑ€: ไธœไธ€ๅฑ€๏ผŒไฝ ๆ˜ฏๅบ„ๅฎถ (็ฌฌ1ๅทก๏ผŒ็‰Œๅข™ไฝ™69ๅผ )ใ€‚
- ็Šถๆ€: ๅฝ“ๅ‰ๆŽ’ๅ 1/4 (ไธŽไธ€ไฝๅทฎ 0)ใ€‚
- ๅฎ็‰Œ: 5ไธ‡
- ๅ„็Žฉๅฎถๅˆ†ๆ•ฐ: ไฝ ๆœ‰ 25ๅˆ†, ไธ‹ๅฎถ: 25ๅˆ†, ๅฏนๅฎถ: 25ๅˆ†, ไธŠๅฎถ: 25ๅˆ†ใ€‚
- ไฝ ็š„ๆ‰‹็‰Œ: 1ไธ‡ 5ไธ‡ 7ไธ‡ 3็ญ’ 5็ญ’ 6็ญ’ 8็ญ’ 8็ญ’ 3็ดข 5็ดข 8็ดข ๅ— ็™ฝ ๅ‘
- ็‰Œๆ•ˆ: 5 ๅ‘ๅฌ๏ผŒ่ฟ›ๅผ  82 ๅผ ใ€‚
- ้˜ฒๅพก๏ผš
  ๆœ€ๅฎ‰ๅ…จ็‰Œๆ”พ้“ณ็އ๏ผš11.3%
  ๅนณๅ‡ๆ”พ้“ณ็އ๏ผš18.5%
  ๆœ€ๅฑ้™ฉ็‰Œๆ”พ้“ณ็އ๏ผš25.9%
ๅœบไธŠๅทฒ่ง็‰Œไฟกๆฏ
ๅ„็Žฉๅฎถๅ‰ฏ้œฒไฟกๆฏ:ๆœฌๅฎถๅ‰ฏ้œฒ๏ผšๆ— , ไธ‹ๅฎถๅ‰ฏ้œฒ๏ผšๆ— , ๅฏนๅฎถๅ‰ฏ้œฒ๏ผšๆ— , ไธŠๅฎถๅ‰ฏ้œฒ๏ผšๆ— 
ๅ„็Žฉๅฎถ็‰Œๆฒณไฟกๆฏ:ๆœฌๅฎถ๏ผšๆ— , ไธ‹ๅฎถ๏ผšๆ— , ๅฏนๅฎถ๏ผšๆ— , ไธŠๅฎถ๏ผšๆ— 

[ไปปๅŠก]
ๆ นๆฎๅฝ“ๅ‰ๆƒ…ๆ™ฏ๏ผŒ้€‰ๆ‹ฉไธ€ๅผ ๆœ€ๅบ”่ฏฅๆ‰“ๅ‡บ็š„ๆ‰‹็‰Œใ€‚

่พ“ๅ‡บๆ ผๅผ

ๆจกๅž‹่พ“ๅ‡บไธฅๆ ผไธบ"ๅ•ๅผ ็‰Œๆ–‡ๆœฌ"๏ผŒไธๅธฆ"ๆ‰“"ๅญ—๏ผŒไธๅธฆ่งฃ้‡Šใ€‚ไพ‹ๅฆ‚๏ผš

็™ฝ

ไฝฟ็”จๆ–นๆณ•

llama.cpp ๆŽจ็†

llama-server -m Qwen3-4B-Instruct-2507-mahjong-alpha.gguf -c 2048

Python ๆŽจ็†็คบไพ‹

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "TTDXQ/Qwen3-4B-Instruct-2507-mahjong-alpha"
)
tokenizer = AutoTokenizer.from_pretrained(
    "TTDXQ/Qwen3-4B-Instruct-2507-mahjong-alpha"
)

# ๅ‡†ๅค‡่พ“ๅ…ฅ
input_text = "[ๆƒ…ๆ™ฏๅˆ†ๆž]\n- ็‰Œๅฑ€: ไธœไธ€ๅฑ€๏ผŒไฝ ๆ˜ฏๅบ„ๅฎถ (็ฌฌ1ๅทก๏ผŒ็‰Œๅข™ไฝ™69ๅผ )ใ€‚\n..."

# ๆŽจ็†
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=10)
result = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(result)  # ่พ“ๅ‡บ: ็™ฝ

ๆ•ฐๆฎ้›†

่ฎญ็ปƒๆ•ฐๆฎไฝฟ็”จ pjura/mahjong_board_states ็š„ 2018 ๅนด้ƒจๅˆ†ๆ•ฐๆฎใ€‚่ฏฅๆ•ฐๆฎ้›†ๆฅๆบไบŽๅคฉ้ฃŽ้บปๅฐ†็š„ๆธธ็Žฉ่ฎฐๅฝ•๏ผŒๆฏๆกๆ•ฐๆฎๅŒ…ๅซ 511 ไธชๆ•ฐๆฎ็‚น๏ผŒๆถต็›–ๆธธๆˆๅŸบ็ก€ไฟกๆฏใ€ๅฎ็‰ŒๆŒ‡็คบ็‰Œใ€่ง†่ง’็Žฉๅฎถๆ‰‹็‰Œใ€็Žฉๅฎถๅ‰ฏ้œฒใ€็‰Œๆฒณไฟกๆฏใ€็Žฉๅฎถ่ˆ็‰Œใ€ๅผƒ็‰Œๅ†ณ็ญ–็ญ‰ใ€‚

ๆ•ฐๆฎๅค„็†

ๅฐ†ๅŽŸๅง‹ๆ•ฐๆฎ่ฝฌๆขไธบไพฟไบŽ้˜…่ฏป็š„่‡ช็„ถ่ฏญ่จ€ๆ่ฟฐๅฝขๅผ๏ผŒๅนถๆ นๆฎๆ•ฐๆฎ่ฎก็ฎ—ๅ‡บๅทก็›ฎๆ•ฐใ€ๅฎž้™…ๅฎ็‰Œใ€็ฎ€ๆ˜“ๆ”พ้“ณๅ‚่€ƒ็ญ‰ไฟกๆฏใ€‚ๆ นๆฎๅทก็›ฎ่ฐƒๆ•ดๆ ทๆœฌๆฏ”ไพ‹๏ผš

  • 1~3 ๅทก๏ผš15%
  • 4~6 ๅทก๏ผš20%
  • 7~12 ๅทก๏ผš35%

ๆœ€็ปˆไฝฟ็”จ 192000 ๆกๆ ทๆœฌ๏ผŒๆœชๆททๅ…ฅ้€š็”จๆŒ‡ไปคๆ•ฐๆฎๆˆ–่‡ชๅปบๆ•ฐๆฎใ€‚

  • ่ฎญ็ปƒ้›†๏ผš192000
  • ้ชŒ่ฏ้›†๏ผš2000
  • ๆต‹่ฏ•้›†๏ผš2019 ๅนดๆ•ฐๆฎๆŒ‰้œ€ๆŠฝๅ–
  • ่ฎญ็ปƒ / ้ชŒ่ฏ / ๆต‹่ฏ•๏ผšๅฎŒๅ…จไบ’ไธ้‡ๅ 

ๆ•ฐๆฎ้›†ๅผ•็”จ

@dataset{mahjong_board_states,
  title = {MahJong Board States Dataset},
  author = {Patrick Jura},
  year = {2024},
  url = {https://huggingface.co/datasets/pjura/mahjong_board_states}
}

่ฎญ็ปƒไฟกๆฏ

ๆจกๅž‹้…็ฝฎ

  • ๅŸบ็ก€ๆจกๅž‹๏ผšunsloth/Qwen3-4B-Instruct-2507
  • ่ฎญ็ปƒๅŠ ่ฝฝ็ฒพๅบฆ๏ผš4bit
  • ๅพฎ่ฐƒๆ–นๅผ๏ผšQLoRA
  • ่ฎญ็ปƒๆก†ๆžถ๏ผšUnsloth
  • Max sequence length๏ผš2048

LoRA ๅ‚ๆ•ฐ

  • Rank๏ผš128
  • Alpha๏ผš256
  • ็›ฎๆ ‡ๆจกๅ—๏ผšๅ…จ้ƒจ

่ฎญ็ปƒ่ถ…ๅ‚ๆ•ฐ

  • Learning rate๏ผš1e-4
  • LR scheduler๏ผšcosine
  • Batch size๏ผš64
  • ๅ•ๅกๆ‰นๆฌก๏ผš2
  • ๆขฏๅบฆ็ดฏ็งฏๆญฅๆ•ฐ๏ผš32
  • Training steps๏ผš3000
  • Warmup steps๏ผš300
  • Random seed๏ผš3407
  • ๅŠ ่ฝฝๆœ€ไผ˜ๆฃ€ๆŸฅ็‚น๏ผšๆ˜ฏ

่ฎญ็ปƒๆ—ถ้—ด

  • ๆ€ปๆ—ถ้•ฟ๏ผš็บฆ 16.44 ๅฐๆ—ถ

่ฏ„ๆต‹็ป“ๆžœ

ไธŽๆ•ฐๆฎๅบ“ๅผƒ็‰ŒๅŠจไฝœๅฏนๆฏ”

ๆŽจ็†ๅ‚ๆ•ฐ๏ผšTemperature=0.1, Top_P=0.1

่ฏ„ๆต‹ๆŒ‡ๆ ‡่ฏดๆ˜Ž๏ผš

  • ๅพ—ๅˆ†๏ผšๆปกๅˆ† 500 ๅˆ†๏ผˆๆฏไธชๆ ทๆœฌๆญฃ็กฎๅพ— 1 ๅˆ†๏ผŒ้”™่ฏฏๅพ— 0 ๅˆ†๏ผ‰
  • ๆ ทๆœฌๅ…จๅฏน็އ๏ผš3 ๆฌกๆต‹่ฏ•ๅ‡ไธŽๆต‹่ฏ•้›†็ป“ๆžœไธ€่‡ด็š„ๆ ทๆœฌๅ ๅ…จ้ƒจๆ ทๆœฌ็š„ๆฏ”ไพ‹
  • ๆ ทๆœฌ้›ถๅˆ†็އ๏ผš3 ๆฌกๆต‹่ฏ•ๅ‡ไธŽๆต‹่ฏ•้›†็ป“ๆžœไธ็ฌฆ็š„ๆ ทๆœฌๅ ๅ…จ้ƒจๆ ทๆœฌ็š„ๆฏ”ไพ‹

็‰Œๆ•ˆๆต‹่ฏ•

ๆจกๅž‹ ๆ–นๆณ• ๅพ—ๅˆ† ๆ ทๆœฌๅ…จๅฏน็އ ๆ ทๆœฌ้›ถๅˆ†็އ
Qwen3-4B ๆ็คบ่ฏๅทฅ็จ‹ 50.21 6.60% 86.13%
Qwen3-4B ๅพฎ่ฐƒ 229.66 45.87% 53.93%
DeepSeek-V3.2 ๆ็คบ่ฏๅทฅ็จ‹ 181.66 21.40% 46.33%

้˜ฒๅฎˆๆต‹่ฏ•

ๆจกๅž‹ ๆ–นๆณ• ๅพ—ๅˆ† ๆ ทๆœฌๅ…จๅฏน็އ ๆ ทๆœฌ้›ถๅˆ†็އ
Qwen3-4B ๆ็คบ่ฏๅทฅ็จ‹ 53.55 6.17% 84.43%
Qwen3-4B ๅพฎ่ฐƒ 239.89 47.93% 52.00%
DeepSeek-V3.2 ๆ็คบ่ฏๅทฅ็จ‹ 172.00 16.00% 46.80%

็ปผๅˆๆต‹่ฏ•

ๆจกๅž‹ ๆ–นๆณ• ๅพ—ๅˆ† ๆ ทๆœฌๅ…จๅฏน็އ ๆ ทๆœฌ้›ถๅˆ†็އ
Qwen3-4B ๆ็คบ่ฏๅทฅ็จ‹ 53.44 0.60% 84.40%
Qwen3-4B ๅพฎ่ฐƒ 233.33 46.53% 53.20%
DeepSeek-V3.2 ๆ็คบ่ฏๅทฅ็จ‹ 179.44 18.07% 44.93%

ไธŽ Mortal ๅฏนๆฏ”

ๆŽจ็†ๅ‚ๆ•ฐ๏ผšTemperature=0.6, Top_P=0.95

ๆต‹่ฏ•1๏ผšๅ…จ้ƒจๅทก็›ฎๆ•ฐๆฎ

  • ๆ ทๆœฌๆ•ฐ๏ผš3000
  • Top-1 ๅ‡†็กฎ็އ๏ผš50.73%
  • Top-3 ๅ‡†็กฎ็އ๏ผš83.37%

ๆต‹่ฏ•2๏ผšๅŽป้™คๆ—ฉๅทกๆ•ฐๆฎ

  • ๆœ‰ๆ•ˆๆ ทๆœฌๆ•ฐ๏ผš3000
  • Top-1 ๅ‡†็กฎ็އ๏ผš48.70%
  • Top-3 ๅ‡†็กฎ็އ๏ผš79.20%

ๆณจ๏ผšMortal ๆ˜ฏๅฝ“ๅ‰ๅผ€ๆบๆœ€ๅผบ็š„็ซ‹็›ด้บปๅฐ† AI ไน‹ไธ€

ไป“ๅบ“้“พๆŽฅ

License

ๆœฌๆจกๅž‹้ตๅพช Apache License 2.0 ่ฎธๅฏ่ฏใ€‚

่ฎญ็ปƒๆ•ฐๆฎๆฅ่‡ช pjura/mahjong_board_states๏ผŒๅ…ถ่ฎธๅฏ่ฏไธบ CC BY 4.0๏ผŒไฝฟ็”จๆ—ถ่ฏทไฟ็•™็›ธๅบ”็ฝฒๅไธŽๅผ•็”จใ€‚

Acknowledgements

ๆ„Ÿ่ฐขไปฅไธ‹ๅผ€ๆบ่ต„ๆบ๏ผš

  • unsloth/Qwen3-4B-Instruct-2507
  • pjura/mahjong_board_states
  • Mortal
Downloads last month
30
GGUF
Model size
4B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TTDXQ/Qwen3-4B-Instruct-2507-mahjong-alpha

Quantized
(35)
this model

Dataset used to train TTDXQ/Qwen3-4B-Instruct-2507-mahjong-alpha