← All Models

GGUF

Qwen2.5 0.5B Instruct GGUF

•

Alibaba

qwen

A mini version of Qwen2.5.

Model info

Model

Qwen2.5 0.5B Instruct GGUF

Author

Alibaba

Repository

🤗 lmstudio-community/Qwen2.5-0.5B-Instruct-GGUF↗

Arch

qwen

Parameters

0.5B

Format

gguf

Size on disk

about 397.81 MB

Download and run Qwen2.5 0.5B Instruct GGUF

Open in LM Studio to view download options

Download lmstudio-community/qwen2.5-0.5b-instruct-gguf from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get lmstudio-community/qwen2.5-0.5b-instruct-gguf

Call lmstudio-community/qwen2.5-0.5b-instruct-gguf from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "lmstudio-community/qwen2.5-0.5b-instruct-gguf",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy