GGUF

Qwen2.5 Coder 0.5B Instruct GGUF

Alibaba

qwen

0.5B version of the code-specific Qwen 2.5 for code generation, code reasoning and code fixing.

Model info

Model

Qwen2.5 Coder 0.5B Instruct GGUF

Author

Alibaba

Arch

qwen

Parameters

0.5B

Format

gguf

Size on disk

about 397.81 MB

Download and run Qwen2.5 Coder 0.5B Instruct GGUF

Open in LM Studio to view download options

Download lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf

Call lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy