GGUF
•
qwen
0.5B version of the code-specific Qwen 2.5 for code generation, code reasoning and code fixing.
Model info
Model
Qwen2.5 Coder 0.5B Instruct GGUF
Author
Alibaba
Arch
qwen
Parameters
0.5B
Format
gguf
Size on disk
about 397.81 MB
Download the model using lms
— LM Studio's developer CLI.
lms get lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf
curl http://localhost:1234/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "lmstudio-community/qwen2.5-coder-0.5b-instruct-gguf",
"messages": [
{ "role": "system", "content": "Always answer in rhymes." },
{ "role": "user", "content": "Introduce yourself." }
],
"temperature": 0.7,
"max_tokens": -1,
"stream": true
}'
lms log stream
to see your prompts as they are sent to the LLM.lmstudio.js
- LM Studio SDK documentation (TypeScript)lms log stream
- Stream server logslms
- LM Studio's CLI documentation