•
qwen2
Promising 27 languages and lightning fast responses, this is the smallest entry in Alibaba's Qwen2 family that scales up to 72B parameters.
Model info
Model
Qwen 2 0.5B
Author
Qwen
Repository
Arch
qwen2
Parameters
0.5B
Format
gguf
Size on disk
about 352.97 MB
Download the model using lms
— LM Studio's developer CLI.
lms get qwen2-0.5b
curl http://localhost:1234/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "qwen2-0.5b",
"messages": [
{ "role": "system", "content": "Always answer in rhymes." },
{ "role": "user", "content": "Introduce yourself." }
],
"temperature": 0.7,
"max_tokens": -1,
"stream": true
}'
lms log stream
to see your prompts as they are sent to the LLM.lmstudio.js
- LM Studio SDK documentation (TypeScript)lms log stream
- Stream server logslms
- LM Studio's CLI documentation