← All Models

Qwen 2 0.5B

•

Qwen

qwen2

Promising 27 languages and lightning fast responses, this is the smallest entry in Alibaba's Qwen2 family that scales up to 72B parameters.

Model info

Model

Qwen 2 0.5B

Author

Qwen

Arch

qwen2

Parameters

0.5B

Size on disk

about 352.97 MB

Format

gguf

Download and run Qwen 2 0.5B

Open in LM Studio to view download options

Use Qwen 2 0.5B in your code

💡 LM Studio needs to be installed and run at least once for this to work. Don't have it yet? Get it here.

CLI Bootstrap

npx lmstudio install-cli # (only needed once)

Model Load

lms load qwen/qwen2-0.5b-instruct-gguf
Alternatively, load the model in the LM Studio app.

Use Qwen 2 0.5B via an OpenAI-like API

Reuse your existing OpenAI client code and point it to LM Studio instead.

Python example
# Example: reuse your existing OpenAI client code
from openai import OpenAI

# Point to the local server
client = OpenAI(base_url="http://localhost:1234/v1", 
                api_key="lm-studio") # not used

completion = client.chat.completions.create(
  model="qwen/qwen2-0.5b-instruct-gguf",
  messages=[
    {"role": "system", "content": "Always answer in rhymes."},
    {"role": "user", "content": "Introduce yourself."}
  ],
  temperature=0.7,
)

print(completion.choices[0].message)

Develop

Learn more