← All Models

Phi 3.1 Mini 128k

•

Microsoft

phi3

Microsoft's latest Phi Mini model supports a whopping context length of 128k tokens in a small size, offering extremely long chats for cheap.

Model info

Model

Phi 3.1 Mini 128k

Author

Microsoft

Repository

🤗 lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF↗

Arch

phi3

Parameters

3.8B

Format

gguf

Size on disk

about 2.39 GB

Download and run Phi 3.1 Mini 128k

Open in LM Studio to view download options

Download phi-3.1-mini-128k from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get phi-3.1-mini-128k
If you don't have it yet, get it by running npx lmstudio install-cli

Call phi-3.1-mini-128k from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "phi-3.1-mini-128k",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more