← All Models

MLX

Phi 3 mini 4k instruct 4bit

•

mlx-community

phi

The Phi-3-Mini-4K-Instruct is a 3.8B parameters, lightweight, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties

Model info

Model

Phi 3 mini 4k instruct 4bit

Author

mlx-community

Repository

🤗 mlx-community/Phi-3-mini-4k-instruct-4bit↗

Arch

phi

Parameters

3.8B

Format

safetensors

Size on disk

about 2.15 GB

Download and run Phi 3 mini 4k instruct 4bit

Open in LM Studio to view download options

Download phi-3-mini-4k from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get phi-3-mini-4k

Call phi-3-mini-4k from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "phi-3-mini-4k",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy