← All Models

Gemma 2 27B

•

google

gemma

The large option of the Gemma 2 model family. Built by Google, using from the same research and technology used to create the Gemini models

Model info

Model

Gemma 2 27B

Author

google

Arch

gemma

Parameters

27B

Size on disk

about 12.45 GB

Format

gguf

Download and run Gemma 2 27B

Open in LM Studio to view download options

Use Gemma 2 27B in your code

💡 LM Studio needs to be installed and run at least once for this to work. Don't have it yet? Get it here.

CLI Bootstrap

npx lmstudio install-cli # (only needed once)

Model Load

lms load lmstudio-community/gemma-2-27b-it-gguf
Alternatively, load the model in the LM Studio app.

Use Gemma 2 27B via an OpenAI-like API

Reuse your existing OpenAI client code and point it to LM Studio instead.

Python example
# Example: reuse your existing OpenAI client code
from openai import OpenAI

# Point to the local server
client = OpenAI(base_url="http://localhost:1234/v1", 
                api_key="lm-studio") # not used

completion = client.chat.completions.create(
  model="lmstudio-community/gemma-2-27b-it-gguf",
  messages=[
    {"role": "system", "content": "Always answer in rhymes."},
    {"role": "user", "content": "Introduce yourself."}
  ],
  temperature=0.7,
)

print(completion.choices[0].message)

Develop

Learn more