Get Load Config
Get the load configuration of the model
Required Python SDK version: 1.2.0
LM Studio allows you to configure certain parameters when loading a model through the server UI or through the API.
You can retrieve the config with which a given model was loaded using the SDK.
In the below examples, the LLM reference can be replaced with an embedding model reference without requiring any other changes.
Pro Tip
Context length is a special case that has its own method.
import lmstudio as lms
model = lms.llm()
print(model.get_load_config())