Documentation
Basics
Agentic Flows
Integrations
Tools Provider
Prompt Preprocessor
Generators
Custom Configuration
Publishing a Plugin
Text Embedding
Tokenization
API Reference
Model Info
Basics
Agentic Flows
Integrations
Tools Provider
Prompt Preprocessor
Generators
Custom Configuration
Publishing a Plugin
Text Embedding
Tokenization
API Reference
Model Info
Plugin support is currently in private beta. Join the beta here.
Tools provider is a function that returns an array of tools that the model can use during generation.
The following are some plugins that make use of tools providers:
Gives the LLM tools to search and read Wikipedia articles.
Gives the LLM tools to run JavaScript/TypeScript code in a sandbox environment using deno.
Allows the LLM to generate random numbers using "dice".
This page's source is available on GitHub