functionary
Basic Information
Functionary is an open source project that provides a language model and associated server tooling designed to interpret and execute external functions or plugins. The system converts function definitions into typed prompts and injects them as system messages so the model can decide when and how to call functions, whether serially or in parallel, and how to use their outputs to produce grounded responses. It offers model artifacts targeted at different resource envelopes and capabilities, including models with code-interpreter features and very long context lengths. The repository supplies server implementations that are compatible with vLLM, SGLang, Text-Generation-Inference and llama-cpp, an OpenAI-compatible chat API surface, examples for calling real Python functions, and deployment options such as Docker and serverless Modal. Documentation and examples show how to provide tools as JSON Schema-like definitions and how to make raw or OpenAI-style requests to the running service.
Links
Categorization
App Details
-
$$$$ -
$$$$