Godot LLM
An asset by Adriankhl
Install Asset
Install via Godot
To maintain one source of truth, Godot Asset Library is just a mirror of the old asset library so you can download directly on Godot via the integrated asset library browser
Quick Information
Godot LLM
This plugin adds GdLlama, GDEmbedding, GDLlava, and LlmDB nodes which provides functionalities to generate text using large language model (LLM).Features:* Simple text generation* Enforce the format of text generation output by Json schema* Instruct and interactive mode* Sentence Embedding* Multimodal: generate text from image or game screen* Vector database for retrieval augmented generationIf you have concerns about legal issues of LLM in games, check this documentation: https://github.com/Adriankhl/godot-llm/blob/main/LLM_LEGAL.mdSupport Windows (cpu, vulkan), macOS(cpu, metal), Linux (cpu, vulkan), Android (cpu)macOS support is on best effort basis since I don't have a mac myselfThis is a gpu build, if you want cpu backend only, you can get it from the github release page: https://github.com/Adriankhl/godot-llm/releases
Supported Engine Version
4.2
Version String
1.0
License Version
MIT
Support Level
community
Modified Date
1 year ago
Git URL
Issue URL
This plugin adds GdLlama, GDEmbedding, GDLlava, and LlmDB nodes which provides functionalities to generate text using large language model (LLM).
Features:
* Simple text generation
* Enforce the format of text generation output by Json schema
* Instruct and interactive mode
* Sentence Embedding
* Multimodal: generate text from image or game screen
* Vector database for retrieval augmented generation
If you have concerns about legal issues of LLM in games, check this documentation: https://github.com/Adriankhl/godot-llm/blob/main/LLM_LEGAL.md
Support Windows (cpu, vulkan), macOS(cpu, metal), Linux (cpu, vulkan), Android (cpu)
macOS support is on best effort basis since I don't have a mac myself
This is a gpu build, if you want cpu backend only, you can get it from the github release page: https://github.com/Adriankhl/godot-llm/releases
Reviews
Quick Information
Godot LLM
This plugin adds GdLlama, GDEmbedding, GDLlava, and LlmDB nodes which provides functionalities to generate text using large language model (LLM).Features:* Simple text generation* Enforce the format of text generation output by Json schema* Instruct and interactive mode* Sentence Embedding* Multimodal: generate text from image or game screen* Vector database for retrieval augmented generationIf you have concerns about legal issues of LLM in games, check this documentation: https://github.com/Adriankhl/godot-llm/blob/main/LLM_LEGAL.mdSupport Windows (cpu, vulkan), macOS(cpu, metal), Linux (cpu, vulkan), Android (cpu)macOS support is on best effort basis since I don't have a mac myselfThis is a gpu build, if you want cpu backend only, you can get it from the github release page: https://github.com/Adriankhl/godot-llm/releases
Supported Engine Version
4.2
Version String
1.0
License Version
MIT
Support Level
community
Modified Date
1 year ago
Git URL
Issue URL