Skip to content
Media 0 for listing Universal Offline LLM Plugin

Description

Multiple models are supported (models repository : https://huggingface.co/models?search=gguf)

Demo here: https://youtu.be/XYvh9Gl5URE

Tuto here: https://youtu.be/PDKmFhN4OaY

This plugin allows you to integrate an AI in your game to generate texts and more (see https://arxiv.org/pdf/2302.05817v1.pdf).

The use cases are only limited by your imagination!

Obviously, it can easily be used for:

  • Making conversational AI: NPC messages generation & hero possible responses generation
  • Automatic dialog generation

Documentation & model installation walkthrough : https://docs.isaratech.com/ue4-plugins/llama-plugin

A tutorial is available here to get you started with these features: https://docs.isaratech.com/ue4-plugins/llama-plugin/tutorial-how-to-make-an-interactive-discussion

And if you are used to language models like ChatGPT, you can imagine things way more fun to do with an AI in your game :)

As the plugin is callable in editor (eventually in the construction script), it's even possible to imagine more usages:

  • GPT-like prompt to help developer during its game development
  • Offline and automatic string translation
  • Scenario generation
  • Random text generation

Unlike most similar plugins or tools, this plugin doesn't rely on an API: everything can run on your device and off-line (no internet connection required). The model files can be found for free on the internet, this way there is no pay-per-prompt policy: once installed and set-up, you can ask for an unlimited amount of prompts for free.

Warning: before purchasing the plugin, be aware of this:

  • Text generation is quite fast (sufficient for interaction), but not instantaneous; generating a lot of content will take some time
  • Loading a model require a good amount of memory on the computer (at least 16GB recommended)
  • The quality of the answers provided by a model depends on the model and how you use it (refer to the documentation of your model)

Included formats

  • logo of Unreal Engine format