Post

Upcoming features/changes in lrc-ai-assistant

Upcoming features/changes in lrc-ai-assistant

Upcoming changes

Selection of AI models

In the next couple days maybe weeks, I want to rewrite the whole Lua code for the model selection in lrc-ai-assistant. New models are released in a pretty short time manner as well for Ollama, as for the Google and OpenAI. At the moment the table of selectable models is hardcoded in the Defaults.lua, which makes it necessary to release a new version if something changes. This obviously sucks, so I will rely on querying local Ollama, Google and OpenAI which models are currently available. I’m still unsure if a model pull function for Ollama should be part of the plugin, since this is a very time consuming task, I think this will be left a manual step.

Redesign of the prompts

For now the plugin heavily relies on the structured response that is submitted to the API, and not so much on sophisticated prompts which I now think is a disadvantage. I think the generated results will get more usable and customizable when most of its structure and content is controlled by the prompt.

What are your thoughts on that?

This post is licensed under CC BY 4.0 by the author.