LLM Knowledge base
Adds flow nodes that use Large Language Models using Knowledge bases for their functioning
The LLM Knowledge base skill adds two capabilities to your Smart App to generate responses to users and operators using a large language model AI service that uses a predefined Knowledge base as its content.
How to install?
Installing the package
Depending on your license, the LLM Knowledge base skill can be installed in the packages section of the platform.
Not all Smart Apps support the LLM Knowledge base skill. When they do however you can perform the following steps to install the skill to your App.
Go to packages
Click on Browse skills
Click on LLM Knowledge base
Click on Install
Publish the app to gain access to the 'AI - Knowledge bases' page
Configuring the AI
The prompts can be configured in the Prompts page in the AI section, see here for more details.
Knowledge bases can be configured in the Knowledge bases page in the AI section, see here for more details.
Configuring the Inbox settings
If you want to use the knowledge base and the LLM Prompt in the inbox to generate suggestions to the operators and agents, make sure to configure the Prompt and Knowledge base in the Settings page called "Inbox AI", see below:

How to use?
In the Flow Designer
The LLM Knowledge base skill introduces the following flow nodes to your Flow designer in order to provide responses that are generated by the LLM to users of your Smart App:
In the Inbox
The LLM Knowledge base skill also introduces an Inbox Command for generating response suggestions using the LLM. The Inbox Command is available in the input bar when an operator or agent has joined the conversation.

When clicking the inbox commands button a list appears with the available commands. Depending on the skills you have installed you get zero, one or more options. When the LLM KB Skill is installed you should at least see the option "AI Suggestions".

You can click the AI suggestions option directly (so without having typed anything yet in the input bar) as shown above, or first type a hint to the AI and then click on the AI suggestions option to hint the AI into a specific direction for its answer:

Getting started with Google Vertex Knowledge bases
Since the 0.6.0 update of the Knowledge base skill the preferred way of creating knowledge bases is to use the Google Vertex AI RAG retrieval stategy.
When creating a new Knowledge base you will be given this option:

For existing knowledge bases, make sure to first create a new Google Vertex version.
Then, you can download the files you've uploaded in your old knowledge base before by right clicking on the name of the file and then click Download:

After downloading, you can simply upload them in the recently created Google Vertex version of your Knowledge base.
Frequently asked questions
I have no 'Knowledge bases' page in the AI section after installing the skill?
After installing the skill you need to publish the app again. After publishing you should gain access to the Knowledge bases. Just by dragging a node in the Flows section, or changing a line in the Script section you can get your app in a publishable state.
I get a warning in the inbox when I try to use the Inbox Command: AI Suggestions
You should configure the prompt and/or knowledge base in the Settings section, see above, when you get this message.

How do I download the files from my Knowledge base?
You can download the files you've uploaded before by right clicking on the name of the file and then click Download:

Last updated
Was this helpful?
