LLM Knowledge base

Adds flow nodes that use Large Language Models using Knowledge bases for their functioning

0.6.0 update - With the update of the LLM Knowledge base skill to version 0.6.0, we now make use of Google Vertex which improves both the quality and reliability for retrieving information from the uploaded documents. When creating a new knowledge base make sure to set 'Google Vertex AI RAG' as the retrieval strategy. For more info, read below.

The LLM Knowledge base skill adds two capabilities to your Smart App to generate responses to users and operators using a large language model AI service that uses a predefined Knowledge base as its content.

How to install?

Installing the package

Depending on your license, the LLM Knowledge base skill can be installed in the packages section of the platform.

Not all Smart Apps support the LLM Knowledge base skill. When they do however you can perform the following steps to install the skill to your App.

1. Go to packages

2. Click on Browse skills

3. Click on LLM Knowledge base

4. Click on Install

5. Publish the app to gain access to the 'AI - Knowledge bases' page

Configuring the AI

The prompts can be configured in the Prompts page in the AI section, see here for more details.

Knowledge bases can be configured in the Knowledge bases page in the AI section, see here for more details.

Configuring the Inbox settings

If you want to use the knowledge base and the LLM Prompt in the inbox to generate suggestions to the operators and agents, make sure to configure the Prompt and Knowledge base in the Settings page called "Inbox AI", see below:

Configuring which knowledge base and prompt to use for providing inbox suggestions

How to use?

In the Flow Designer

The LLM Knowledge base skill introduces the following flow nodes to your Flow designer in order to provide responses that are generated by the LLM to users of your Smart App:

• Iterate: LLM Knowledge base

• Say: LLM Knowledge base

In the Inbox

The LLM Knowledge base skill also introduces an Inbox Command for generating response suggestions using the LLM. The Inbox Command is available in the input bar when an operator or agent has joined the conversation.

Inbox commands

When clicking the inbox commands button a list appears with the available commands. Depending on the skills you have installed you get zero, one or more options. When the LLM KB Skill is installed you should at least see the option "AI Suggestions".

AI suggestions

You can click the AI suggestions option directly (so without having typed anything yet in the input bar) as shown above, or first type a hint to the AI and then click on the AI suggestions option to hint the AI into a specific direction for its answer:

How to hint the AI for a specific answer

Getting started with Google Vertex Knowledge bases

Since the 0.6.0 update of the Knowledge base skill the preferred way of creating knowledge bases is to use the Google Vertex AI RAG retrieval stategy.

When creating a new Knowledge base you will be given this option:

For existing knowledge bases, make sure to first create a new Google Vertex version.

Then, you can download the files you've uploaded in your old knowledge base before by right clicking on the name of the file and then click Download:

After downloading, you can simply upload them in the recently created Google Vertex version of your Knowledge base.

Frequently asked questions

I have no 'Knowledge bases' page in the AI section after installing the skill?

After installing the skill you need to publish the app again. After publishing you should gain access to the Knowledge bases. Just by dragging a node in the Flows section, or changing a line in the Script section you can get your app in a publishable state.

I get a warning in the inbox when I try to use the Inbox Command: AI Suggestions

You should configure the prompt and/or knowledge base in the Settings section, see above, when you get this message.

Prompt and/or knowledge base not configured yet

How do I download the files from my Knowledge base?

You can download the files you've uploaded before by right clicking on the name of the file and then click Download: