Say: LLM

To provide the user a way to ask questions that can be answered by a LLM

This node is a special type of Say. Instead of it saying the exact text you configured in the attributes of this node it will simply continue the conversation based on what happened so far and the instruction you provide in the Prompt.

Large language models are great at understanding user questions and provide sensible answers based on the information stored in the common knowledge of the language model. The LLM Flows skill adds this flow node to your flow designer.

How to use?

The Say LLM node can be used anywhere in your flow. One of the use cases for this node could for instance be to summary the conversation so far without writing any code. Instead you simply write a prompt with the following instruction:

Prompt to use together with the Say: LLM node

Now you can construct a flow that uses this prompt to summarize the conversation to confirm with the user the information provided so far:

Use the Say LLM in your flow

The LLM can use a specific instruction from you (as the Smart App designer) to guide the generation of the answer. This instruction is given in the form of a "Prompt". The prompt can be configured in the AI section of the platform. Besides instructions, the prompt will also contain content that the LLM can use on top of its own dataset to generate answers, like information regarding your address, opening hours, parking instructions, etc. See the Prompts page for more information on this topic.

Node properties

Property	Description	Explanation
Prompt	The prompt which contains the instructions and content the LLM can use when generating a response