In this step, we verify that the Q&A data and attached images set in STEP 2 and STEP 3 , as well as the AI behavior set in STEP 4 and STEP 5 , are working as intended.
◆ Table of Contents
◆ How to conduct a conversation test
There are two methods for conducting conversation tests, depending on the purpose:
1. Conversation test about the knowledge search tool on the ugo Portal
This method allows you to easily check the conversation behavior in a chat format on the ugo Portal without actually starting ugo. Use this when you want to quickly check whether the Q&A data and AI settings are working correctly.
*Conversation tests using AI agents other than the knowledge search tool (weather forecast, transit information, web search tools) cannot be performed on the ugo Portal. Please perform conversation tests using an actual ugo (on a real device).
Steps for a conversational test on the knowledge search tool
① Click Global Menu > Chat History.
② Click on "Test Chat" in the upper right corner of the conversation list screen.
③ In the "Test Chat" dialog box, specify the building and floor that will be the test environment, and then click "Start a conversation".
④ The "Chat Simulation" screen will be displayed.
Click the "Settings" button and configure the AI model to use and the Additional Instructions created in STEP 5.
For the AI model, be sure to select "Accurate".
For this example, we will copy and paste the additional instructions created in STEP 5.
⑤ After setup, enter your question in the chat box at the bottom of the screen, and ugo's answer will be displayed using the knowledge search tool.
If you have linked an image to the Q&A, the image to be displayed on the signage will also be displayed at the same time.
Please conduct a conversation test in a chat format as shown in the diagram below and check ugo's responses.
💡 Points to check
Q&A hit confirmation:
- During the test, clicking the [Q&A Hit Count] dropdown
will show you which Q&A entries were searched for and used as answers to your question. Let's check if the anticipated Q&A is being found. - If you don't get the answer you expected, please check the following:
• Is the AI model set to Accurate?
• What does the Q&A data contain?
Japanese-language test:
- If you type a question in Japanese in the chat box, you can check if the AI can use its automatic translation function to provide a response based on your settings.
Consideration of additional instructions:
- If the response feels a little unnatural, or if you want it to use specific phrasing, you can adjust the AI's response by setting "additional instructions." For details, please refer to "STEP 5: How to set up automatic conversations".
2. Actual conversation testing with ugo (on a real device)
With ugo powered on, you'll actually speak to it to test it.
This is done to verify the voice recognition sensitivity, the display on the signage, and the natural pronunciation of the responses.
Preparation: Check the input gain of the signage microphone.
Please check that the setting for "Microphone input sensitivity during conversation" under the automatic conversation icon is not set to 0.
Test Procedure
① Click the Automatic Conversation Icon at the top of the operation screen.
② Turn ON the toggle switch for Auto-Conversation Settings.
③ Please confirm that the Automatic Conversation Icon is set to ON. When this is set, ugo begins detecting people.
④ Click on Show AI Agent Setting Dialog.
⑤ Check the box for each tool. If you are using the web search tool, enter the domain name.
⑦ When you stand in front of ugo, it will speak the phrase you set in the [Opening Greeting] section of the [Automatic Conversation Settings] and enter a state where it can converse with the user. Ask ugo a question and check the response.
💡 Points to check
Confirmation of the answer:
- When ugo answers a question, use the knowledge search tool to check if it is providing the expected answer.
- When a question is asked using Q&A content linked to an image in the knowledge base, check if the image linked to the signage
is also displayed simultaneously when ugo answers the question.
If you do not get the answer you expected, or if the image is not displayed correctly, review the Q&A data and the [additional instructions] in the AI agent settings.
Test on how to pronounce proper nouns:
- When ugo answers a question, please check if it pronounces proper nouns correctly.
If there are any errors in pronunciation, please add the correct pronunciation to the Q&A data.
It is also effective to specify in the "Additional Instructions" section of the AI agent settings that it should pronounce them correctly.
Testing answers using the tool:
- ugo will provide answers based on the tools used in the AI agent settings, and display weather information and transit directions on the signage. Let's check if it's displayed. - When using a web search tool, check if ugo is able to answer the question appropriately by referring to websites. If you are unable to provide the correct answer, please check if you have forgotten to check the [Tools] option in the AI agent settings. Please also review the [Additional Instructions].
*Weather forecasts are available for cities worldwide.
*Transfer information is only available for railways within Japan.
*Express train fares such as Shinkansen are not included.
Consideration of additional instructions:
- If you feel that ugo's responses are a little unnatural, or if you want it to use specific phrasing, you can adjust the AI's responses by setting "additional instructions" . For details, please refer to "STEP 4 Overview and Mechanism of AI Agent Settings".
◆ Review of Q&A data and additional instructions
If ugo does not provide the intended answer during the conversation test, there may be a problem with the Q&A or additional instructions. Please return to
" STEP 2: How to Register Knowledge and Q&A ", " STEP 3: Registering Resources and Attaching Images to Q&A ", or " STEP 4: Overview and Mechanism of AI Agent Settings " and edit the Q&A or additional instructions.
The way ugo answers will change depending on the settings of the Q&A and additional instructions, so please try adding or changing the wording yourself.
Through repeated testing, ugo will be able to provide optimal interaction tailored to your production environment.
Please edit and save any additional instructions in your notepad or similar software for your records.
◆ Notes
Signage display after the conversation ends:
- Once the conversation ends, the signage will automatically revert to the default image displayed when ugo was launched. If you want to display the image provided by the customer on the signage after the conversation has ended, use the "Signage Image" command with automatic conversation turned ON. Consider running the integrated Flow.Further details will be explained in the next section, " STEP 7 Operation in Combination with Flow ."
Regarding overlap with the display area of the on-screen text:
- When using the AI automated conversation function to display images and videos on signage, ugo's speech will be displayed as "text overlays (subtitles)". It will be displayed on the screen in real time. This text overlay will be displayed on top of the content, so please pay attention to the display area when creating images and videos. The top 200 pixels of the signage screen will be used for displaying text overlays. - If important information (text, faces, logos, etc.) is placed within this area of an image or video, it will be displayed as text overlay during ugo's speech. Overlapping images may significantly reduce visibility. The top 200px of the screen should be designated as a "safety zone for text overlays," and designed to display only a background image or as a blank space. I highly recommend it.
| Text display area | Top of screen 200px |
| Recommended layout | Please place important content away from the top 200px. |
Once this step is complete, you can move on to the next step, " STEP 7: Operation in combination with Flow, " and begin full-scale operation.