Xavier: Published

2020-07-27T10:36:02Z

Published

Xavier: Published

2020-07-22T09:24:23Z

Published

New page

{{Article
|Standalone=No
|DisplayName=Working with Intent Accuracy Report
|TocName=Intent Accuracy Report
|Context=Learn to understand and use the Intent Accuracy Report feature.
|ComingSoon=Yes
|Section={{Section
|sectionHeading=What is the Intent Accuracy Report?
|anchor=what-is-iar
|alignment=Vertical
|structuredtext=The intent accuracy report is a visual representation that depicts intents that can be mistaken for others intents by your bot. The intent accuracy report shows an overview of the ''predicted intent vs the expected intent''. It can help you understand why the bot predicted an intent as Intent X instead of predicted it as Intent Y. The number of correct and incorrect predictions are summarized with count values and broken down by each intent. The expected intents are shown as rows, the predicted intents are shown as columns.
|Status=No
}}{{Section
|sectionHeading=When to use the Intent Accuracy Report
|anchor=when-to-use-iar
|alignment=Vertical
|structuredtext=You can use the Intent Accuracy Report when you create a bot for the first time. As the report provides you an insight into how your bot will perform in the real world. Based on the training utterances, the report will show if the bot will have some confusion between intents when working with live data. If you find that the utterances used by customers are different from your training utterances, this report will not be accurate. To overcome this, ensure that you provide some good training utterances.

You can also use the Intent Accuracy Report whenever you add more utterances or newer intents. This report will indicate how your bot will perform when the new changes are included.
|Status=No
}}{{Section
|sectionHeading=Understanding the Intent Accuracy Report
|anchor=understanding-iar
|alignment=Vertical
|structuredtext={{NoteFormat|The Intent Accuracy report is based on the training utterances used in the bot. It does not show the performance of the live data.|}}The '''Intent Accuracy Indicator''' score indicates how accurately the bot can predicting intents correctly. A higher percentage indicates better chances of your bot identifying an intent accurately.

In the intent accuracy report, the expected intents are shown as rows, the predicted intents are shown as columns. The diagonal cells indicate that the predicted and expected intents match. Each cell in the matrix is colored according to the intent accuracy.

*Intents that are highly likely to be mistaken from another intent and require immediate attention are marked as ''Critical'' and are highlighted in red.
*Intents that have a likelihood to be mistaken for another intent are marked as ''Advisory'' and are highlighted in yellow.
*Intents that have a low likelihood to be mistaken for another intent are marked as ''Minimal'' and are marked in dark grey.

[[File:GDE_intent_accuracy_report.png|border|center|frameless|500x500px|link=https://all.docs.genesys.com/File:GDE_intent_accuracy_report.png]]

To view more information on how the bot classified utterances to that intent, click any cell to display a detailed breakdown of how the intent was classified. For example, in the following example, The '''Query Rebate Status''' intent was classified as '''View Previous Rebates''' intent in 20% of cases and as '''File Rebate Returns''' in 20% of cases.
[[File:GDE_intent_accuracy_report_details.png|border|frameless|400x400px|link=https://all.docs.genesys.com/File:GDE_intent_accuracy_report_details.png|center]]

You can toggle the display of the '''Critical''', '''Advisory''', and '''Minimal''' highlights. You can view the percentages for each marked cell by toggling the '''Percentages''' option.

For example, if you want to view only '''Critical''' intents and the '''Percentages''':

[[File:GDE_intent_accuracy_report_toggles.png|center|frameless|600x600px|link=https://all.docs.genesys.com/File:GDE_intent_accuracy_report_toggles.png]]
|FAQHeading=How do I interpret the Intent Accuracy report?
|Status=No
}}{{Section
|sectionHeading=How to improve the Intent Accuracy Report
|anchor=improve-iar
|alignment=Vertical
|structuredtext=<br />
If your intent accuracy report shows that you may need to make improvements by showing '''Critical''' or '''Advisory''' intents, you can try these top tips:

{{{!}} class="wikitable" cellspacing="0" cellpadding="0" border="1"

{{!}} width="226" valign="top"{{!}}'''Top tip'''
{{!}} width="375" valign="top"{{!}}'''Action to take'''
{{!}}-
{{!}} width="226" valign="top"{{!}}Do you have enough utterances for each intent?
{{!}} width="375" valign="top"{{!}}Ensure you have at least 10 or 20 utterances for each intent.
{{!}}-
{{!}} width="226" valign="top"{{!}}Are you training your bot evenly?
{{!}} width="375" valign="top"{{!}}Ensure you have an even distribution of utterances across intents. For example, ensure all intents have around 10 utterances. Do not have one intent that has more utterances than other intents.
{{!}}-
{{!}} width="226" valign="top"{{!}}Are you using a similar phrasing in utterances across different intents?
{{!}} width="375" valign="top"{{!}}If Intent A is being mistaken as Intent B, you can go to the utterances in Intent A and Intent B and modify them, so they are not similar in both intents.
{{!}}-
{{!}} width="226" valign="top"{{!}}Should any intents be merged?
{{!}} width="375" valign="top"{{!}}It may make sense for you to merge two intents, for example, you may have two intents for making payments that you can merge into one single intent. You can combine Intent A and Intent B by copying the utterances from Intent A into Intent B and deleting Intent A.
{{!}}-
{{!}} width="226" valign="top"{{!}}Have you thought of your prompts for the intents? Can they be improved to help users understand what the bot is asking for?
{{!}} width="375" valign="top"{{!}}You can update your prompts by updating:

*The '''Welcome message''' option in '''Bot Settings'''.
*The '''Prompts''' option under '''Intents''' > '''Slots''' > '''Edit'''. Add or update the phrase when asking for a slot.
*The '''Confirmation Questions''' tab in '''Intents''' to add or update your confirmation questions for each intent.
{{!}}}
|FAQHeading=How do I improve my Intent Accuracy Report?
|Status=No
}}
}}

@@ Line 4: / Line 4: @@
 |TocName=Intent Accuracy Report
 |Context=Learn to understand and use the Intent Accuracy Report feature.
-|ComingSoon=Yes
+|ComingSoon=No
 |Section={{Section
 |sectionHeading=What is the Intent Accuracy Report?

GDE/Current/User/Intent Accuracy Report - Revision history

Xavier: Published

Xavier: Published