PE-GPR/9.0.0/Help/ModelAccuracy - Revision history

Vivian.hood@genesys.com: Published

2020-12-16T20:55:05Z

Published

Vivian: Published

2020-09-23T17:24:24Z

Published

Vivian: Published

2020-08-04T12:38:44Z

Published

New page

{{Article
|Standalone=No
|DisplayName=View model accuracy
|TocName=View model accuracy
|Context=View how well your model is performs over time. For a more complete picture, the graph also shows model accuracy when trained and feature coverage.
|ComingSoon=No
|Platform=GenesysEngage-cloud
|Section={{Section
|sectionHeading=The Model Accuracy tab
|anchor=modelacc
|alignment=Horizontal
|Media=Image
|image=GPRModelAccuracy.png
|structuredtext=The '''Model Accuracy''' tab provides a view into how well your model performs over time.

This tab is on the '''Predictors''' window: [[File:GPRPredictorsWindow.png|200 px|link=https://all.docs.genesys.com/File:GPRPredictorsWindow.png]]
|structuredtextwide='''Prerequisites:''' To use this tab, your account must include one or more Predictors and have scoring data available.

===Configure the view===
The '''Model Accuracy''' tab enables you to select the following information:

*The name and ID of the predictor. Use the selector to specify which predictor to view.
*The name and ID of the model. Use the selector to specify which model to view.
*The displayed date range. Use the year and month selectors to specify the month to view.
*The '''Plot By''' selector enables you to set the granularity with which the graph displays data. You can choose to view data by Day, Hour, or 15-Minute interval.

'''Note:''' This page does not display real-time updates. GPR refreshes the data displayed once per day, at 3:00 am UTC.
|Status=No
}}{{Section
|sectionHeading=How to read the graph
|anchor=modaccgraph
|alignment=Horizontal
|Media=Image
|image=GPRModelAccuracyGraph.png
|structuredtext=The Model Accuracy graph shows the mean absolute error value, indicating the difference over time between the results the model predicts and the actual outcomes. This value, and how to interpret it, varies depending on the type of KPI your model optimizes.
|structuredtextwide=The graph also includes a horizontal line marking the accuracy level when the model was trained, enabling you to compare the training result with real-world performance. The gray bars show the feature coverage level, since feature coverage issues are often the reason for degradations in model accuracy.

'''Note:''' The Feature Coverage tab can help you troubleshoot issues if feature coverage does seem to be the source of a model's drift away from accuracy. To view the five features having the strongest impact on the KPI value, see the '''Top Features''' horizontal bar graph on {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|display text=the Simulator tab}}.

'''Example'''

When you view the graph, keep in mind that the right-hand vertical axis shows the mean absolute error rate, not the actual KPI value. The example image on this page shows the graph for a model designed to optimize CSAT. The horizontal red training line shows that when you created the model, it had an error rate of 1.26. That is, the average difference between the predicted CSAT and the actual CSAT was 1.26 points. As you have used this model over time, this difference between the predicted CSAT and the actual CSAT has ranged from 1.40 to 1.56.

To export the model accuracy data as a CSV file, click the '''Export to CSV''' button.
|Status=No
}}
}}

@@ Line 11: / Line 11: @@
 |alignment=Horizontal
 |Media=Image
-|image=GPRModelAccuracy.png
+|image=GPRRModelAccuracy.png
 |structuredtext=The '''Model Accuracy''' tab provides a view into how well your model performs over time.
 |structuredtextwide=The '''Model Accuracy''' tab enables you to select the following information:
 *The name and ID of the predictor. Use the selector to specify which predictor to view.
@@ Line 39: / Line 31: @@
 |structuredtextwide=The graph also includes a horizontal line marking the accuracy level when the model was trained, enabling you to compare the training result with real-world performance. The gray bars show the feature coverage level, since feature coverage issues are often the reason for degradations in model accuracy.
-'''Note:''' If feature coverage does seem to be the source of a model's drift away from accuracy, use the '''Feature Coverage''' tab to troubleshoot issues. To view the five features having the strongest impact on the KPI value, see the '''Top Features''' horizontal bar graph on {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|display text=the Simulator tab}}.
+'''Note:''' If feature coverage does seem to be the source of a model's drift away from accuracy, use the '''Feature Coverage''' tab to troubleshoot issues. To view the features ranked by strongest impact on the KPI value, see the '''Top Features''' horizontal bar graph on {{Link-SomewhereInThisVersion|manual=Help|topic=AIMonitoring|display text=the Feature Coverage tab}}.
 '''Example'''

@@ Line 3: / Line 3: @@
 |DisplayName=View model accuracy
 |TocName=View model accuracy
-|Context=View how well your model is performs over time. For a more complete picture, the graph also shows model accuracy when trained and feature coverage.
+|Context=View how well your model is performs over time, how accurate your model was when trained, and feature coverage.
 |ComingSoon=No
 |Platform=GenesysEngage-cloud
@@ Line 15: / Line 15: @@
 This tab is on the '''Predictors''' window: [[File:GPRPredictorsWindow.png|200 px|link=https://all.docs.genesys.com/File:GPRPredictorsWindow.png]]
-|structuredtextwide='''Prerequisites:''' To use this tab, your account must include one or more Predictors and have scoring data available.
+|structuredtextwide='''Prerequisites:''' To use this tab, you must fulfill the following conditions:
 ===Configure the view===
@@ Line 33: / Line 36: @@
 |Media=Image
 |image=GPRModelAccuracyGraph.png
-|structuredtext=The Model Accuracy graph shows the mean absolute error value, indicating the difference over time between the results the model predicts and the actual outcomes. This value, and how to interpret it, varies depending on the type of KPI your model optimizes.
+|structuredtext=The Model Accuracy graph shows the mean absolute error value, indicating the difference over time between the results the model predicts and the actual outcomes. This value, and how to interpret it, varies depending on the type of key performance indicator (KPI) your model optimizes.
 |structuredtextwide=The graph also includes a horizontal line marking the accuracy level when the model was trained, enabling you to compare the training result with real-world performance. The gray bars show the feature coverage level, since feature coverage issues are often the reason for degradations in model accuracy.
-'''Note:''' The Feature Coverage tab can help you troubleshoot issues if feature coverage does seem to be the source of a model's drift away from accuracy. To view the five features having the strongest impact on the KPI value, see the '''Top Features''' horizontal bar graph on {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|display text=the Simulator tab}}.
+'''Note:''' If feature coverage does seem to be the source of a model's drift away from accuracy, use the '''Feature Coverage''' tab to troubleshoot issues. To view the five features having the strongest impact on the KPI value, see the '''Top Features''' horizontal bar graph on {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|display text=the Simulator tab}}.
 '''Example'''
-When you view the graph, keep in mind that the right-hand vertical axis shows the mean absolute error rate, not the actual KPI value. The example image on this page shows the graph for a model designed to optimize CSAT. The horizontal red training line shows that when you created the model, it had an error rate of 1.26. That is, the average difference between the predicted CSAT and the actual CSAT was 1.26 points. As you have used this model over time, this difference between the predicted CSAT and the actual CSAT has ranged from 1.40 to 1.56.
+When you view the graph, keep in mind that the vertical axis on the right shows the mean absolute error rate, not the actual KPI value. The example image on this page shows the graph for a model designed to optimize CSAT. The horizontal red training line shows that when you created the model, it had an error rate of 1.26. That is, the average difference between the predicted CSAT and the actual CSAT was 1.26 points. As you have used this model over time, this difference between the predicted CSAT and the actual CSAT has ranged from 1.40 to 1.56.
-To export the model accuracy data as a CSV file, click the '''Export to CSV''' button.
+To export the model accuracy data as a .csv file, click the '''Export to CSV''' button.
 |Status=No
 }}
 }}