Difference between revisions of "Draft: PE-GPR/9.0.0/Help/AIMonitoring"

From Genesys Documentation
Jump to: navigation, search
m (Text replacement - "\|Platform=([^\|]*)GenesysEngage-onpremises([\|]*)" to "|Platform=$1GenesysEngage-cloud$2")
 
Line 6: Line 6:
 
|ComingSoon=No
 
|ComingSoon=No
 
|Platform=GenesysEngage-cloud
 
|Platform=GenesysEngage-cloud
|Prereq=
 
 
|Section={{Section
 
|Section={{Section
 
|sectionHeading=The Feature Coverage tab
 
|sectionHeading=The Feature Coverage tab
|anchor=
 
 
|alignment=Horizontal
 
|alignment=Horizontal
 
|Media=Image
 
|Media=Image
Line 17: Line 15:
 
This tab is on the '''Predictors''' window:  
 
This tab is on the '''Predictors''' window:  
 
[[File:GPRPredictorsWindow.png|200 px]]
 
[[File:GPRPredictorsWindow.png|200 px]]
 +
|structuredtextwide='''Prerequisites:''' To use this tab, you must have created a Customer Profile dataset, an Agent Profile dataset, one or more Predictors, and have scoring data available.
  
'''Prerequisites:''' To use this tab, you must have created a Customer Profile dataset, an Agent Profile dataset, one or more Predictors, and have scoring data available.
+
===Configure the view===
 
 
'''Note:''' This page does not display real-time updates. GPR refreshes the data displayed once per day, at 3:00 am UTC.
 
|structuredtextwide====Configure the view===
 
 
The '''Feature Coverage''' tab enables you to select the following information:
 
The '''Feature Coverage''' tab enables you to select the following information:
  
Line 28: Line 24:
 
*The displayed date range. Use the year and month selectors to specify the month to view.
 
*The displayed date range. Use the year and month selectors to specify the month to view.
 
*The granularity—Day, Hour, or 15 minutes—at which the data is displayed on the dials and on the Trends window that opens when you click one of the dials.
 
*The granularity—Day, Hour, or 15 minutes—at which the data is displayed on the dials and on the Trends window that opens when you click one of the dials.
|FAQHeading=
+
 
 +
'''Note:''' This page does not display real-time updates. GPR refreshes the data displayed once per day, at 3:00 am UTC.
 
|Status=No
 
|Status=No
 
}}{{Section
 
}}{{Section
Line 34: Line 31:
 
|anchor=dials
 
|anchor=dials
 
|alignment=Vertical
 
|alignment=Vertical
|Media=
 
|image=
 
 
|structuredtext=[[File:GPRMonitoringDial.png|150 px]] The '''Feature Coverage''' tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.
 
|structuredtext=[[File:GPRMonitoringDial.png|150 px]] The '''Feature Coverage''' tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.
  
Line 41: Line 36:
  
 
The dials are colored red, yellow, and green to provide a quick visual indicator of whether the feature coverage for the associated parameter is satisfactory. ''Green'' indicates that you have good coverage, ''yellow'' means that you should review your coverage quality, and ''red'' indicates that coverage is not adequate and you should take action to improve predictor performance.
 
The dials are colored red, yellow, and green to provide a quick visual indicator of whether the feature coverage for the associated parameter is satisfactory. ''Green'' indicates that you have good coverage, ''yellow'' means that you should review your coverage quality, and ''red'' indicates that coverage is not adequate and you should take action to improve predictor performance.
|structuredtextwide=
 
|FAQHeading=
 
 
|Status=No
 
|Status=No
 
}}{{Section
 
}}{{Section
Line 48: Line 41:
 
|anchor=metrics
 
|anchor=metrics
 
|alignment=Vertical
 
|alignment=Vertical
|Media=
 
|image=
 
 
|structuredtext=====Feature coverage scores====
 
|structuredtext=====Feature coverage scores====
 
Three of the dials show the percentage of features available when the selected model was trained that are also in the actual data used for scoring. One shows agent features, one customer features, and one shows the result for all features taken together.
 
Three of the dials show the percentage of features available when the selected model was trained that are also in the actual data used for scoring. One shows agent features, one customer features, and one shows the result for all features taken together.
Line 67: Line 58:
  
 
If weighted feature coverage drops but feature coverage is steady, the small amount of missing data must disproportionately affect key features.
 
If weighted feature coverage drops but feature coverage is steady, the small amount of missing data must disproportionately affect key features.
|structuredtextwide=
 
|FAQHeading=
 
 
|Status=No
 
|Status=No
 
}}{{Section
 
}}{{Section
Line 74: Line 63:
 
|anchor=trends
 
|anchor=trends
 
|alignment=Vertical
 
|alignment=Vertical
|Media=
 
|image=
 
 
|structuredtext=[[File:GPRAIMonitorTrends.png|550 px]]
 
|structuredtext=[[File:GPRAIMonitorTrends.png|550 px]]
  
Line 83: Line 70:
 
#To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph. This
 
#To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph. This
 
#Hover your mouse over the Trend line to open a tooltip showing the exact date and feature coverage value for that point on the line.
 
#Hover your mouse over the Trend line to open a tooltip showing the exact date and feature coverage value for that point on the line.
|structuredtextwide=
 
|FAQHeading=
 
 
|Status=No
 
|Status=No
 
}}
 
}}
 
}}
 
}}

Latest revision as of 18:09, July 31, 2020

This is a draft page; the published version of this page can be found at PE-GPR/9.0.0/Help/AIMonitoring.
This topic is part of the manual Genesys Predictive Routing Help for version 9.0.0 of Genesys Predictive Routing.

Gain insight into your Machine Learning model performance factors to ensure you always get the best predictions.

The Feature Coverage tab

1

The Feature Coverage tab provides a view into whether you have adequate data to make good predictions.

This tab is on the Predictors window:

GPRPredictorsWindow.png

Prerequisites: To use this tab, you must have created a Customer Profile dataset, an Agent Profile dataset, one or more Predictors, and have scoring data available.

Configure the view

The Feature Coverage tab enables you to select the following information:

  • The name and ID of the predictor. Use the selector to specify which predictor to view.
  • The name and ID of the model. Use the selector to specify which model to view.
  • The displayed date range. Use the year and month selectors to specify the month to view.
  • The granularity—Day, Hour, or 15 minutes—at which the data is displayed on the dials and on the Trends window that opens when you click one of the dials.

Note: This page does not display real-time updates. GPR refreshes the data displayed once per day, at 3:00 am UTC.

How to read the dials

GPRMonitoringDial.png The Feature Coverage tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.

Note: If the window displays no agent feature dials, there are no agent features present in the selected model.

The dials are colored red, yellow, and green to provide a quick visual indicator of whether the feature coverage for the associated parameter is satisfactory. Green indicates that you have good coverage, yellow means that you should review your coverage quality, and red indicates that coverage is not adequate and you should take action to improve predictor performance.

Metrics definitions

Feature coverage scores

Three of the dials show the percentage of features available when the selected model was trained that are also in the actual data used for scoring. One shows agent features, one customer features, and one shows the result for all features taken together.

The values range from 0 to 1, with higher being better. If all features in the training dataset used to create the model are also in the data used for scoring, the value is 1. A lower value shows that some data you expect might no longer be available.

If, over time, feature coverage drops but weighted feature coverage holds steady, the data in the missing features might be of low value in any case, since the weighted coverage value gives emphasis to the features with the highest impact on the KPI configured in the predictor.

Weighted feature coverage scores

The remaining three dials also show the percentage of features available when the selected model was trained that are also in the actual data used for scoring, but with that figure adjusted to weigh the most significant features higher.

As a result of the weighting, if coverage is good for very significant features but poor for insignificant ones, the weighted result is still good. However, even if feature coverage is good for most features, if it is poor for one or more significant features, the weighted result is poor.

In these dials also, the values range from 0 to 1, with higher being better.

If weighted feature coverage drops but feature coverage is steady, the small amount of missing data must disproportionately affect key features.

View feature coverage trends

GPRAIMonitorTrends.png

The feature coverage dials show data for the selected month period. To view feature coverage trends over the selected time, follow these steps:

  1. Click any of the six dials. A Trends window opens, with a graph showing all data points for the metric you clicked during the month you selected on the main window. The data points reflect the granularity selected in the Plot By field.
  2. To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph. This
  3. Hover your mouse over the Trend line to open a tooltip showing the exact date and feature coverage value for that point on the line.