PE-GPR/9.0.0/Help/AIMonitoring - Revision history

Vivian.hood@genesys.com: Published

2020-12-16T20:55:04Z

Published

Vivian: Published

2020-09-23T17:23:49Z

Published

Vivian: Published

2020-08-04T12:39:55Z

Published

WikiSysop: Text replacement - "\|Platform=([^\|])GenesysEngage-onpremises([\|])" to "|Platform=$1GenesysEngage-cloud$2"

2020-07-25T02:30:12Z

Text replacement - "\|Platform=([^\|]*)GenesysEngage-onpremises([\|]*)" to "|Platform=$1GenesysEngage-cloud$2"

WikiSysop: Text replacement - "\|Platforms?=([^\|])PureEngage([\|])" to "|Platform=$1GenesysEngage-onpremises$2"

2020-07-15T11:44:39Z

Text replacement - "\|Platforms?=([^\|]*)PureEngage([\|]*)" to "|Platform=$1GenesysEngage-onpremises$2"

Bgrenon: Published

2020-06-09T13:37:44Z

Published

Vivian: Published

2020-05-26T15:31:17Z

Published

New page

{{Article
|Standalone=No
|DisplayName=Monitor predictor feature coverage
|TocName=Monitor predictor feature coverage
|Context=Gain insight into your Machine Learning model performance factors to ensure you always get the best predictions.
|ComingSoon=No
|Platform=PureEngage
|Prereq=
|Section={{Section
|sectionHeading=The AI Monitoring tab
|anchor=
|alignment=Horizontal
|Media=Image
|image=GPRAIMonitoring.png
|structuredtext=The '''AI Monitoring''' tab provides a view into whether you have adequate data to make good predictions.

This tab is on the '''Predictors''' window:
[[File:GPRPredictorsWindow.png|200 px]]

'''Prerequisites:''' To use this tab, you must have created a Customer Profile dataset, an Agent Profile dataset, one or more Predictors, and have scoring data available.

'''Note:''' This page does not display real-time updates. GPR refreshes the data displayed once per day, at 3:00 am UTC.
|structuredtextwide====Configure the view===
The '''AI Monitoring''' tab enables you to select the following information:

*The name and ID of the predictor. Use the selector to specify which predictor to view.
*The name and ID of the model. Use the selector to specify which model to view.
*The displayed date range. Use the year and month selectors to specify the month to view.
|FAQHeading=
|Status=No
}}{{Section
|sectionHeading=How to read the dials
|anchor=dials
|alignment=Vertical
|Media=
|image=
|structuredtext=[[File:GPRMonitoringDial.png|150 px]] The '''AI Monitoring''' tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.

The dials are colored red, yellow, and green to provide a quick visual indicator of whether the feature coverage for the associated parameter is satisfactory. ''Green'' indicates that you have good coverage, ''yellow'' means that you should review your coverage quality, and ''red'' indicates that coverage is not adequate and you should take action to improve predictor performance.
|structuredtextwide=
|FAQHeading=
|Status=No
}}{{Section
|sectionHeading=Metrics definitions
|anchor=metrics
|alignment=Vertical
|Media=
|image=
|structuredtext=====Feature coverage scores====
Three of the dials show the fraction of features available when the selected model was trained that are also in the actual data used for scoring. One shows agent features, one customer features, and one shows the result for all features taken together.

The values range from 0 to 1, with higher being better. If all features in the training dataset used to create the model are also in the data used for scoring, the value is 1. A lower value shows that some data you expect might no longer be available.

If, over time, feature coverage drops but weighted feature coverage holds steady, the data in the missing features might be of low value in any case, since the weighted coverage value gives emphasis to the features with the highest impact on the KPI configured in the predictor.

====Weighted feature coverage scores====
The remaining three dials also show the fraction of features available when the selected model was trained that are also in the actual data used for scoring, but with that figure adjusted to weigh the most significant features higher.

*To view the feature weighting, see the bar graph showing the top features on the {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|anchor=simulator|display text=Predictors Simulator tab}}.

As a result of the weighting, if coverage is good for very significant features but poor for insignificant ones, the weighted result is still good. However, even if feature coverage is good for most features, if it is poor for one or more significant features, the weighted result is poor.

In these dials also, the values range from 0 to 1, with higher being better.

If weighted feature coverage drops but feature coverage is steady, the small amount of missing data must disproportionately affect key features.
|structuredtextwide=
|FAQHeading=
|Status=No
}}{{Section
|sectionHeading=View feature coverage trends
|anchor=trends
|alignment=Vertical
|Media=
|image=
|structuredtext=[[File:GPRAIMonitorTrends.png|550 px]]

The feature coverage dials show data for the previous 15 minutes. To view feature coverage trends over a longer time, do the following steps:

#Click any of the six dials. A Trends window opens, with a graph showing all data points for the metric you clicked during the month you selected on the main window.
#To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph.
#Hover your mouse over the Trend line to open a tooltip showing the exact date and feature coverage value for that point on the line.
|structuredtextwide=
|FAQHeading=
|Status=No
}}
}}

@@ Line 10: / Line 10: @@
 |alignment=Horizontal
 |Media=Image
-|image=GPRAIMonitoring.png
+|image=GPRAfeatureCoverage.png
 |structuredtext=The '''Feature Coverage''' tab provides a view into whether you have adequate data to make good predictions.
 |structuredtextwide=The '''Feature Coverage''' tab enables you to select the following information:
 *The name and ID of the predictor. Use the selector to specify which predictor to view.
 *The name and ID of the model. Use the selector to specify which model to view.
-*The displayed date range. Use the year and month selectors to specify the month to view.
+*The displayed date range. Use the year and month selectors, on the right side of the window, to specify the month to view.
 *The granularity—Day, Hour, or 15 minutes—at which the data is displayed on the dials and on the Trends window that opens when you click one of the dials.
@@ Line 51: / Line 45: @@
 The remaining three dials also show the percentage of features available when the selected model was trained that are also in the actual data used for scoring, but with that figure adjusted to weigh the most significant features higher.
-*To view the feature weighting, see the bar graph showing the top features on the {{Link-SomewhereInThisVersion|manual=Help|topic=Analysis|anchor=simulator|display text=Predictors Simulator tab}}.
+*To view the feature weighting, see the bar graph showing the top features on the left side of this window.
 As a result of the weighting, if coverage is good for very significant features but poor for insignificant ones, the weighted result is still good. However, even if feature coverage is good for most features, if it is poor for one or more significant features, the weighted result is poor. As a result, coverage can appear good on the non-weighted dials and poor on the weighted ones.

@@ Line 6: / Line 6: @@
 |ComingSoon=No
 |Platform=GenesysEngage-cloud
 |Section={{Section
-|sectionHeading=The AI Monitoring tab
+|sectionHeading=The Feature Coverage tab
 |alignment=Horizontal
 |Media=Image
 |image=GPRAIMonitoring.png
-|structuredtext=The '''AI Monitoring''' tab provides a view into whether you have adequate data to make good predictions.
+|structuredtext=The '''Feature Coverage''' tab provides a view into whether you have adequate data to make good predictions.
 This tab is on the '''Predictors''' window:
 [[File:GPRPredictorsWindow.png|200 px]]
-'''Prerequisites:''' To use this tab, you must have created a Customer Profile dataset, an Agent Profile dataset, one or more Predictors, and have scoring data available.
+===Configure the view===
+The '''Feature Coverage''' tab enables you to select the following information:
 *The name and ID of the predictor. Use the selector to specify which predictor to view.
 *The name and ID of the model. Use the selector to specify which model to view.
 *The displayed date range. Use the year and month selectors to specify the month to view.
-|FAQHeading=
+*The granularity—Day, Hour, or 15 minutes—at which the data is displayed on the dials and on the Trends window that opens when you click one of the dials.
 |Status=No
 }}{{Section
@@ Line 33: / Line 31: @@
 |anchor=dials
 |alignment=Vertical
-|Media=
+|structuredtext=[[File:GPRMonitoringDial.png|150 px]] The '''Feature Coverage''' tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.
-|image=
-|structuredtext=[[File:GPRMonitoringDial.png|150 px]] The '''AI Monitoring''' tab presents six dials, each with a range of 0-1, which indicates the percent coverage of the specified performance factor. The number below the dial corresponds with the point indicated by the needle on the dial. That is, a dial setting of 0.59, as shown in the graphic, equals 59%.
+'''Note:''' If the window displays no agent feature dials, there are no agent features present in the selected model.
 The dials are colored red, yellow, and green to provide a quick visual indicator of whether the feature coverage for the associated parameter is satisfactory. ''Green'' indicates that you have good coverage, ''yellow'' means that you should review your coverage quality, and ''red'' indicates that coverage is not adequate and you should take action to improve predictor performance.
 |Status=No
 }}{{Section
@@ Line 45: / Line 41: @@
 |anchor=metrics
 |alignment=Vertical
 |structuredtext=====Feature coverage scores====
 Three of the dials show the percentage of features available when the selected model was trained that are also in the actual data used for scoring. One shows agent features, one customer features, and one shows the result for all features taken together.
@@ Line 64: / Line 58: @@
 If weighted feature coverage drops but feature coverage is steady, the small amount of missing data must disproportionately affect key features.
 |Status=No
 }}{{Section
@@ Line 71: / Line 63: @@
 |anchor=trends
 |alignment=Vertical
 |structuredtext=[[File:GPRAIMonitorTrends.png|550 px]]
-The feature coverage dials show data for the previous 15 minutes. To view feature coverage trends over a longer time, do the following steps:
+The feature coverage dials show data for the selected month period. To view feature coverage trends over the selected time, follow these steps:
-#Click any of the six dials. A '''Trends''' window opens, with a graph showing all data points for the metric you clicked during the month you selected on the main window.
+#Click any of the six dials. A '''Trends''' window opens, with a graph showing all data points for the metric you clicked during the month you selected on the main window. The data points reflect the granularity selected in the '''Plot By''' field.
-#To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph.
+#To show a shorter period of time within the month, click the blue selector line below the main chart. This activates a slider function, enabling you to narrow the time period shown on the upper Trend graph. This
 #Hover your mouse over the Trend line to open a tooltip showing the exact date and feature coverage value for that point on the line.
 |Status=No
 }}
 }}

@@ Line 5: / Line 5: @@
 |Context=Gain insight into your Machine Learning model performance factors to ensure you always get the best predictions.
 |ComingSoon=No
-|Platform=GenesysEngage-onpremises
+|Platform=GenesysEngage-cloud
 |Prereq=
 |Section={{Section

PE-GPR/9.0.0/Help/AIMonitoring - Revision history

Vivian.hood@genesys.com: Published

Vivian: Published

Vivian: Published

WikiSysop: Text replacement - "\|Platform=([^\|]*)GenesysEngage-onpremises([\|]*)" to "|Platform=$1GenesysEngage-cloud$2"

WikiSysop: Text replacement - "\|Platforms?=([^\|]*)PureEngage([\|]*)" to "|Platform=$1GenesysEngage-onpremises$2"

Bgrenon: Published

Vivian: Published

WikiSysop: Text replacement - "\|Platform=([^\|])GenesysEngage-onpremises([\|])" to "|Platform=$1GenesysEngage-cloud$2"

WikiSysop: Text replacement - "\|Platforms?=([^\|])PureEngage([\|])" to "|Platform=$1GenesysEngage-onpremises$2"