Difference between revisions of "ATC/Current/AdminGuide/Outcomes Overview"
(Published) |
(Published) |
||
Line 10: | Line 10: | ||
|anchor=OutcomeModelOverview | |anchor=OutcomeModelOverview | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext={{MINTYDOCSPRODUCT}} uses AI to predict whether a | + | |structuredtext={{MINTYDOCSPRODUCT}} uses AI to predict whether a visitor will achieve a particular business objective. These business objectives are called '''outcomes'''. For each outcome you define, there is a machine learning model that evaluates a visitor's behavior against the behavior of other visitors on your website to determine the visitor's outcome score. Your organization's models are unique to you. |
− | Each outcome score represents the likelihood that the | + | Each outcome score represents the likelihood that the visitor will achieve the particular business outcome, based on the actions the visitor has taken so far during the session or on other activities related to the visitor that are included in the appropriate events (for example, geolocation). |
− | The model updates a | + | The model updates a visitor's score for each outcome in real-time, and a visitor's scores can change as they navigate your website. |
− | If a | + | If a visitor communicates with an agent, the agent can see the visitor's outcome scores while viewing the visitor's complete set of journey context data. Also, the outcome scores can trigger action maps that enhance a visitor's engagement on your site. {{NoteFormat|Because our internal service handles the training and deployment of models, it is not possible to deploy customer-specific models with {{MINTYDOCSPRODUCT}}. |
Our team investigates and integrates new algorithms into the scoring service based on customer use cases.|}} | Our team investigates and integrates new algorithms into the scoring service based on customer use cases.|}} | ||
|Status=No | |Status=No | ||
Line 23: | Line 23: | ||
|anchor=OutcomeModelDataGathering | |anchor=OutcomeModelDataGathering | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext={{ | + | |structuredtext={{MintyDocsProduct}} monitors all the ways visitors arrive on and interact with your webpages. For example, if you are an e-commerce site, {{MintyDocsProduct}} tracks how visitors navigate your website and place items in their shopping cart as they proceed to the checkout page. |
+ | <br />{{NoteFormat| | ||
* How a visitor achieves a certain probability score is unique to your business and website. | * How a visitor achieves a certain probability score is unique to your business and website. | ||
* Outcome scores and the associated data science are scored in a GDPR-compliant manner. Predictive Engagement's data scientists work exclusively on anonymized GDPR-compliant data.|1}}For more information, see {{Link-AnywhereElse|product=ATC|version=Current|manual=AdminGuide|topic=About_data_tracking}}. | * Outcome scores and the associated data science are scored in a GDPR-compliant manner. Predictive Engagement's data scientists work exclusively on anonymized GDPR-compliant data.|1}}For more information, see {{Link-AnywhereElse|product=ATC|version=Current|manual=AdminGuide|topic=About_data_tracking}}. | ||
Line 31: | Line 32: | ||
|anchor=OutcomeModelStartTraining | |anchor=OutcomeModelStartTraining | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext=Each of your machine learning models | + | |structuredtext=Each of your machine learning models require training before they can make predictions. |
+ | |||
+ | To start the training: | ||
#{{Link-SomewhereInThisVersion|manual=AdminGuide|topic=Manage_outcomes|display text=Create an outcome}}. | #{{Link-SomewhereInThisVersion|manual=AdminGuide|topic=Manage_outcomes|display text=Create an outcome}}. | ||
− | #Have | + | #Have visitors use your tracked website. To verify user activity, use {{Link-SomewhereInThisVersion|manual=AdminGuide|topic=Live_Now}}. |
− | After you complete these steps, the model training automatically | + | After you complete these steps, the model training begins automatically within 24 hours. The training process completes and the model is ready to work before the start of the next business day.{{NoteFormat|Initially, you see only a green bar with a check next to it in the '''Outcome Scores''' section. This bar indicates that the outcome condition was met. |
− | You | + | You see outcome scores after your model is trained. |}}<br /> |
|Status=No | |Status=No | ||
}}{{Section | }}{{Section | ||
Line 44: | Line 47: | ||
|anchor=OutcomeModelOngoingTraining | |anchor=OutcomeModelOngoingTraining | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext=The model training process is fully automated | + | |structuredtext=The model training process is fully automated. You do not need a data scientist to start, monitor, or maintain the training. Your model is retrained nightly using the last 30 days of your user data. Also, your model is evaluated periodically and retrained on fresh data. |
− | While the model is undergoing retraining, outcome scores are predicted using the previously trained version of the model. During the training process, | + | While the model is undergoing retraining, outcome scores are predicted using the previously trained version of the model. During the training process, agents can continue working as normal. |
− | Your newly trained model is tested to ensure it performs better than the previous version in terms of its precision and recall. If the new model does not work at least as well as the previous model, the previous model is reinstated until more data is gathered. Historical models are not retained.{{NoteFormat| | + | Your newly trained model is tested to ensure that it performs better than the previous version in terms of its precision and recall. If the new model does not work at least as well as the previous model, the previous model is reinstated until more data is gathered. Historical models are not retained.{{NoteFormat| |
− | * When you add a new outcome, your model training | + | * When you add a new outcome, your model training accounts for it automatically. |
− | * Automated model training and predictions are performed on the original customer journey events, which are not anonymized and | + | * Automated model training and predictions are performed on the original customer journey events, which are not anonymized and generally contain PII.|}}<br /> |
|Status=No | |Status=No | ||
}}{{Section | }}{{Section | ||
Line 57: | Line 60: | ||
|anchor=OutcomeModelImprovePredictions | |anchor=OutcomeModelImprovePredictions | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext=In general, the longer your models run and the more data they evaluate, the better their predictions | + | |structuredtext=In general, the longer your models run and the more data they evaluate, the better their predictions are. |
− | The best way to improve a model's predictions is to increase the number of achieved outcomes. In general, your dataset should contain several hundred positive examples | + | The best way to improve a model's predictions is to increase the number of achieved outcomes. In general, your dataset should contain several hundred positive examples for your model to be adequately trained to make reliable predictions. |
Other factors can affect the accuracy of your model's performance, including: | Other factors can affect the accuracy of your model's performance, including: | ||
− | * | + | *Total number of visitor journeys recorded |
− | * | + | *Frequency that an outcome occurs in the data |
− | * | + | *Richness of events that the visitor produces {{NoteFormat|You can {{Link-SomewhereInThisVersion|manual=AdminGuide|topic=Web_tracking|anchor=ExcludeIPAddressesses|display text=exclude IP addresses}} to prevent events generated internally from influencing your models.|2}} |
|Status=No | |Status=No | ||
}}{{Section | }}{{Section | ||
|sectionHeading=Predict based on custom events | |sectionHeading=Predict based on custom events | ||
|alignment=Vertical | |alignment=Vertical | ||
− | |structuredtext= | + | |structuredtext=You can provide predictions that other predictive systems generate as "custom events." The Outcome Score Service can consume the custom events and use them to train models and generate outcome predictions based on the features that an external system produces. This example shows how a generalized AI system enables hyper-personalization. |
<nowiki>**</nowiki>We need to put this in plain English, but I want clarification before I begin... | <nowiki>**</nowiki>We need to put this in plain English, but I want clarification before I begin... |
Revision as of 15:29, December 17, 2020
Contents
Genesys Predictive Engagement's AI-powered outcome scoring service learns to predict your business outcomes using machine learning models that are unique to your business.
Predicting outcome scores
Genesys Predictive Engagement uses AI to predict whether a visitor will achieve a particular business objective. These business objectives are called outcomes. For each outcome you define, there is a machine learning model that evaluates a visitor's behavior against the behavior of other visitors on your website to determine the visitor's outcome score. Your organization's models are unique to you.
Each outcome score represents the likelihood that the visitor will achieve the particular business outcome, based on the actions the visitor has taken so far during the session or on other activities related to the visitor that are included in the appropriate events (for example, geolocation).
The model updates a visitor's score for each outcome in real-time, and a visitor's scores can change as they navigate your website.
If a visitor communicates with an agent, the agent can see the visitor's outcome scores while viewing the visitor's complete set of journey context data. Also, the outcome scores can trigger action maps that enhance a visitor's engagement on your site.How Genesys Predictive Engagement gathers outcome probability data
Genesys Predictive Engagement monitors all the ways visitors arrive on and interact with your webpages. For example, if you are an e-commerce site, Genesys Predictive Engagement tracks how visitors navigate your website and place items in their shopping cart as they proceed to the checkout page.
- How a visitor achieves a certain probability score is unique to your business and website.
- Outcome scores and the associated data science are scored in a GDPR-compliant manner. Predictive Engagement's data scientists work exclusively on anonymized GDPR-compliant data.
Start training your models
Each of your machine learning models require training before they can make predictions.
To start the training:
- Create an outcome.
- Have visitors use your tracked website. To verify user activity, use Live Now.
Ongoing training
The model training process is fully automated. You do not need a data scientist to start, monitor, or maintain the training. Your model is retrained nightly using the last 30 days of your user data. Also, your model is evaluated periodically and retrained on fresh data.
While the model is undergoing retraining, outcome scores are predicted using the previously trained version of the model. During the training process, agents can continue working as normal.
Your newly trained model is tested to ensure that it performs better than the previous version in terms of its precision and recall. If the new model does not work at least as well as the previous model, the previous model is reinstated until more data is gathered. Historical models are not retained.- When you add a new outcome, your model training accounts for it automatically.
- Automated model training and predictions are performed on the original customer journey events, which are not anonymized and generally contain PII.
Improve predictions
In general, the longer your models run and the more data they evaluate, the better their predictions are.
The best way to improve a model's predictions is to increase the number of achieved outcomes. In general, your dataset should contain several hundred positive examples for your model to be adequately trained to make reliable predictions.
Other factors can affect the accuracy of your model's performance, including:
- Total number of visitor journeys recorded
- Frequency that an outcome occurs in the data
- Richness of events that the visitor produces TipYou can exclude IP addresses to prevent events generated internally from influencing your models.