Predictive Model and Record Description Using Segmented Sensitivity Analysis

Model description, both at the overall level on what variables are most important to the forecast, and reasons for an individual record forecast can be a competitive advantage in a business or consulting situation. Design objectives for this model description include 1) describe the model in terms of variables understandable to the target audience 2) independent of the predictive algorithm, 3) support a single or ensemble of models, 4) pick up non-linearities in variables and 5) pick up interaction effects between variables. The Segmented Sensitivity Analysis (SSA) method has been used by the author for 25 years in a variety of data mining projects. As with other descriptive techniques, there is a bit of art when developing a solution for a specific use case. A number of SSA variations and use cases will be discussed to illustrate how the system can be adapted. The SSA model description can also be helpful during the model building process, as well as detecting and describing model drift over time, as the behavior of the scoring data slowly changes or drifts from the training data.

Greg Makowski, https://www.linkedin.com/in/GregMakowski has been training and deploying AI since 1992, has been growing Data Science Teams since 2010, has exited 4 startups and has 6 AI patents granted or in various stages. He is currently the Chief of Data Science at Ccube, leading GenAI/AI consulting and framework development for enterprise applications. See also: https://www.ccube.com/genai.