Course Description
Analytic model management ensures that models are not only superior to alternatives, but they also meet or exceed current business needs. Explore the process of building, validating, and evaluating a predictive analytics model.
Learning Objectives
Model Building
- start the course
- recognize key phases in developing a model
- recognize important aspects of data preparation for model development
- identify key functions in the model creation process
Model Considerations and Validation
- identify key considerations of model validation
- balance model complexity with overfitting
- identify features of two-fold validation
Model Evaluation
- recognize key features of Occam's Razor
- calculate mean squared error measures
- recognize prediction variation measures
- recognize evaluation measures for classification models
- interpret lift and gain charts
- interpret ROC curves and AUC
Practice: Classification Model Performance
- determine the superior classification model