evaluate#
- datarobotx.evaluate(model, evaluation_data=None)[source]#
Show evaluation metrics and plots for a model
DataRobot automatically calculates several model evaluation metrics and plots to help assess model performance.
This helper retrieves these metrics and plots and renders them in-notebook; if an external dataset is provided, it will automatically be uploaded and calculations requested.
For Binary Models with external evaluation data: evaluate will score the dataset against all DataRobot metrics for binary classification and display the lift chart, roc curve, and feature impact chart.
For Regression Models with external evaluation data: evaluate will score the dataset against all DataRobot metrics for regression and display the lift chart, residuals chart, and feature impact chart.
- Parameters:
model (Union[Model, ModelOperator]) – The drx model that should be used in the evaluation.
evaluation_data (Union[pd.DataFrame, str], optional) – The evaluation data to be used. If Pandas Dataframe, the data will be uploaded to DR and scored. If a string, should correspond to a previously uploaded external test set or an ai catalog id.
Notes
Only Binary and Regression models are presently supported; if no evaluation_data is provided only the metrics and feature impact plot will be included.
- Return type: