Validation

As part of training a skill, the training data is split into two parts; the training set, and the validation set. The training set is used to train the skill, while the validation set is only used to evaluate the skill's performance. Metrics on the training set let you see how your model is progressing in terms of its training, but it is metrics on the validation set that let you get a measure of the quality of your skill - how well it is able to make new predictions based on data it has not seen before.