This is an old revision of the document!
Crossvalidation
Train/Dev/Test sets
Training set | Hold-out / Dev set | Test set
- Goal of dev set: Which algorithm does better
- Goal of test set: Performance estimate of final classifier
For NNs with large data sets: Often 98%/1%/1%
Mismatched train/test distribution
- Should have same distribution