Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
| data_mining:error_analysis [2018/05/21 22:05] – [Missmatched train and dev/test set] phreazer | data_mining:error_analysis [2018/05/21 22:11] – [Problems with different train and dev/test set dist] phreazer | ||
|---|---|---|---|
| Line 172: | Line 172: | ||
| Still high gap between train and train-dev => variance problem | Still high gap between train and train-dev => variance problem | ||
| + | If Train and Train-dev would be closer => data-mismatch problem. | ||
| + | |||
| + | Summary: | ||
| + | * Human level 4% | ||
| + | * Avoidable bias | ||
| + | * Train 7% | ||
| + | * Variance | ||
| + | * Train-dev: 10% | ||
| + | * Data mismatch | ||
| + | * Dev: 12% | ||
| + | * Degree of overfitting to dev set (if to high => bigger dev set) | ||
| + | * Test: 12% | ||