Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | Next revisionBoth sides next revision | ||
| data_mining:error_analysis [2018/05/21 19:55] – [Misslabeled data] phreazer | data_mining:error_analysis [2018/05/21 22:05] – [Missmatched train and dev/test set] phreazer | ||
|---|---|---|---|
| Line 154: | Line 154: | ||
| * Train set: 205.000 with high and low qual; Dev & Test: 2500 low quality | * Train set: 205.000 with high and low qual; Dev & Test: 2500 low quality | ||
| * Advantage: Optimizing right data | * Advantage: Optimizing right data | ||
| - | * Disadvantage: | + | * Disadvantage: |
| + | |||
| + | ====== Problems with different train and dev/test set dist ====== | ||
| + | |||
| + | Not always good idea to use different dist in train and dev | ||
| + | |||
| + | * Human error ~ 0 | ||
| + | * Train 1% | ||
| + | * Dev 10% | ||
| + | |||
| + | Training-dev set: same distribution as training set, but not used for training | ||
| + | |||
| + | * Train 1% | ||
| + | * Train-dev: 9% | ||
| + | * Dev: 10% | ||
| + | |||
| + | Still high gap between train and train-dev => variance problem | ||