Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
data_mining:error_analysis [2018/05/21 19:30] – [Working on most promising problems] phreazer | data_mining:error_analysis [2018/05/21 19:45] – [Working on most promising problems] phreazer | ||
---|---|---|---|
Line 130: | Line 130: | ||
Result: Calc percentage of problem category (potential improvement " | Result: Calc percentage of problem category (potential improvement " | ||
+ | General rule: Build your first system quickly, then iterate (dev/test setup, build system, bias/ | ||
+ | ====== Misslabeled data ====== | ||
+ | |||
+ | DL algos: If % or errors is //low// and errors are //random//, they are robust | ||
+ | |||
+ | Add another col " | ||
+ | |||
+ | Principles when fixing labels: | ||
+ | |||
+ | - Apply same process to dev and test set (same distribution) | ||
+ | - Also see what examples algo got right (not only wrong) | ||
+ | - Train and dev/test data may come from different distribution (no problem if slightly different) |