data_mining:strategy

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
data_mining:strategy [2018/05/21 17:16] phreazerdata_mining:strategy [2018/05/21 18:50] (current) – [Human level performance] phreazer
Line 43: Line 43:
  
 E.g. high quality images in dev/test set, user upload low quality images. => change metric and/or dev/test set E.g. high quality images in dev/test set, user upload low quality images. => change metric and/or dev/test set
 +
 +====== Human level performance ======
 +
 +Bayes optimal error (best optimal error)
 +
 +Human level error could be used as an estimate for Bayes error (e.g. in Computer Vision)
 +
 +  * H: 1%, Train: 8%, Dev: 10% => bias reduction
 +  * H: 7,5%, Train: 8, Dev: 10% => variance reduction (more data, regularization)
 +
 +What's human-level error? Best performance possible as a human / usefullness
 +
 +Measure of error between Human Error, Train Error and Dev error
 +
 +  * Avoidable bias: Human level <> Training Error
 +    * Train bigger model
 +    * Train longer/better opti algos
 +    * NN architecture/hyperparam search
 +  * Variance: Training Error <> Dev Error
 +    * More data
 +    * Regularization
 +    * NN architecture/hyperparam search
 +
  • data_mining/strategy.1526915818.txt.gz
  • Last modified: 2018/05/21 17:16
  • by phreazer