Skip to content

Latest commit

 

History

History
33 lines (27 loc) · 2.67 KB

literature.md

File metadata and controls

33 lines (27 loc) · 2.67 KB

Notes

  • Uses generative model.
  • Assumes that samples from an out-distribution are given.
  • Decomposes the the overall posterior $P(y|x)$ into $P(y|x,i)$ and $P(y|x,o)$. For in-distribution $P(y|x,i) >> P(y|x,o)$ and $P(y|x) = p(y|x,i)$. For OOD, $P(y|x,i) << P(y|x,o)$ and $P(y|x) = \frac{1}{M}$.
  • Uses GMM to learn $P(y|x,i)$ and $P(y|x,o)$.
  • Uses 80 million tiny image dataset to learn $P(y|x,o)$.
  • Gives guarantees of performance far away like ours.
  • Treats OOD detection as binary class classification using confidence as criteria and reports AUC.

Notes

  • Fits GMM with respect to features extracted at different levels of deep-nets.
  • Considers the closest Gaussian in terms of Mahalanobis distance (We consider Euclidean distance as for small regions over the manifold in a polytope the manifold can be approaximated as Euclidean).
  • Does not need OOD samples to train on like ours.
  • Uses AUROC of threshold-based detector using the confidence score.
  • Uses DenseNet-100, ResNet-34 rained on CIFAR-10 and tests on TinyImageNet, LSUN, SVHN and adversarial (DeepFool) samples. Used statistics: AUROC, AUPR, TNR at 95% TPR, dtection accuracy.

Notes

  • Assumes the learned features of the training set to follow a Gaussian Mixture (GM) distribution, with each component representing a class.
  • Transforms the projected feature space using a loss function with regularization from deep-net as Gausian.
  • Hein et al showed far away from training data ReLU net produce arbitarily high confidence. This paper fits a Gaussian at the end.

Notes

  • Stabilises training of RBF networks and show, for the first time, that these type of models can achieve competitive accuracy versus softmax models.
  • two-sided Jacobian regularisation makes it possible to obtain reliable uncertainty estimates for RBF networks.
  • Obtain excellent uncertainty in a single forward pass, while maintaining competitive accuracy.