061022 – Self-supervised

Try your self-supervision and your self-distillation loss

Transformers trained with self-supervised learning using self-distillation loss (DINO) have been shown to produce attention maps that highlight salient foreground objects

[1] https://arxiv.org/abs/2202.11539

>>>NEXT>>>