Definition
Keeping only the highest-scoring few items and ignoring the rest.
A selection rule that retains the k entries with the largest scores, used both in attention sparsification and in decoding strategies.
Also called: top-k retrieval
Keeping only the highest-scoring few items and ignoring the rest.
A selection rule that retains the k entries with the largest scores, used both in attention sparsification and in decoding strategies.
Also called: top-k retrieval