Skip to main content

Module attention

Module attention 

Source
Expand description

QSA indexing, q8 KV append, and selected decode attention.