• sleep_deprived@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    Exactly. Attention mechanisms excel at extracting signal from noise. This would simply reinforce that noise can come in this shape.