Skip to content

wmt/010-wmt-linear-hash #6

@utterances-bot

Description

@utterances-bot

[WMT-010] Linear = Hash 函数——输出层碰撞是翻译的信息瓶颈 | GrepCode

NMT 的输出 Linear 层不只是投影——它是 hidden space 到 vocab space 的 Hash 函数。碰撞发生在这里,K_lang 控制碰撞程度,梯度从碰撞桶里提取信息。

https://www.grepcode.cn/wmt/010-wmt-linear-hash.html

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions