"scale factor was wrong in my original version" problem #10

Open

opened

on Jan 27, 2023

Hi, what is mean "NOTE scale factor was wrong in my original version, can set manually to be compat with prev weights" in class EffAttention? can you explain more? and how set manually?

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests