Skip to content

add page for evaluating probe on a specific claim/sentence#2

Open
straeter wants to merge 1 commit into
jammastergirish:mainfrom
straeter:eval_probe
Open

add page for evaluating probe on a specific claim/sentence#2
straeter wants to merge 1 commit into
jammastergirish:mainfrom
straeter:eval_probe

Conversation

@straeter

Copy link
Copy Markdown

Nice work! I was missing a page to eval a probe manually on a test sample and added a page for it:

  • added page 5 Eval Probe -> load pre-computed probe and test it on a sample sentence/claim. Output will be a plot with the probe outputs for each layer
  • save model in session state, so it can be removed from GPU if swapping between probes (this could also be integrated in the whole app, atm memory just piles up)
  • removed some python cache files (.pyc) from git cache + added .idea folder (for pycharm) to gitignore

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant