Since we're fixing bugs now, it's getting harder and harder to tell whether we're messing something elsewhere.
The proper way to deal with this is probably to introduce unit tests with an aggregated set of sentences and their expected OKR structures.
That way we can always make sure these tests pass before we merge a PR.
If we want to go further we can integrate github with Jenkins to run this process automatically.
Part of these unit tests can also include running the evaluations to get an updated metric associated with each PR.
Since we're fixing bugs now, it's getting harder and harder to tell whether we're messing something elsewhere.
The proper way to deal with this is probably to introduce unit tests with an aggregated set of sentences and their expected OKR structures.
That way we can always make sure these tests pass before we merge a PR.
If we want to go further we can integrate github with Jenkins to run this process automatically.
Part of these unit tests can also include running the evaluations to get an updated metric associated with each PR.