|
- /post_hoc_evaluator@post_hoc_evaluator.evaluators.prediction.mauve: mauve_text |
post_hoc_evaluator.evaluators.prediction.gen_ppl and ost_hoc_evaluator.evaluators.prediction.mauve will run on all dataloader that have prediction in their name. So we need to prepend full dataloader name to the metric name like val/<dataloader_name>/mauve
xlm-core/src/xlm/configs/lightning_train/experiment/mauve.yaml
Line 3 in 87a7e03
post_hoc_evaluator.evaluators.prediction.gen_pplandost_hoc_evaluator.evaluators.prediction.mauvewill run on all dataloader that havepredictionin their name. So we need to prepend full dataloader name to the metric name likeval/<dataloader_name>/mauve