Thank you for your amazing work! About the msrvtt_train_evalscores.pkl

[tiesanguaixia]

Hi! Thank you for your amazing work! I want to ask how can I generate the msrvtt_train_evalscores.pkl? I see the shape is [6513,20], so which caption is respectively corresponding to the every 20 scores of a video?

[ylqi]

Hi, Thank you for your interest in our work. Please refer to the commands in preprocess.sh to create the msrvtt_train_evalscores.pkl.

[tiesanguaixia]

Hi, Thank you for your interest in our work. Please refer to the commands in preprocess.sh to create the msrvtt_train_evalscores.pkl.

Hi, when I run such command, I notice that there is not a directory named output/metadata and there is not a cocofmt.json in it, so what should the cocofmt_file be like?

python compute_scores.py    --cocofmt_file output/metadata/${DATASET}_${SPLIT}_cocofmt.json\
                            --output_pkl output/metadata/${DATASET}_${SPLIT}_evalscores.pkl\
                            --remove_in_ref

And I encountered this error:

Traceback (most recent call last):
  File "data/preprocess/compute_scores.py", line 59, in <module>
    scorers = [(Bleu(), "Bleu_4"), (Meteor(), "METEOR"), (Rouge(), "ROUGE_L"), (Cider(), "CIDEr")]
TypeError: __init__() missing 1 required positional argument: 'df'

Do you have any advice? Thanks a lot!

[ylqi]

Hi, Thank you for your interest in our work. Please refer to the commands in preprocess.sh to create the msrvtt_train_evalscores.pkl.

Hi, when I run such command, I notice that there is not a directory named output/metadata and there is not a cocofmt.json in it, so what should the cocofmt_file be like?

python compute_scores.py    --cocofmt_file output/metadata/${DATASET}_${SPLIT}_cocofmt.json\
                            --output_pkl output/metadata/${DATASET}_${SPLIT}_evalscores.pkl\
                            --remove_in_ref

And I encountered this error:

Traceback (most recent call last):
  File "data/preprocess/compute_scores.py", line 59, in <module>
    scorers = [(Bleu(), "Bleu_4"), (Meteor(), "METEOR"), (Rouge(), "ROUGE_L"), (Cider(), "CIDEr")]
TypeError: __init__() missing 1 required positional argument: 'df'

Do you have any advice? Thanks a lot!

Hi, the cocofmt_file is provided in /data/metadata, e.g., msrvtt_val_cocofmt.json. Those files are all created by preprocess.sh, using the official annotation files in data/preprocess/input.