Data structure when using my own data

[yueguo-50]

Hey!

I'm a bit confused about the relationship within the <DATA_PATH>. Let me break it down: If I want to align sentences from 10 pairs of source and target, would it work like this? Under the "summaries" folder, would A.txt be the first source file? And then, within the "A" folder, would "doc_A1" represent the first sentence from the first target, while "doc_A2" would be the second sentence from the same target?

Just want to make sure I've got it right. Thanks!

[oriern]

Hi,
Thanks for reaching out.

SuperPAL was originally designed to align between multiple documents and a single summary that summarizes them all together. Therefore, under 'summaries'- A.txt contains a summary of topic A. Accordingly under folder A there will be many documents on the same topic A (that A.txt is their summary). You don't have to split them into sentences.

If you have only a single document per summary, each folder (except 'summaries') should contain a single document.

I hope it is clear now.